Saying pc use in Copilot Studio! This new characteristic permits your Copilot Studio brokers to work together instantly with web sites and desktop functions. Need to be a part of the restricted preview? Learn on.
AI innovation is accelerating at an unprecedented tempo, and Microsoft Copilot Studio is on the forefront—integrating one of the best AI developments right into a platform constructed to resolve enterprise challenges at scale. Final month, we launched deep reasoning capabilities for brokers, help for mannequin context protocol (MCP), and the overall availability of agent flows in Copilot Studio.
Right this moment, we’re excited to announce that pc use is coming to Copilot Studio by an early entry analysis preview. This new functionality permits your Copilot Studio brokers to deal with web sites and desktop functions as instruments. With pc use, brokers can now work together with any system that has a graphical consumer interface!
Obtain new efficiencies with pc useÂ
Pc use allows brokers to work together with web sites and desktop apps by clicking buttons, choosing menus, and typing into fields on the display. This permits brokers to deal with duties even when there isn’t any API out there to hook up with the system instantly. If an individual can use the app, the agent can too.
Pc use adapts to adjustments in apps and web sites robotically. It adjusts in actual time utilizing built-in reasoning to repair points by itself, so work continues with out interruption. It’s also constructed on Copilot Studio’s sturdy safety measures and governance frameworks, to assist guarantee compliance with organizational and trade requirements.
With pc use in Copilot Studio, makers can construct brokers that automate duties on consumer interfaces throughout each desktop and browser functions, together with Edge, Chrome, and Firefox. Moreover, pc use runs on Microsoft-hosted infrastructure, that means organizations don’t must handle their very own servers. Enterprise information stays inside Microsoft Cloud boundaries and isn’t used to coach the Frontier mannequin. This helps your group speed up deployment, cut back upkeep, and decrease infrastructure prices.
Unlock new worth with agentic and automation situations
To convey this expertise to life, think about the next excessive worth use instances:
- Automated information entry: Think about a situation the place an enterprise must enter massive volumes of information from varied sources right into a centralized system. Pc use can automate this course of, decreasing guide effort and minimizing errors.
- Market analysis: Advertising and marketing groups can leverage the device to automate the gathering of market information from varied on-line sources for evaluation, offering beneficial insights with out the necessity for guide intervention.
- Bill processing: For finance departments, the device can automate the extraction of information from invoices and enter it into accounting programs, streamlining the complete invoicing course of and decreasing guide errors.
Reimagining robotic course of automation (RPA)
Pc use brokers are reworking robotic course of automation (RPA). They overcome conventional limitations, just like the fragility of UI components, and may deal with complicated dynamic interfaces. This makes automation accessible to folks past skilled RPA builders.
In Copilot Studio, pc use addresses frequent RPA challenges by making automation smarter and extra intuitive:
- It responds to adjustments in actual time: When buttons or screens change, the device retains working with out breaking your movement.
- It’s straightforward to make use of: You may describe what you need in pure language, no coding wanted, and take a look at and refine the immediate with real-time side-by-side video of the pc use reasoning chain and the deliberate UI automation.
- It’s constructed with intelligence: The agent sees what’s on the display and makes sensible selections in actual time, even in complicated or continually altering environments.
- It comes with full visibility: Makers can view a historical past of pc use exercise at will, together with captured screenshots and reasoning steps.
The way forward for innovation with Copilot Studio
Copilot Studio is the end-to-end agent platform designed to assist organizations obtain their AI and operational objectives. We wish to empower you to streamline processes, improve productiveness, and drive innovation.
If you’re occupied with exploring the brand new pc use functionality, we’d love to listen to from you! Please fill out this manner to tell us you wish to take part.
We may even share extra about this new announcement at Microsoft Construct in Might 2025—register right here to hitch us!Â
