What is the Copilot Studio Kit, now the Copilot Agent Kit?

Short answer

The Copilot Studio Kit, now called the Copilot Agent Kit, is a set of tools from Microsoft's Power CAT team that you install in a Power Platform environment. It adds automated agent testing, a compliance hub, insights, a debugger, an agent inventory and more. It is open source under the MIT license and needs Dataverse, admin rights and the Creator Kit.

A toolbox around Copilot Studio, not inside it

Copilot Studio is good at building one agent. Running thirty of them in a company raises other questions: does this agent still answer correctly after last week’s change, which agents use which connectors, who owns the one that nobody remembers building. The Copilot Studio Kit is Power CAT’s answer. Power CAT is Microsoft’s customer advisory team for the Power Platform. The kit has since been renamed the Copilot Agent Kit; most people still search for the old name.

You install it as a solution in a Power Platform environment. It then works on agents in that environment.

What is in it

The overview page lists these parts (November 2026):

Area Tools
Testing Test automation with rubrics, rubrics refinement, Webchat Playground
Governance Compliance Hub (can quarantine or delete agents), Power Shield for data policy connector requests, Agent Inventory, Agent Review Tool
Insight Agent Insights Hub, Conversation KPIs, Conversation Analyzer, Agent Value
Building Agent Library, Prompt Advisor, Adaptive Cards Gallery, SharePoint synchronization
Debugging and release Agent Debugger, pipelines

The testing part is what most teams install it for. You write test cases with the question and what a good answer looks like, and the kit runs them against the agent, so a change in instructions or knowledge that breaks an answer shows up before users notice.

What you need before installing

  1. A Dataverse environment and the System administrator role in it.
  2. Power Apps component framework for canvas apps and Code Apps switched on.
  3. Licenses for model-driven apps and premium cloud flows for the people using the kit.
  4. The Creator Kit, deployed first.
  5. Data policies that allow all connectors the kit uses.
  6. Optionally Application Insights, for the insight features.
  7. Optionally Copilot Credits: generative answers test cases average about 50 credits, the Prompt Advisor about 120 credits per iteration.

Installation is from Microsoft Marketplace or from GitHub, followed by the kit’s setup wizard.

The common mistake: treating it as a product with a support desk

Because it carries Microsoft’s name and lives on Microsoft Learn, teams expect it to behave like Copilot Studio itself. It is an open-source solution under the MIT license. Neither the overview nor the repository says it falls under standard Microsoft product support. Plan for that the way you would for any community tool: someone in your team owns the installation and its updates.

What this means for a team

The kit is worth it once agents are more than an experiment: when several makers build agents, when an agent faces customers, or when an admin has to answer “which agents do we have”. For one or two internal agents, the built-in analytics in Copilot Studio and the Copilot Hub in the Power Platform admin center may be enough, see How do you govern Copilot Studio agents as an admin?.

What the kit tests is whether each agent answers as its maker intended. It does not make agents share what they know: every agent still has its own instructions and knowledge. Licensing for building agents is on What license do you need for Copilot Studio?.

Where Bombos fits

The kit tests and governs agents one by one; the team’s knowledge is still copied into each of them. Bombos is a plugin that gives Copilot, your Studio agents and the other AI tools your team uses (Claude, ChatGPT, Codex, Cursor, your own agents) one shared memory of team knowledge, learned rules, mail and documents, traceable, in the cloud or on your own server. One person can try it first with their own agents.

Related questions

Is the Copilot Studio Kit an official Microsoft product?

It is built by Microsoft's Power CAT team and documented on Microsoft Learn, and the source is on GitHub under the MIT license. It is a separate solution you install yourself, not a feature built into Copilot Studio.

Does using the kit cost Copilot Credits?

Some features do. Microsoft estimates generative answers test cases at about 50 credits on average and the Prompt Advisor at about 120 credits per iteration. The kit also needs licenses for model-driven apps and premium cloud flows.

Where do I install it from?

From Microsoft Marketplace or from the GitHub repository microsoft/Power-CAT-Copilot-Studio-Kit, then you run its setup wizard. The Creator Kit has to be deployed in the environment first.

Sources

  1. Microsoft Learn: Copilot Agent Kit overview
  2. Microsoft Learn: Copilot Agent Kit prerequisites
  3. GitHub: microsoft/Power-CAT-Copilot-Studio-Kit
The first half hour · free

What does your AI forget?

  1. 01You tell us which AI you use and where it keeps starting over.
  2. 02We show what a shared memory changes there, on your own examples.
  3. 03You keep the plan, with or without Bombos.
Piet Baudoin
Piet BaudoinYou talk to Piet, from the Bombos teamDutch team from Utrecht and Nijmegen · data in Europe
We reply the same working day.