Copilot Studio Announced #321

Copilot Studio: Custom Graders Library and Ready-to-Use Microsoft Graders

Makers can reuse graders across agent evaluations

Microsoft is adding a central library in Copilot Studio where makers can create, save and reuse custom graders. General availability is scheduled for November 15, 2026.

Key points

  • Shared evaluation criteria can standardize quality measurement across agents and test sets.
  • Makers can also use out-of-the-box graders provided by Microsoft.
  • The library supports discovering and managing saved custom graders.

What to do

No action is required. Tell makers about the planned library and Microsoft-provided graders for agent evaluation. Review which evaluation criteria teams could share across agents and test sets.

Timeline

  1. 30 October 2026 Published
  2. 15 November 2026 General availability (planned) General availability of the graders library and Microsoft-provided graders.
Speaker notes

The change is about making agent quality evaluation more consistent across teams. Instead of duplicating evaluation criteria, makers can build and reuse a shared set of custom graders. Microsoft also provides out-of-the-box graders. General availability is scheduled for November 15, 2026; the source does not confirm that availability has begun. No administrative action is required, and the source does not specify licensing requirements.

Sources and links

Area, status, change type, licence and flags are indicative. Always open the source before you act on a card.