started · updated
Microsoft develops synthetic data platform to evaluate Copilot AI
Microsoft Research has developed the Industry Evaluation Data Generation Platform to evaluate Microsoft Copilot at an enterprise scale. Because real enterprise data contains sensitive information that cannot be used for testing, the platform creates full-scale synthetic environments.
These synthetic environments are grounded in publicly available real-world sources, such as SEC filings, online job postings, and O*NET occupational data. By mimicking real business workflows, the platform allows Microsoft to identify issues that generic benchmarks might overlook while maintaining safety and privacy through automated content-safety checks.
Separately, research notes indicate that Microsoft 365 Copilot licensing may impact performance. Users with a dedicated Microsoft 365 Copilot license receive Priority Access, which is intended to support faster response times and more reliable availability during periods of high demand. However, standard access remains dependent on available service capacity, and factors such as request complexity or service load can also affect response speeds.