New 
Software Engineer II
 Microsoft | |
 United States, Washington, Redmond | |
 Nov 02, 2025 | |
|
OverviewAre you interested in building AI Agent platforms and agentic experiences that solve missioncritical enterprise problems? Our teamis responsible forEvals and Experimentation across Dynamics 365, supporting multipleAgent teams anddelivering quality AI solutions at planet scale. Wepartnercloselywith Applied Science,Product Management,and Engineering teams toensure everyAI feature has data sets, evaluation metrics and experimentation processesintegrated with their releasepipelinesand productiondeployments. We are looking for a Software Engineer II towork across the stack and ensure that our partner teams have everything they needto move fast and deliver the most impactful Agents to all our Dynamics 365 customers. About Us: The Business & Industry Copilots (BIC) group is a rapidly growing organization thatis responsible forthe Microsoft Dynamics 365 suite of products, Power Apps, Power Automate, Dataverse, AI Builder, Microsoft Industry Solution and more. Microsoft is considered one of the leaders in Software as a Service in the world of businessapplications,and this organization is at thecoreof how business applications are designed and delivered. Microsoft's mission is to empower every person and every organization on the planet to achieve more. Asemployeeswe come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
ResponsibilitiesDevelop features with a focus on quality, usability & performance. Participate in livesite operations with an emphasis on timely response, delivery, and stakeholder satisfaction. Collaborate across internal & external stakeholders including mentoring others. Work across the stack to lead delivery of end-to-end agent platform features (lifecycle, deployment, observability) that scale across enterprise workloads. Own evaluations and experimentation pipelines to allow partner teams to define hypotheses, design A/B experiments, instrument metrics, and analyze results to drive product decisions. Build and maintain evaluation suites for agents (quality, safety, latency, cost) and integrate evaluations into CI/CD to ensure continuous improvement. Prototype rapidly, iterate on architecture and UX, and lead technical tradeoffs that improve reliability, performance, and automation. Embody our culture and values. | |