> Markdown version of [/jobs/ext/2056550-principal-software-engineer](https://www.wearedevelopers.com/jobs/ext/2056550-principal-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Software Engineer - **Company:** Microsoft - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $142,800.0 - $274,800.0 - **Contract:** Permanent contract - **Skills:** C (Programming Language), Java (Programming Language), JavaScript (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Big Data, Microsoft Online Services, C Sharp (Programming Language), C++ (Programming Language), Distributed Systems, Fault Tolerance, Python (Programming Language), Reliability Engineering, Software Engineering, Large Language Models, Multi-Agent Systems, Information Technology - **Published:** August 14, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/17921866?backUrl=%2Fcareer%2F17921866%2FPrincipal-Software-Engineer-New-York-New-York ## About the Role * Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: * Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter., * Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. * Deep experience with large-scale distributed systems and reliability engineering, especially delivering dependable outcomes across many interacting service dependencies operating under heavy or unusual load. * Experience building AI-first or agentic systems, and designing systems, APIs, and tooling intended to be operated by autonomous agents, including the observability, guardrails, and safety mechanisms that make agent-driven operation trustworthy. * Experience with AI/ML evaluation, measurement, or benchmarking systems, such as LLM-based grading, metric design, or large-scale data and quality pipelines. Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. ## Description * Sets the technical direction for the Copilot offline evaluation platform and partners with teams across the Copilot organization to turn ambiguous quality questions into rigorous, reproducible evaluations-the scenarios, metrics, and scorecards that gate what ships. * Leads the architecture of an AI-first, agentic-first evaluation platform in which autonomous agents are first-class operators, designing the services, pipelines, and tooling that agents can operate, extend, and reason about, with the observability and guardrails required to make agent-driven operation trustworthy. * Owns the platform's hardest challenge: delivering trustworthy results across a deep chain of dependencies pushed far beyond their normal operating envelope, with designs for graceful degradation, intelligent retries, dependency-aware gating, and reliability under sustained and growing load. * Defines how Copilot's agentic experiences are evaluated end to end, from multi-turn trajectories and tool selection to task outcomes and modalities such as UX and voice, building the simulation, scraping, and scoring capabilities needed to make agent behavior measurable. * Leads by example and mentors engineers across teams to build extensible, maintainable systems, driving modernization of the evaluation runtime and platform so it can scale with rapidly growing demand while improving cost efficiency and latency. * Stays at the forefront of agentic systems, large-scale AI evaluation, and autonomous operations, bringing emerging patterns and practices into the organization and sharing that knowledge to raise the bar for how Copilot measures quality. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [System Resilience: Surviving the Software Storm](https://www.wearedevelopers.com/videos/874-system-resilience-surviving-the-software-storm) - [Designing and Deploying Distributed Multimodal Multi-Agent Systems with Google's AI Stac](https://www.wearedevelopers.com/videos/1976-designing-and-deploying-distributed-multimodal-multi-agent-systems-with-google-s-ai-stac) - [The Software Engineer 2030: From Coder To AI Orchestrator? - Patrick Schnell](https://www.wearedevelopers.com/videos/1825-the-software-engineer-2030-from-coder-to-ai-orchestrator-patrick-schnell) - [The AI-Native Engineering Org: What’s Real, What’s Hype, What’s Next](https://www.wearedevelopers.com/videos/100004-the-ai-native-engineering-org-what-s-real-what-s-hype-what-s-next) - [Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure](https://www.wearedevelopers.com/videos/1532-agentic-ai-from-theory-to-practice-developing-multi-agent-ai-systems-on-azure) ## Related Articles - [How Much Does a Software Engineer Make? Realistic Software Engineering Salaries](https://www.wearedevelopers.com/magazine/425-how-much-does-a-software-engineer-make-realistic-software-engineering-salaries) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers) - [Are Software Engineer Wages Being Pushed Down? A Report on Tech Salaries](https://www.wearedevelopers.com/magazine/417-are-software-engineer-wages-being-pushed-down-a-report-on-tech-salaries) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)