Senior Software Engineer, Tooling

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

The Microsoft AI Red Team is an interdisciplinary group of security experts, adversarial ML researchers, and software engineers with the mission of proactively identifying failures in Microsoft’s AI systems before they impact customers. Within the AI Red Team, our Tooling group builds platforms and developer experiences that enable teams across Microsoft to evaluate AI-powered systems at scale. Our team is the home of PyRIT (https://github.com/Azure/PyRIT ), an open-source framework used for AI risk identification and evaluation. We are expanding this space by building a new platform that enables product teams to run system-level evaluations of agentic applications and model-enabled experiences inside normal engineering workflows. We are looking for a Senior Software Engineer to help build this new system-level evaluation platform for agentic applications and model-enabled experiences. These systems increasingly involve multi-step reasoning, tool and API use, multimodal inputs, and memory. In this role, you will lead architecture and technical direction, drive key design decisions, and deliver a platform that integrates into engineering workflows and pipelines to test and measure a broad set of risks and harms.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Responsibilities:

• Lead system design and architecture; author and drive design reviews to ensure solutions meet security, privacy, compliance, scalability, and reliability requirements.
• Drive implementation of core platform capabilities (e.g., orchestration/execution engine, extensibility model, integration patterns, reporting/telemetry signals).
• Establish engineering best practices and standards for code quality, testing, reproducibility, performance, and operational excellence.
• Lead incident retrospectives and drive systemic improvements through root cause analysis, prevention mechanisms, and reliability investments.
• Define success and guardrail metrics; drive instrumentation and feedback loops enabling continuous improvement and high-quality ship decisions.
• Foster cross-team alignment with partner engineering teams and stakeholders to ensure broad adoption and clear integration paths.

Required/minimum qualifications

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Additional or preferred qualifications

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 2+ years of experience designing, building, and operating scalable, highly available cloud services or distributed systems on platforms such as Azure, AWS, GCP, or comparable cloud environments, with production ownership and CI/CD pipeline integration.
• 1+ years of experience leading design and architecture for a product area or subsystem, including authoring design documents, driving design reviews, and ensuring solutions meet security, reliability, and performance requirements.
• 3+ years of experience designing, developing, or maintaining secure software systems, with applied knowledge of authentication, data protection, access control, and secure coding practices.
• 1+ years experience with generative AI or agentic systems, such as LLM-based applications, tools/function calling, retrieval/memory, or multimodal pipelines, especially in the context of evaluation, testing, or safety/security.
• Experience applying distributed systems concepts such as concurrency, conflict resolution, and consensus algorithms to the design of resilient and maintainable back-end architectures.
• Demonstrated experience designing and delivering platforms or frameworks that are adopted by multiple independent product teams (e.g., shared services, SDKs, internal developer platforms, or evaluation frameworks).
  
  

#MSFT #Security #MSCareerEvents25 #MSECAI #AeGIS #airedteam

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.