FULL_TIME
5-10
Senior Applied Sciences
11/28/2025
Build benchmarks, evaluation datasets, metrics, and methods to assess and improve the performance of language models. Collaborate closely with engineering, research, product, and other teams to ensure AI-driven experiences meet quality standards.
Working Hours
40 hours/week
Company Size
10,001+ employees
Language
English
Visa Sponsorship
No
About The Company
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters.
Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.
About the Role
Build benchmarks, evaluation datasets, metrics, and methods to assess and improve the performance and effectiveness of language models and prompts and drive iterative enhancements. Deliver high-impact analyses that generate actionable insights to steer product and business decisions and improve user satisfaction. Collaborate closely with engineering, research, product, and other teams to ensure AI-driven experiences meet quality and user experience standards. Analyze latest AI innovations and explore opportunities to apply cutting-edge techniques for building scalable, high-impact solutions that enhance product capabilities and deliver exceptional user experiences. Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. Hands-on experience with Large Language (LLMs), including evaluation techniques, prompt engineering, model fine-tuning/post-training. 3+ years of experience in applied science or machine learning, natural language processing (NLP), or AI systems. Proficiency in Python, C#, or similar languages. These requirements include but are not limited to the following specialized security screenings: Exceptional analytical and problem-solving skills with a track record of tacking complex challenges. Solid communication and presentation abilities, capable of conveying technical concepts to diverse audiences. Proven experience across the product lifecycle from ideation to shipping. Publications in leading AI/ML conferences (e.g., NeurIPS, ICML, ACL), demonstrating thought leadership and technical depth.
Key Skills
StatisticsPredictive AnalyticsResearchMachine LearningNatural Language ProcessingAI SystemsPythonC#Analytical SkillsProblem-SolvingCommunicationPresentation SkillsModel Fine-TuningPrompt EngineeringPublicationsTechnical Depth
Categories
TechnologyData & AnalyticsScience & ResearchEngineeringSoftware
Apply Now
Please let Microsoft know you found this job on PrepPal. This helps us grow!
Get Ready for the Interview!
Do you know that we have special program that includes "Interview questions that asked by Microsoft?"
Elevate your application
Generate a resume, cover letter, or prepare with our AI mock interviewer tailored to this job's requirements.