FULL_TIME
2-5
Data Scientist
11/26/2025
Formulate data-driven approaches to evaluate and improve AI agent performance. Engage with product teams and collaborate with other data scientists to translate findings into actionable insights.
Working Hours
40 hours/week
Company Size
10,001+ employees
Language
English
Visa Sponsorship
No
About The Company
Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; it embraces it. Each day we make progress together by showing up as our authentic selves. We show up with a learn-it-all mentality. We show up cheering on others, knowing their success doesn't diminish our own. We show up every day open to learning our own biases, changing our behavior, and inviting in differences. Because impact matters.
Microsoft operates in 190 countries and is made up of approximately 228,000 passionate employees worldwide.
About the Role
Formulate data-driven approaches to evaluate and improve AI agent performance, leveraging diverse algorithms and data sources. Apply state-of-the-art LLM and machine learning techniques to analyze and optimize agent behavior Use data exploration to uncover patterns in agent interactions, identify new opportunities or issues, and assess data limitations within our problem space. Engage with product teams and collaborate with other data scientists, engineers, designers, and product managers to translate findings into clear, actionable insights that shape product features and improve our Copilot Studio platform. PhD in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field OR MSc in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) or consulting experience OR BSc in Data Science, Mathematics, Statistics, Econometrics, Physics, Operations Research, Computer Science, or related field AND 2+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR equivalent experience Programming Skills: Proficiency in one or more programming/scripting languages for working with data, such as Python, C++, or C#. Machine Learning Experience: Experience in applying machine learning to large-scale data sets. Solid understanding of ML algorithms and evaluation techniques Analytical Mindset: Strong data analysis and problem-solving skills. Ability to use data to draw insights and make decisions, experiment design, and interpret model performance metrics. Excellent teamwork and communication skills. Comfortable working in a fast-paced, interdisciplinary environment and presenting complex findings in a clear, impactful way. Experience with building ML and LLM products, focusing on NLP and conversational AI. Passion for learning and stay informed with State of the Art progress
Key Skills
Data AnalysisMachine LearningStatistical TechniquesProgrammingNLPConversational AITeamworkCommunicationProblem SolvingExperiment DesignModel Performance MetricsData ExplorationAlgorithm EvaluationAI Agent PerformanceProduct CollaborationLearning
Categories
TechnologyData & AnalyticsScience & ResearchEngineeringConsulting
Apply Now
Please let Microsoft know you found this job on PrepPal. This helps us grow!
Get Ready for the Interview!
Do you know that we have special program that includes "Interview questions that asked by Microsoft?"
Elevate your application
Generate a resume, cover letter, or prepare with our AI mock interviewer tailored to this job's requirements.