Test Automation Specialist (AI)

We're seeking someone to join our team as a Test Automation Specialist (AI) in our Human Capital Management - AI Model Validation Team. This role is pivotal in ensuring the reliability, quality, and compliance of Generative AI-powered (GenAI) products through systematic validation, testing, and evaluation. You will work closely with product managers, data scientists, and engineering teams to understand product requirements, assess AI model behavior, and drive the development of automated and AI-assisted validation frameworks.
  
In the Human Capital Management division, we provide advice and insight to attract, retain, reward and develop a talented global workforce, giving employees the support and tools they need to succeed. Join our Budapest Analytics Center of Excellence, a cornerstone of Morgan Stanley’s global Data and Intelligence organization. Our team plays a pivotal role in advancing the firm’s Artificial Intelligence initiatives by designing and delivering innovative validation solutions for AI-driven products. With AI recognized as one of the top strategic priorities within Human Capital Management, this is an exciting opportunity to contribute to a high-visibility program that shapes how the firm adopts and governs emerging technologies.
 
Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving and innovating to better serve our clients and our communities in more than 40 countries around the world.
 
What you'll do in the role:

• Drive the validation of GenAI-based products, models and AI-driven product features, ensuring outputs meet business requirements and ethical standards. 

• Develop, maintain, and improve automated or semi-automated validation workflows, leveraging scripting and AI-assisted testing tools. 

• Collaborate with product owners, developers, and other stakeholders to translate business requirements into testable validation criteria. 

• Analyse and interpret validation results to identify inconsistencies, biases, and performance issues in AI model outputs. 

• Create detailed documentation on validation methodology, results, and recommendations. 

• Support continuous improvement by proposing process enhancements and contributing to validation best practices across the team. 

• Communicate validation findings effectively to both technical and non-technical stakeholders, ensuring shared understanding and actionable outcomes. 

• Participate in cross-functional reviews to help shape product design and feature rollouts from a validation perspective.

 
What you'll bring to the role:

• Bachelor’s or Master's degree in Mathematics, Computer Science, Physics, Economics, or a related quantitative field 

• At least 5+ years of professional experience in software testing, test automation, business analysis, or a related technical validation role would generally be expected to find the skills required for this role. Experience with natural language processing, large language models (LLM) and/or generative AI is a plus

• Genuine interest in AI and other emerging technologies 

• Knowledge in Python and understanding of various data sources and technologies such as relational databases (SQL), data lakes and APIs 

• Strong analytical and problem-solving skills, with attention to detail and rigor in testing methodologies. Familiarity with common statistical methods is a plus 

• Ability to drive projects independently, work with diverse stakeholders, and deliver results from conception to completion 

 
#LI-hybrid #LI-JL1 #BP

WHAT YOU CAN EXPECT FROM MORGAN STANLEY:

At Morgan Stanley, we raise, manage and allocate capital for our clients – helping them reach their goals. We do it in a way that’s differentiated – and we’ve done that for 90 years.  Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren’t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you’ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There’s also ample opportunity to move about the business for those who show passion and grit in their work.

To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices​ into your browser.

Certified Persons Regulatory Requirements:
If this role is deemed a Certified role and may require the role holder to hold mandatory regulatory qualifications or the minimum qualifications to meet internal company benchmarks.

Flexible work statement
Interested in flexible working opportunities? Morgan Stanley empowers employees to have greater freedom of choice through flexible working arrangements. Speak to our recruitment team to find out more.

Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential. Our skilled and creative workforce is comprised of individuals drawn from a broad cross section of the global communities in which we operate and who reflect a variety of backgrounds, talents, perspectives, and experiences. Our strong commitment to a culture of inclusion is evident through our constant focus on recruiting, developing, and advancing individuals based on their skills and talents.