US Tech - AI Evaluation Engineer (QA) Senior Associate

Industry/Sector

Not Applicable

Specialism

Data Science

Management Level

Senior Associate

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.

Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn’t clear, you ask questions, and you use these moments as opportunities to grow.

Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:

• Respond effectively to the diverse perspectives, needs, and feelings of others.
• Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.
• Use critical thinking to break down complex concepts.
• Understand the broader objectives of your project or role and how your work fits into the overall strategy.
• Develop a deeper understanding of the business context and how it is changing.
• Use reflection to develop self awareness, enhance strengths and address development areas.
• Interpret data to inform insights and recommendations.
• Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.

The Opportunity

As part of the People Tech & AI team you will develop, test, and validate Generative AI agents and data pipelines, promoting reliability, scalability, and alignment with PwC standards. As a Senior Associate you will analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions. This position provides an exciting opportunity to enhance your skills in automated testing and governance controls while contributing to innovative AI-driven solutions.

Responsibilities

- Apply automated testing and governance controls effectively

- Analyze complex issues and provide actionable insights

- Mentor and guide junior associates in their tasks

- Uphold rigorous standards of quality and technical excellence

What You Must Have

- Bachelor's Degree in Computer Science, Data Processing/Analytics/Science

- At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering

- In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college

What Sets You Apart

- Demonstrating three years of specialized training in technology preferred

- Experience with test automation and CI/CD pipelines

- Familiarity with LLMs and prompt engineering concepts

- Understanding enterprise data patterns and quality frameworks

- Building and maintaining automated test suites for AI agents

- Validating integrations with Power Automate platform

- Executing LLM evaluation frameworks using defined metrics

- Working with data scientists and ML engineers

- Upholding professional standards and documentation expectations

Travel Requirements

Up to 20%

Job Posting End Date

Learn more about how we work: https://pwc.to/how-we-work

PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within