Senior Manager, Quality Engineering

About Panasonic Well:

Panasonic Well is a venture and business incubator from the Panasonic Group focused on pioneering new health and wellness solutions by connecting hardware, software and services through industry-leading, responsible AI. We are committed to building an ecosystem of technology that improves well-being for every generation.

Panasonic Well operates in the US as Panasonic Well LLC and in Japan as a division of Panasonic Holdings Corporation.

About The Role:

As a Senior Manager for Quality Engineering at Panasonic Well, you’ll lead a team of high performing quality assurance professionals in assuring the overall quality of Panasonic Well product offerings including Umi (our health and wellness coach) and the underlying platform.  You’ll partner with the other engineering leaders, SRE, and Security to ensure that Panasonic Well and our customers are protected against unexpected outcomes, especially in the AI (non-deterministic) space.  This role is accountable for the full quality strategy and responsible for AI-based testing, automated testing, and manual testing as needed; this role will partner with engineering, SRE, and security to ensure unit tests, observability, and security assurance practices are followed.  

In this role, you will report directly to the Global Head of Engineering and AI and will play a critical role in the Engineering Leadership team.

What You’ll Get To Do:

• Lead a team of QA engineers, mentoring talent and fostering a culture of quality throughout the development lifecycle
• Ensure quality across Panasonic Well’s main product offerings including Umi, an AI-powered wellness coach, partnering with key engineering, SRE, and Security leaders.
• Develop comprehensive testing strategies for AI-powered applications, including evaluation frameworks that measure model performance and reliability
• Partner with Product and Engineering teams to define quality metrics that balance product innovation with reliability
• Design and implement automated testing infrastructure that scales with our AI products
• Establish processes for regression testing, user acceptance testing, and continuous quality improvement
• Analyze quality metrics to identify trends and recommend improvements to products and processes
• Stay current with emerging QA methodologies and tools particularly relevant to AI systems
• Design and implement robust evaluation benchmarks for large language model capabilities, safety, and alignment
• Develop testing frameworks to detect and mitigate harmful model outputs, hallucinations, and potential misuse risks
• Collaborate with research teams to translate frontier AI safety research into practical testing methodologies
• Stay informed of the AI teams’ systems to measure and track model performance across diverse use cases and deployment scenarios
• Lead red-teaming exercises to identify potential vulnerabilities in AI systems
• Define clear criteria for model release readiness from a quality and safety perspective
• Create scalable processes for human evaluation of model outputs across multiple dimensions

What You’ll Bring:

• 10+ years of experience in Quality Assurance, with at least 7 years in a leadership role
• Demonstrated experience developing testing strategies for AI/ML-powered applications
• Strong understanding of AI evaluation frameworks, agentic AI,  prompt testing, and alignment methodologies
• Experience with automation frameworks and CI/CD pipelines
• Excellent communication skills and ability to collaborate across technical and non-technical teams
• Track record of building and scaling QA processes in fast-paced environments
• Bachelor's degree in Computer Science or related field (or equivalent experience)
• Expertise driving and delivering testing solutions for complex AI/ ML technology programs or products from inception to delivery. Including technical program/project management for consumer software products with AI, Data, and Cloud Infrastructure backgrounds. Health, lifestyle,  and wellness experience is a plus.
• Strong collaboration and communication skills.
• Experience in working with cloud-based platforms and services.
• Excellent written and verbal communication skills, with the ability to articulate technical concepts to both technical and non-technical stakeholders effectively.
• Demonstrates critical thinking capabilities with strong attention to detail.
• Understands and deals well with rapid development cycles and constant change remains flexible and calm when facing uncertainty.
• Has the ability to find innovative ways to resolve problems both tech