AI Quality Associate

<p><em>Please note: This position is not eligible for immigration sponsorship.&nbsp;</em></p> <h3>Company Overview</h3> <p>We are the better way to work in finance. As private equity’s value creation partner, we sit at the heart of PE—where sponsors and CFOs meet. Through financial consulting rooted in data, technology, and AI, we help clients drive value—supporting the office of the CFO to drive end-to-end value creation.</p> <p>If you crave challenging work and are looking to grow, come solve complex issues alongside 1,600+ finance &amp; technology experts in a supportive, collaborative environment.</p> <p>Backed by premier private equity firms and headquartered in New York with 11 offices around the globe, we are a high-growth, entrepreneurial firm looking for people who want to be part of building something great. Come make your mark.</p> <h3>AI Quality Associate</h3> <p>The AI Quality Associate focuses on validating the quality of AI-generated outputs, agent behaviors, and AI-assisted workflows. This impactful role will be critical in building benchmark scenarios, defining scoring rubrics, evaluating business usefulness, and identifying failure patterns that conventional pass or fail software testing would not catch.</p> <p>This position will ideally be based in one of our US offices and is a hybrid role with the flexibility to work remotely 2 days per week (also eligible for remote candidates).</p> <p>This position is not eligible for immigration sponsorship.</p> <h3>What You’ll Do:</h3> <p><strong>AI Output Evaluation </strong></p> <ul> <li>Design and execute structured evaluations for AI-enabled features and workflows</li> <li>Assess outputs for groundedness, instruction adherence, consistency, usefulness, tone, control compliance, and risk</li> <li>Identify hallucinations, unsupported assertions, missing logic, and unsafe recommendations</li> </ul> <p><strong>Benchmark &amp; Rubric Development </strong></p> <ul> <li>Build and maintain golden datasets, benchmark prompts, comparison sets, and scorecards</li> <li>Develop rubrics that allow quality to be measured consistently across releases and changes</li> </ul> <p><strong>Workflow &amp; Model Change Validation </strong></p> <ul> <li>Compare performance across prompt versions, workflow revisions, tools, and models</li> <li>Support release decisions with evidence on quality regression or improvement</li> </ul> <p><strong>Business &amp; Domain Partnership </strong></p> <ul> <li>Work closely with Finance SMEs, product managers, and engineers to determine what acceptable looks like in real business contexts</li> &l