Staff Evaluation Systems Engineer, Autonomous Vehicles

Job Description

Role: You will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our End-to-End ML Stack.  

In this position, you will work closely with AI/ML Engineers, Simulation Engineers, Systems Engineers, Product Managers to identify, analyze, monitor and prioritize the most important signals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs. 

If you're interested in having a major impact on accelerating AV Behavioral Evaluation assessment on ML-driven autonomy through creative problem solving, let's chat! 

What You’ll Do: 

• Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML stack. 

• Provide hands-on implementation of infrastructure solutions to assess AV performance from ELT tooling at GM from simulation and on-road data. 

• Proactively scope and identify metrics needed to improve our evaluation workflows and devise paths for implementation if not available. 

• Contribute to automated triage strategies for AV deficiencies in an End-to-End stack architecture and present findings to relevant stakeholders. 

• Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance. 

• Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as definition of success of evaluation initiatives. 

• Map and articulate link between continuous improvement processes with the product safety case and compliance with safety standards. 

Additional Job Description

Your Skills & Abilities: 

• Strong Python and SQL programming 

• Prior knowledge