Associate Principal, AI Engineer
IlluminaAbout the role
Location
This role is located at our HQ in San Diego, CA.
Position Summary
The Assoc Principal AI Engineer is the most senior individual contributor on the AI Engineering team, responsible for the design, development, and productionization of the most complex AI systems in the organization. This is a deeply technical, hands-on role for an engineer who has spent years in the trenches building, training, fine-tuning, and shipping AI systems at scale and is now ready to set technical direction across multiple teams.
The role combines applied research with production engineering. The Assoc Principal AI Engineer translates the latest advances in foundation models, agentic systems, and machine learning into robust, observable, and economically viable production systems. They write code, design systems, lead the hardest technical decisions, and shape the engineering culture that determines how AI gets built across the company.
Key Responsibilities
Technical Leadership
- Set the technical direction for AI Engineering across foundation model integration, fine-tuning pipelines, RAG systems, agentic workflows, and evaluation infrastructure.
- Own the most complex and ambiguous AI engineering problems in the company, from initial design through production deployment and ongoing optimization.
- Establish engineering standards for model development, prompt management, evaluation, deployment, and observability that the rest of the AI organization adopts.
- Lead architecture reviews and serve as the senior technical reviewer for high-stakes AI initiatives.
AI Systems Development
- Design and build production-grade Generative AI systems including retrieval-augmented generation, multi-agent orchestration, tool-using agents, and domain-adapted models.
- Develop fine-tuning, distillation, and post-training pipelines using techniques such as SFT, DPO, RLHF, and parameter-efficient methods (LoRA, QLoRA, adapters).
- Architect and implement vector retrieval systems, semantic search, and hybrid retrieval pipelines optimized for accuracy, latency, and cost.
- Build robust evaluation frameworks covering automated metrics, LLM-as-judge, human review, regression testing, and safety evaluations.
Platform and Infrastructure
- Design and build the AI platform that powers internal teams, including model serving infrastructure, prompt and prompt-template management, experiment tracking, and feature stores.
- Optimize inference performance across latency, throughput, and cost, including quantization, batching, caching, speculative decoding, and intelligent routing across model providers.
- Establish LLMOps practices for continuous evaluation, drift detection, prompt versioning, rollback strategies, and incident response.
- Partner with platform and infrastructure teams to ensure AI workloads run reliably on GPU and accelerator hardware across cloud environments.
Research to Production
- Stay current with the rapidly evolving AI research landscape and identify which advances translate into production value for the business.
- Prototype emerging techniques (new model architectures, training methods, agent frameworks) and lead the path from experiment to production system.
- Contribute to internal technical strategy on build versus buy decisions for foundation models, vector databases, agent frameworks, and AI tooling.
Cross-Functional Influence
- Partner with product, data science, research, and business stakeholders to scope AI initiatives and shape solutions that deliver measurable business impact.
- Mentor senior and staff engineers, raising the technical bar across the AI organization.
- Represent AI Engineering in executive forums, customer conversations, vendor evaluations, and industry engagements.
- Author technical documents, design docs, and (where appropriate)
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s