Sr. Engineer, Applied AI (AI Code Gen)

Job Posted: 6/6/24

Location: Americas (North, Central and South America)

Hi there!

We're looking for a Senior AI Engineer to join Zapier’s AI Code Gen Team and help us move closer to our mission of making automation accessible to everyone. At Zapier, we envision a future where everyone has their own personal automation assistant, powered by the perfect blend of AI and our robust automation systems. The AI Code Gen team is at the heart of this mission, working to scale Zapier’s ecosystem so we can confidently say “yes” to every automation use case. We have ambitious goals to reshape how people think about workflows on the web, potentially transforming the very core of how Zapier operates.

As a Senior AI Engineer on our team, you’ll play a crucial role in designing, developing, and maintaining AI-powered systems that solve real-world problems. You’ll be responsible for integrating AI models into existing software, troubleshooting, and ensuring these systems run smoothly. Communication is key—whether you’re collaborating with fellow engineers or explaining complex AI concepts to non-technical stakeholders, your ability to bridge that gap will be vital.

With the rise of large language models (LLMs) and the evolving landscape of AI tooling, we believe a new kind of engineering is emerging—one that blends the best of classical ML research with backend engineering. We’re looking for someone who not only has deep experience working with LLMs but also understands how to harness these tools to create new, valuable experiences. This role sits at the intersection of traditional skill sets, requiring both the expertise of ML research and the practical know-how of backend engineering, along with proficiency in the latest AI technologies.

If you’re interested in advancing your career at a fast-growing, profitable, impact-driven company, then read on…

• Our Commitment to Applicants

• Culture and Values at Zapier

• Zapier Guide to Remote Work

• Zapier Code of Conduct

• Diversity and Inclusivity at Zapier

Even though our job description may seem like we're looking for a specific candidate, the role inevitably ends up tailored to the person who applies and joins. Regardless of how well you feel you fit our description, we encourage you to apply if you meet these criteria:

About You

• You have 7+ years of experience, with at least 5 of those years dedicated to building distributed, scalable web applications. You possess strong communication skills, problem-solving abilities, and a drive to deliver outstanding customer experiences for both external users and internal stakeholders.

• You are familiar with underlying technologies like transformer networks, attention mechanisms, and how they contribute to models’ abilities to generate coherent responses, generate function calls, and perform other language tasks.

• You have worked with large language models (LLMs) to perform complex tasks in production environments. You’re well-versed in advanced prompt techniques for LLM grounding, such as chain-of-thought, static few-shot examples, and dynamic few-shot examples. You also have experience fine-tuning LLMs to meet specific needs, focusing on training data optimization and bias mitigation.

• You are proficient in deploying evaluation frameworks for LLMs, with a focus on performance, reliability, and bias assessment.

• You have experience with Retrieval-Augmented Generation (RAG) systems and understand how to optimize knowledge retrieval for improved model accuracy and speed. You have a solid understanding of different indexing and chunking strategies based on the system’s data and goals, as well as semantic search and vector databases, and how they differ from traditional retrieval methods and databases.

• You have a proven track record of working through the full lifecycle of building, testing, deploying, and scaling LLM architectures.

• You are an expert at identifying and docume