Sr. Engineer, Applied AI

Job Posted: Jun 26, 2024

Location: NAMER

Hi there!

We're looking for a Senior AI Engineer to join Zapier & help advance our mission to make automation work for everyone. To service this mission, we’re looking to grow our core automation platform by building API-based AI solutions that support integration builders. Come join us on this mission!

• Our Commitment to Applicants

• Culture and Values at Zapier

• Zapier Guide to Remote Work

• Zapier Code of Conduct

• Diversity and Inclusivity at Zapier

About You

• You know AI fundamentals. You are familiar with underlying technologies like transformer networks, attention mechanisms, and how they contribute to the models’ abilities to generate coherent responses.  You understand semantic search and vector databases. You’re familiar with advanced prompt techniques for LLM grounding such as chain-of-thought, static few-shot examples, and dynamic few-shot. You understand Retrieval-Augmented Generation (‘RAG’) systems and how to optimize knowledge retrieval for improved model accuracy and speed.

• You love shipping to customers. You’ll be on a team focused on understanding customers' needs and translating those needs from specifications into functional, production-ready code. You know how to balance speed versus quality to support the features we build for our customers.

• You have deployed AI to solve customer problems. You have worked with LLMs to perform complicated tasks in production environments and can fine-tune LLMs to specific needs, with a focus on training data optimization and bias mitigation. You’re proficient in deploying evaluation frameworks for LLMs, focusing on performance, reliability, and bias assessment. You understand different indexing/chunking strategies based on the data and goal of the system.

• You foster collaboration and have a platform mindset. We pride ourselves in working together as a team, and with other teams across the organization. This includes Product and Design on a day-to-day basis but also includes teams like Security, Legal, Production Engineering and other Product teams. Strong teamwork and communication are essential; you’ll often find opportunities to drive work forward and document how things work.

• You embody our values. At Zapier, our values are at the heart of how we work together and how we think about our customers. In our remote setting, they help develop trust and ensure we work and collaborate to democratize automation.

Things You’ll Do

• Integrating LLMs into software products at Zapier, setting up necessary infrastructure ensuring its performance, scalability, and reliability.

• Develop and maintain features that enable our mission to support the creation, expansion, and maintenance of the automation platform as we scale.

• Exploring new and divergent LLM systems that will create a measurable impact in improvement over our base implementations.

• Design and implement prompting for LLMs that help our users create new automations, making the process more intuitive and efficient.

• Design and develop comprehensive evaluation suites to assess model performance and reliability.

• Improve the performance & accuracy of our models, and the APIs that surround them.

• Join the team in listening & working closely with our customers, and building a deep understanding of their needs to better serve them.

• Improve the monitoring and observability of our services (SLOs, Alerts, Dashboards) and ensure our services are healthy.

• Identify challenges and opportunities to reduce technical debt in our services.

• Join our yearly company retreats that rotate to various cities throughout North America to meet and collaborate with Zapiens in person.

How to Apply

At Zapier, we believe that diverse p