Member of Technical Staff: Data

Essential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP.

We believe that a small, focused team of motivated individuals can create outsized breakthroughs. We are building a world-class multi-disciplinary team who are excited to solve hard real-world AI problems. We are well-capitalized and supported by March Capital and Thrive Capital, with participation from AMD, Franklin Venture Partners, Google, KB Investment, NVIDIA.

Data is a critical source of skills and knowledge for our models. While messy and vast, data hides some of the biggest gains of any research bet. We’re excited to push new ground in identifying the quality and usefulness of our data sources based on the capabilities we need for our models.

What you’ll be working on

• Design and develop systems for processing and analyzing large volumes of data, ensuring efficient data flow and quality.

• Lead the development and deployment of machine learning classifiers and embeddings to categorize and enhance data quality.

• Oversee full-cycle engineering projects in data acquisition, including advanced web crawling, parsing and data ingestion.

• Architect, build, and maintain robust distributed systems for large-scale data management.

What we are looking for

• Minimum of 3 years of experience in data-intensive applications and software development.

• Proficiency in Python and distributed systems such as Spark, DataFlow, etc.

• Strong understanding of Kubernetes

• Creative problem-solving skills and willingness to explore new technologies and approaches

• Strong communication skills, capable of collaborating effectively across diverse teams

• [Bonus] You have previous experience in curating and processing datasets for ML model training and evaluation

We encourage you to apply for this position even if you don’t check all of the above requirements but want to spend time pushing on these techniques.

We are based in-person in SF. We offer relocation assistance to new employees.