Data Engineer

AutogenAI changes how people write. We're busy creating a new kind of product where users collaborate with Artificial Intelligence to produce relevant, impactful bid proposals. Our SaaS bid writing application launched in October and already has product-market fit, with over £1m ARR. We are growing at an explosive rate, and need to continue meeting the needs of our end users as we evolve our platform in a fast-changing environment.

We’re looking for a data engineer to join a fast-growing team of data scientists and software engineers, to help with meeting rapidly growing demand for our services and increasing volumes of data being handled. The ideal candidate will be an experienced programmer who has specialised in data management, including the construction and maintenance of data pipelines and ingest processes. The salary range is £80-100K + equity, with two days a week in our London office.

Responsibilities

• Design, build, and maintain scalable and robust data pipelines and ingestion workflows to extract and transform customer data (primarily text).
• Integrate these pipelines into more general infrastructure, including search databases, document management interfaces, internal and customer-facing dashboards and IAC configuration.
• Assist in development of low-latency data services to handle end user interactions that combine LLM requests, data retrieval and custom logic for text processing.
• Research and develop services that use LLM functionality to drive new features.
• Lead in triaging and resolving production data issues.
• Contribute to engineering standards, tooling, processes, and culture, including through code review, pairing and post-mortems.

This list is not exhaustive. As a young company experiencing very fast growth, we need people who will enthusiastically jump into tasks outside of their field of expertise when necessary.

No agencies - this role is exclusive to a single recruiter. Uninvited approaches will be marked as spam.

Requirements

You must have:

• Previous experience in creating and maintaining cloud-based pipelines for data ingest, processing and management from a variety of sources.
• 3+ years of programming experience, with expertise in Python and Pandas and the ability to write well-tested, clean code that is easy to maintain and extend.
• Strong numerical and analytical skills, and a good sense of how to balance accuracy and speed to obtain the most effective results.
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.

Huge bonus points if you have familiarity with:

• Setting up and running scalable data pipelines in AWS.
• Document parsing and content extraction with PDF, DOCX etc.

• TypeScript - we use this for our SaaS backend.
• Terraform - we use this for infrastructure.
• Large language models or other AI / NLP services.
• Managing database services and APIs.

Benefits

We are a hybrid-working company, with two office days in London each week and occasional working retreats in sunny locations.

The salary range is £80-100K. We’re growing fast, and we’ll include equity on a vesting arrangement. We’re very open to discussion around working hours and other flexibilities. Additionally, you’ll get your choice of laptop, a home office allowance, 28 days holiday + bank holidays, and more.