Senior Software Engineer (Open Source / Python)

We are looking for Senior Software Engineers to collaborate directly with our CTO and the product team on the dlt library code and work with our community. If you're someone who thrives in the fast-paced environment of a small team and is excited about playing a pivotal role in shaping the day-to-day processes of an early-stage startup, then this opportunity is made for you.

dlt is an open-source library that automatically creates datasets out of messy, unstructured data sources. You can use the library to move data from about anywhere into most of well-known SQL and vector stores, data lakes, storage buckets, or local engines like DuckDB. It automates many cumbersome data engineering tasks and can be handled by anyone who knows Python. More on Show HN

dltHub is based in Berlin and New York City. It was founded by data and machine learning veterans. We are backed by Dig Ventures and many technical founders from companies such as Hugging Face, Instana, Matillion, Miro, and Rasa.

Your Task and Responsibilities:

• Contribute to dlt, including code, tests, and documentation
• Maintain the open source project with the team (e.g., review PRs, resolve issues, talk with community contributors, etc.)
• Actively participate in defining the library architecture and API (i.e., the library is our product—we must take input from other team members and our users)
• Frequently engage the open source community (e.g., providing technical help during developer workshops and bootcamps)
• Learn and apply data engineering principles for tasks requiring data loading, dataset creation, and interfacing data lakes and warehouses

Requirements

Who You Are:

• You really like Python and are fluent in writing Python code (e.g., Python typing, unit testing, writing docstrings, etc.)
• You are interested in the Python ecosystem (i.e., popular libraries, tools, Python internals, PEPs, how Python is used outside of software engineering, etc.)
• You have experience leading, mentoring, or supporting other developers to grow as software engineers
• You have a degree in computer science, data science, or other equivalent experience
• You have some experience with databases and data warehouses (i.e., you understand the relational data model, transactions, concurrency, etc.)
• You are familiar with GitHub workflows (e.g., pull requests, code reviews, CI/CD services, etc.)
• You are based in Berlin and willing to work in our office regularly

Nice to Have:

• You might have experience with data engineering (e.g., building data pipelines, dataset modeling, enabling others to use the data, etc.)
• You might have experience with DevOps (e.g., CI systems like GitHub Actions, Docker, Kubernetes, AWS/GCP/Digital Ocean, etc.)
• You might have experience with machine learning (e.g., the toolset, the workflows, practical applications, etc.)

Benefits

We are office first company but give you plenty of opportunities for deep work and work from home. We prioritize automation, starting with our own tasks before extending them to others.

• Dedicated "no meeting days" to help the team focus on their most impactful work
• Building connections with the team in person is crucial, so we host regular team lunches and events
• As we work often from the Berlin office, we cover your public transportation ticket
• We are deeply committed to your personal and professional growth, so we have an annual budget for learning and development.