Senior Software Engineer – Crawling (m/f/d)
Certivity GmbHAbout the role
About the Job
We’re growing fast and looking for a hands-on Senior Software Engineer (m/f/d) to help us unlock and scale access to the world’s data. You’ll design and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products.
This is a chance to work on complex engineering challenges with massive real-world impact. You’ll work alongside a sharp, collaborative team and ship production systems end-to-end. If you’re passionate about building tools that ingest, process, and deliver data at scale—we want to talk.
What you will do
- Build and scale web crawling and scraping systems that can handle dynamic, large-scale data extraction.
- Design robust pipelines for data ingestion, cleaning, and enrichment.
- Work closely with product and ML teams to deliver data-driven features.
- Deploy and operate containerized apps in cloud environments (AWS, Azure, GCP).
- Improve and automate deployments with CI/CD, Ansible, or serverless stacks.
- Stay ahead of anti-bot measures, optimizing systems for reliability and performance.
- Contribute to technical architecture and help shape the engineering culture.
Your profile
- 5+ years of professional software development experience.
- Strong skills in Python (bonus: Go, Java/Spring Boot).
- Hands-on experience with web scraping, data pipelines, and the challenges of large-scale data collection.
- Solid experience with Docker and cloud platforms (AWS, Azure, or GCP).
- Proficiency with Git, CLI tools, and containerized deployments.
- Familiarity with tools like Apache Airflow, Ansible, or serverless architectures.
- Clear communicator who thrives in a collaborative, fast-paced environment.
- Comfortable working onsite/hybrid with a tight-knit team.
- Full-stack skills (React, Angular, or Vue) - or willingness to learn frontend quickly.
- Experience with ML pipelines, data labeling workflows, or Large Language Models (LLMs).
- Knowledge of anti-scraping measures.
- Familiarity with Terraform, Kubernetes, and modern DevOps tooling.
Why us?
- Hybrid work in Munich.
- Flexible working time.
- 30 days of vacation per year.
- 30 days of workcation per year, in the EU and some selected countries.
- High autonomy and flat hierarchies.
- Direct access to the users and quick iteration cycles.
Closing
We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills - and together we will make great things happen!
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s