Senior Software Engineer – Crawling (m/f/d)

<h3>About the Job</h3> <p><span><span>We’re growing fast and looking for a hands-on <strong>Senior Software Engineer</strong> <strong>(m/f/d)</strong> to help us unlock and scale access to the world’s data. You’ll design and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products.</span></span><span> </span></p><p><span><span>This is a chance to work on complex engineering challenges with massive real-world impact. You’ll work alongside a sharp, collaborative team and ship production systems end-to-end. If you’re passionate about building tools that ingest, process, and deliver data at scale, let's </span><span>talk.</span></span><span> </span></p> <h3>What you will do</h3> <ul><li><span><span>Build and scale<strong> web crawling </strong>and <strong>scraping systems</strong> that can handle dynamic, large-scale data extraction.</span></span></li><li><span><span>Design robust <strong>pipelines for data ingestion</strong>, cleaning, and enrichment.</span></span></li><li><span><span>Work closely with <strong>product and ML teams</strong> to deliver data-driven features.</span></span></li><li><span><span>Deploy and operate <strong>containerized apps</strong> in <strong>cloud </strong>environments (AWS, Azure, GCP).</span></span></li><li><span><span>Improve and automate deployments with <strong>CI/CD, Ansible,</strong> or <strong>serverless stacks.</strong></span></span></li><li><span><span>Stay ahead of <strong>anti-bot measures</strong>, optimizing systems for reliability and performance.</span></span></li><li><span><span>Contribute to <strong>technical architecture</strong> and help shape the<strong> engineering culture.</strong></span></span></li></ul> <h3>Your profile</h3> <ul><li><span><span>5+ years of professional software development experience.</span></span></li><li><span><span>Strong skills in <strong>Python</strong><strong> </strong>(bonus: Go, Java/Spring Boot).</span></span></li><li><span><span>Hands-on experience with <strong>web scraping</strong>, <strong>data pipelines</strong>, and the challenges of large-scale data collection.</span></span></li><li><span><span>Solid experience with <strong>Docker </strong>and <strong>cloud platforms</strong> (AWS, Azure, or GCP).</span></span></li><li><span><span>Proficiency with <strong>Git</strong>, <strong>CLI tools,</strong> and <strong>containerized deployments.</strong></span></span></li><li><span><span>Familiarity with tools like Apache Airflow, Ansible, or serverless architectures.</span></span></li><li><span><span>Clear <strong>communicator </strong>who thrives in a collaborative, fast-paced environment.</span></span></li><li><span><span>Comfortable working <strong>onsite/hybrid </strong>with a tight-knit team.</span></span></li></ul><span><span>Nice to Have:</span></span><ul><li><span><span><strong>Full-stack skills</strong> (React, Angular, or Vue) - or willingness to learn frontend quickly.</span></span></li><li><span><span>Experience with<strong> ML pipelines,</strong> data labeling workflows, or Large Language Models (<strong>LLMs</strong>).</span></span></li><li><span><span>Knowledge of <strong>anti-scraping measures.</strong></span></span></li><li><span><span>Familiarity with Terraform, Kubernetes, and modern DevOps tooling.</span></span></li></ul> <h3>Why us?</h3> <ul><li>Hybrid work in <strong>Munich</strong>: About two days a week in the office</li><li><strong>Flexible working hours</strong>, no tracking</li><li><strong>30 vacation days </strong>per year</li><li><strong>30 days</strong> of "<strong>workcation"</strong> per year, within the EU and selected countries</li><li>High <strong>autonomy </strong>and flat hierarchies</li><li><strong>EGYM Wellpass </strong>for unlimited access to fitness courses and gyms (20 € / month)</li><li><strong>Udemy </strong>access for educational videos</li></ul> <h3>Closing</h3> <span>We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills - and together we will make great things happen!</span>