Senior Spark Engineer

<p>At Superlinked we’re building the backbone of how people and data connect. Our Python framework turns messy, complex data into vector embeddings - the magic that makes Search, RecSys, RAG &amp; Analytics actually work (<a href="https://www.loom.com/share/e428fecb982c4925936652da7d833f5c?sid=f314d848-bd60-4355-b164-73723a477f7f" target="_blank">check our product intro</a>!). </p><ul> <li>$9.5M Seed raised from Index Ventures, Theory Ventures + top San Francisco investors</li> <li>Founded by ex-Google &amp; McKinsey leaders (our CEO Daniel scaled YouTube’s ads to $10B+)</li> <li>Partnered with MongoDB, Redis, Starburst, Dataiku</li> </ul><p>As our Senior Spark Engineer, you’ll own the batch processing engine of the framework - the part that makes Superlinked’s intelligence possible. You’ll work closely with <a href="https://www.linkedin.com/in/kemenes/" target="_blank">Balazs Kemenes</a> (Head of Engineering) and the team to build, optimize and scale Spark-based systems for vector computations.</p><h3>What You’ll Do</h3><ul> <li>Own Spark, PySpark, Dataproc &amp; EMR batch pipelines end-to-end.</li> <li>Tune and optimize Spark jobs for speed, stability and cost.</li> <li>Build tools for monitoring, debugging and performance.</li> <li>Collaborate with engineers to improve abstractions for computation.</li> <li>Provide technical leadership on Spark best practices.<br/></li> </ul><h3>Who You Are</h3><ul> <li>6-8+ years in software engineering with focus on data-intensive apps.</li> <li>Deep Spark/PySpark &amp; Python expertise.</li> <li>Hands-on experience with Dataproc, EMR, Databricks.</li> <li>Strong grasp of batch processing, DAG execution &amp; big data systems.</li> <li>Pragmatic, performance-driven, DevOps mindset.</li> </ul><p><br/><strong>Nice to have</strong>: compiler architectures, GPU acceleration, LLM workflows, or deep IR/vector DB knowledge.</p><h3><br/>Why Join Us</h3><p>We’re a small team (22 people across Budapest, UK, Tel Aviv, San Francisco) with no politics and lots of ownership. If you want your work to actually matter, you’ll feel at home here.</p><p>💰 Competitive salary + equity </p><p>🏝 Team offsites (Mallorca, Istanbul, the Alps, Portugal next)</p><p>🏢 Hybrid setup: 1 office day/week @ Create26, Király utca </p><p><br/>And here is the crew that would love to row with you. Join us! :)</p><p></p>