Senior Backend Software Engineer

<h2><strong>About Shelf</strong></h2> <p>There is no AI Strategy without a Data Strategy. Getting GenAI to work is mission-critical for most companies, but 90% of AI projects haven't deployed. Why? Poor data quality - it is the #1 obstacle companies have in getting GenAI projects into production.</p> <p>We've helped some of the best brands like Glovo, Lufthansa, Herbalife, and Nespresso solve their data issues and deploy their AI strategy with Day 1 ROI.</p> <p>Simply put, Shelf unlocks AI readiness. We provide the core infrastructure that enables GenAI to be deployed at scale. We help companies deliver more accurate GenAI answers by eliminating bad data in documents and files before they go into an LLM and create bad answers.</p> <p>Shelf is partnered with Microsoft, Salesforce, Snowflake, Databricks, OpenAI and other big tech players who are bringing GenAI to the enterprise. </p> <p><strong>Our mission</strong> is to empower humanity with better answers everywhere.</p> <h2><strong>Job Description:</strong></h2> <p>As a Backend Engineer at Shelf, you'll architect and build the distributed systems that make enterprise AI actually work. While others are chasing AI hype, we're solving the unglamorous but critical problem that determines whether AI succeeds or fails: data quality at scale.</p> <p>You won't just write code—you'll design architectures that handle petabytes of unstructured data, provision and optimize databases across multiple cloud regions, and build services that process millions of documents daily. Every architectural decision you make ripples through to the accuracy of AI systems at companies like Glovo, Lufthansa, and Nespresso.</p> <p>This is systems engineering at its most demanding. You'll tackle challenges like building multi-tenant distributed systems with strict data isolation, implementing real-time data quality scoring at scale, and creating self-healing pipelines that maintain 99.9% uptime. Your services will integrate with everything from enterprise systems to cutting-edge LLMs, requiring both deep technical knowledge and pragmatic engineering judgment.</p> <p>We obsess over backend quality because we're building the quality layer for AI itself. When your code elegantly handles edge cases, gracefully degrades under load, and self-monitors for anomalies, you're not just meeting engineering standards - you're directly preventing AI hallucinations and ensuring accurate answers for millions of end users.</p> <p>We're a product company that ships fast without compromising on lasting quality. You'll work alongside proactive, ever-learning engineers in an environment where AI isn't just what we build—it's how we build.</p> <p>The best engineers we know are drawn to problems that matter. If you're excited by the challenge of building the infrastructure that makes the AI revolution actually deliver on its promises, this role offers the rare combination of technical depth, meaningful impact, and the prestige of solving problems that the industry hasn't figured out yet.</p> <h3><strong>Responsibilities</strong></h3> <ul> <li>Design efficient database schemas and distributed architectures that elegantly handle multi-tenant data isolation, horizontal scaling, and fault tolerance</li> <li>Create comprehensive technical specifications and architecture diagrams that clearly communicate system design decisions and trade-offs</li> <li>Define &amp; maintain SLOs for your services and architect solutions that consistently meet them, even under peak load conditions</li> <li>Develop modular, composable components using Python, leveraging AI coding assistants to accelerate development while maintaining high code quality</li> <li>Transform ML models and LLMs into production-ready, reusable services with proper versioning, monitoring, and deployment pipelines</li> <li>Instrument services for performance metrics, track processing throughput, and build automated data quality and consistency checks</li> <li>Take full ownership of the systems you build, monitoring their health, optimizing performance, and ensuring they scale gracefully as data volumes grow</li> <li>Stay current with industry best practices in distributed systems, data engineering, and AI infrastructure—experiment with new approaches and share your findings with the team</li> <li>Contribute to our engineering standards and practices, mentor colleagues, and actively participate in our culture of continuous learning and improvement</li> <li>Build and maintain data pipelines across diverse storage solutions including S3, RDS/PostgreSQL, Elasticsearch, DynamoDB, and modern data warehouses</li> </ul> <h3><strong>Requirements</strong></h3> <ul> <li>Over 4 years of professional software engineering experience, including more than 1 year specializing in Python</li> <li>Deep understanding of distributed systems, concurrency patterns, and event-driven architectures</li> <li>Hands-on experience with AWS or Azure cloud primitives - you've personally provis