Senior Software Engineer, AI/MLOps
GalileoAbout the role
This is an hybrid role based in Burlingame, CA with the team working together in person 2 days per week.
About Galileo
Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.
Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.
Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.
Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.
About the role
As an early engineer at Galileo, you will play a foundational role in designing, building, and scaling our products and team. We’re looking for an exceptional Senior Software Engineer, interested in solving complex problems at the intersection of Data and ML and passionate about the opportunities in Observability and Reliability for GenAI.
What you'll be doing
- Technical Design and Architecture - you will champion for the right scalable, reliable architecture and obtain buy-in from all the stakeholders
- Planning and Execution - you will work with your team to help plan the roadmap and execute it
- PR and Design Reviews - you will uphold the engineering excellence/quality bar by reviewing your peer’s PRs
- Collaboration - you will collaborate closely with Product Managers, designers and other TLs to ensure we are building the right strategy and leveraging each other’s work.
- Advance Engineering - you will participate in design reviews, on-call and support, participate in and present during Tech Talks and learning sessions & help interview other engineering candidates
What we're looking for
- 5+ years of experience building Data or AI/ML products
- Experience building APIs in Python (FastAPI preferred)
- Experience building large scale distributed systems and familiarity with
- Messaging and Pub-Sub systems such as RabbitMQ/Kafka
- Storage/database systems similar to Postgres, MongoDB, Cassandra, S3
- OLAP systems such as ClickHouse, Pinot
- Orchestration systems such as Celery
- Experience building test suites using frameworks such as PyTest/PyUnit
- Experience working effectively during the product development process, working cross-functionally with a product manager, designer, user researcher, and data scientist
- Excellent communication skills for collaborating with cross-functional partners
- High productivity and care to help teams collaborate more effectively and efficiently
- A startup mindset, biasing towards thoughtful action with minimal direction.
Bonus Points
- Experience working with Docker and Kubernetes.
- Experience building applications on at least one of AWS, Google Cloud, or Microsoft Azure.
- Experience building customer facing products with ML frameworks (like PyTorch, Tensorflow, Keras, etc)
- Experience building agentic applications (like LLMs, rags, agents, etc.) with common frame
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s