Software Engineer, Platform & Data Infrastructure

This is an onsite role based in Burlingame, CA with the team working together in person 2 days per week.

About Galileo

Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.

Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.

Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.

Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.

Ideal Candidate

A talented software engineer excited to work on the backbone of the Galileo platform. We are looking for someone who has built large-scale real-time infrastructure, services, and APIs that scale to millions of queries. Addressed challenges that come with systems of scale. Worked on and optimized high throughput traffic on SQL and NoSQL data stores, time-series databases and/or Object stores.

You Have…

• Experience with large scale distributed systems
• Experience with NoSQL databases and time-series databases
• Worked on real-time high throughput caching systems
• Excellent python programming skills
• Worked with raw-data lookup indexes such as Lucene and/or similar frameworks
• Experience with runtime orchestration and pub-sub frameworks like RabbitMQ, Celery, Kafka
• Built low-latency data lookup APIs
• Done extensive performance optimizations
• Built internal tooling foundations for performance testing, load testing and benchmarking

Bonus Skills

• Experience with time-series or columnar databases (e.g., ClickHouse, TimescaleDB, DuckDB)
• Familiarity with distributed query engines or streaming frameworks (Presto, Trino, Flink, Spark Streaming)
• Hands-on with container orchestration and scaling systems (Kubernetes, EKS)
• Experience building observability and performance tooling (Grafana, OpenTelemetry, flame graphs)

What will this role work on/get to do?

You'll be responsible for the backbone that powers Galileo’s platform. This role is all about solving hard systems problems at scale and making our infrastructure resilient, fast, and reliable. 

In this role, you will:

• Build and scale core infrastructure – design and optimize distributed systems and APIs that handle millions of real-time queries with low latency and high reliability.
• Develop data-intensive systems – work across SQL, NoSQL, time-series, and object stores, ensuring data pipelines and lookups are o