See yourself at Twilio

Join the team as our next Staff Data Platform Engineer.

Who we are & why we’re hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.

Although we're headquartered in San Francisco, we're on a journey to becoming a globally antiracist company that supports diversity, equity & inclusion wherever we do business. We employ thousands of Twilions worldwide, and we're looking for more builders, creators, and visionaries to help fuel our growth momentum.

About the job

As a Data Platform Engineer on the Insights Foundations team, you’ll build systems that process hundreds of thousands of data points per second and data models that unlock rich capabilities for our customer data platform (CDP) engine. Our Data Platform Engineers have a deep understanding of large distributed systems which comprise the compute kernels that rely on this data. You’ll be responsible for leading execution and guiding the technical decisions of the team to deliver high business impact.

The Insights Foundations team owns and operates the analytical database platform for multiple Twilio products.  We were early adopters of the Clickhouse open source OLAP database, and provide a self hosted, managed solution for product teams to leverage due to our scale.  We ingest gigabytes of data per second, and query across petabyte scale supporting real time analytics use cases that empower our customers data management decisions.  Some solutions we enable are Segment Product Observability, Marketing Analytics, and low-level telemetry data analysis.  However, when building a platform on one of the fastest and most efficient databases currently available, we have more use cases than we can currently support.

We iterate quickly on these products and features and learn new things daily — all while writing quality code. We work closely with product and design and solve some of the toughest engineering problems to unlock new possibilities for our customers. If you get excited by building products with high customer impact — this is the place for you.

Responsibilities

In this role, you’ll:

• Lead the execution of building our next generation analytics platform that powers the insights for the leading customer data platform (CDP) and other products inside Twilio.
• Partner with engineering teams to build and maintain analytics pipelines that power industry leading features.
• Build highly performant solutions that unlock differentiated CDP capabilities at scale
• Collaborate with subject matter experts, fellow developers, and internal stakeholders to turn technical roadmaps and goals into business impact
• Maintain a high bar of operational excellence for our systems and services as well as a high standard for data quality, consistency, and compliance
• Mentor engineers on the team, leading projects, sharing domain knowledge, and positively influencing their careers

Qualifications

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

• 5+ years  of experience writing production-grade code in a modern programming language

• Strong background in distributed data processing, software engineering of data services and/or data stores
• Familiar with big data technologies like Clickhouse, Apache Iceberg, Spark, Trino and comfortable working with commerce-scale datasets
• Experience with SQL performance tuning and schema design
• Hands on experience with kubernetes in a large scale ecosystem, specifically stateful sets
• Highly effective collaborator who works well with teammates and product partners to deliver completed work on time
• Well-versed in concurrent programming
• Solid grasp of Linux systems and networking concepts
• Experience maintaining and operating always-on cloud services
• Comfortable asking questions and taking initiative to solve problems in a rapidly growing company, where it is