Tech Lead, AML Inference

About the Team
The mission of our Applied Machine Learning (AML) team is to push the next-generation AI infrastructure and recommendation platform for ads ranking, search ranking, live streaming, and e-commerce. We drive substantial impact across ByteDance’s core businesses by building world-class ML platforms and systems.

We are seeking an Tech Lead, AML Inference to oversee the development and execution of ByteDance’s inference infrastructure. This role will lead and mentor a team of Machine Learning Engineers focused on inference, ensuring reliability, scalability, and performance across large-scale distributed systems. The Inference Lead will collaborate closely with research, product, and platform teams to design and deliver cutting-edge solutions that power critical ranking and recommendation services.

Responsibilities
- Lead and mentor a team of inference-focused Machine Learning Engineers, setting technical direction and ensuring best practices.
- Drive the design and evolution of distributed inference infrastructure to support feeds, ads, search, and other core ranking models.
- Oversee the development of monitoring, observability, and management tools to ensure reliability and scalability of online inference services.
- Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end-to-end performance.
- Partner with research and product teams to translate requirements into robust and efficient inference solutions.
- Stay at the forefront of advancements in inference frameworks, ML hardware acceleration, and distributed systems, incorporating innovations where impactful.

The base salary range for this position in the selected city is $208800 - $616000 annually.