Software Engineer - Model Serving Infrastructure - USDS

Team Intro

The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company. We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer - Model Serving Infrastructure to join our team to support and advance that mission.



- Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.

- Responsible for building monitoring/managing tools to oversee the reliability and scalability of online inference servers

- Responsible for triaging system inefficiency and bottlenecks and improving system performance

- Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions

- Responsible for collaboration with product teams and providing general solutions to meet their requirements