Tech Lead, AI Compute Infrastructure

<div class="content-intro"><h2><strong>About HeyGen</strong></h2> <p>At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade, visual content has become the preferred method of information creation, consumption, and retention. But the ability to create such content, in particular videos, continues to be costly and challenging to scale. Our ambition is to build technology that equips more people with the power to reach, captivate, and inspire audiences.<br>Learn more at&nbsp;<a href="https://www.heygen.com">www.heygen.com</a>.&nbsp; Visit our Mission and Culture doc <a href="https://docs.google.com/document/d/1JQ6k6Ce8VRE60zO09Uc94JVaxRWA2xC1-IbIFAAHPvs/edit?usp=sharing">here</a>.&nbsp;</p></div><p>We are seeking a seasoned<strong> Technical Leader</strong> to build and scale the foundational compute infrastructure that powers our state-of-the-art AI models—from multimodal training data pipelines to high-throughput, low-latency video generation.</p> <h3>Responsibilities</h3> <p>You will be the core engineer responsible for building the robust, efficient, and scalable platform that enables our research and production teams to rapidly iterate on HeyGen's generative video models. Your contributions will directly impact model performance, developer productivity, and the final quality of every AI-generated video.</p> <ul> <li> <p><strong>Optimize GPU Utilization:</strong> Design and implement mechanisms to aggressively <strong>optimize GPU and cluster utilization</strong> across thousands of devices for inference, training, data processing and large-scale deployment of our <strong>state-of-art video generation models</strong>.</p> </li> <li> <p><strong>Develop Large-Scale AI Job Framework:</strong> Build highly scalable, reliable frameworks for launching and managing massive, heterogeneous compute jobs, including multi-modal high-volume data ingestion/processing, distributed model training, and continuous evaluation/benchmarking.</p> </li> <li> <p><strong>Enhance Observability:</strong> Develop world-class <strong>observability, tracing, and visualization tools</strong> for our compute cluster to ensure reliability, diagnose performance bottlenecks (e.g., memory, bandwidth, communication).</p> </li> <li> <p><strong>Accelerate Pipelines:</strong> Collaborate closely with AI researchers and AI engineers to integrate innovative acceleration techniques (e.g., custom CUDA kernels, distributed training libraries) into production-ready, scalable training and inference pipelines.</p> </li> <li> <p><strong>Infrastructure Management:</strong> Champion