Member of Technical Staff, Large Generative Models

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the role:

Captions is seeking an exceptional Research Engineer (MOTS) to advance the state-of-the-art in large-scale multimodal video diffusion models. You'll conduct novel research on generative modeling architectures, develop new training techniques, and scale models to billions of parameters. As a key member of our ML Research team, you'll work at the cutting edge of multimodal generation while building systems that enable natural, controllable video creation. We're already training large-scale models with demonstrated product impact, and we're excited to continue expanding the scope and capabilities of our research.

We're especially excited about pushing the boundaries of audio-video generation, with a focus on realistic and charismatic human behavior that enables natural storytelling and creative iteration. Our models power creative tools used by millions of creators, and we're tackling fundamental challenges in how to generate compelling human motion, expression, and speech. 

Key Responsibilities:

Research & Architecture Development:

• Design and implement novel architectures for large-scale video and multimodal diffusion models

• Develop new approaches to multimodal fusion, temporal modeling, and video control

• Research temporal video editing techniques and controllable generation

• Research and validate scaling laws for video generation models

• Create new loss functions and training objectives for improved generation quality

• Drive rapid experimentation with model architectures and training strategies

• Validate research directly through product deployment and user feedback

Model Training & Optimization:

• Train and optimize models at massive s