Student Researcher (Seed - Multimodal Interaction and World Model - Pre-Training) - 2025 Fall/Winter (PhD)

Responsibilities

Our team's mission is to empower content understanding and creation using CV/NLP related technologies. We focus on cutting-edge R&D in areas like multi-modal understanding, vision and language, foundation models, audio/music understanding and generation with an emphasis on content creation. The team is a mix of experienced research scientists and research engineers, aiming to push the research boundaries in multi-modality and applying our research results to improve the experience of users.

We are looking for talented individuals to join us for a Student Researcher opportunity in 2025. Student Researcher opportunities at ByteDance aim to offer students industry exposure and hands-on experience. Turn your ambitions into reality as your inspiration brings infinite opportunities at ByteDance.

The Student Researcher position provides unique opportunities that go beyond the constraints of our standard internship program, allowing for flexibility in duration, time commitment, and location of work.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to TikTok and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities:
1. Drive research and development of models that enhance multimodal understanding and improve reasoning capabilities.
2. Design and implement novel model architectures that balance performance and computational efficiency.
3. Investigate scaling strategies and conduct systematic ablation studies to derive transferable insights.
4. Collaborate closely with senior researchers on cutting-edge projects, with the opportunity to publish findings at top-tier conferences.

Qualifications

Minimum Qualifications
- Currently pursuing a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
- Strong understanding of Transformer architectures, including Dense and Mixture-of-Experts (MoE), and familiarity with scaling models on GPUs or TPUs.
- Hands-on experience with PyTorch or JAX, along with distributed training frameworks.
- Familiarity with state-of-the-art techniques for preparing large-scale multimodal training datasets.
- Publications in top-tier venues, such as CVPR, ECCV, ICCV, NeurIPS, ICLR, ICML, EMNLP, ACL, COLING, etc.
- Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.

Preferred Qualifications:
- Highly competent in algorithms and programming; Strong coding skills in Python and popular deep learning frameworks.
- Work and collaborate well with team members.
- Self-motivated with a strong interest in multimodal learning, reasoning, and model scalability.
- Ability to work independently; Strong communication skills.

By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy.

Job Information

About Doubao (Seed)

Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements.​

With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision, Audio, AI Infra and AI Safety. Our team has labs and research positions across China, Singapore, and the US.​

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.​

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.​

Diversity & Inclusion​

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reac