Research Intern – 3D/4D Generation and Perception Foundation Model Research – Sony AI

Sony Corporation of America, located in New York, NY, is the U.S. headquarters of Sony Group Corporation, based in Tokyo, Japan. Sony's principal U.S. businesses include Sony Electronics Inc., Sony Interactive Entertainment LLC, Sony Music Entertainment, Sony Music Publishing and Sony Pictures Entertainment Inc. With some 900 million Sony devices in hands and homes worldwide today, a vast array of Sony movies, television shows and music, and the PlayStation Network, Sony creates and delivers more entertainment experiences to more people than anyone else on earth. To learn more: www.sony.com/en.
 

Position Summary

Sony AI is looking for research interns to join our 3D/4D Foundation Model team. Our team emphasizes both fundamental and applied research, aiming to develop 3D/4D generation and perception model. As a research intern, you will engage in cutting-edge research, create methodologies, design, and prototype solutions. You will collaborate with a dedicated team of scientists and engineers to address complex challenges in 3D/4D foundation models and generative AI, such as object asset generation, scene generation, character generation, and video generation. Additionally, you may have the opportunity to collaborate with Sony's entertainment divisions in gaming, movies, music, and anime.

Roles and Responsibilities

• Conduct fundamental and innovative research in 3D/4D generation and perception models, including but not limited to architecture design and methodology design.

• Be self-motivated and capable of proposing and implementing innovative ideas.

• Deep understanding of 3D/4D foundation model development and various applications, such as object asset generation, scene generation, character generation, and video generation.

• Write reports and give presentations to internal and external audiences.

• Contribute to library and tool development to support research and business.

• Publish influential research outcomes in top-tier conferences and journals.

Technical Topics of Interest

• Multi-View Diffusion

• Feedforward/Large Reconstruction Models

• 3D-aware/Controllable Video Generative Models

• Multimodal Generation: joint/conditional generation with sound, music, etc.

• Diffusion Transformers (DiT)

• Gaussian Splatting and other 3D Representations and Rendering Techniques

• LLMs for 3D/4D

• High-Performance Computing (HPC) and software skills for large-scale training

Required Qualifications and Skills

• Currently has, or is in the process of obtaining, a master's/PhD degree in computer science or a related field.

• Publications or expertise in computer vision and generative AI applications (e.g., object asset generation, scene generation, character generation, video generation), multi-view diffusion, large reconstruction models, diffusion transformers, large-scale training, etc.

• Ability to communicate research in a clear and precise manner.

• Excellent analytical and programming skills in large-scale deep learning.

• Familiar with Python, PyTorch, etc.

• Experience with research communities, including having published papers at conferences, e.g., CVPR, ICCV, ECCV, SIGGRAPH, NeurIPS, ICLR, ICML, etc.

• Strong communication and presentation skills.

The target hourly rate for this internship is $50.00 per hour.  The individual will be paid hourly and eligible for overtime.   

#LI-AS1

Sony is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religious creed, sex (including pregnancy), gender, national origin, citizenship, ancestry, age, physical or mental disability, military status, status as a veteran or disabled veteran, sexual orientation, gender identity or expression, marital or family status, genetic information, medical condition, or any other basis protected by applicable federal, state, or local law, ordinance, or regulation.

Disability Accommodation for Applicants to Sony Corporation of America

Sony Corporation of America provides reasonable a