Software Engineer II, AI Box
BoxAbout the role
WHAT IS BOX?
Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for leading global organizations, including AstraZeneca, JLL, Morgan Stanley, and Nationwide. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia.
By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It’s the billions of files and information flowing across teams, departments, and key business processes every single day: contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift.
WHY BOX NEEDS YOU
Artificial intelligence has been rapidly advancing in recent years, particularly in the area of generative AI. With the help of new large language models and massive amounts of data, AI systems are now able to understand and generate content on an unprecedented scale. is a brand new capability that was recently announced by Box to harness the power of these advanced AI models in the Box Content Cloud. Box AI will make it easier than ever to uncover and share insights, find timely answers to critical questions, and effortlessly create content based on an organization’s data in Box. Box AI is also the fundamental instrument for Intelligent Content Management. This involves intelligent metadata extraction, workflow automation, agentic workflows and more.
As an ML Infra engineer on the AI Platform team, you will play a pivotal role in developing core capabilities that drive Box AI. This presents a unique opportunity to work at the forefront of machine learning and generative AI technologies while making a significant impact on how billions of enterprise users accomplish their work.
WHAT YOU'LL DO
- Build out core components of the AI Platform to power new Box AI capabilities such as Audio and Video AI.
- Implement and maintain pipelines for Retrieval Augmented Generation (RAG) and Vector Search.
- Work closely with ML engineers to implement multi-agent systems using LLMs to perform tasks autonomously.
- Optimize systems to improve scalability and availability of the platform.
WHO YOU ARE
- You are passionate about building infrastructure that powers machine learning systems.
- You like to be an owner and strive to do work you're proud of, both technically and in your team interactions.
- Able to inspire other people to work with you, and you enjoy mentoring and coaching, as well as learning from other engineers.
- You've built, deployed, and supported ML/AI systems at scale.
- You have strong analytical and problem-solving skills, with the ability to work with large and complex distributed systems.
Required skills
- Rough data-driven solutions
- Ownership mindset with focus on delivering high-quality work both technically & collaboratively
- Proficiency with at least one object oriented language like Python, C, C++, Java, Scala
- Bachelors degree in Computer Science, Statistics, Mathematics, Physics, or a related field
- Strong understanding of statistical modeling, data structures, and algorithms
Preferred skills
- Familiarity with distributed system concepts and understanding of large scale systems
- Familiarity with natural language processing, query understanding, and large language models
- Familiarity with Large Language Models, RAG, Agentic Frameworks like LangChain
LEARN MORE ABOUT BOX AI
Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s