Senior Software Engineer, AI Infrastructure - Developer Tooling
ByteDanceAbout the role
About the Team
We're building the AI-powered backbone of our developer tools. You'll work on three core systems: a retrieval infrastructure powering our AI products, a coding agent that assists users in writing code, and the evaluation frameworks that measure their effectiveness.
Responsibilities
Retrieval Systems (RAG Infrastructure)
- Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
- Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
- Develop query understanding and rewriting components to improve retrieval relevance
- Manage vector database infrastructure at production scale
Coding Agent Development
- Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
- Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
- Develop context management strategies for long-form code understanding
Evaluation & Benchmarking
- Design and maintain evaluation frameworks for retrieval quality and agent task completion
- Build custom benchmark suites for real-world coding task assessment
- Create reproducible testing infrastructure with automated regression detection
The base salary range for this position in the selected city is $202160 - $368220 annually.
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s