Senior, Software Engineer - Backend

Position Summary...

Walmart's Enterprise Business Services (EBS) is a powerhouse of seven exceptional teams delivering world-class technology solutions and services making a profound impact at every level of Walmart. As a key part of Walmart Global Tech, our teams set the bar for operational excellence and leverage emerging technology to support millions of customers, associates, and stakeholders worldwide. Joining EBS means embarking on a journey of limitless growth, relentless innovation, and the chance to set new industry standards that shape the future of Walmart.

About the Team
The Enterprise People Technology team supports the successful deployment and adoption of new People technology across the enterprise. As a Fortune #1 company, our work impacts millions of associates globally. We strive to continuously improve people technology and products to help managers and associates focus on what matters most—supporting our customers and members. People Technology is a major segment of Walmart Global Tech’s Enterprise Business Services, invested in building robust technology solutions for Finance, People, and the Associate Digital Experience.

What you'll do...

• Design and implement platform features that enable advanced semantic routing for GenAI-powered services, ensuring requests are directed to the most appropriate models or agents based on context and intent.
• Develop and maintain evaluation pipelines for semantic router data, including metrics, dashboards, and automated tests to assess routing accuracy and system performance.
• Collaborate with researchers and data scientists to improve semantic routing algorithms and integrate advancements in natural language understanding.
• Contribute to agent-to-agent communication protocols to support orchestration and collaboration between multiple GenAI agents and services within the platform.
• Develop platform features using microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket)—all in Python.
• Uphold engineering and operational excellence standards, embracing automation and the DRY (Don’t Repeat Yourself) principle.
• Support operational excellence for semantic routing and agent communication systems, including monitoring, troubleshooting, and participating in on-call rotations for production support.
• Be an active member of a collaborative team, contributing to code reviews, design discussions, and problem-solving.

What You’ll Bring

Essential Skills

• Strong Python developer with a proven track record of writing production-quality code.
• Experience designing and building Python-based web services in a production setting (FastAPI experience preferred).
• Familiarity with version control using Git in team environments.
• Comfortable working with Linux environments and containerization technologies such as Docker.
• 2+ years of industry experience with demonstrated ownership and delivery of software products.

GenAI & Semantic Routing Skills (Preferred)

• Experience developing or deploying GenAI-based applications (e.g., large language models, generative AI frameworks).
• Experience with open-source and/or commercial GenAI libraries/frameworks such as Hugging Face Transformers, LangChain, OpenAI API, or similar.
• Ability to productionize and evaluate GenAI models.
• Familiarity with prompt engineering, vector databases (e.g., Pinecone, FAISS, Weaviate), and orchestration tools for GenAI workflows.
• Experience with semantic routing, including designing systems that direct user queries or tasks to the appropriate AI agents or models.
• Ability to analyze and improve semantic routing algorithms and evaluate their effectiveness using data-driven approaches.
• Awareness of responsible AI principles, including model evaluation and monitoring.

Supplemental Skills

• Experience developing large-scale data pipelines in e-commerce, recommender systems, or similar domains.
• Exposure to MLOps practices and tools (e.g., MLflow, Kubeflow, Airflow).
• Experience with observability and monitoring tools for production AI s