(USA) Senior, Software Engineer (Machine Learning)

Position Summary...

As a Senior Machine Learning Engineer, you are a technical leader working at the intersection of machine learning and software engineering. You have expertise in both areas and are responsible for the full lifecycle of complex machine learning systems – from initial ideas and design to deployment, monitoring, and updates. This role requires strong technical skills, strategic planning, system design ability, and mentorship.

What you'll do...

As a Senior Software Engineer – Machine Learning, you are a technical leader working at the intersection of machine learning and software engineering. You have expertise in both areas and are responsible for the full lifecycle of complex machine learning systems – from initial ideas and design to deployment, monitoring, and updates. This role requires strong technical skills, strategic planning, system design ability, and mentorship.

Senior Engineers don't just implement existing plans; they define the technical approach and architecture for systems. You will be important in setting and promoting best practices, guiding technical direction in your area, and possibly contributing to the overall engineering strategy. While your specific focus might align with roles like a Tech Lead guiding a team, an Architect defining a critical technical area, or a Solver tackling high-risk problems, the core elements are technical leadership, system-level thinking, and broad impact. You will balance hands-on work with system design and technical guidance.

About Team: 
Our eCommerce Search team is an integral part of Walmart International, which encompasses over 5,200 retail units across 23 countries, including Canada, Central America, Chile, Mexico, and South Africa. We are dedicated to building a cutting-edge machine learning platform that addresses the diverse needs of customers, associates, and the business. Our mission is to enhance the shopping experience for millions of customers worldwide by leveraging advanced technologies and innovative solutions.

What you’ll do:

• Design and implement scalable model serving platforms for both batch and real-time
  inference

• Build model deployment pipelines with automated testing and validation

• Develop monitoring, logging, and alerting systems for ML services

• Create infrastructure for A/B testing and model experimentation

• Implement model versioning and rollback capabilities

• Design efficient scaling and load balancing strategies for ML workloads

• Collaborate with data scientists to optimize model serving performance
  
  
  

What you’ll bring:

• 7+ years of software engineering experience, with 3+ years in ML serving/infrastructure

• Strong expertise in container orchestration (Kubernetes) and cloud platforms

• Experience with model serving technologies (TensorFlow Serving, Triton, KServe)

• Deep knowledge of distributed systems and microservices architecture

• Proficiency in Python and experience with high-performance serving

• Strong background in monitoring and observability tools

• Experience with CI/CD pipelines and GitOps workflows
  
  
  

Nice to Have:

• Experience with model serving frameworks:

• • TorchServe for PyTorch models

  • TensorFlow Serving for TF models

  • Triton Inference Server for multi-framework support

  • BentoML for unified model serving

• Expertise in model runtime optimizations:

• • Model quantization (INT8, FP16)

  • Model pruning and compression

  • Kernel optimizations

  • Batching strategies

  • Hardware-specific optimizations (CPU/GPU)

• Experience with model inference workflows:

• • Pre/post-processing pipeline optimiza