Staff Software Engineer - Agentic AI Platform

Business Area:

Engineering

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

Our Data Services Pillar is the heart of data innovation. We don’t just work with technology; we build it. Our mission is to empower data practitioners by creating seamless, enterprise-grade experiences for data engineering, warehousing, streaming, operational databases, and AI.

Join Cloudera’s Machine Learning Platform team as a Staff Software Engineer. You will be a core technical leader responsible for designing, building, and delivering our next-generation AI and MLOps platform. You will design, build, and deliver an enterprise-grade platform enabling enterprises to create, deploy, and orchestrate agentic applications and multi-agent platforms using foundation models with enterprise data at scale in a hybrid cloud environment.

As a Staff-level engineer, you will drive technical architecture, advocate for engineering best practices, and collaborate closely with cross-functional teams (Product, Design, Frontend, and Field Engineering) to enhance developer velocity and platform agility.

Our Core Tech Stack:

• Backend: Python, gRPC, SQL

• Infrastructure: Kubernetes, Knative, Keda, Docker, Hybrid Cloud (AWS, GCP, Azure, OpenShift)

• GenAI & ML: LangChain, CrewAI, LlamaIndex, Closed and open source LLMs

• Data & Vector DBs: Quadrant, Pinecone or Milvus, Redis, Postgres

In this role you will..

• Architect and Build: Design, code, and implement elegant, scalable, enterprise-quality platform and application services / SDKs that support autonomous agents, multi-agent collaboration, and advanced tool-use capabilities.

• Implement Agentic Evaluation & Observability: Build automated evaluation pipelines and trajectory tracking to continuously bench, audit, and evaluate agent reasoning loops, tool-calling accuracy, and guardrail compliance.

• Architect Memory Management Systems: Develop and optimize robust stateful memory architectures for enterprise agents, handling short-term context window strategies, long-term semantic/episodic memory persistence, and secure cross-session state management.

• Enable RAG use cases: Implement AI application services powered by machine learning models, enabling scalable Retrieval-Augmented Generation (RAG) and semantic search.

• Lead by Example: Advocate for and establish engineering best practices, coding standards, and rigorous system design methodologies.

• Enhance Platform Velocity: Work to enhance developer velocity, framework abstraction, and team agility across the AI platform ecosystem.

• Collaborate Cross-Functionally: Build strong relationships and collaborate with platform and UI engineers, data scientists, quality engineers, UX designers, Product Management, Field Engineering, and external enterprise partners.

• Cross-Functional Collaboration: Build strong technical relationships with platform engineers, UI developers, UX designers, and Product Management to deliver cohesive user experiences.

• Mentorship: Act as a senior technical leader on the team, mentoring junior engineers and actively contributing to a culture of engineering excellence and craftsmanship.

What You Bring (Required Experience):

• Experience: 8+ years of software engineering experience building scalable backend microservices and distributed systems.

• Core Languages: Deep expertise in Python Go, Java, or C#/C++, along with gRPC and SQL.

• Cloud & Containerization: Extensive hands-on experience designing and developing microservices on Kub