Senior Cloud Engineer – AI Platform (LLM) (f/m/x)

At idealo, we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production.

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

About your new role 

• Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation) for reproducible environments. 

• Provide platform primitives: model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas. 

• Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs. 

• Define and monitor SLOs and implement latency/cost controls (caching, batching, routing). 

• Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks. 

• Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD. 

• Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response). 

Skills & Requirements 

• 5+ years of experience in cloud/platform engineering running production systems at scale. 

• Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure. 

• Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD, networking, security, and observability. 

• Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).  

• Knowledge of TypeScript (Node.js) and Python (tooling, pipelines). 

• Comfortable with containerization, automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar). 

• Mindset: evaluation-aware, data-driven, cost- & latency-conscious, up-to-date with fast-moving AI tech. 

• Nice to have: exposure to prompt/agent frameworks and e-commerce systems. 

Requirements

At idealo you can expect

• You need vacation? We offer you 30 days of vacation. Not enough? You can "buy" an additional 15 days every year by converting your salary and it's seen as a positive thing.

• You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.

• And what about the office? Our office in the heart of Berlin offers exc