Senior Software Engineer - Enterprise Platform

ABOUT BASETEN

Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including IVP, Spark Capital, Greylock, and Conviction, we’re trusted by leading AI-driven innovators like Writer, Abridge, Bland, Patreon, Descript, Retool, and Zed to deliver industry-leading performance, security, and reliability for their mission-critical workloads. With our recent $75M Series C funding, we’re growing fast to make AI accessible across all products.

THE ROLE

As a Senior Enterprise Platform Engineer at Baseten, you'll architect and lead development of infrastructure and platform features for our enterprise customers and cloud partners. This includes enabling self-hosted and single tenant clusters, region-aware request routing, enterprise-grade data and security integrations, and more.

EXAMPLE INITIATIVES

You'll get to work on these types of projects as part of our Infrastructure team:

• Multi-cloud capacity management

• Inference on B200 GPUs

• Multi-node inference

• Fractional H100 GPUs for efficient model serving

RESPONSIBILITIES

• Architect and develop infrastructure and platform features tailored for enterprise customers, including self-hosted clusters, single-tenant environments, and cross-cloud workload orchestration.

• Lead technical initiatives to productize secure and scalable private connectivity solutions.

• Design and implement solutions addressing the complex regulatory and compliance requirements of our customers, including data residency, auditability, and enterprise data protection.

• Advance our self-hosted infrastructure offerings, focusing on capacity management, release management, and observability tooling.

• Collaborate on partner-focused initiatives to deliver secure, minimal Baseten deployments within partner environments.

• Evaluate and implement emerging virtualization technologies to enhance platform isolation and security.

• Independently develop technical specifications, collaborate cross-functionally to define product requirements, and drive projects from conception through execution.

• Provide mentorship and leadership on enterprise infrastructure best practices, fostering knowledge-sharing across engineering teams.

REQUIREMENTS

• Bachelor's degree or higher in Computer Science or related field

• 5+ years of experience building distributed systems, cloud infrastructure, or Kubernetes-based solutions in production environments

• Past experience working with enterprise security, compliance, and privacy requirements

• Advanced understanding of distributed systems concepts, cloud architectures, and performance optimization

• Demonstrated ability to independently manage technical projects, from planning and specification through implementation

• Excellent collaboration and communication skills, with experience coordinating across functional teams and directly with customers

• Preferred experienc