Intermediate Backend Engineer, AI Powered: Duo Workflow

GitLab is an open core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations. Our mission is to enable everyone to contribute to and co-create the software that powers our world. When everyone can contribute, consumers become contributors, significantly accelerating the rate of human progress. This mission is integral to our culture, influencing how we hire, build products, and lead our industry. We make this possible at GitLab by running our operations on our product and staying aligned with our values. Learn more about Life at GitLab.

An overview of this role

Are you confident that AI is going to change our daily work as developers? Do you want to play an active role in shaping that future? The Duo Workflow Group at Gitlab is creating the future of AI driven development at GitLab. At this moment we’re building an AI-Powered coding agent to speed up routine tasks, to improve your work, or to learn different approaches or technologies. At the same time we’re building the underlying platform to power AI driven workflows across GitLab.

As our new Backend Engineer, you’ll build out our core service written that hosts and coordinates our AI agents. You’ll be involved in making sure the service follows up-to-date best practices for Python web development and orchestrating the communication between different services via gRPC as well as contributing to the core AI functionality. As a Python engineer through and through you’ll spread your knowledge across a company where the main language is Ruby.

 Some examples of our projects: 

• Duo Workflow Architecture
• Componentizing Duo Workflow Graph

What You’ll Do  

• Write high-quality, efficient, and maintainable code while adhering to best practices and contributing to code reviews
• Build a highly scalable web platform based on Python and gRPC that can be deployed in different environments.
• Design and develop interactions with the latest LLMs.
• Contribute to a testing infrastructure that allows us to verify agentic AI behaviours.
• Embrace continuous learning and stay connected with industry best practices, tools, and technologies around AI to drive improvements in our software.
• Advocate for improvements to product quality, security, and performance
• Collaborate with more Senior Engineers on the architectural plans and technical designs ensuring scalability, performance, maintainability and measurability of our Duo Workflow platform.
• Participate in Tier 2 or Tier 3 weekday, weekend, and/or occasional night on-call rotations to assist troubleshooting product operations, security operations, and urgent engineering issues.

What You’ll Bring 

• A deep interest in the way AI will change the process of software development
• Multiple years of experience building Python Web Services in a multi-service environment ( e.g. FastAPI, Starlette)
• Familiar with deploying, monitoring and debugging Python applications in different setups.

• Experience with Relational Database Management Systems and SQL.
• Experience with LLM frameworks such as LangChain or directly interacting with LLM APIs
• Experience with the gRPC framework is a plus.
• Experience with languages that our other services use such as Go, Typescript, Ruby or IDE Extension development is a plus.
• A commitment to Diversity, Inclusion and Belonging (DIB at GitLab).
• A passion for creating products and features used by developers.
• An ability to self manage and organize in an asynchronous and collaborative work environment.
• Demonstrated capacity to clearly and concisely communicate about complex technical, architectural, and/or organizational problems and propose thorough iterative solutions.
• Familiarity with various stages of software development end-to-end