Senior Software Quality Engineer - Generative AI

Job Summary

Do you want to work in a team where learning new things is a daily routine? Do you want to be part of the AI movement that is shaping the IT industry? Become a quality leader in a team that will play a critical role in infusing Red Hat products with generative AI. We have developed a platform that other teams at Red Hat use to quickly and easily develop virtual assistants for Red Hat products and we seek a quality engineer who will help us expand our capabilities. Be prepared to work in a highly distributed environment which is largely unshaped and very fast paced, adding a bit of startup freshness and agility to our corporate stability.

In this role, you will  be responsible for all aspects of quality for the Lightspeed Core including designing test plans, extending automation frameworks, and developing new automated tests. You will make sure our platform fulfills the highest possible enterprise standards for quality, performance, usability, and supportability. You will gain a deep technical understanding of a variety of popular technologies, including containers, Red Hat OpenShift AI, Langchain, vector databases, RAG and others. You will also have an opportunity to contribute to a broader ecosystem which will give Red Hat customers and the open source community the ability to be self-sufficient in deploying and operating virtual assistants for Red Hat products. In collaboration with the team’s manager and lead engineer, you will become the face of the team and have the opportunity to influence and coordinate the quality standards with partnering teams. This is a very high profile project and the position is critical to the project's future success. It includes a lot of flexibility and therefore requires a highly motivated and self-driven person.

At Red Hat, our commitment to open source innovation extends beyond our products - it’s embedded in how we work and grow. Red Hatters embrace change – especially in our fast-moving technological landscape – and have a strong growth mindset. That's why we encourage our teams to proactively, thoughtfully, and ethically use AI to simplify their workflows, cut complexity, and boost efficiency. This empowers our associates to focus on higher-impact work, creating smart, more innovative solutions that solve our customers' most pressing challenges.

What you will do

• Work in a fast-paced agile globally distributed environment of talented engineers

• Execute manual and automated tests for the Lightspeed Core project and deliver clear status in a timely manner

• Conduct failure analysis, explore, identify and document new bugs, advocate for the resolution of  bugs and communicate the impact on customers to developers and support

• Coordinate bug verification, regression testing as well as project delivery related testing with partnering teams

• Design, develop and maintain automation frameworks, CI and scripts supporting Lightspeed Core testing

• Participate in the test planning and product planning processes

• Conduct new feature research and design test cases

• Constantly learn new things and maintain an overview of current technologies

• Provide mentoring and leadership to other team members

• Exercise influence and customer centricity to motivate product teams to adopt the common platform rather than to build their own code from scratch

What you will bring

• Bachelor's degree or higher, or equivalent in computer science or a related field

• 5+ years of professional experience working in QE or similar roles

• Familiarity with testing methodologies and techniques

• Experience with generative AI, at minimum as advanced user level

• Understanding the elementary concepts of generative AI like prompt tuning, prompt engineering, RAG, tokenization, chunking

• Programming skills in shell, Ruby, Golang, Python or another programming language

• Demonstrated ability to quickly learn new technologies with minimal guidance; willingness to learn and work with new technologies

• Excellent written and verbal communication skills and ability to work with distributed teams

The following are considered a plus

• Experience with CI/CD and technologies like Prow, Tekton or ArgoCD

• Experience testing multi-agent architecture or Langchain-based code

• Contributions to open source projects or publicly available code samples

• Experience designing, developing and maintaining automation frameworks and scripts with Ruby, Golang and Python for OpenShift testing and implementation

#LI-JS1

#AI-HIRING

The salary range for this position is $124,