Senior QA Automation Engineer (with AI)

About us

Zenitech is a leading technology solutions provider dedicated to reshaping the global digital landscape. Headquartered in the UK, Zenitech operates internationally, with offices in Lithuania, Romania, and Hungary.

We use a bespoke approach depending on where the client is on their digital journey, comprising a combination of access to dedicated R&D labs, technology implementation advice, and specialist near-shore development talent. As an international community of individuals who are open to learning from each other, we collectively define and contribute to the digital future of our clients’ businesses.

About the role

Our client is a U.S.-based company specializing in healthcare navigation and care coordination. Founded in 1999 they offer services that assist employees of self-funded employers in managing the complexities of healthcare. Their model emphasizes early intervention in an employee's healthcare journey, aiming to improve outcomes and reduce costs for employers

What you will do

• Own testing strategy and testing solutions, design a multi-layer AI test pyramid. Creating living test standards, not static documents.

• Ensure regression testing for non-deterministic outputs

• Ensure variety of tests:

  • Unit tests (prompt + function)

  • Integration tests (agents, tools, APIs)

  • End-to-end conversational tests

  • Chaos / failure injection tests

• Define AI-specific performance standards

• Develop performance tests for:

  • Concurrent chat sessions

  • Agent orchestration

  • Long-running workflows

• While testing track:

  • Latency (p50 / p95 / p99)

  • Token usage & cost behavior

  • Throughput under load

  • Degraded performance modes

Requirements

• Solid experience in Python

• Proven experience in developing test automation frameworks (PyTest, Playwright, Cypress, or similar)

• CI/CD integration (GitHub Actions, GitLab CI, Jenkins)

• API testing (REST, GraphQL, async workflows)

• Infrastructure-aware testing (cloud services, queues, event-driven systems)

• Knowledge in AI driven software testing, such as: LLMs, chatbots

• AI specific software testing techniques: Prompt variability testing, hallucination detection strategies, bias and drift awareness, golden datasets and snapshot testing

What we offer

• Hybrid/flexible working model and flexible working hours

• Private Medical and/or Health Insurance (location dependent)

• Length of Service Awards

• Referral programme

• The option of a cafeteria package, meal tickets, or team lunches (location dependent)

• A culture of continuous growth, supported by our People Lead system and various training resources for your personal development

• Agile mindset, simplified processes, and a great atmosphere where commitment and autonomy are celebrated

• A community-first mindset, working with talented people across technology products and consulting

• Charity events and programs

Additional benefits based on location:

Hungary:

Extensive cafeteria package tailored to your needs (including SZÉP card)

Romania:

Bookster library subscription, and the opportunity to work from abroad (max. 60 days per annum)

(*) As we hire permanent employees for this role, we offer remote opportunities only in Romania and Hungary.

Why Zenitech?

• Impactful Projects: Drive meaningful change through digital transformation projects and have an opportunity to make an impact on many different industries.

• Collaborative Culture: Be part of a diverse, inclusive team committed to growth, innovation, and continuous learning.

• Professional Growth: Zenitech supports continuous learning and development through the People Lead system, helping you advance your skills and career.

Diversity and Inclusion

Zenitech celebrates diversity in all its forms. We aim to create an inclusive environment where everyone feels valued for their unique contributions and perspectives. If you require any adjustments during the application process, please let us know—we’re here to