(part-time) Senior QA with GenAI experience (freelance)

Location: Remote (Poland preferred)
Start Day: ASAP

Engagement: Part-time (with potential to transition to full-time)

Language requirement: Polish – mandatory

Contract type: B2B only
Salary rate: up to 125PLN net+vat/h


Project Description

We are looking for a QA Engineer to join the client’s team working on Python-based web applications integrated with AI/ML components. This role combines traditional software testing with quality assurance for predictive models and data pipelines.

The ideal candidate has solid experience in testing web applications and is either familiar with or motivated to learn how to evaluate the quality and fairness of AI/ML systems.

This is a part-time opportunity with potential to evolve into a full-time role based on project needs and performance.

Responsibilities

Design and execute test scenarios for Python-based web applications

Assess AI model performance using metrics such as precision, recall, F1-score, bias, fairness, and explainability

Conduct robustness testing and validate data quality used for training models

Work with tools supporting AI/ML model testing (e.g. MLflow, TensorBoard, Great Expectations, Evidently AI)

Cooperate with data scientists and engineers to define QA standards for data-driven systems

Apply testing methodologies suited for predictive, model-based architectures

Requirements

Must-haves:

• Experience testing web applications (especially in Python environments)
• Fluency in Polish (for communication, documentation, and collaboration)
• Understanding of the difference between classical software QA and data/model-based testing

Nice-to-haves:

• Practical experience in testing AI/ML models or data validation processes
• Familiarity with model performance metrics (precision, recall, F1-score)
• Exposure to tools such as MLflow, TensorBoard, Great Expectations, Evidently AI
• Experience with fairness, bias, or explainability validation of AI systems

Benefits

In return, we offer:

• 100% remote, flexible work;
• work with an experienced team of developers and continuous development of your hard and soft skills;
• dev-friendly processes such as Continuous Integration, Continuous Delivery, Code Review and bug bashes;
• long-term collaboration on challenging products (FinTech, B2B software, E-commerce and more).
  

Looking for a full-time job? Check out our Career Page and find out more about our open recruitment processes.

If you need any disability-related adaptation at any step of the recruitment process – simply let the recruiter know! We'd be happy to help.