Skip to main content
Join us

QA Engineer

Tunis, TunisiaPart-timeRemote friendly

QA Engineer

The Project

a local-first web application for AI-assisted End-to-End test automation. Users can record browser journeys using Playwright Codegen, describe what the test should verify, and use an LLM to generate complete executable Playwright + pytest test scripts.

The platform executes the generated tests, collects failure artifacts such as screenshots and Playwright traces, and uses a multimodal AI model to provide a functional verdict based on the final state of the application.

The platform also includes test self-healing, data-driven testing, retry and flaky-test detection, batch execution, reporting, dashboards, and CI/CD quality gates.

The Role

We are looking for a QA Engineer who will contribute to the consultation, QA strategy, functional design, and implementation of the testing strategy for the platform.

The role combines QA analysis, test scenario design, test automation, functional validation, API testing, and continuous quality improvement.

Responsibilities

1. QA Consultation & Test Strategy

  • Participate in defining the overall QA strategy for the platform.
  • Analyze new features and identify functional, negative, edge-case, and regression scenarios.
  • Define test cases, acceptance criteria, and quality requirements.
  • Contribute to the functional and technical design of the testing workflows.
  • Identify potential risks and failure points in the platform.
  • Define appropriate QA metrics such as pass rate, flaky tests, execution duration, and failure rate.

2. Test Automation

  • Design and maintain End-to-End automated tests using Playwright.
  • Use pytest for automated test execution.
  • Validate AI-generated Playwright test scripts.
  • Design robust assertions that verify the actual functional behavior of the application.
  • Test different Playwright locator strategies including roles, labels, placeholders, text, CSS selectors, and complex locators.
  • Validate screenshots, traces, and other test execution artifacts.

3. AI Testing & Validation

A major part of the role is testing the AI-powered components of the platform.

  • Evaluate the quality and reliability of AI-generated test scripts.
  • Test different generation and regeneration scenarios.
  • Validate the AI-powered self-healing mechanism.
  • Test the multimodal AI functional-verdict system.
  • Identify potential false positives and false negatives in AI analysis.
  • Verify that the AI verdict evaluates the actual functional objective rather than simply relying on the pytest status.
  • Contribute to improving prompts, validation rules, and AI testing workflows.

4. Functional & Regression Testing

  • Design and execute functional test campaigns.
  • Build automated regression test suites.
  • Test positive, negative, and unexpected scenarios.
  • Validate data-driven testing with multiple datasets.
  • Test retry mechanisms and flaky-test detection.
  • Validate individual and batch test execution.

5. API & Backend Testing

  • Test the platform's REST APIs.
  • Validate HTTP status codes, responses, and error handling.
  • Test CRUD operations for projects, test suites, and results.
  • Validate execution, generation, healing, refinement, reporting, and analysis endpoints.
  • Test asynchronous execution and polling mechanisms.
  • Validate SQLite persistence and legacy JSON migration.

6. CI/CD & Quality Gates

  • Design and maintain tests suitable for CI environments.
  • Validate the platform's CI quality gate.
  • Test both successful and failed CI scenarios.
  • Contribute to GitHub Actions integration.
  • Ensure that failing test suites correctly cause the CI quality gate to fail.

7. Reporting & Quality Monitoring

  • Validate the accuracy and consistency of dashboard metrics.
  • Test project and test-suite statistics.
  • Validate Markdown and PDF reports.
  • Verify consistency between pytest results, AI verdicts, and generated artifacts.
  • Document defects and track their resolution.

8. Security & Robustness Testing

  • Test user input validation and edge cases.
  • Identify potential security and robustness issues.
  • Validate artifact access and protection against path traversal vulnerabilities.
  • Verify that API keys and secrets are never hard-coded or exposed.
  • Test failure scenarios involving OpenRouter and backend unavailability.

Technical Environment

  • Playwright
  • Python
  • pytest
  • Flask / REST APIs
  • React
  • OpenRouter / LLMs
  • Multimodal AI
  • SQLite
  • Git & GitHub
  • GitHub Actions
  • CI/CD
  • End-to-End Testing
  • API Testing

The platform is built around Python 3.9+, Flask, SQLite, pytest, Playwright Python Sync API, OpenRouter, ReportLab, and React 18.

Requirements

  • Background in Computer Science, Software Engineering, QA, or a related field.
  • Good understanding of software testing methodologies.
  • Experience or strong interest in test automation.
  • Knowledge of Playwright, Selenium, or similar automation tools.
  • Good Python fundamentals.
  • Understanding of REST APIs and web applications.
  • Familiarity with Git/GitHub and CI/CD.
  • Interest in Generative AI, LLMs, and AI-powered software testing.
  • Strong analytical and problem-solving skills.
  • Attention to detail.
  • Ability to identify edge cases and think from a user's perspective.
  • Ability to work independently and contribute to technical decisions.

What You Will Build

You will not simply execute test cases.

You will contribute to the design of the QA strategy and testing architecture of an AI-powered test automation platform, from defining test scenarios and automation workflows to validating AI-generated tests, execution results, visual AI verdicts, and CI/CD quality gates.

The ultimate goal is to ensure that the platform determines not only whether a test script passes, but whether the functionality being tested actually works as intended.

Apply for this role