Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Who we'd reach at Client of Weekday AIFound and reached by Power Apply
Best leadEngineering manager

Leads the team you would join

Tech lead

Leads the work day to day

Technical recruiter

Owns the opening

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a remote full-time QA engineering role in India for someone with at least four years of QA experience in AI or data science settings. The work covers testing GenAI, LLM, agentic AI and RAG systems with pytest, Python and API testing frameworks. The engineer would build automation for CI/CD pipelines and report on model output quality.

What you’ll do

  • Define and implement test plans for GenAI, LLM, agentic AI and RAG systems.
  • Design and maintain automated test suites with pytest and Python.
  • Develop and run API tests for model endpoints, data pipelines and microservices.
  • Run functional, regression and performance testing of AI services.
  • Integrate testing into CI/CD pipelines.
  • Analyse model output quality, bias and fairness, and document findings.
  • Create test harnesses for new model releases and maintain test data and mocks.
  • Report defects and validate fixes.
  • Mentor junior testers.

What they’re looking for

  • At least four years of QA engineering experience in AI or data science environments.
  • Strong pytest and Python skills.
  • API testing experience with tools such as Requests or RestAssured.
  • Hands-on experience testing GenAI, LLM, agentic AI and RAG.
  • Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
  • Understanding of AI ethics, bias mitigation and explainability.
  • Strong analytical skills and a detail-focused approach.
  • Ability to explain AI concepts as testable requirements.

What’s on offer

  • Remote working in India.
  • Salary range stated as Rs 1,000,000 to Rs 2,500,000 per year (INR 10-25 LPA).

Skills

Questions about this role

Is this role remote?

Yes, the role is remote within India.

What is the salary?

The posting states a salary range of Rs 1,000,000 to Rs 2,500,000 per year.

How many years of experience are needed?

At least four years of QA engineering experience in AI or data science is required.

Which tools should I know?

Strong knowledge of pytest, Python and API testing frameworks is required, along with CI/CD tools such as Jenkins or GitHub Actions.