Leads the team this role joins
In-house, owns the opening
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a full-time, worldwide remote role for a test engineer who validates the quality, reliability and safety of AI-powered systems on a healthcare payment integrity platform. The job combines test automation across APIs, UI, security and performance with SQL-based data validation and AI-assisted testing workflows. Candidates need to manage time-zone overlap with the team, since the posting lists no fixed region.
What you’ll do
- Build and maintain automated test suites covering API, UI, security and performance.
- Write end-to-end and integration tests with Playwright or similar frameworks.
- Test REST and GraphQL services for contracts, error handling and edge cases.
- Connect test suites to CI/CD pipelines for continuous validation.
- Use AI coding and testing tools to generate, refactor and scale tests.
- Run security checks such as authentication, authorization and common OWASP risks.
- Design and run load and performance tests, and help the engineering team fix bottlenecks.
- Validate data integrity across APIs and pipelines using SQL.
- Take part in sprint planning, release validation and root cause analysis.
What they’re looking for
- A bachelor's degree in a related field or equivalent experience.
- Experience in QA automation, test engineering or a related software role.
- Hands-on work with a modern test framework, Playwright preferred.
- Experience testing APIs, distributed systems and data pipelines.
- Strong SQL and data-validation skills.
- Experience with CI/CD pipelines and Agile teams.
- Experience with cloud systems, AWS preferred.
- Ability to analyze system behavior and identify root causes.
Nice to have
- Experience testing AI or ML models, or validating AI-generated outputs.
- Familiarity with LLMs, agent workflows or AI-assisted coding tools.
- Experience in healthcare or regulated data environments, including HIPAA.
- Experience with k6, JMeter or OWASP ZAP.
What’s on offer
- Competitive salary, health insurance and a 401(k) with employer match.
- Paid parental leave.
Skills
Questions about this role
Is this AI Test Engineer role remote?
Yes, the role is listed as remote and worldwide.
Is this a full-time position?
Yes, it is listed as full-time.
What benefits are offered?
The posting mentions health insurance, a 401(k) with employer match and paid parental leave.
Do I need a degree?
A bachelor's degree in computer science, engineering or a related field is listed, or equivalent experience.