An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
About The Team
Youll work most closely with the fullstack engineering team and their leads, collaborating regularly with the cloud engineering team on API and backend testing, and with the ML team for feature validation. Cross-departmentally, youll work with Product Management on acceptance criteria and release readiness, and with Customer Support on field-reported issues.
About The Role
We are looking for a Senior QA Engineer to own the end-to-end test automation strategy for Gather AIs fullstack platform. You will build and maintain Playwright-based E2E test suites, design API automation coverage, integrate tests into CI/CD pipelines, and develop a structured evaluation framework for LLM-powered features.
This is a greenfield opportunity to shape QA practices and tooling from the ground up at a production AI/robotics company — not a ticket-closing QA factory. Your work directly affects product quality for real customers.
What Youll Do
- Build and maintain Playwright-based E2E test automation suites covering critical user workflows, API validation, and edge case handling across web applications
- Design and implement a comprehensive API automation framework for backend services, including REST endpoint coverage and data validation
- Integrate automated test suites into CI/CD pipelines (GitHub Actions) with reporting, failure alerting, and quality gates
- Develop a structured LLM tool evaluation framework — defining test methodologies, evaluation criteria, and repeatable benchmarks for AI/ML-powered features
- Identify and address gaps in test coverage, flaky tests, and QA technical debt; drive adoption of quality metrics (test coverage, defect escape rate, automation coverage)
- Collaborate with engineering leads, Product, and Customer Support to define release readiness criteria and prioritize regression coverage
- 5–8+ years of QA/test engineering experience with a strong focus on automation
- Hands-on Playwright experience building and maintaining E2E test suites (TypeScript/JavaScript)
- API test automation expertise using tools such as Playwright API testing, Postman/Newman, or pytest
- CI/CD integration experience (GitHub Actions, Jenkins, or similar) with test pipeline design and reporting
- BS in Computer Science, Engineering, or a related field; solid functional testing fundamentals and strong analytical thinking
- Experience or aptitude for LLM/AI tool evaluation (prompt testing, output quality assessment, hallucination detection)
- Performance or load testing experience (k6, Locust, JMeter, or similar)
- Experience with database testing and data validation (SQL, data pipeline verification)
- Familiarity with Docker or containerized test environments
Skills
JavascriptLoad TestingRoboticsTestingApiCloudSqlQa EngineerIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New IT / Software Development & Related roles in India.
One email a day. Unsubscribe any time.

