Senior AI QA Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 weeks ago
5-10 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 25 Dec 2026

Posted: 3 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Senior AI QA Engineer role at Get Well Network in Bengaluru, Karnataka, India for people with 5–10 years of experience. You'll build frameworks to ensure clinical insights are accurate, safe, and reliable using Python, Go, R, SQL, NoSQL, and NLP. You'll also execute integration and regression tests for data-heavy backend processes.

  • Bengaluru
  • Work from office
  • 5–10 years

What you'll do

  • Architect Multi-Layered Validation Frameworks
  • Automated Model Grading
  • Data Pipeline Integrity

Good fit if you

  • Have 5–10 years of experience
  • Know Python, Go, R, SQL, NoSQL, and NLP
  • Understand QA and Compliance
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

Title: Senior AI QA Engineer

Location: Bengaluru (Bangalore)

Opportunity:

As a Senior AI QA Engineer for our Precision Patient Care Pipeline, you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies.

Key Responsibilities:

  • Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations.
  • Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics).
  • Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity.
  • Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation.
  • Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics.
  • Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior.

Requirements:

  • 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation.
  • Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems.
  • AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, and custom scoring algorithms). Familiarity with tools like LangSmith, Arize Phoenix, or MLflow.
  • Vibe Coding Mastery: Proficiency with AI-native development tools such as Cursor, Windsurf, Claude Code.
  • Modern Automation Stack: Proficiency with frameworks like PyTest, and experience with traditional tools (Cypress, Playwright, or Selenium) for end-to-end flows.
  • API & Data Testing: Solid understanding of API testing (Postman/RestAssured) and database validation (SQL/NoSQL).
  • Strategic Thinking: Experience serving as a Subject Matter Expert (SME) on test process development for large-scale systems.

Preferred (Good to Have):

  • Clinical Domain Knowledge: Familiarity with healthcare data standards such as FHIR, HL7, or SNOMED CT.
  • Healthcare Compliance: Understanding of HIPAA regulations and the nuances of handling ePHI/PHI.
  • Statistical Foundation: Understanding of sensitivity, specificity, and F1-scores in a clinical context.

Skills

PythonGoRSQLNoSQLNLPData EngineeringSeleniumCypressPlaywrightPyTestPostmanAPI TestingQACompliance

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

GW RhythmX is revolutionizing healthcare through connected, AI-native intelligence that unites clinical insight, patient engagement, and system-wide care orchestration. The company combines market-leading AI precision care technology with extensive trusted patient engagement leadership to help health systems deliver the right care, at the right time, through the right clinician and channel. Its solutions are deployed across more than 150 health systems, touching more than 85M patients including 8M U.S. military veterans. The company's award-winning solutions were recognized again in 2024 by KLAS Research, Fierce Healthcare, and AVIA Marketplace. A SymphonyAI Group company, GW RhythmX leverages various firm assets, including $1B+ in R&D investment, longitudinal data related to 300 million patients, 4.4 billion total annual claims, and 1.8 million healthcare professionals at more than 3,000 facilities globally.

GW RhythmX  is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age or veteran status.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.