SDET - AI ML Validation Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 4 months ago
7-10 years
Bengaluru / Bangalore, Karnataka
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 4 months ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Experience Range: 7-10 years

Job Location: Bangalore with Hybrid

Primary Skill

AI Validation & Testing

Chatbot & RAG Testing

  • LLM/Prompt Evaluation
  • Python Validation
  • AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
  • RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
  • Agentic AI: Builds and tests agentic solutions such as MCP and prompting

Test Data & AI Evaluation

Data Quality

  • AI Eval Metrics
  • Responsible AI
  • Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
  • AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
  • Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation

Languages & Frameworks

Python

  • Pytest
  • Core Languages: Proficient in Python for automation
  • Test Frameworks: Hands-on with Pytest, or equivalent
  • Framework Design: Build, scale, and maintain automation frameworks end-to-end

Secondary Skill

UI & API Testing

UI Automation

  • REST/GraphQL APIs
  • Contract Testing
  • UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
  • API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
  • Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
  • Tools: Experience with tools like Postman/Insomnia/Newman

Cloud, Infrastructure & CI/CD

AWS

  • SQL
  • CI/CD Pipelines
  • Cloud Exposure: Working knowledge of AWS/Azure services for test environments
  • SQL Proficiency: Uses SQL to query, validate, and debug data confidently
  • CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.

Skills

PythonData ManagementAiSqlAi MlMl

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Defective software can result in lost clients and users, fallen business processes, revenue impacts, security breaches or regulation violation. These risks grow as organizations increase their dependency on software. To mitigate these risks, testing and QA have become an essential part of the success of every software project. Unfortunately most testing and QA miss the critical business context, and instead just focus on the obvious technical risks. This approach does not take into account the bigger picture and does not look at the interrelationship between software testing and business risks.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru / Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.