Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs
Job Description
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
Skills
PythonData ManagementAiSqlAi/mlAi/ml EngineerMl EngineerMlIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Defective software can result in lost clients and users, fallen business processes, revenue impacts, security breaches or regulation violation. These risks grow as organizations increase their dependency on software. To mitigate these risks, testing and QA have become an essential part of the success of every software project. Unfortunately most testing and QA miss the critical business context, and instead just focus on the obvious technical risks. This approach does not take into account the bigger picture and does not look at the interrelationship between software testing and business risks.
Important dates & deadlines?
Application Deadline
03 Oct 26, 06:14 PM IST
Similar Jobs
View All




