QA Automation Engineer - AI Labs

• Role/ Job Title: Generative AI (GenAI) Senior QA Engineer
• Business: Data & Analytics
• Function/ Department:Data & Analytics

Job Purpose :

• 'Design and execute comprehensive test strategies and plans for GenAI applications, APIs, and RAG systems.
• Demonstrate strong reasoning and analytical skills in test planning, coverage analysis, and defect triaging.
• Perform functional, regression, integration, performance, and exploratory testing across AI workflows.
• Implement modular automation frameworks for scalability, maintainability and Reduce manual effort
• Validate model responses for accuracy, consistency, relevance, bias, and ethical compliance.
• Create and maintain detailed documentation, including test plans, test cases, test results, and QA reports.
• Collaborate with cross-functional teams to define test coverage, acceptance criteria, and performance benchmarks.
• Own the quality lifecycle from test planning to defect triaging and production validation.
• Continuously improve QA processes, tools, and automation frameworks.
• Stay updated with emerging QA tools, GenAI testing techniques, and industry best practices.

Roles & Responsibilities:

• 'Develop and maintain automated test suites for UI, API, and performance testing.
• Lead end-to-end testing of GenAI workflows.
• Implement modular automation frameworks for scalability, maintainability and Reduce manual effort
• Define and enforce QA standards, test coverage metrics, and release quality gates.
• Take complete ownership of new QA initiatives, from requirement analysis to production validation.
• Collaborate with developers and product teams to identify edge cases and failure scenarios.
• Conduct load, stresstesting for critical APIs and services.
• Mentor junior QA engineers and contribute to test strategy discussions.
• Drive defect triaging, RCA, and continuous improvement initiatives.

Secondary Responsibilities :

• Conduct exploratory testing and usability validation.
• Maintain test documentation, and release notes.
• Evaluate and onboard new testing tools and frameworks.
• Facilitate UAT, production smoke testing, and post-release validation to ensure high product reliability

Managerial & Leadership Responsibilities:

• Conduct exploratory testing and usability validation.
• Maintain test documentation, and release notes.
• Evaluate and onboard new testing tools and frameworks.
• Facilitate UAT, production smoke testing, and post-release validation to ensure high product reliability

Qualifications:

B.Tech/MCA

Years of Experience:

1+ Years of Experience preferred