Job Description
About The Role
We are looking for a Senior Automation QA Engineer to own end-to-end test automation across API and UI layers for our AI-native platform, including agent workflow validation.
Key Responsibilities
- Design and execute test strategies for API and UI layers using Pytest and Playwright (Angular).
- Own CI/CD quality gates in Azure DevOps, ensuring reliable build promotion and release readiness.
- Build and maintain coverage for agent workflow testing, including non-determinism, agent graph validation, and confidence score assertions.
- Develop reusable automation frameworks and data setup utilities backed by PostgreSQL.
- Contribute to LLM evaluation and observability workflows using Langfuse or similar tooling.
Looking to get Placed? Try our Placement Guarantee Plan
- 6+ years of experience in QA automation.
- Strong hands-on expertise with Pytest and Playwright, with proven depth in both API and UI automation.
- Solid proficiency in Python and experience working with PostgreSQL for test data and validation.
- Hands-on experience with Azure DevOps CI/CD pipelines and quality gates.
- Awareness of LLM/agent testing challenges (non-determinism, agent graph validation, confidence score assertions); exposure to Langfuse or LLM evaluation frameworks is a plus and can be built on the job.
Skills
PythonAiIf an employer asks you to pay any kind of fee, please notify us immediately. Jobaaj does not charge any fee from the applicants and we do not allow other companies also to do so.
About Company
As a leading cloud data analytics company based in Dallas, TX, USA, Anblicks is committed to bringing value to various industries using Cloud Data Analytics. Anblicks is a Cloud Data Analytics Company – Enabling Enterprises with Data-Driven Decision Making. Since 2004, Anblicks has been enabling customers across. Anblicks is a Cloud Data Analytics Company – Enabling Enterprises with Data-Driven Decision Making.
Important dates & deadlines?
Application Deadline
01 Aug 26, 04:19 PM IST
Similar Jobs
View All
Don't Miss out any Updates
Subscribe now for the latest job alerts
and never miss an update
Engineer III - App Engg & AI
Share with
