Senior Software QA Engineer (AI Model Testing)

Department Icon IT / Software Development & Related
Posted: 6 months ago
4-6 years
Bengaluru / Bangalore, Karnataka
IT / Software Development & Related
work from office
Full Time

Posted: 6 months ago

This job is no longer accepting applications

It closed on 24 Jun 2026. Here are 6 live jobs like it - apply in one step.

See all live IT / Software Development & Related jobs
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Autonomize AI is building the intelligence layer for healthcare. Our Genesis platform replaces brittle, manual knowledge workflows with AI agents that reason, retrieve, and act - reducing administrative burden so clinicians can focus on patients.

Were looking for engineers who dont just integrate AI into software - they think in agents, design for inference, and treat LLMs as first-class infrastructure.

What This Role Is

Youll architect and ship across the full Genesis stack: agentic pipelines, backend APIs, data infrastructure, and clinical-facing UI. Youll work directly with founders and customers. Youll own things end-to-end.

This is not a role where you bolt AI onto existing CRUD. Youll be making foundational decisions about how intelligent systems are designed, evaluated, and operated at scale in a regulated industry.

Youll Thrive Here If

AI-native engineering is your default mode

  • Youve built production systems where LLMs are doing real work - not demos, not PoCs
  • Youve designed and shipped RAG pipelines, multi-agent workflows, or tool-using agents in production
  • You understand prompt engineering as an engineering discipline: versioning, evaluation, regression testing
  • Youve instrumented AI systems for observability - latency, token usage, hallucination rate, drift
  • You can reason about model tradeoffs (context length, cost, latency, accuracy) and make architectural calls accordingly
  • Youve worked with LLM SDKs (OpenAI, Anthropic, Bedrock, etc.) and agentic orchestration frameworks (LangChain, LlamaIndex, CrewAI, or similar)

You build robust backend systems

  • 4+ years building production web applications from scratch
  • Deep Python proficiency; comfortable with FastAPI, Django, or Flask in production
  • Experience designing APIs that serve both humans and AI agents (tool schemas, structured outputs, streaming)
  • Async-first thinking: asyncio, task queues, event-driven architectures
  • Kafka, Redis, or ActiveMQ for real-time data movement
  • Postgres, Elasticsearch, MongoDB, or graph databases (Neo4j, TigerGraph) in production

You operate at cloud scale

  • Docker and Kubernetes in production - this is a hard requirement
  • At least one public cloud (AWS, Azure, GCP) with real operational experience
  • Microservices and cloud-native design patterns
  • Youve been on-call. You know what a bad deploy feels like at 2am.

You can ship a frontend when the product demands it

  • React, TypeScript, or modern JS frameworks
  • Enough frontend fluency to build clinical interfaces without a dedicated frontend handoff

Bonus: Youve Done This Before

  • Led a small engineering team - mentored, reviewed, unblocked
  • CKAD or equivalent Kubernetes certification
  • ML/DL model deployment experience (PyTorch, scikit-learn)
  • Built evaluation harnesses or used MLflow, LangSmith, or similar for AI observability
  • Healthcare domain experience (FHIR, HL7, clinical workflows)

What We Value Above Credentials

  • Bias toward action - you ship, then iterate. You learn by doing, not by planning.
  • Owner mentality - you dont wait for permission. You identify what needs to exist and build it.
  • Intellectual honesty - youd rather say I dont know, let me find out. When unsure, seek the right information from your peers or leaders.
  • Async-first communication - you write clearly, document decisions, and work well across time zones.

What Youll Get

  • VC-backed healthcare AI company growing fast
  • Full-stack ownership - no handoffs, no silos, no thats not my team
  • Direct access to founders and customers - your technical decisions will be seen and felt
  • Professional development budget - conferences, courses, certifications, books
  • Flexible -friendly culture built around output, not hours

If youve been waiting for a role where AI isnt a feature - its the foundation - this is it.

Skills

PythonPrompt EngineeringDjangoFlaskAiMl

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Autonomize AI is on a mission to help organizations make sense of the worlds data. We help organizations harness the full potential of data to unlock business outcomes. Unstructured dark data contains nuggets of information that when paired with human context will unlock some of the most impactful insights for most organizations, and its our goal to make that process effortless and accessible.

We are an ambitious team committed to human-machine collaboration. Our founders are serial entrepreneurs passionate about data and AI and have started and scaled several companies to successful exits. We are a global, remote company with expertise in building amazing data products, captivating human experiences, disrupting industries, being ridiculously funny, and of course scaling AI.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New IT / Software Development & Related roles in Bengaluru / Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.