Machine Learning Engineer (Agent Intelligence & Evaluation)

Department Icon Data Science Analytics & Machine Learning
Posted: 2 months ago
0-1 years
Delhi, Delhi
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 2 months ago
This job's closing date (21 Oct 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Voice agents fail in ways traditional software doesnt. An ASR confidence drop on a regional accent misfires a tool call, an LLM hallucinates a policy because upstream latency broke turn-taking, and support teams roll these agents back within a week without anyone able to explain what went wrong.

What youll work on

Evaluation frameworks. Text-only evals miss most of what matters in voice: barge-in, prosody, latency-induced errors, cross-turn context loss. Youll design audio-native metrics, generate adversarial conversational datasets across accents and edge cases, and build LLM-as-judge rubrics for task completion, empathy, and recovery from tool failures.

End-to-end observability. Tracing a failed interaction means correlating audio packets, STT hypotheses, LLM reasoning traces, tool calls, and TTS output back to a single conversation ID. Youll help shape the schema and analysis layer that makes cascade failures visible across the stack.

Self-improvement systems. Once you can measure and trace, the interesting work is closing the loop: mining production traces for failure patterns, generating targeted fine-tuning data or prompt updates, and validating that fixes hold under adversarial replay.

Who were looking for

Someone who cares about the research questions for their own sake, and equally cares whether the work ships. Papers at Interspeech, ACL, NeurIPS, or EMNLP on speech, dialogue systems, agent evaluation, or human-AI interaction are directly relevant.

Comfortable in Python, and familiar with at least one of: speech models (Whisper, Conformer variants), LLM tool-use and agent frameworks, or observability stacks (OpenTelemetry, Langfuse, Arize, Hamming).

Current PhD students in ML, NLP, or speech are the strong default; exceptional MS students or research engineers with a publication track record are welcome to apply.

Nice to have

Prior work on evaluation methodology, dataset synthesis, or interpretability. Experience with real-time systems, telephony, or streaming pipelines. A blog, repo, or workshop paper that shows how you think in public.

Skills

PythonAiMlMachine Learning

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Ixigo, a leading travel platform in India, revolutionizes travel experiences through innovative technology solutions. Empowering travelers with comprehensive information and convenient booking options, Ixigo simplifies the journey planning process. Ixigo Careers present exciting opportunities for passionate individuals eager to shape the future of travel tech. Whether in software development, marketing, or customer service, joining Ixigo means becoming part of a dynamic team committed to excellence and customer satisfaction. Embracing a culture of creativity and collaboration, Ixigo offers a platform for professional growth and personal development. Explore Ixigo Careers to embark on a rewarding journey of innovation and impact in the travel industry.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Delhi.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.