Voice AI / Speech ML Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 4 months ago
3-5 years
Gurugram, Haryana
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 4 months ago
This job's closing date (7 Sep 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Job Overview

  • We are looking for a strong Voice AI / Speech ML Engineer who can work on fine-tuning and improving speech models for real-world users across different accents, dialects, noisy audio environments, and multilingual conversations.
  • This role is focused on making speech AI systems work beyond clean demo conditions. The engineer will work on speech-to-text, text-to-speech, language model layers where required, and audio data pipelines for low-resource or multi-dialect use cases.
  • The ideal candidate should have hands-on applied ML experience, strong exposure to speech models, and practical experience with messy audio data, model fine-tuning, evaluation, and production deployment.

Key Responsibilities

  • Fine-tune speech-to-text, text-to-speech, and related voice AI models for real-world accents, dialects, and noisy audio conditions.
  • Work on audio data sourcing, cleaning, labeling, augmentation, and preparation for model training.
  • Build and improve training pipelines for low-resource, multilingual, and multi-dialect speech use cases.
  • Evaluate model performance using practical metrics such as word error rate, naturalness, robustness to noise, and code-switching accuracy.
  • Test models on real-world audio instead of relying only on standard benchmarks.
  • Improve model performance based on production feedback and user audio samples.
  • Work with modern speech model architectures such as Whisper-family models, neural TTS, ASR/STT models, and speech-to-speech systems.
  • Optimize models for latency, accuracy, and real-time serving where required.
  • Collaborate closely with engineering and product teams to ship voice AI features quickly.
  • Own the model lifecycle from data preparation and training to evaluation and production improvement.

Ideal Candidate Profile

  • 3+ years of experience in applied ML, speech AI, voice AI, ASR/STT, TTS, or related ML engineering roles.
  • Hands-on experience fine-tuning and deploying ML models in production.
  • Strong experience with Python, PyTorch, and ML training workflows.
  • Experience working with ASR/STT, TTS, speech recognition, speaker/audio processing, or voice AI systems.
  • Practical experience with audio data collection, cleaning, labeling, augmentation, and preprocessing.
  • Strong understanding of model evaluation, especially for real-world speech performance.
  • Experience measuring WER, latency, robustness, and model quality across different audio conditions.
  • Comfortable working with noisy, imperfect, and low-resource datasets.
  • Ability to own technical work independently and ship fast.
  • Strong problem-solving ability and practical engineering mindset.

Good to Have

  • Experience with low-resource languages, multilingual speech, or multi-dialect speech systems.
  • Experience with Whisper, wav2vec, Conformer, DeepSpeech, FastSpeech, Tacotron, VITS, or similar speech architectures.
  • Experience with code-switching, accent adaptation, or dialect-specific model improvement.
  • Experience deploying speech models for real-time or near-real-time use cases.
  • Exposure to MLOps, model monitoring, inference optimization, or production ML pipelines.
  • Interest in voice AI, emerging markets, and real-world speech technology.

You Are a Good Fit If

  • You have fine-tuned speech or ML models and shipped them to production.
  • You understand that real-world audio data is messy and requires strong preprocessing.
  • You can evaluate models using practical business and product metrics, not only benchmark scores.
  • You are comfortable working independently with imperfect data.
  • You can improve model performance through data, training, evaluation, and production feedback loops.

You May Not Be a Fit If

  • You have only used speech APIs without training or fine-tuning models.
  • You have not worked with audio data pipelines or model evaluation.
  • You are looking for a research-only role without production responsibility.
  • You are not comfortable working with noisy, incomplete, or low-resource datasets.
  • You have not handled applied ML systems end to end.

Skills

PythonMl EngineerAiMl

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

UpTye is an AI-powered platform connecting skilled professionals with top companies. We help job seekers find the right opportunities and employers discover the best talent.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Gurugram.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.