Machine Learning Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 6 hours ago
2-5 years
Bengaluru, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 15 Jan 2027

Posted: 6 hours ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Machine Learning Engineer role at convin in Bengaluru for people with 2–5 years of experience. You'll build conversational AI systems, fine-tune Python, PyTorch, NLP, and Hugging Face models, and deploy LLM, Docker, Kubernetes, Prometheus, and Grafana infrastructure.

  • Bengaluru
  • Work from office
  • 2–5 years

What you'll do

  • Fine tune and maintain custom SLMs
  • Own and improve LLM serving stack
  • Lead training of an in-house TTS model

Good fit if you

  • Have strong Python and PyTorch skills
  • Bring practical LLM fine tuning experience
  • Know how to deploy production models
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

Machine Learning Engineer: Speech & Language Models

Company: Convin.ai
Location: Bengaluru
Experience: 2-5 years

About the role

We're building conversational AI and voicebot systems that run in production at scale, across multiple Indian languages and code-mixed speech. We're looking for an ML Engineer who is comfortable across both speech and text, can own models from training through to serving, and enjoys exploring new model families and turning them into reliable production systems.

You'll work on small language models (SLMs) tailored to our tasks, the inference infrastructure that serves them, and a new initiative to explore and train our own text-to-speech (TTS) model.

What you'll do

Small language models
- Fine-tune, distill, and maintain custom SLMs for company-specific tasks such as call analysis, structured extraction, and agent reasoning.
- Build and curate training and evaluation datasets, including synthetic data generation and labeling pipelines.
- Run systematic evaluations against task-specific metrics and larger reference models, and iterate on quality, latency, and cost.
- Apply model optimization techniques such as quantization, knowledge distillation, and LoRA/QLoRA fine-tuning.

LLM serving infrastructure
- Own and improve our LLM serving stack built on NVIDIA Triton Inference Server, vLLM, SGLang, and NVIDIA Dynamo, including deployment, scaling, and capacity planning across GPUs.
- Tune inference for low-latency, high-concurrency voice workloads: batching, prefix/KV caching, quantized weights, and speculative decoding where useful.
- Maintain routing, health checks, and fallbacks across model backends, and build observability (metrics, dashboards, alerts) for production models.
- Debug production issues end to end, from GPU memory and throughput problems to tool-calling and output-format reliability.

Speech: ASR and TTS
- Work with ASR systems for multilingual and code-mixed audio, including evaluation, fine-tuning, and transcript quality improvements.
- Survey and benchmark open-source TTS models for naturalness, latency, streaming support, and language coverage.
- Lead the training of an in-house TTS model: data collection and cleaning, speaker and prosody considerations, training, evaluation (MOS, intelligibility, latency), and deployment for real-time voice agents.

What we're looking for

Must have
- Strong Python and PyTorch skills, with hands-on experience training or fine-tuning transformer models.
- Practical experience with LLM fine-tuning and evaluation (Hugging Face ecosystem, PEFT, or similar).
- Experience deploying models to production and reasoning about latency, throughput, and GPU cost.
- Hands-on experience with at least one of Triton Inference Server, vLLM, or SGLang in production.
- Comfort working with messy real-world data and building data pipelines around it.
- Ability to read papers, try new approaches quickly, and report results clearly.

Good to have
- Experience with speech models: ASR (Whisper-style, CTC/RNN-T) or TTS (VITS, FastSpeech, flow-matching or codec-based models).
- Experience with NVIDIA Dynamo or other distributed inference frameworks (disaggregated prefill/decode, KV-cache-aware routing).
- Experience with Indian languages or code-mixed text and speech.
- Knowledge of quantization formats (FP8, AWQ, GPTQ) and distributed training (FSDP, DeepSpeed).
- Experience with observability tooling (Prometheus, Grafana) and containerized deployments (Docker, Kubernetes).
- Open-source contributions or published work in NLP or speech.

Skills

PythonMachine LearningNLPPyTorchHugging FaceLLMDockerKubernetesPrometheusGrafana

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Convin is an AI-powered conversation intelligence platform that helps contact centers and sales teams analyze customer interactions, automate quality assurance, and improve agent performance.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.