AI ML Ops Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 1 month ago
2-5 years
Indore, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 24 Nov 2026

Posted: 1 month ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Designation: Senior Software Engineer – Analytics
Location: Indore
Educational Qualifications: B.E/B.Tech
Exp: 3-5 Years
Mode of work: Hybrid

Role Overview
We are seeking an AI/ML Ops Engineer to own the deployment, monitoring, and scaling of ML models and pipelines in production. You will build the infrastructure and automation that lets models move reliably from training to production and stay healthy once there.

Key Responsibilities
  • CI/CD for ML: Build and maintain automated pipelines for model training, testing, and deployment.
  • Infrastructure: Containerize and orchestrate model-serving infrastructure (Docker, Kubernetes) at scale.
  • Monitoring: Set up monitoring for model performance, data/concept drift, latency, and system health.
  • Versioning & Reproducibility: Manage model/experiment versioning and reproducibility (MLflow, DVC, or similar).
  • Cloud & GPU Management: Manage scalable, cost-efficient GPU/cloud infrastructure for training and inference workloads.
Technical Requirements
  • Strong hands-on experience with Docker and Kubernetes
  • CI/CD tooling (GitHub Actions, Jenkins, GitLab CI, or similar)
  • Experience with model-serving frameworks (Triton Inference Server, TorchServe, or similar)
  • Cloud platform experience (AWS/Azure/GCP), especially GPU infrastructure
  • Python for automation and tooling
  • Experience with experiment tracking and model registries (MLflow, DVC, Weights & Biases)
  • Monitoring/observability tooling (Prometheus, Grafana, or similar)
  • Production experience with Triton Inference Server: model repositories, ensembles, dynamic batching, instance groups
  • GPU operations on Kubernetes: NVIDIA GPU Operator, MIG/time-slicing, node pools, driver/CUDA version management
  • Hands-on with TensorRT / ONNX Runtime conversion and performance profiling (Nsight, perf_analyzer) gRPC and streaming service patterns; load testing tools (Locust, k6)
  • Strong Linux, networking and debugging fundamentals for bare-metal environments
Mandatory Skills
  • Docker, Kubernetes, CI/CD, Python, cloud infrastructure (AWS/Azure/GCP)
Good to Have
  • Experience deploying LLM/NLP inference services specifically (batching, quantization, low-latency serving)
  • Familiarity with vLLM, Ollama, or similar for local LLM hosting
  • Infrastructure-as-code experience (Terraform, Helm)
  • Experience with NVIDIA NVCF, NeMo or NIM deployments
  • Serving TTS/ASR models where time-to-first-byte matters
  • Log/trace stacks (Loki, OpenTelemetry, ELK) and on-call tooling

Skills

LinusGCPCICDKubernetesAzureMonitoring ToolsPythonDockerAWSPythonGRPCNLPLLMAzureKubernetes

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Tarento is a digital transformation company that helps businesses accelerate their digital journey through cutting-edge technologies, consulting, and product engineering.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Indore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.