Manager_AI Platform & Agent Ops

Posted: 17 hours ago
2-5 years
Bangalore, India
work from office
Full Time
Closes 15 Jan 2027

Posted: 17 hours ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Role Overview

We are building a next-generation Enterprise AI Platform powering AI Agents, Multi-Agent Systems, AI Workflows, RAG Applications, Knowledge Systems, and Enterprise Integrations. We are looking for a highly capable Platform & AgentOps Engineer to lead the deployment, operations, scalability, security, and reliability of our AI platform across cloud and customer environments.

This is a hands-on engineering role for builders who enjoy owning production systems end-to-end. You will be responsible for designing deployment architectures, operating Kubernetes platforms, automating cloud infrastructure, establishing operational excellence, and ensuring that AI applications can be deployed, monitored, governed, and scaled reliably in enterprise environments.

Key Responsibilities

  • Own the deployment and operational architecture for AI Agents, Agent Servers, Workflow Engines, RAG Platforms, Model Gateways, and AI Runtime Services.
  • Design, build, and operate Kubernetes-based platforms supporting large-scale AI workloads.
  • Lead cloud infrastructure engineering, environment provisioning, deployment automation, release management, and platform reliability initiatives.
  • Establish CI/CD, GitOps, Infrastructure-as-Code, observability, security, disaster recovery, and operational standards across the platform.
  • Drive production readiness reviews, scalability planning, performance optimization, capacity management, and incident response processes.
  • Work closely with AI and Platform Engineering teams to ensure applications are cloud-native, secure, observable, and enterprise-ready.
  • Support customer deployments across cloud, hybrid-cloud, and enterprise-managed environments.

Mandatory Skills & Experience

Cloud & Platform Engineering

  • Strong hands-on Google Cloud Platform (GCP) experience is mandatory.
  • Deep expertise with services such as GKE, Cloud Run, BigQuery, Cloud Storage, Pub/Sub, IAM, VPC Networking, Cloud Monitoring, Secret Manager, Cloud Functions, and API Gateway.
  • Strong experience with Azure and/or AWS is highly desirable.
  • Experience designing and operating secure, scalable, multi-environment cloud architectures.

Kubernetes & Container Platforms

  • Deep production experience with Kubernetes (GKE preferred).
  • Strong expertise in Docker, Helm, Ingress Controllers, Autoscaling, Stateful Workloads, Service Discovery, Networking, Storage, and Secrets Management.
  • Experience operating multi-cluster and multi-environment Kubernetes deployments.
  • Strong troubleshooting capabilities across Kubernetes, networking, infrastructure, and application layers.

Infrastructure as Code & Deployment Automation

  • Strong Terraform expertise is mandatory.
  • Experience building reusable infrastructure modules and enterprise-scale Infrastructure-as-Code frameworks.
  • Hands-on experience with GitHub Actions, GitLab CI/CD, Azure DevOps, ArgoCD, FluxCD, and GitOps deployment models.
  • Experience implementing automated provisioning, release automation, environment management, and deployment governance.

AgentOps & AI Infrastructure

  • Experience deploying and operating AI applications in production.
  • Understanding of Agent Servers, AI Workflow Engines, Model Gateways, RAG Services, Vector Databases, AI Runtime Infrastructure, and LLM-based applications.
  • Experience supporting OpenAI, Azure OpenAI, Claude, Gemini, Ollama, vLLM, TGI, or similar AI serving environments.
  • Understanding of AI workload scaling, model routing, latency optimization, throughput planning, token consumption monitoring, and operational governance.

Observability, Reliability & Operations

  • Strong experience with OpenTelemetry, Prometheus, Grafana, ELK, Datadog, Cloud Monitoring, or Application Insights.
  • Deep understanding of monitoring, distributed tracing, logging, ing, SRE practices, reliability engineering, and operational excellence.
  • Experience leading incident management, root-cause analysis, disaster recovery planning, backup strategies, and production support.

Distributed Systems & Messaging

  • Strong experience with Redis, Redis Pub/Sub, Redis Streams, Kafka, RabbitMQ, Google Pub/Sub, Azure Service Bus, or AWS SQS/SNS.
  • Understanding of event-driven architectures, distributed systems, fault tolerance, high availability, and scalability patterns.

Security & Enterprise Deployments

  • Experience implementing RBAC, IAM, SSO, SAML, OIDC, Secret Management, Network Security, Compliance Controls, and Secure Software Delivery practices.
  • Experience deploying applications into enterprise, regulated, and customer-managed environments.

Highly Desirable

  • MCP (Model Context Protocol) infrastructure and integrations.
  • Self-hosted LLM platforms using vLLM, Ray Serve, Ollama, TGI, or Kubernetes-based inference infrastructure.
  • Vector databases such as Pinecone, Qdrant, Weaviate, Chroma, pgvector, and Vertex AI Search.
  • Service Mesh technologies including Istio and Linkerd.
  • Airflow, Temporal, Dagster, Prefect, or workflow orchestration platforms.
  • Platform Engineering, Internal Developer Platforms (IDP), Developer Experience tooling, and FinOps.

Skills

LLMRAGKafkaAirflowBigQueryRedisAWSAzureGoogle CloudGCPDockerKubernetesTerraformGitHub ActionsGitLab CI

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Tredence is a leading data science and analytics company driving business impact through cutting-edge insights and solutions. With a focus on innovation and collaboration, Tredence empowers organizations to harness the power of data to make informed decisions and achieve strategic goals. Our talented team of data scientists, analysts, and consultants deliver transformative outcomes across industries, driving growth and competitive advantage. Join Tredence to embark on a rewarding career where you can contribute to solving complex business challenges and shaping the future of analytics. Explore exciting career opportunities and unlock your potential with Tredence today.

Read More

Similar Jobs

View all
Loading...
Bag Logo
Jobaaj
Get jobs like this by email

New Others roles in Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.