Onshore AI Platform Architect

Position Title: Onshore AI Platform Architect

Location: Milpitas, CA (Onsite)

Employment: Full time
Experience: 12+ Yrs total/ 7+ Yrs Cloud, 5+ Yrs AI Platform

ROLE OVERVIEW:

We are seeking an Onshore AI Platform Architect to own the design, build, modernization, and governance of enterprise AI platform infrastructure across Azure and Google Cloud. The role establishes the scalable, secure, and cost-efficient platform layer—GPU compute, Kubernetes, MLOps/LLMOps, and Generative AI services—that enables data science, AI engineering, and business teams to build, deploy, and operate AI and GenAI solutions at scale.

KEY RESPONSIBILITIES:

black small squareDefine enterprise AI platform strategy, reference architectures, AI landing zones, and platform blueprints across Azure and Google Cloud Platform.

black small squareArchitect AI infrastructure: GPU clusters, Kubernetes (AKS/GKE), model training & inference platforms, vector databases, and feature stores.

black small squareDesign and operate Azure AI Foundry, Azure OpenAI, Azure ML, Google Vertex AI, and Gemini-based GenAI services.

black small squareEstablish enterprise MLOps and LLMOps frameworks—CI/CD pipelines, automated model training, deployment, evaluation, and rollback.

black small squareBuild GenAI patterns for RAG, agentic AI, and secure integration of enterprise data with LLMs (OpenAI, Vertex, Gemini, open-source models).

black small squareImplement AI security and governance: identity (Entra ID / Google IAM), RBAC, private networking, Key Vault / Secret Manager, and Responsible AI controls.

black small squareAutomate platform provisioning via Terraform, Bicep, and GitOps; drive cost optimization and policy-driven governance.

black small squareDesign AI observability—model performance, drift, GPU utilization, and prompt/response monitoring using Azure Monitor and Cloud Operations.

black small squareAdvise executives and technical teams; lead architecture workshops, roadmaps, and mentor platform engineers.

REQUIRED TECHNICAL SKILLS:

AI Platforms & Cloud

black small squareAzure AI Foundry, Azure OpenAI, Azure ML

black small squareGoogle Vertex AI, Model Garden, Gemini

black small squareMicrosoft Azure + Google Cloud (multi-cloud)

MLOps / LLMOps & Automation

black small squareAzure ML & Vertex AI Pipelines, MLflow, Kubeflow

black small squareTerraform, Bicep, GitHub Actions, Azure DevOps

black small squarePython, PowerShell, Bash, YAML

Containers & Infra

black small squareKubernetes, AKS, GKE, Docker, Registries

GPU compute, model serving, vector DBs, RAG

black small squareEntra ID, Google IAM, RBAC, Key Vault, Secret Manager

Defender for Cloud, Security Command Center, Responsible AI

REQUIRED QUALIFICATIONS:

black small squareBachelor’s degree in computer science, Engineering, IT, or related field.

black small square12+ years of infrastructure/cloud/platform experience, including 7+ years in cloud architecture and 5+ years designing enterprise AI/ML platforms.

black small squareProven hands-on delivery of Azure AI and Google Vertex AI environments, including GPU and Kubernetes-based AI platforms.

black small squareStrong grounding in networking, storage, security, and distributed systems; experience leading customer-facing architecture workshops.

PREFERRED CERTIFICATIONS & ENVIRONMENT

black small squareAzure Solutions Architect Expert, Azure AI Engineer Associate; Google Professional Cloud Architect & Professional ML Engineer.

black small squareKubernetes (CKA/CKAD), TOGAF, and ITIL Foundation preferred.

black small squarePreferred client environments: Semiconductor, Manufacturing, High-Tech, SaaS, and Enterprise IT running large-scale AI/GenAI across hybrid and multi-cloud.

“Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin, or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at .”