ML Infrastructure Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 5 months ago
5-7 years
Bengaluru / Bangalore, Karnataka
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 5 months ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Byteridge is seeking a Rapid Prototyping Engineer specializing in AI Infrastructure and Optimization to work with our most strategic customers on deploying, fine-tuning, and optimizing large language models at scale. You will be at the forefront of Byteridges AI infrastructure capabilities, helping customers unlock the full potential of foundation models through expert-level deployment on GPU infrastructure. This highly technical role requires deep expertise in machine learning infrastructure, GPU optimization, and production ML systems, combined with the ability to translate complex technical concepts into customer success.

The Core Responsibilities For The Job Include The Following

Model Deployment and Optimization:

  • Lead end-to-end deployments of large language models on AWS infrastructure for strategic customers.
  • Design and implement training, fine-tuning, and inference pipelines using Amazon SageMaker AI.
  • Optimize model performance through GPU-level tuning, kernel optimization, and infrastructure configuration.
  • Deploy models on diverse GPU architectures, including NVIDIA and AWS custom silicon (Trainium, Inferentia).

Infrastructure Architecture And Performance

  • Architect scalable ML infrastructure using SageMaker AI Inference, HyperPod, and distributed training frameworks.
  • Implement CUDA-level optimizations and custom kernels for improved model performance.
  • Design storage and networking architectures optimized for high-throughput ML workloads.
  • Troubleshoot and resolve complex performance bottlenecks at the GPU driver and kernel level.

Customer Engagement And Technical Leadership

  • Partner with AWS AI Specialist Solution Architects and customer ML teams to understand model requirements and deployment constraints.
  • Provide technical guidance on model selection, fine-tuning strategies, and production best practices.
  • Conduct performance benchmarking and cost optimization analysis for ML workloads.
  • Share field insights with AWS product teams to influence infrastructure and service roadmaps.

Requirements

  • Bachelors degree in Computer Science, Engineering, or equivalent practical experience (Masters or PhD preferred).
  • 5+ years of experience in machine learning infrastructure, model deployment, or GPU computing.
  • Strong programming skills in Python and experience with ML frameworks (PyTorch, TensorFlow, JAX).
  • Deep understanding of LLM architectures, training methodologies, and inference optimization.

Technical Expertise (High-Level Alignment)

  • Hands-on experience training, fine-tuning, or deploying large language models in production.
  • Proficiency with GPU programming, CUDA, and kernel-level optimization techniques.
  • Experience with distributed training frameworks and multi-GPU/multi-node orchestration.
  • Strong knowledge of AWS core services: EC2 (GPU instances), S3 EFS, VPC, and networking.

Preferred Experience

  • Direct experience with Amazon SageMaker AI (Training, Inference, HyperPod) or equivalent ML platforms.
  • Understanding of GPU architectures (NVIDIA A100 H100) and AWS custom silicon (Trainium, Inferentia).
  • Experience with model compression techniques (quantization, pruning, distillation).
  • Knowledge of MLOps practices, model monitoring, and production ML system design.
  • Background in high-performance computing, distributed systems, or systems programming.

Essential Attributes

  • Ability to dive deep into technical problems and debug complex infrastructure issues.
  • Strong analytical skills with a data-driven approach to optimization.
  • Excellent communication skills to explain complex technical concepts to diverse audiences.
  • Comfortable working in ambiguous, fast-paced environments with evolving requirements.
  • Ownership mindset with the ability to drive projects from architecture to production.

This job was posted by Sweety S from Byteridge.

Skills

PythonMachine LearningLarge Language ModelsAiMl

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Byteridge is a technology solutions and services company. We are experts in delivering software solutions, data analytics, cloud services and digital transformation solutions.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru / Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.