Engineer, LLM Ops

Do you want to shape the future of fintech and healthtech Energized by challenges and inspired by bold goals Ready to elevate your career alongside driven and talented colleagues If that sounds like you, explore a career at Alegeus today. Opportunity Happens Here.
Engineer, LLM Ops
Join our team at Alegeus, where youll experience unmatched opportunity and a culture that cares deeply about succeeding together. As an Engineer, LLM Ops, youll play a critical role in enabling governed, scalable, and high-quality AI adoption—driving how LLM-powered solutions are deployed, monitored, and continuously improved across the enterprise. Collaborate with dedicated colleagues, embrace a spirit of innovation, and build an enriching career with us.
OPPORTUNITY HAPPENS HERE — REALIZE YOURS
Alongside The Best And The Brightest, You Will Regularly

• Shape the future of AI operations by building and evolving LLMOps practices that drive reliable, secure, and scalable deployment of AI-powered solutions.
• Lead the operational excellence of generative AI by managing prompt lifecycles, model configurations, and evaluation workflows that ensure consistent, high-quality outcomes.
• Drive innovation with responsible AI rollout strategies, leveraging A/B testing, feature flags, and human-in-the-loop processes to safely bring new capabilities to production.
• Elevate AI performance and quality through advanced monitoring, evaluation frameworks, and continuous feedback loops that improve accuracy, cost-efficiency, and user experience.
• Champion governed AI adoption by embedding auditability, traceability, and compliance into every stage of the LLM lifecycle.
• Collaborate cross-functionally with AI engineers, data scientists, platform teams, and business stakeholders to transform cutting-edge AI prototypes into production-ready solutions.
  

Essential Skills For Creating a Lasting Impact
Alegeus colleagues are known as problem-solvers, risk-takers, and innovative thinkers. As an Engineer, LLM Ops, these skills are essential for success:

• Abilities: Strong problem-solving and collaboration skills with the ability to operationalize LLMOps practices—including prompt lifecycle management, evaluation, observability, governance, and secure AI deployment—across cross-functional teams.
• Experience: 3+ years in LLMOps, AI operations, software engineering, DevOps, cloud engineering, MLOps, or related roles, with hands-on exposure to generative AI (LLMs, prompts, RAG, embeddings) and experience with Azure OpenAI or similar platforms, CI/CD tools (Azure DevOps, GitHub Actions), and programming in Python or C#/.NET.
• Education: Bachelors degree or equivalent experience in a relevant field (e.g., computer science, engineering, or related discipline).
• Location: Bangalore, India
  

Because We Care, We Offer

• A flexible work environment
• Competitive salaries, paid vacation, and holidays
• Robust professional development programs
• Comprehensive health, wellness, and financial packages
  

SHARED AMBITION. INSPIRED FUTURE.
At Alegeus, our success is guided by our aligned vision and values—it is how we work together and collaborate to achieve our goals.

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired
• People First. We pride ourselves in bringing talented people together and treating one another with care.
• Partner Powered. We are committed to empowering our partners, knowing our success is shared and we win as one.
• Always Advancing. We are driven by potential and relentlessly determined to achieve our goals.
  

I truly believe that people who are well-skilled and talented can go wherever they want in this company. We want to create the best place anyone has ever worked. - Alegeus employee
Apply now, connect a friend to this opportunity, or sign up for job alerts!
We are committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, age, physical or mental disability, veteran or military status, genetic information, sexual orientation, marital status, or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances. The information collected by this application is solely to determine suitability for employment, verify identity and maintain employment statistics on applicants.
At Alegeus, being transparent about our compensation philosophy and approach is more than just a legal requirement. As our organization continues to grow and evolve, we have made a commitment to ensure that our compensation framework is equitable, data-driven, consistent, and unbiased, with allowable pay differences based on factors unique to each candidate (think: skills, experience, qualifications, etc.) in order to attract and retain a highly talented and committed workforce.
We are taking an inside-out approach to pay transparency by first educating our valued managers and internal workforce and then moving to publishing compensation ranges externally. In the interim, if you are a California, Colorado, Connecticut, Maryland, Nevada, New Jersey, New York, Ohio or Washington resident and this role is physically available in your state or classified as remote, you may be eligible to receive additional information about the compensation and benefits for this role, which we will provide upon request. Please send an email identifying the title of the role you are interested in and the state you reside in to [HIDDEN TEXT].
Alegeus may use AI technology during candidate interviews. The uses include recording, note-taking, and summarizing candidate interviews. The information generated by the AI technology will be used by Alegeus during the hiring process. If you wish to opt out of having AI technology transcribe your interview, please notify your recruiter in advance of the interview. Otherwise, by agreeing to an interview with us, you consent to the use of AI technology during your interview.