Generative AI Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 2 months ago
6-8 years
Bengaluru / Bangalore, Karnataka
Data Science Analytics & Machine Learning
hybrid
Full Time

Posted: 2 months ago
This job's closing date (1 Nov 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Senior GenAI / LLM Engineer

Experience: 6+ Years

Location: Bangalore

Work Mode: Hybrid

Employment Type: Full-time

About the Role

CoffeeBeans is looking for a Senior GenAI / LLM Engineer to build and optimize production-grade Generative AI applications. The ideal candidate will have strong hands-on experience across LLM application development, prompt optimization, evaluation, guardrails, and observability.

What Youll Do

  • Build and optimize LLM/GenAI applications for real-world business use cases.
  • Design and improve prompts for accuracy, consistency, and reliability.
  • Create LLM evaluations (evals) to measure response quality, relevance, groundedness, and performance.
  • Design and implement custom guardrails for domain-specific AI applications, beyond basic prompt instructions.
  • Debug and improve LLM applications using LangSmith, MLflow, or similar observability tools.
  • Build and optimize RAG pipelines, including retrieval and context strategies.
  • Work with LLM frameworks and APIs to develop scalable AI solutions.
  • Collaborate with engineering, product, and business teams to take AI solutions from POC to production.

Must Have

  • 6+ years of software/AI/ML engineering experience.
  • Strong Python development experience.
  • Hands-on experience building GenAI/LLM applications.
  • Strong experience with Prompt Engineering / Prompt Optimization.
  • Experience writing and implementing LLM evals.
  • Experience building custom AI/LLM guardrails.
  • Hands-on experience with LangSmith, MLflow, or similar tools for LLM debugging/observability.
  • Experience with RAG, embeddings, and vector databases.
  • Experience with frameworks such as LangChain, LangGraph, LlamaIndex, or equivalent.
  • Experience working with LLMs such as OpenAI, Anthropic, Gemini, Azure OpenAI, or open-source models.

Good to Have

  • Experience with AI Agents / Agentic AI.
  • Knowledge of MCP (Model Context Protocol).
  • Experience with Docker, Kubernetes, and cloud platforms.
  • Understanding of LLM security concepts such as prompt injection and hallucination prevention.

What Were Looking For

Someone who has hands-on experience building, evaluating, debugging, and improving real-world LLM applications—not just experimenting with prompts or ChatGPT.

If youre excited about building reliable, production-ready GenAI solutions, wed love to hear from you!

Skills

PythonAi/mlPrompt EngineeringAiMlLlmLlmsGenerative AiGenaiRagEmbeddingsOpenaiAzure OpenaiAnthropicChatgptGuardrailsLangchainLanggraphLlamaindexAi AgentsAgenticAgentic AiMcpModel Context ProtocolMlflowAi Engineer

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

We build products. We tackle real world challenges. We solve business problems. Organisational transformations. Custom development. Technology advisory.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru / Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.