An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
Senior GenAI / LLM Engineer
Experience: 6+ Years
Location: Bangalore
Work Mode: Hybrid
Employment Type: Full-time
About the Role
CoffeeBeans is looking for a Senior GenAI / LLM Engineer to build and optimize production-grade Generative AI applications. The ideal candidate will have strong hands-on experience across LLM application development, prompt optimization, evaluation, guardrails, and observability.
What Youll Do
- Build and optimize LLM/GenAI applications for real-world business use cases.
- Design and improve prompts for accuracy, consistency, and reliability.
- Create LLM evaluations (evals) to measure response quality, relevance, groundedness, and performance.
- Design and implement custom guardrails for domain-specific AI applications, beyond basic prompt instructions.
- Debug and improve LLM applications using LangSmith, MLflow, or similar observability tools.
- Build and optimize RAG pipelines, including retrieval and context strategies.
- Work with LLM frameworks and APIs to develop scalable AI solutions.
- Collaborate with engineering, product, and business teams to take AI solutions from POC to production.
Must Have
- 6+ years of software/AI/ML engineering experience.
- Strong Python development experience.
- Hands-on experience building GenAI/LLM applications.
- Strong experience with Prompt Engineering / Prompt Optimization.
- Experience writing and implementing LLM evals.
- Experience building custom AI/LLM guardrails.
- Hands-on experience with LangSmith, MLflow, or similar tools for LLM debugging/observability.
- Experience with RAG, embeddings, and vector databases.
- Experience with frameworks such as LangChain, LangGraph, LlamaIndex, or equivalent.
- Experience working with LLMs such as OpenAI, Anthropic, Gemini, Azure OpenAI, or open-source models.
Good to Have
- Experience with AI Agents / Agentic AI.
- Knowledge of MCP (Model Context Protocol).
- Experience with Docker, Kubernetes, and cloud platforms.
- Understanding of LLM security concepts such as prompt injection and hallucination prevention.
What Were Looking For
Someone who has hands-on experience building, evaluating, debugging, and improving real-world LLM applications—not just experimenting with prompts or ChatGPT.
If youre excited about building reliable, production-ready GenAI solutions, wed love to hear from you!
Skills
PythonAi/mlPrompt EngineeringAiMlLlmLlmsGenerative AiGenaiRagEmbeddingsOpenaiAzure OpenaiAnthropicChatgptGuardrailsLangchainLanggraphLlamaindexAi AgentsAgenticAgentic AiMcpModel Context ProtocolMlflowAi EngineerIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
We build products. We tackle real world challenges. We solve business problems. Organisational transformations. Custom development. Technology advisory.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bengaluru / Bangalore.
One email a day. Unsubscribe any time.

