Gen AI Senior Architect

Job Title - Gen AI Senior Architect

Key Skills - AI & ML, LLM, LangGraph, LangChain, RAG, Python & Vector Database

Experience - 13+ years

Location - Hyderabad & Pune

We at Coforge are hiring a GenAI Senior Architecture with the following skillset:

• Develop and maintain the architectural framework for Generative AI and LLM-powered solutions, including RAG, AI agents, and multi-step workflows, ensuring alignment with business goals and technical standards.
• Lead the design, fine-tuning, and deployment of Generative AI models (e.g., GPT, DALL·E, Stable Diffusion) and LLM-based applications for use cases such as content generation, automation, copilots, and decision support systems.
• Design and implement LLM orchestration pipelines using frameworks such as LangChain, LangGraph, Semantic Kernel, or similar tools. Build agentic workflows, tool-augmented agents, and multi-step reasoning pipelines.
• Architect and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., FAISS, Pinecone, Azure AI Search) and embedding models to enable enterprise knowledge integration.
• Collaborate with software engineering teams to integrate Generative AI capabilities, LLM services, and autonomous agents into existing applications, APIs, and enterprise workflows.
• Ensure AI/LLM solutions are scalable, optimized for latency and cost, and production-ready across cloud and hybrid environments.
• Implement and enforce ethical AI guidelines, including bias mitigation, explainability, safety guardrails, and responsible AI practices for LLM deployments.
• Stay abreast of advancements in LLMs, prompt engineering, agent frameworks, multimodal AI, and GenAI tooling, incorporating emerging techniques into the AI strategy.
• Work closely with data scientists, ML engineers, product teams, and business stakeholders to identify AI-driven opportunities and ensure successful solution delivery.
• Create comprehensive documentation for AI architectures, LLM workflows, prompt templates, and best practices. Establish coding, evaluation, governance, and compliance standards.
• Minimum 7+ years of experience in AI/ML architecture or a related role.
• Proven experience in designing, developing, and deploying Generative AI and LLM-based solutions in production environments.
• Hands-on experience with LangChain, LangGraph, Semantic Kernel, or similar orchestration frameworks for building LLM pipelines and agent-based systems.
• Experience in developing RAG pipelines, integrating vector databases, and applying prompt engineering techniques.
• Strong experience with AI/ML frameworks and tools such as TensorFlow, PyTorch, and Hugging Face.
• Experience with cloud platforms such as AWS, Azure, or GCP, including the deployment of scalable AI/LLM solutions.

Technical Skills

• Proficiency in programming languages such as Python (preferred), Java, or C++.
• Strong expertise in LLMs, prompt engineering, embeddings, fine-tuning, and model optimization techniques.
• Hands-on experience with:
• LangChain, LangGraph, and agent frameworks
• Vector databases (Pinecone, FAISS, Weaviate, Azure AI Search)
• API integration and microservices architecture
• RAG architecture and knowledge retrieval systems
• Strong understanding of machine learning, deep learning, and MLOps concepts.
• Familiarity with AI governance, Responsible AI principles, model evaluation frameworks, and observability tools.