Allianz - Senior Databricks & AI Architect
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Senior Databricks & AI Architect role at Allianz PNB Life in Thiruvananthapuram / Trivandrum for people with 8–10 years of experience. You'll build end-to-end data architectures on the Databricks Data Intelligence Platform, design AI workflows involving LangChain, LlamaIndex, RAG, and agentic AI, and implement Spark-based architectures, ETL, machine learning, and Snowflake integration.
- Thiruvananthapuram
- Work from office
- 8–10 years
- Bachelors or Masters
What you'll do
- Design end-to-end architectures on Databricks
- Build agentic AI and RAG workflows
- Standardise data engineering and ETL templates
Good fit if you
- Have 8+ years in data engineering
- Bring hands-on Databricks ecosystem leadership
- Understand insurance or financial services
AI-generated from the job description. Check the full description before you apply.
Job Description
Position Overview
We are seeking a visionary Senior Databricks & AI Architect to lead the evolution of our modern data platform and AI roadmap.
In this role, you will bridge the gap between complex insurance data domains and cutting-edge AI execution.
You will be responsible for designing scalable Spark-based architectures, implementing rigorous FinOps and optimisation strategies, and pioneering Agentic AI workflows to automate high-value insurance processes (e.g., claims, underwriting, and risk assessment).
Key Responsibilities
- Design and govern end-to-end data architectures on the Databricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
- Lead the design of emerging AI workflows, specifically focusing on Agentic AI (multi-agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policy and regulatory documents.
- Own the platforms efficiency, implementing cluster policies, Photon engine optimisations, and cost-attribution models to ensure high performance with a focus on ROI.
- Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurance data.
- Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
- Ensure all designs comply with industry regulations using Databricks Unity Catalog.
- 8+ years in Data Engineering/Architecture, with at least 3+ years of hands-on leadership within the Databricks ecosystem.
- Expert-level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.
- Proven experience building and deploying AI solutions, with a deep understanding of the Agentic AI landscape.
- Specific experience in Databricks cost management, instance selection, and performance tuning (Z-Ordering, Liquid Clustering).
- Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
- Prior experience in the Insurance or FinServ sector is highly preferred.
- Bachelors or Masters degree in Computer Science, Data Science, or a related field.
- Preferred: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.
(ref:hirist.tech)
Skills
Data ScienceEtlMachine LearningSnowflakeData EngineerAiSqlLlmRagLangchainLlamaindexAgenticAgentic AiMulti-agent SystemsDatabricksIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Thiruvananthapuram / Trivandrum.
One email a day. Unsubscribe any time.

