Allianz - Senior Databricks & AI Architect

Department Icon Data Science Analytics & Machine Learning
Posted: 8 hours ago
8-10 years
Thiruvananthapuram / Trivandrum, Kerala
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 15 Jan 2027

Posted: 8 hours ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Senior Databricks & AI Architect role at Allianz PNB Life in Thiruvananthapuram / Trivandrum for people with 8–10 years of experience. You'll build end-to-end data architectures on the Databricks Data Intelligence Platform, design AI workflows involving LangChain, LlamaIndex, RAG, and agentic AI, and implement Spark-based architectures, ETL, machine learning, and Snowflake integration.

  • Thiruvananthapuram
  • Work from office
  • 8–10 years
  • Bachelors or Masters

What you'll do

  • Design end-to-end architectures on Databricks
  • Build agentic AI and RAG workflows
  • Standardise data engineering and ETL templates

Good fit if you

  • Have 8+ years in data engineering
  • Bring hands-on Databricks ecosystem leadership
  • Understand insurance or financial services
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

Position Overview

We are seeking a visionary Senior Databricks & AI Architect to lead the evolution of our modern data platform and AI roadmap.

In this role, you will bridge the gap between complex insurance data domains and cutting-edge AI execution.

You will be responsible for designing scalable Spark-based architectures, implementing rigorous FinOps and optimisation strategies, and pioneering Agentic AI workflows to automate high-value insurance processes (e.g., claims, underwriting, and risk assessment).

Key Responsibilities

  • Design and govern end-to-end data architectures on the Databricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
  • Lead the design of emerging AI workflows, specifically focusing on Agentic AI (multi-agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policy and regulatory documents.
  • Own the platforms efficiency, implementing cluster policies, Photon engine optimisations, and cost-attribution models to ensure high performance with a focus on ROI.
  • Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurance data.
  • Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
  • Ensure all designs comply with industry regulations using Databricks Unity Catalog.

Required Skills & Experience

  • 8+ years in Data Engineering/Architecture, with at least 3+ years of hands-on leadership within the Databricks ecosystem.
  • Expert-level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.
  • Proven experience building and deploying AI solutions, with a deep understanding of the Agentic AI landscape.
  • Specific experience in Databricks cost management, instance selection, and performance tuning (Z-Ordering, Liquid Clustering).
  • Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
  • Prior experience in the Insurance or FinServ sector is highly preferred.

Education & Certifications

  • Bachelors or Masters degree in Computer Science, Data Science, or a related field.
  • Preferred: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.

(ref:hirist.tech)

Skills

Data ScienceEtlMachine LearningSnowflakeData EngineerAiSqlLlmRagLangchainLlamaindexAgenticAgentic AiMulti-agent SystemsDatabricks

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Thiruvananthapuram / Trivandrum.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.