Senior Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 4 hours ago
5-10 years
Megapolis, Pune Corporate Office - Mantri, Pune, West, MAHARASHTRA, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 13 Dec 2026

Posted: 4 hours ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Job Purpose

To design and deliver AI-powered Business Intelligence solutions by integrating Databricks Genie, PowerBI Co-Pilot & Semantic Models, and Metric Views on top of a robust end-to-end data engineering stack.

The role focuses on enabling self-service analytics using natural language (GenAI), ensuring business-friendly data consumption, and building governed, scalable, and high-performance data ecosystems across batch and real-time pipelines.

Duties and Responsibilities

  •  Translate business problems into AI-driven BI solutions
  •  Own end-to-end delivery: ingestion ? transformation ? semantic layer ? AI consumption
  •  Design scalable data architecture aligned with lakehouse principles
  •  Ensure data quality, governance, and metric consistency
  •  Collaborate with business teams to onboard them onto Genie-based analytics
  •  Optimize performance of queries, pipelines, and AI responses
  •  Establish best practices for AI in BI (prompting, semantic tuning, governance)
  •  Drive adoption of self-service BI with minimal dependency on tech teams
Key Decisions / Dimensions
  •  Define semantic layer design and metric definitions
  •  Decide GenAI prompting strategies and instruction frameworks
  •  Prioritize data vs AI optimization trade-offs
  •  Handle production issues with RCA and long-term fixes
  •  Drive architectural decisions for lakehouse + AI integration
  • Major Challenges
  •  Ensuring accuracy and trust in AI-generated insights
  •  Driving adoption of GenAI-based BI over traditional dashboards
  •  Maintaining semantic consistency across multiple tools
  •  Balancing performance, cost, and scalability
  •  Managing dependencies across data engineering, AI, and business teams
  • Required Qualifications and Experience
  •  Azure Databricks – PySpark, SQL, Delta Lake
  •  PowerBI – CoPilot, Semantic Model
  •  Strong experience in Semantic Modeling & Metrics Layer design
  •  Hands-on with Databricks Genie / GenAI-based BI workflows
  •  Databricks One (Unified BI Experience)
  •  Prompt Engineering / Instruction tuning for AI systems
  •  Python (Pandas, PySpark, FastAPI)
  •  Azure Data Factory (ADF) for ETL pipelines
  •  Strong SQL and data modeling skills
  • Good to Have

    •  Cosmos DB / MongoDB (NoSQL concepts)
    •  Azure Data Explorer (KQL)
    • ________________________________________
    • DATA STACK (MANDATORY FOR SCREENING)
    • SNo Data Platform / Concepts Associated Technologies
    • 1 Databricks Lakehouse PySpark, SQL, Delta Lake
    • 2 AI for BI Databricks Genie, Genie Rooms, Instructions, Agents, PowerBI CoPilot
    • 3 Semantic Layer Semantic Models, Metric Views
    • 4 ETL & Orchestration Azure Data Factory
    • 5 Programming Python, C#/.NET
    • 6 Cloud Platform Azure (Preferred)

    7 DevOps CI/CD Pipelines, Git

    Skills

    Skills As Per JDPythonC#SQLNoSQLFastAPI.NETPandasPrompt EngineeringData EngineeringPySparkDatabricksETLData ModelingMongoDB

    If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

    About Company

    Bajaj Finance Limited is one of India's largest non-banking financial companies, incorporated on 25 March 1987 as Bajaj Auto Finance Limited and headquartered in Pune, Maharashtra. It is a subsidiary of Bajaj Finserv Limited and part of the Bajaj Group.

    Originally focused on two- and three-wheeler financing, the company now offers consumer durable loans, personal loans, business and SME lending, home loans, loans against property, and deposits. Bajaj Finance is listed on the NSE and BSE and employs over 70,000 people.

    Read More

    Similar Jobs

    View all
    Loading...
    Bag Logo
    Jobaaj
    Get jobs like this by email

    New Data Science Analytics & Machine Learning roles in Megapolis.

    Job Alert
    Google hiring for Specific Roles Apply Now!
    1 min ago
    New Opportunity
    Amazon is hiring freshers Apply Now!
    5 min ago
    Featured Jobs
    Microsoft opening 50+ positions Apply Now!
    10 min ago

    One email a day. Unsubscribe any time.