Senior Data & AI Engineer (Databricks Specialist)

Department Icon Data Science Analytics & Machine Learning
Posted: 4 months ago
8-10 years
Hyderabad / Secunderabad, Telangana, Telangana
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 4 months ago
This job's closing date (16 Aug 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Position Overview

We are seeking a dynamic, self-driven Data & AI Engineer with deep expertise in the Databricks ecosystem to design, build, and accelerate our next-generation data architecture.

In this role, you wont just write backend pipelines; you will be the bridge between complex data engineering and tangible business value.

A critical measure of success in this role is the ability to rapidly build and execute concrete, high-impact technical demonstrations that showcase the power of unified data and AI.

Because we operate globally, you must thrive in an autonomous, highly flexible environment, collaborating effectively across diverse time zones.

Education : Bachelors degree , BE/B. Tech in CS or equivalent

Experience : 8 to 10 years

Location : Hyderabad,India

Position : Senior Data & AI Engineer (Databricks Specialist)

Key Responsibilities

Databricks Architecture & Governance

Design and implement robust data pipelines utilizing the Databricks Lakehouse platform. Take ownership of data governance, security, and fine-grained lineage using Unity Catalog.

Rapid Prototyping & Demos

Quickly conceptualize, build, and present functional, end-to-end data and AI demos (e.g., live dashboards, real-time pipelines, or LLM/RAG prototypes) to stakeholders and clients.

Core Data Engineering

Build scalable, efficient ETL/ELT pipelines using Spark (PySpark/SQL), Delta Lake, and structured streaming. Ensure optimal performance tuning, partitioning, and cost-management of Databricks clusters.

Global Collaboration & Autonomy

Work independently with minimal supervision, managing your own schedule to align with global, cross-functional teams.

Required Skills & Qualifications

Databricks & Governance Mastery

Proven track record implementing Databricks Unity Catalog for data governance, access control, and data lineage.

Deep understanding of Databricks architecture, including Delta Lake, serverless compute, and Workflows.

Core Data Engineering Excellence

  • Strong foundational knowledge of data engineering principles (star schemas, dimensional modeling, data warehousing vs. data lakes).
  • Advanced proficiency in Python/PySpark and SQL.
  • Experience building robust orchestrations and handling both batch and real-time streaming data.

Agility & Communication

Exceptional ability to build quick, concrete POCs (Proof of Concepts) and technical demos that clearly translate data capabilities into business solutions.

Excellent communication skills, with the ability to clearly articulate technical concepts to both technical and non-technical audiences.

Preferred Qualifications

  • Certifications such as Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.
  • Experience integrating Databricks with enterprise ecosystems, cloud provider native services (AWS/Azure/GCP), or modern BI tools.
  • Exposure to building AI/ML workloads (e.g., MLflow, LLM integration, or RAG frameworks) within Databricks.

Skills

Business SolutionsPythonData ArchitectureData GovernanceData WarehousingEtlMachine LearningAi/mlData EngineerAi EngineerAnalyticsAiMlSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Our Purpose is to boost your competitive advantage using AI and Analytics.We Deliver tangible business impact with data-driven insights powered by AI. Drive revenue growth, increaseprofitability and improve operational efficiencies.We Are technologists with keen business acumen - Forever curious, always on the front lines oftechnological advancements. Applying our latest learnings, and tools to solve your everyday business challenges.We Believe the power of AI should not be the exclusive preserve of the few. Every business, regardless ofits size or sector deserves the opportunity to harness the power of AI to makebetter decisions and drive business value.We See a world where our AI and Analytics solutions democratise decision intelligence for all businesses.With Cognida.ai, our motto is ‘No enterprise left behind’.
Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad / Secunderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.