Data Engineer (Databricks)

Department Icon Data Science Analytics & Machine Learning
Posted: 1 week ago
2-5 years
Pune, Maharashtra, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 2 Jan 2027

Posted: 1 week ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Data Engineer role at Onit in Pune, Maharashtra, India for people with 2–5 years of experience. You'll build and operate Databricks-based data pipelines using Python, SQL, PySpark, and AWS. You'll ensure data quality and governance for an AI-driven legal operations platform.

  • Pune
  • Work from office
  • 2–5 years

What you'll do

  • Design and maintain scalable batch and incremental pipelines
  • Implement the canonical data model with the Data Architect
  • Build production pipelines that resolve duplicate and conflicting records

Good fit if you

  • Have 2–5 years of experience
  • Bring hands-on Databricks and PySpark skills
  • Know Python, SQL, and AWS
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

Key Responsibilities

  • Pipeline Development: Design, build, and maintain scalable batch and incremental pipelines in Databricks (PySpark, Spark SQL, Delta Lake) that ingest data from multiple source systems into a medallion (bronze/silver/gold) architecture.
  • Data Integration & Modelling: Implement the canonical data model defined with the Data Architect, so figures reconcile consistently across every product surface.
  • Entity Resolution: Build production pipelines that resolve duplicate and conflicting records across systems that were never designed to reconcile with one another.
  • Data Quality Engineering: Profile source data, implement automated data quality checks and expectations, and build monitoring and reporting so data quality stays continuously visible against defined targets.
  • Orchestration & Reliability: Orchestrate and monitor jobs with Databricks Workflows, optimise Spark performance and cost, and troubleshoot pipeline failures.
  • Governance & Privacy: Apply Unity Catalog governance, multi-tenant data isolation, and anonymisation and aggregation rules for pooled cross-customer analytics.
  • Collaboration: Partner with the Data Scientist to productionise comparability models and data quality metrics, and with Engineering to expose curated data to the product.

Required Skills

  • 5+ years in data engineering or analytics engineering, building production data pipelines in a cloud environment.
  • Hands-on Databricks experience: PySpark and Spark SQL, Delta Lake, Databricks Workflows/Jobs, and Unity Catalog.
  • Strong SQL and Python, with solid data modelling skills (dimensional and/or canonical models) and experience with the lakehouse/medallion architecture.
  • Practical experience with deduplication, record linkage, or entity resolution, and with diagnosing and remediating data quality problems at scale.
  • Experience implementing automated data quality checks, pipeline monitoring, and Spark performance and cost optimisation.
  • Experience with cloud platforms (AWS preferred), Git-based version control, and CI/CD for data pipelines.
  • Clear communication with data scientists, architects, and product stakeholders, including flagging data limitations early.
  • Working proficiency with AI tools (e.g., Claude, Databricks Assistant, GitHub Copilot) to accelerate pipeline development, debugging, and documentation, with the judgment to validate AI-generated code before production use.

Preferred Qualifications

  • Databricks certification (e.g., Data Engineer Associate or Professional).
  • Experience with streaming or incremental ingestion (e.g., Auto Loader, Structured Streaming, Delta Live Tables).
  • Experience building data for benchmarks, scoring models, or analytics intended for external consumption.
  • Experience with anonymisation, aggregation thresholds, or privacy-preserving analytics.
  • Background in enterprise B2B SaaS or the legal technology domain.
Benefits & Perks That Support You:
Onit offers a comprehensive total rewards package designed to support the whole employee at work and beyond:
Health Coverage: Employee and immediate family members.
Time Away: Flexible paid time off and 10 company paid holidays annually.
Family Support: Exceptional paid leave for birth parents, non-birth parents, and caregivers.  Onit also offers surrogacy and adoption reimbursement.
Income Protection: 100% employer-paid life and disability insurance.
Additional Coverage Options: Voluntary benefits including hospital indemnity, critical illness, accident.
Tax-Advantaged Accounts: Flexi, NPS.
Community Engagement: One paid volunteer day each year to give back to the community.

Our Commitment to Applicants
We know that not everyone will check every box in a job description. At Onit, we value diversity, inclusion, and authenticity. If you’re excited about this role but your experience doesn’t align perfectly with every qualification, we encourage you to apply. You may be exactly who we’re looking for.

Onit Values 
Customer First - Customer success is our success. We deliver value, listen, and act on customer needs. 
Purposeful Innovation - Innovation fuels our growth. We harness creativity to solve problems and lead with the intentions and expertise. 
Win as One - Teamwork is how we win. We are accountable, act with integrity, and communicate openly. 
Intentional Growth - Our people are the difference. We create an environment with compelling work, impactful contributions, and career growth. 

Skills

PythonSQLData EngineeringPySparkDatabricksAWSCI/CDGitGitHubCustomer SuccessCommunicationTeams

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Onit is a global leader of workflow and artificial intelligence solutions for legal, compliance, sales, IT, HR and finance departments. With Onit, companies can transform best practices into smarter workflows, better processes and operational efficiencies. We help transform the way organizations get things done—enabling them to navigate the future of business.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Pune.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.