Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 7 months ago
3-5 years
India
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 7 months ago

This job is no longer accepting applications

It closed on 20 May 2026. Here are 6 live jobs like it - apply in one step.

See all live Data Science Analytics & Machine Learning jobs
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Company Summary

Irth Solutions is a software product company building cutting-edge technology platforms that continuously set industry benchmarks. With a strong product culture, collaborative environment, and high growth potential, Irth offers an exciting opportunity to work on modern, enterprise-scale data platforms.

Irth is currently building a modern, multi-cloud, enterprise-grade data estate using Databricks to centralize data across AWS, Azure, and GCP. We are hiring a Data Engineer to support the implementation and operationalization of this unified data platform.

Job Summary

Irth is developing a unified Databricks-based Lakehouse platform to consolidate and govern data across multiple cloud environments and products.

As a Data Engineer, you will play a hands-on role in implementing scalable data pipelines, applying governance and quality standards, and supporting the enterprise data architecture. You will work closely with the Senior Data Architect to build reliable, secure, and high-performance data pipelines using Databricks, Spark, and cloud-native technologies.

This role is ideal for mid-level engineers looking to expand their expertise in Databricks, Spark, Delta Lake, and modern lakehouse architecture.

Requirements

Data Pipeline Development

  • Build and maintain ingestion pipelines across AWS, Azure, and GCP
  • Implement batch and streaming pipelines using Databricks, Spark/PySpark, SQL, Delta Live Tables, and Lakeflow
  • Apply medallion architecture patterns for structured data transformation
  • Implement CDC, SCD Type 1/2, schema evolution, and data validation

Platform & Storage Implementation

  • Manage Delta Lake storage, tables, partitions, and performance optimization (OPTIMIZE, Z-ORDER, VACUUM)
  • Support metadata management, lineage tracking, and cataloging using Unity Catalog
  • Assist with multi-cloud integrations between cloud storage platforms and Databricks

Governance, Quality & Compliance

  • Implement data quality validation, profiling, and monitoring aligned with governance standards
  • Apply security controls including RBAC, encryption, and data classification
  • Support metadata and lineage implementation using Unity Catalog, Purview, or similar tools

Orchestration, Automation & Operations

  • Build and manage workflows using Databricks Workflows, Delta Live Tables, Azure Data Factory, or similar tools
  • Support CI/CD pipelines, code versioning, and deployment automation
  • Assist in troubleshooting, pipeline recovery, and performance tuning

Collaboration & Documentation

  • Work closely with the Senior Data Architect to implement architecture designs
  • Participate in design reviews and technical discussions
  • Document pipelines, data models, transformation logic, and operational procedures

Skills & Experience

Required:

  • 3-5 years of experience in data engineering, ETL, or cloud data platforms
  • Experience with Databricks, Spark, PySpark, or distributed data processing
  • Strong SQL and structured data transformation skills
  • Experience with at least one cloud platform (Azure preferred; AWS/GCP acceptable)
  • Knowledge of data modeling, schema evolution, pipeline troubleshooting, and data quality
  • Understanding of security practices including RBAC, encryption, and credential management

Preferred:

  • Experience with Delta Lake, medallion architecture, and lakehouse design
  • Familiarity with Unity Catalog, Purview, Glue Catalog, or similar tools
  • Experience with orchestration tools (ADF, Airflow, Databricks Workflows)
  • Experience with Git, CI/CD, and DevOps practices
  • Knowledge of Power BI, geospatial data, or AI/ML data preparation
  • Relevant cloud or Databricks certifications (DP-203, Data Engineer Associate, etc.)

EDUCATION

  • Bachelors or masters degree in computer science, Software Engineering, or a related field, or equivalent professional experience

Benefits

WHAT IS IN IT FOR YOU

  • Being an integral part of a dynamic, growing company that is well respected in its industry
  • Competitive pay based on experience

Skills

Data ValidationData ArchitectureData ModelingEtlData ProcessingImplementationAi/mlData EngineerAiMlSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Irth, is the first review and rating app for places and products by people of color, for everyone. Irth, which stands for “as in, birth…as in, where you were born,” is where people of color can find safe spaces and avoid harmful ones. Irth’s mission is to provide a trusted platform for people of color to share their experiences, empowering them to make informed decisions about where they spend their time and money. By amplifying the voices of marginalized communities, Irth aims to create a more equitable and inclusive world for all.
Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in India.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.