Junior Data Engineer

Job Title: Junior Data Engineer (ETL, Development & Data Operations)

Role Type: Junior / Developer / Analyst

Experience: 0 - 2 Years

Location: MRC Nagar, Chennai

Role Overview

The Junior Data Engineer will play a key role in building, maintaining, and optimizing end-to-end data pipelines across modern cloud-based data platforms. The role involves supporting data ingestion, transformation, validation, and operational monitoring to ensure reliable, high-quality, and timely data delivery for analytics, reporting, and business decision-making.

Key Responsibilities

• Design, develop, and maintain ETL pipelines using Databricks and PySpark.
• Extract, transform, and integrate data from multiple sources, including APIs, databases, and flat files.
• Implement and optimize data transformations and load curated datasets into Delta Tables.
• Schedule, orchestrate, and monitor workflows using Databricks Workflows.
• Perform daily data validation checks to ensure accuracy, completeness, and consistency of data loads.
• Maintain and update data catalog, lineage documentation, and metadata repositories.
• Generate and circulate success/failure reports, job run summaries, and operational dashboards.
• Build and maintain data quality dashboards and monitoring tools using Power BI or Superset.
• Collaborate with Data Leads, BI teams, and cross-functional stakeholders for schema design, data integration, and analytics support.
• Troubleshoot ETL issues, apply error-handling logic, and contribute to pipeline performance optimization.

-

Required Skills and Competencies

Technical Skills:

• Programming: SQL, Python, PySpark
• ETL Platforms & Tools: Databricks Notebooks, Databricks Workflows, Delta Lake
• Cloud Storage: Azure Data Lake / AWS S3
• Version Control: Git, GitHub
• Data Quality & Reporting: Excel, Power BI, Superset

Knowledge Areas:

• Strong understanding of ETL concepts, data integration, and data quality frameworks
• Basic familiarity with data modeling and cloud-based architectures
• Understanding of data governance, security, and metadata management principles

Soft Skills:

• Analytical and problem-solving mindset
• Strong attention to detail and process discipline
• Effective communication and teamwork abilities
• Eagerness to learn and adapt to new technologies

Education:

Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.

Why Join Us:

• Opportunity to work on cutting-edge data technologies and cloud platforms.
• Collaborative environment with mentorship and learning opportunities.
• Exposure to end-to-end data lifecycle management and real-world data engineering challenges.