Senior Data Engineer

On-Site Location : Ahmedabad

About Job

We are seeking an Azure Data Engineer to join our data team. As a Senior Data Engineer, you will work on various data engineering tasks including designing and optimizing data pipelines, data modelling, and troubleshooting data issues. You will work closely with cross-functional teams to ensure the reliability, scalability, and efficiency of our data systems. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a passion for leveraging data to drive business insights.

Responsibilities:

?Design and optimize data pipelines for various data sources

?Design and implement efficient data storage and retrieval mechanisms

?Develop data modelling solutions and data validation mechanisms

?Troubleshoot data-related issues and recommend process improvements

?Collaborate with data scientists and stakeholders to provide data-driven insights and solutions

?Experience in designing, developing, and maintaining data pipelines and infrastructure.

Skills Required:

?5+ years of experience in data engineering or related field

?Strong experience in designing and optimizing data pipelines, and data modelling

?Strong proficiency in programming languages Python

?Experience with big data technologies like Hadoop, Spark, and Hive

?Experience with Azure cloud data services

?Strong experience with database technologies like SQL, NoSQL, and data warehousing

?Knowledge of distributed computing and storage systems

?Basic understanding of DevOps

?Strong analytical and problem-solving skills

?Excellent communication and collaboration skills

Qualifications

Bachelors degree in Computer Science, Data Science, or a Computer related field (Masters degree preferred)