Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in cloud engineering and data engineering, with a strong focus on utilizing platforms such as AWS and Azure. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven initiatives.

Key Responsibilities:

• Design and implement scalable data solutions using cloud technologies, primarily AWS and Azure.
• Develop and maintain ETL processes using Azure Data Factory (ADF) and other relevant tools.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data sets.
• Optimize data storage and retrieval processes using Azure Data Lake Storage (ADLS) and other cloud storage solutions.
• Write efficient and reusable code in Python and PySpark to process large datasets.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Stay updated with the latest trends and technologies in cloud computing and data engineering.

Required Skills:

• Strong experience with cloud platforms, specifically AWS and Azure.
• Proficiency in data engineering tools and frameworks, including Azure Data Factory and Azure Data Lake Storage.
• Solid programming skills in Python and PySpark.
• Experience in building and optimizing data pipelines and architectures.
• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.

If you are passionate about data engineering and cloud technologies, and you thrive in a fast-paced environment, we would love to hear from you. Join us in driving innovation and excellence in our data initiatives.