Data Engineer - Python, Pyspark, SQL

About the Role

This role is perfect for a Data Engineer with extensive experience in building and managing data pipelines. You will play a vital role in transforming raw data into actionable insights.

What You'll Do

• Develop and maintain efficient data pipelines to ensure seamless data flow across various platforms.
• Partner with data scientists and analysts to clarify data requirements and deliver effective data solutions.
• Execute ETL processes to extract, transform, and load data from diverse sources into centralized data repositories.
• Optimize storage and retrieval methods to improve performance and scalability of data systems.
• Utilize cloud technologies such as AWS and Azure for implementing robust cloud-based solutions.
• Monitor data quality through comprehensive testing and validation practices.
• Keep abreast of the latest advancements in data engineering tools and methodologies.

What We're Looking For

• Proven experience as a Data Engineer or in a related position.
• Strong skills in Python and PySpark for effective data manipulation and analysis.
• Solid understanding of SQL for database querying and management.
• Experience with various ETL tools and processes.
• Familiarity with frameworks and tools used for building data pipelines.
• Knowledge of cloud services, especially AWS and Azure.
• Strong problem-solving abilities with a keen eye for detail.

In this role, you will enhance your technical expertise while contributing to key data initiatives that drive business intelligence.