Senior Data Engineer

We are seeking a Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on utilizing PySpark and SQL to manage and analyze large datasets. As a Senior Data Engineer, you will play a crucial role in designing and implementing data pipelines, ensuring data quality, and optimizing data workflows to support our analytics and business intelligence initiatives.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using PySpark to process large volumes of data efficiently.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets for analysis.
• Write complex SQL queries to extract, transform, and load (ETL) data from various sources into data warehouses.
• Monitor and troubleshoot data pipeline performance, ensuring timely delivery of data to stakeholders.
• Implement best practices for data governance and security, ensuring compliance with data privacy regulations.
• Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives within the team.

Required Skills:

• Proficiency in PySpark for big data processing.
• Strong SQL skills for data manipulation and querying.
• Experience with data warehousing concepts and ETL processes.
• Familiarity with cloud platforms and data storage solutions is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills to collaborate effectively with cross-functional teams.

If you are passionate about data engineering and looking to make a significant impact in a fast-paced environment, we encourage you to apply for this exciting opportunity.