Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in Python, PySpark, Databricks, and Azure. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.

Key Responsibilities:

• Develop and maintain robust data pipelines using Python and PySpark to ensure efficient data processing and transformation.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets for analysis.
• Utilize Databricks for data processing and analytics, ensuring optimal performance and reliability.
• Implement data storage solutions on Azure, ensuring data security and accessibility.
• Monitor and troubleshoot data pipeline performance, making necessary adjustments to improve efficiency.
• Document data processes and workflows to ensure clarity and maintainability.

Required Skills:

• Proficiency in Python and experience with PySpark for data processing.
• Familiarity with Databricks and its functionalities.
• Experience with Azure cloud services and data storage solutions.
• Strong analytical and problem-solving skills.
• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.

If you are passionate about data engineering and eager to work in a fast-paced environment, we encourage you to apply for this exciting opportunity.