Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have a strong background in data engineering and be proficient in Python, PySpark, Apache Airflow, and Snowflake. As a Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes.

Key Responsibilities:

• Design and implement robust data pipelines using Python and PySpark to process large datasets efficiently.
• Utilize Apache Airflow for orchestrating complex workflows and ensuring timely data processing.
• Work with Snowflake to manage and optimize data storage and retrieval, ensuring high performance and reliability.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
• Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
• Ensure data quality and integrity throughout the data lifecycle.

Required Skills:

• Strong proficiency in Python and experience with PySpark for data processing.
• Familiarity with Apache Airflow for workflow management.
• Experience with Snowflake or similar cloud data warehousing solutions.
• Solid understanding of data modeling, ETL processes, and data architecture principles.
• Excellent problem-solving skills and the ability to work independently as well as part of a team.

If you are passionate about data engineering and eager to contribute to innovative data solutions, we encourage you to apply for this exciting opportunity. Join us in leveraging data to drive business success and enhance our operational capabilities.