Data Engineer - AWS

Mactores is seeking an AWS Data Engineer (Senior) to join our team. The ideal candidate will have extensive experience in PySpark and SQL and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate must also have experience in data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.

Responsibilities

• Develop and maintain data pipelines using Amazon EMR or Amazon Glue.
• Create data models and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
• Build and maintain the orchestration of data pipelines using Airflow.
• Collaborate with other teams to understand their data needs and help design solutions.
• Troubleshoot and optimize data pipelines and data models.
• Write and maintain PySpark and SQL scripts to extract, transform, and load data.
• Document and communicate technical solutions to both technical and non-technical audiences.
• Stay up-to-date with new AWS data technologies and evaluate their impact on our existing systems.

Requirements

• Bachelors degree in Computer Science, Engineering, or a related field.
• 3+ years of experience working with PySpark and SQL.
• 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.

  Looking to get Placed? Try our Placement Guarantee Plan

  Get Hired
• 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
• 1+ years of experience building and maintaining the orchestration of data pipelines using Airflow.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills.
• Ability to work independently and within a team environment.
• AWS Data Analytics Specialty Certification
• Experience with Agile development methodology

This job was posted by Dhwani Thakkar from Mactores.