Data Engineer - ETL/Data Pipeline

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
3-8 years
Mumbai, Maharashtra, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Responsibilities
  • Design, implement, and manage end-to-end data pipelines using Apache Airflow to extract, transform, and load data from various sources into AWS data stores (S3, Redshift, etc.).
  • Utilize a wide range of AWS services, including but not limited to EC2, S3, Lambda, Glue, EMR, and Redshift, to build scalable and cost-effective data solutions.
  • Develop ETL workflows using Airflow to cleanse, enrich, and transform raw data into formats suitable for analysis and reporting.
  • Design and maintain data storage solutions on AWS, ensuring data is stored securely and efficiently.
  • Implement security measures and best practices to protect sensitive data and comply with data privacy regulations.
  • Automate repetitive tasks and data workflows using Airflow DAGs, reducing manual intervention and improving workflow efficiency.
Eligibility :
  • Proven experience as a Data Engineer with hands-on experience in AWS cloud services and Apache Airflow.
  • Strong proficiency in Python for scripting and data manipulation tasks.
  • In-depth knowledge of AWS services for data processing, storage, and analytics.
  • Familiarity with big data technologies such as Hadoop, Spark, and NoSQL databases is a plus.
  • Experience with data warehousing concepts and data modeling.
  • Strong understanding of ETL principles and data integration techniques.
  • Knowledge of version control systems like Git for code management and collaboration.
(ref:hirist.com)

Skills

AnalyticsData IntegrationData ManipulationData ModelingData ProcessingData WarehousingEtlPythonReporting

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Mumbai.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.