An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
- Design, implement, and manage end-to-end data pipelines using Apache Airflow to extract, transform, and load data from various sources into AWS data stores (S3, Redshift, etc.).
- Utilize a wide range of AWS services, including but not limited to EC2, S3, Lambda, Glue, EMR, and Redshift, to build scalable and cost-effective data solutions.
- Develop ETL workflows using Airflow to cleanse, enrich, and transform raw data into formats suitable for analysis and reporting.
- Design and maintain data storage solutions on AWS, ensuring data is stored securely and efficiently.
- Implement security measures and best practices to protect sensitive data and comply with data privacy regulations.
- Automate repetitive tasks and data workflows using Airflow DAGs, reducing manual intervention and improving workflow efficiency.
- Proven experience as a Data Engineer with hands-on experience in AWS cloud services and Apache Airflow.
- Strong proficiency in Python for scripting and data manipulation tasks.
- In-depth knowledge of AWS services for data processing, storage, and analytics.
- Familiarity with big data technologies such as Hadoop, Spark, and NoSQL databases is a plus.
- Experience with data warehousing concepts and data modeling.
- Strong understanding of ETL principles and data integration techniques.
- Knowledge of version control systems like Git for code management and collaboration.
Skills
AnalyticsData IntegrationData ManipulationData ModelingData ProcessingData WarehousingEtlPythonReportingIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Mumbai.
One email a day. Unsubscribe any time.

