Sr. Data Engineer (Python)

We are looking for an experienced Senior Data Engineer with 7+ years of expertise in designing, building, and managing large-scale data solutions on AWS. This role requires strong technical leadership, hands-on development skills, and the ability to architect robust data platforms that empower analytics, machine learning, and business intelligence across the organization.
Responsibilities

• Lead the design and implementation of scalable data architectures (data lakes, warehouses, and streaming systems).
• Build and optimize ETL/ELT pipelines for diverse data sources, ensuring high performance and reliability.
• Drive data governance, security, and compliance initiatives across all data platforms.
• Mentor junior engineers and provide technical guidance to cross-functional teams.
• Collaborate with stakeholders to translate business requirements into technical solutions.

• Implement automation and monitoring frameworks to ensure operational excellence.
• Evaluate and adopt emerging AWS services and modern data engineering tools to enhance capabilities.
  

Requirements

• 7+ years of professional experience in data engineering, with at least 4+ years working on AWS.
• Deep expertise in AWS services: S3 Glue, Redshift, Athena, EMR, Kinesis, DynamoDB, Lambda, and Step Functions.
• Strong proficiency in SQL, Python, and Spark for data processing and pipeline development.

• Looking to get Placed? Try our Placement Guarantee Plan

  Get Hired
  Proven experience with workflow orchestration tools (Airflow, Dagster, Step Functions).
• Solid understanding of data modeling, partitioning strategies, and performance tuning.
• Hands-on experience with CI/CD pipelines, Git, and Infrastructure-as-Code (Terraform/CloudFormation).
• Familiarity with containerization (Docker, Kubernetes) and microservices-based architectures.
• Experience in architecting enterprise-scale data platforms.
• Exposure to machine learning pipelines and advanced analytics.
• Strong problem-solving and leadership skills, with the ability to influence technical direction.
  

This job was posted by Gowripriya P from Cloudesign.