Data Engineer - Python/SQL/ETL

Department Icon Data Science Analytics & Machine Learning
149+ Applicants
Posted: 5 months ago
0-1 years
Itanagar, Arunachal Pradesh
work from office

Posted: 5 months ago
|
Applicants: 149+
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

Description
We are seeking a highly skilled AWS Certified Data Engineer (Associate) with strong expertise in Python, PySpark, SQL, and AWS Cloud services. The ideal candidate will be responsible for building scalable data pipelines, designing robust data architectures, and enabling high-quality, model-ready datasets for analytics and machine learning use cases.
This role requires deep hands-on experience in ETL/ELT pipeline development, cloud-based data processing, database design, and infrastructure automation within the AWS ecosystem.
Key Responsibilities
  • Data Ingestion & Processing :
  • Ingest raw data from multiple sources including network logs, customer systems, APIs, and third-party platforms.
  • Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark.
  • Transform and curate large datasets into clean, structured, and analytics-ready formats.
  • Optimize data processing workflows for performance and cost efficiency on AWS.
  • Feature Engineering & Metadata Management :
  • Build and automate feature pipelines in collaboration with Data Scientists.
  • Develop reusable data transformation frameworks.
  • Maintain feature stores and metadata repositories to ensure data consistency and explainability.
  • Implement data validation and quality checks across pipelines.
  • Model Integration & Data Outputs :
  • Design mechanisms to store, version, and serve model outputs.
  • Ensure full data lineage from source ingestion to business reporting layers.
  • Support integration of ML model predictions into downstream applications.
  • Maintain data governance and documentation standards.
  • Infrastructure & Automation :
  • Implement Infrastructure-as-Code (IaC) using tools like Terraform or CloudFormation.
  • Deploy and manage data services on AWS Cloud.
  • Automate job scheduling, monitoring, and alerting for ETL workflows.
  • Ensure high availability, scalability, and security of data systems.
Required Skills & Technical Expertise
Programming & Data Processing :
  • Strong proficiency in Python
  • Hands-on experience with PySpark for distributed data processing
  • Advanced SQL query writing and performance optimization
  • Experience in building scalable ETL/ELT pipelines
Cloud & AWS Services
  • AWS Certified Data Engineer Associate (Preferred)
  • Strong knowledge of AWS services such as :
  • S3
  • EMR
  • Glue
  • Redshift
  • Lambda
  • RDS
  • Kinesis
  • Experience managing cloud-native data architectures
Database & Architecture
  • Experience in relational and NoSQL database design
  • Data modeling (Star schema, Snowflake schema)
  • Query optimization and indexing strategies
Other Skills
  • Strong problem-solving and analytical skills
  • Understanding of CI/CD pipelines
  • Experience with version control (Git)
  • Knowledge of data governance and lineage tools
Preferred Qualifications
  • Experience working with large-scale distributed data systems
  • Exposure to feature store architecture
  • Experience supporting Machine Learning pipelines
  • Familiarity with containerization (Docker, Kubernetes) is a plus
(ref:hirist.tech)

Skills

Data ValidationPythonData GovernanceData ModelingEtlData ProcessingMachine LearningSnowflakeData EngineerAnalyticsMlSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

R Systems is a global digital transformation leader providing AI-driven solutions and services that empower clients to innovate and improve their customers' experiences. Founded in 1993, we are a design-led digital engineering company with integrated product engineering, cloud, automation, data, and analytics capabilities. Our 3,800+ experts work across technology, media and telecom, healthcare, finance, and retail to accelerate digital transformation for companies around the world.

Important dates & deadlines?

Application Deadline

08 May 26, 04:05 PM IST

Similar Jobs

View All
Loading...
Bag Logo
Jobaaj
Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

Data Engineer - Python/SQL/ETL

Share with