An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
Description
We are seeking a highly skilled AWS Certified Data Engineer (Associate) with strong expertise in Python, PySpark, SQL, and AWS Cloud services. The ideal candidate will be responsible for building scalable data pipelines, designing robust data architectures, and enabling high-quality, model-ready datasets for analytics and machine learning use cases.
This role requires deep hands-on experience in ETL/ELT pipeline development, cloud-based data processing, database design, and infrastructure automation within the AWS ecosystem.
Key Responsibilities
- Data Ingestion & Processing :
- Ingest raw data from multiple sources including network logs, customer systems, APIs, and third-party platforms.
- Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark.
- Transform and curate large datasets into clean, structured, and analytics-ready formats.
- Optimize data processing workflows for performance and cost efficiency on AWS.
- Feature Engineering & Metadata Management :
- Build and automate feature pipelines in collaboration with Data Scientists.
- Develop reusable data transformation frameworks.
- Maintain feature stores and metadata repositories to ensure data consistency and explainability.
- Implement data validation and quality checks across pipelines.
- Model Integration & Data Outputs :
- Design mechanisms to store, version, and serve model outputs.
- Ensure full data lineage from source ingestion to business reporting layers.
- Support integration of ML model predictions into downstream applications.
- Maintain data governance and documentation standards.
- Infrastructure & Automation :
- Implement Infrastructure-as-Code (IaC) using tools like Terraform or CloudFormation.
- Deploy and manage data services on AWS Cloud.
- Automate job scheduling, monitoring, and alerting for ETL workflows.
- Ensure high availability, scalability, and security of data systems.
Programming & Data Processing :
- Strong proficiency in Python
- Hands-on experience with PySpark for distributed data processing
- Advanced SQL query writing and performance optimization
- Experience in building scalable ETL/ELT pipelines
- AWS Certified Data Engineer Associate (Preferred)
- Strong knowledge of AWS services such as :
- S3
- EMR
- Glue
- Redshift
- Lambda
- RDS
- Kinesis
- Experience managing cloud-native data architectures
- Experience in relational and NoSQL database design
- Data modeling (Star schema, Snowflake schema)
- Query optimization and indexing strategies
- Strong problem-solving and analytical skills
- Understanding of CI/CD pipelines
- Experience with version control (Git)
- Knowledge of data governance and lineage tools
- Experience working with large-scale distributed data systems
- Exposure to feature store architecture
- Experience supporting Machine Learning pipelines
- Familiarity with containerization (Docker, Kubernetes) is a plus
(ref:hirist.tech)
Skills
Data ValidationPythonData GovernanceData ModelingEtlData ProcessingMachine LearningSnowflakeData EngineerAnalyticsMlSqlIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Itanagar.
One email a day. Unsubscribe any time.

