An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
- Design, build, and maintain scalable batch and real-time data pipelines.
- Develop ETL/ELT workflows to ingest, transform, and integrate data from multiple internal and external sources.
- Build and maintain data warehouse/lakehouse solutions to support analytics and AI/ML workloads.
- Develop robust data models and transformation pipelines using SQL and Python.
- Optimize data storage, query performance, and processing efficiency across cloud platforms.
- Collaborate with Data Science and ML teams to build production-ready datasets and feature pipelines.
- Implement monitoring, testing, and automation to ensure reliability and scalability of data pipelines.
- Contribute to data architecture, engineering standards, and best practices while ensuring secure and compliant data handling.
- Strong experience designing and building production-grade ETL/ELT pipelines.
- Experience with batch and streaming data processing.
- Good understanding of data modeling, warehouse/lakehouse architecture, and performance optimization.
- Strong Python programming skills.
- Advanced SQL.
- Hands-on experience with Apache Spark (PySpark preferred).
- Scala is a plus.
- Experience with one or more cloud ecosystems and modern analytical platforms:
- AWS, Azure, or GCP
- Snowflake, Databricks, Amazon Redshift, Google BigQuery, or Azure Synapse
- Lakehouse technologies such as Delta Lake, Apache Iceberg, or Apache Hudi
- Apache Spark
- Apache Kafka or AWS Kinesis
- Airflow, Dagster, or Prefect
- dbt
- PostgreSQL, MySQL, or other relational databases
- Experience with NoSQL databases such as MongoDB is a plus.
- Docker and Kubernetes
- Infrastructure as Code (Terraform preferred)
- CI/CD for data engineering workflows
- 5–7 years of hands-on experience in Data Engineering.
- Experience building cloud-native data platforms at scale.
- Exposure to AI/ML data pipelines is preferred.
- Experience in fintech, banking, SaaS, or other data-intensive products is a plus.
- Strong problem-solving skills and the ability to work independently in a fast-paced environment.
Skills
PythonScalaSQLNoSQLMachine LearningData ScienceData EngineeringApache SparkPySparkKafkaAirflowDbtSnowflakeDatabricksBigQueryIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allNew Data Science Analytics & Machine Learning roles in Indore.
One email a day. Unsubscribe any time.

