Data Engineer - (Migration & Profiling)? Big Data

Department Icon Data Science Analytics & Machine Learning
Posted: 1 day ago
2-5 years
Mumbai, India | Pune, India | Noida, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 10 Jan 2027

Posted: 1 day ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Job Description

Data Engineer - (Migration & Profiling)

Location: Remote

BGV: Basic

Description
● 5-7 yrs of IT experience
● Good understanding of analytics tools for effective analysis of data
● Should be able to lead teams
● Should have been part of the production deployment team, Production Support team
● Experience with Big Data tools- Hadoop, Spark, Apache Beam, Kafka, etc.
● Experience with object-oriented/object function scripting languages: Python, Java, C++,
Scala, etc.
● Experience with any DW tools like BQ, Redshift, Synapse, or Snowflake
● Experience in ETL and Data Warehousing.
● Experience and firm understanding of relational and non-relational databases like MySQL,
MS SQL Server, Postgres, MongoDB, Cassandra, etc.
● Experience with cloud platforms like AWS, GCP and Azure.
● Experience with workflow management using tools like Apache Airflow.

Role
● Roles & Responsibilities
● Develop high-performance and scalable solutions using GCP that extract, transform, and
load big data.
● Designing and building production-grade data solutions from ingestion to consumption using
Java / Python
● Design and optimize data models on the GCP cloud using GCP data stores such as
BigQuery
● Should be able to handle the deployment process
● Optimizing data pipelines for performance and cost for large-scale data lakes.
● Writing complex, highly optimized queries across large data sets and creating data
processing layers.
● Closely interact with Data Engineers to identify the right tools to deliver product features by
performing POC
● Collaborative team player that interacts with business, BAs, and other Data/ML engineers
● Research new use cases for existing data.
● Preferred:
● Need to be Aware of Design Best practices for OLTP and OLAP Systems
● Should be part of team designing the DB and pipeline
● Should have exposure to Load testing methodologies, Debugging pipelines and Delta load
handling
● Worked on heterogeneous migration projects
● Role
●
● Develop high-performance and scalable solutions using GCP that extract, transform, and
load big data.
● Designing and building production-grade data solutions from ingestion to consumption using
Java / Python
● Design and optimize data models on the GCP cloud using GCP data stores such as
BigQuery

● Should be able to handle the deployment process
● Optimizing data pipelines for performance and cost for large-scale data lakes.
● Writing complex, highly optimized queries across large data sets and creating data
processing layers.
● Closely interact with Data Engineers to identify the right tools to deliver product features by
performing POC
● Collaborative team player that interacts with business, BAs, and other Data/ML engineers
● Research new use cases for existing data.

Skills

PythonJavaC++ScalaSQLHadoopKafkaAirflowSnowflakeBigQueryRedshiftETLData WarehousingMySQLMongoDB

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...
Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Mumbai.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.