Specialist - Data Engineering

Department Icon Data Science Analytics & Machine Learning
Posted: 1 week ago
2-5 years
Select Location, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 8 Jan 2027

Posted: 1 week ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Position Details

  • Title Senior Data Engineer
  • Level Specialist
  • Experience 5 years
  • Function Data Engineering Big Data
  • Employment Type Full time
  • Role Overview

We are seeking a Senior Data Engineer to design build and optimize robust batch and real time data pipelines The ideal candidate is hands on with Apache Spark and Apache Beam proficient in JavaScalaPythonSQL and experienced in ingesting data into Teradata and PostgreSQL You will collaborate closely with business stakeholders to translate reporting needs into scalable high quality ETLELT solutions

  • Key Responsibilities
  • Design develop and maintain batch and streaming ETLELT pipelines using Apache Spark and Apache Beam
  • Ingest and extract data from diverse sources databases APIs files using Java Python Scala and SQL
  • Transform and cleanse data leveraging Java Scala Python PySpark and Spark Scala ensure data is analytics ready
  • Build efficient ingestion pipelines into Teradata PostgreSQL and other relationalanalytical data stores
  • Demonstrate strong mastery of file formats JSON CSV Parquet Excel ORC XML
  • Strong experience in streaming jobs with Confluent Kafka Apache Kafka Spark and Flink
  • Partner with business stakeholders to understand reporting needs and convert them into effective maintainable data pipelines
  • Implement data quality checks validation rules and monitoring to ensure accuracy consistency and completeness
  • Optimize existing pipelines and perform cluster health performance tuning resource allocation caching partitioning job orchestration
  • Document pipelines and transformations design decisions data lineage runbooks

Troubleshoot and resolve data related issues across environments devqaprod and uphold SLAs

Skills

PythonJavaScalaSQLData EngineeringExcelApache SparkPySparkKafkaPostgreSQLApache

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Larsen & Toubro is a multinational company engaged in EPC Projects, Hi-Tech Manufacturing and Services.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Select Location.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.