Lead- Data Engineering

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
4-7 years
Gurugram, Haryana, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

  • As a lead Engineer, mentor junior engineers and be a role model with skill set and attitude.
  • Drive to remain updated in technology by connecting with Industry and organizational technology evolutions.
  • As a lead of the big data team, lead a component design/development and implement scalable big data platform framework and services.
  • Ability to use data to drive products and decisions. Be able to explain complex technical concepts to various stakeholders leadership team, product managers, support, and other engineers.
  • You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS.
  • Design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In----Memory Cache, Query Layer (SQL), Rule Engine and Action Framework ).
  • Design and Implemented Data Access Layer, which can connect to various data sources and uses advanced caching techniques to provide fast responses to real time SQL queries using Big Data Technologies.
  • Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies; spark architecture, Kafka, any Cloud computing etc.
  • Collaborate with leadership to define and set standards for engineering rigor and help cultivate the culture in the team.

Requirements:

  • 7.5-9 years of hands-on software/data engineering experience
  • Exp. in building large scalable and reliable enterprise technology platforms using Big Data open-source technologies such as Java, Hadoop, Spark, Kafka
  • Hands-on with one of the programming language java/scala/python.
  • Exp. in Data Storage: Good understanding of SQL & NoSQL Data bases. Mysql, Mongo.
  • Familiar with cloud solutions for data infrastructure. AWS Preferably.
  • Good hands on one of the data handling frameworks - Spark, Apache Beam, Apache flink etc
  • Familiar with different types of data formats - Apache Parquet, Avro, ORC etc.
  • Proficient with distributed file system and computations concepts.
  • Prior team handling and stakeholder management exp. is must.

Skills

ImplementationMysqlSqlStakeholder ManagementTeam Handling

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Common Services Centers (CSC) are one of the crucial enablers of the Digital India Programme. They are the access points for delivery of various e-governance.Digital India is a flagship programme of the Government of India with a vision to transform India into a digitally empowered society and knowledge economy.

Similar Jobs

View all
Loading...
Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Gurugram.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.