Data Engineer II

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
4-6 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago

This job is no longer accepting applications

It closed on 25 Sep 2023. Here are 6 live jobs like it - apply in one step.

See all live Data Science Analytics & Machine Learning jobs
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Purpose of Role:

We are looking for a senior data engineer to lead solutioning, design and implementation of ETL pipelines, analytics/reporting/visualization solutioning and data requirements for data sciences.

Location - Bangalore

Key Roles and Responsibilities:

  • Lead solutioning, design and implementation of ETL pipelines and data systems needed for analytics, business intelligence, reporting, and data sciences use cases.
  • Ensure data systems created are scalable, are easy to evolve, easy to debug and is easy to experiment
  • Optimize for storage, compute, and job run times. Strive for reducing the cost of infrastructure.
  • Contribute to tech stack choice and system architecture.
  • Solve to handle ever increasing scale of data, ensure data availability, correctness, completeness and freshness. Add necessary alerting to ensure data quality.
  • Ensure ease of maintenance, ease of debuggability, ease of experimentation and ease of evolution of use cases
  • Solve for both snapshot and incremental updates, batch and streaming use cases, fast access to data, etc
  • Contribute to design and architecture reviews, suggest data engineering best practices that should be adopted within the org.
  • Contribute to hiring outstanding engineers in the company, suggest improvements in hiring process
  • Mentor junior engineers and groom them to the next level.

Skills & Competency:

  • Experience with data modelling and building/scaling/evolving/maintaining large scale
  • ETL pipelines in public cloud environment
  • Experience in big data technologies (Hadoop, MapReduce, HDFS, Hive, Hbase, Presto, Spark, Flink, Avro, etc), streaming technologies (Storm, Kafka, etc)
  • Experience with one or more workflow management tools: Airflow, Azkaban, Luigi, Oozie, etc.
  • Experience in Python, any object oriented language (Java, Scala etc) and good expertise with object oriented design.
  • Experience with SQL and No-SQL data stores, tuning and scaling them.
  • Experience with one or more visualization tools
  • Experience with one or more analytics, slice/dice tools.
  • Experience working in any of the cloud computing environments such as AWS, Azure and GCP
  • Experience in using CI/CD pipelines.

Required Experiences:

  • Bachelors (4 years) or higher in Computer Science or related engineering discipline
  • 3+ years of experience in data engineering with 3+ years in role driving choice of solve, design,tech stack and scaling solves.

Preferred Experiences:

  • Possess technical leadership qualities
  • Extremely good at problem solving, is a self thinker.
  • Ability to multitask and thrive in a fast paced timeline-driven environment.
  • Good team player and ability to collaborate with others
  • Self driven and motivated, very high on ownership

Skills

AnalyticsBusiness IntelligenceData QualityEtlImplementationProblem SolvingPythonQualityReportingSqlVisualization

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

At DealShare, buy online home grocery items like snacks & drinks, fruits & veggies and personal care products.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.