Data Engineer II

Purpose of Role:

We are looking for a senior data engineer to lead solutioning, design and implementation of ETL pipelines, analytics/reporting/visualization solutioning and data requirements for data sciences.

Location - Bangalore

Key Roles and Responsibilities:

• Lead solutioning, design and implementation of ETL pipelines and data systems needed for analytics, business intelligence, reporting, and data sciences use cases.
• Ensure data systems created are scalable, are easy to evolve, easy to debug and is easy to experiment
• Optimize for storage, compute, and job run times. Strive for reducing the cost of infrastructure.
• Contribute to tech stack choice and system architecture.
• Solve to handle ever increasing scale of data, ensure data availability, correctness, completeness and freshness. Add necessary alerting to ensure data quality.
• Ensure ease of maintenance, ease of debuggability, ease of experimentation and ease of evolution of use cases
• Solve for both snapshot and incremental updates, batch and streaming use cases, fast access to data, etc
• Contribute to design and architecture reviews, suggest data engineering best practices that should be adopted within the org.
• Contribute to hiring outstanding engineers in the company, suggest improvements in hiring process
• Mentor junior engineers and groom them to the next level.
  

Skills & Competency:

• Experience with data modelling and building/scaling/evolving/maintaining large scale
• ETL pipelines in public cloud environment
• Experience in big data technologies (Hadoop, MapReduce, HDFS, Hive, Hbase, Presto, Spark, Flink, Avro, etc), streaming technologies (Storm, Kafka, etc)
• Experience with one or more workflow management tools: Airflow, Azkaban, Luigi, Oozie, etc.
• Experience in Python, any object oriented language (Java, Scala etc) and good expertise with object oriented design.
• Experience with SQL and No-SQL data stores, tuning and scaling them.
• Experience with one or more visualization tools
• Experience with one or more analytics, slice/dice tools.
• Experience working in any of the cloud computing environments such as AWS, Azure and GCP
• Experience in using CI/CD pipelines.

Required Experiences:

• Bachelors (4 years) or higher in Computer Science or related engineering discipline
• 3+ years of experience in data engineering with 3+ years in role driving choice of solve, design,tech stack and scaling solves.

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired

Preferred Experiences:

• Possess technical leadership qualities
• Extremely good at problem solving, is a self thinker.
• Ability to multitask and thrive in a fast paced timeline-driven environment.
• Good team player and ability to collaborate with others
• Self driven and motivated, very high on ownership

About Dealshare:

A fast-growing e-commerce startup, DealShare is a hyperlocal online buying platform for multi-category consumer products focused on the new WhatsApp first India. Our mission is to target the new 500Mn users from non-metro cities and rural market spaces who havent shopped enough online and are uncomfortable on other platforms.

These users are primarily on mobile & social media. DealShare makes it extremely easy for these users to buy in a couple of clicks, supported by vernacular browsing.

Further, it allows the users to share deals with their friends and avail discounts if their friends purchase the products via the share link. It is a new retail model in which customers get products at cheaper than wholesale rates. The idea is around demand aggregation (C2B) of mass-market products using social virality, thereby significantly reducing operational costs. Our product catalogue includes fruits; vegetables, grocery items, beauty wellness, baby care, pet care, fashion accessories, electronics, home décor etc.

We have made quite the impression by being one of India's quickest entrants to the Unicorn club. Setting king-sized goals, we are all set to expand to 200 cities across 20 states, welcoming 50 million new customers!

Come, build for Bharat, and challenge yourself in the process.

Learn new skills, hone existing ones and grow with the company.