Data Engineer III

Purpose of Role:

Lead data engineer / architect will lead overall data strategy for data collection, ETL, analytics, reporting, visualization and data requirements for data sciences.

Reporting and location

Incumbent will be reporting into the Engineering Manage/Director of Engineering and will be based out of Bangalore Location

Key Roles and Responsibilities:

• Lead the tech vision and roadmap for the data strategy to solve for evolving business needs, rapidly growing data scale and data science requirements.
• Influence leadership on key tech investments to make and drive disproportionate impact through tech.
• Responsible for choice of tech stack, complete design and architecture of data systems
• Create scalable, easy to evolve offline jobs/ETL pipelines.
• Optimise for storage, compute, etc. and have laser focus on reducing cost of infrastructure.
• Solve to handle ever increasing scale of data, ensure data availability, correctness, completeness and freshness.
• Add necessary alerting to ensure data quality.
• Create scalable and efficient solves for business intelligence, analytics, reporting and visualization and other data solutions to be used by the entire organization.
• Ensure ease of maintenance, ease of debuggability, ease of experimentation and ease of evolution of use cases.
• Solve for both snapshot and incremental updates, batch and streaming use cases, fast access to data, etc
• Lead design and architecture reviews, drive data engineering best practices within the org.
• 
  Lead in hiring outstanding engineers in the company, improve the hiring process.
• Mentor junior data engineers and groom them to the next level.

Skills & Competency:

• Experience with data modelling and building/scaling/evolving/maintaining large scale ETL pipelines in public cloud environment
• Experience in big data technologies (Hadoop, MapReduce, HDFS, Hive, Hbase, Presto, Spark, Flink, Avro, etc), streaming technologies (Storm, Kafka, etc)
• Experience with one or more workflow management tools: Airflow, Azkaban, Luigi,Oozie, etc.
• Experience in any object oriented language (Java, Scala etc) and good expertise with object oriented design.
• Experience with SQL and No-SQL data stores, tuning and scaling them.
• Experience with one or more visualization tools
• Experience with one or more analytics, slice/dice tools.
• Experience working in any of the cloud computing environments such as AWS, Azure and GCP
• Experience in using CI/CD pipelines.

Interactions:

• Internal Stakeholders: Business analysts, product managers, business owners, backend/front end engineers

Required Experiences:

• Bachelors (4 years) or higher in Computer Science or related engineering discipline
• 7+ years of experience in data engineering with 2+ years in lead role driving choice of solve, design, tech stack and scaling solves.

Preferred Experiences:

● Possess technical leadership qualities

● Extremely good at problem solving, is a self thinker.

● Ability to multitask and thrive in a fast paced timeline-driven environment.

● Good team player and ability to collaborate with others

● Self driven and motivated, very high on ownership

About Dealshare:

A fast-growing e-commerce startup, DealShare is a hyperlocal online buying platform for multi-category consumer products focused on the new WhatsApp first India. Our mission is to target the new 500Mn users from non-metro cities and rural market spaces who havent shopped enough online and are uncomfortable on other platforms. These users are primarily on mobile & social media. DealShare makes it extremely easy for these users to buy in a couple of clicks, supported by vernacular browsing.

Further, it allows the users to share deals with their friends and avail discounts if their friends purchase the products via the share link. It is a new retail model in which customers get products at cheaper than wholesale rates. The idea is around demand aggregation (C2B) of mass-market products using social virality, thereby significantly reducing operational costs. Our product catalogue includes fruits & vegetables, grocery items, beauty & wellness, baby care, pet care, fashion accessories, electronics, home décor etc.

Weve made quite the impression by being one of Indias quickest entrants to the Unicorn club. Setting king-sized goals, we are all set to expand to 200 cities across 20 states, welcoming 50 million new customers! Currently valued at $1.63 Bn, we are gearing up to explore International markets.

Come, build for Bharat, and challenge yourself in the process.

Learn new skills, hone existing ones and grow with the company.