Senior Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
5-7 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago

This job is no longer accepting applications

It closed on 31 Jul 2023. Here are 6 live jobs like it - apply in one step.

See all live Data Science Analytics & Machine Learning jobs
Job Description
Similar Jobs
Please verify your account first! Send OTP

Job Description

Our Story

Zepto is a fast-growing startup that delivers groceries in 10 minutes flat through an optimized network of dark stores that were building across the country! We’re scaling up rapidly across India with operations live across Mumbai, Bangalore, Delhi, Noida, Ghaziabad, Gurgaon, Chennai, Pune, Kolkata, and Hyderabad.

We are incredibly well funded – we recently announced fundraising from Indian and Global investors that include Y Combinator, Nexus Venture Partners, Glade Brook, and more! We’ve also built out one of the best startup teams in India, with Senior Executives from Uber, Flipkart, Dream11, and institutions like Stanford, INSEAD, IIM, and IIT.

Responsibilities:

  • Designing and implementing the Zepto Data platform with real-time analytics capabilities.
  • Designing and implementing data processing pipelines for different kinds of data sources, formats, and content for the Zepto Data Platform.
  • Designing and implementing a platform to enable data transformations and enrichment to support a seamless scalable analytics experience.
  • Developing techniques to analyze and enhance both structured and unstructured data.
  • Capacity planning and specification of resource requirements for different deployment scenarios and business requirements.
  • Own a sizable component of the Zepto Data Platform and ensure its scalability and reliability with robust observability.
  • Gather feedback from stakeholders for improvement in our Data infrastructure.
  • Lead and encourage documentation, tech excellence, and operational excellence.
  • Adopt agile practices to track and update the status of planned tasks/stories.
  • Mentor and guide a few junior Data Engineers.

Requirements:

  • 5+ years of relevant experience in the field of Data Engineering
  • Proficient in building data platforms (architecture, storage, query processing, observability, etc. ).
  • Experience building/working with Lakehouse architecture.
  • Experience working with different file formats like Parquet, ORC, Avro, JSON, etc, and different data lake formats like Delta Lake, Iceberg, Hudi, etc.
  • Strong Python programming skills with the ability to implement OOPs and functional programming. Knowledge of Scala/Java would be a plus.
  • Strong knowledge of RDBMS and NoSQL databases. Knowledge of Graph databases will be a plus.
  • Strong expertise in building & optimizing data pipelines, architectures, and data sets.
  • Familiarity with big data infrastructure like MapReduce, jo, HDFS, YARN, HBase, etc.
  • Experience building ETL pipelines using ETL tools like Informatica, Talend, Hevo, etc.
  • Experience using orchestration frameworks like Airflow, Oozie, Luigi, etc.
  • Experience using Spark/Flink, and building jobs using Python/Scala/Java.
  • Knowledge of building stream processing platforms using Spark/Flink Streaming, Storm, etc.
  • Knowledge of building REST API endpoints for data consumption.
  • Knowledge of implementing CI/CD on the pipelines is a plus.
  • Experience building self-service tools for analytics would be a plus.
  • Knowledge of the ELK stack would be a plus.
  • Knowledge of Containerization (Docker/Kubernetes) will be a plus.
  • Experience working with one of the popular Public Cloud-based platforms is preferred.
  • Excellent oral and written communication is a must.
  • Well-versed with Agile methodologies and experience in working with scrum teams.
  • Ability to understand business requirements and translate them into technical requirements.
  • A knack for benchmarking and optimization.

Skills

AgileAnalyticsData ProcessingEtlOperational ExcellenceOperationsPythonScrum

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.