Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
1-5 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

What are we looking for?We hire the best engineering minds and nurture them to solve tough engineering problems in the retail ecosystem. We are solving complex problems in B2C, B2B retail, Fintech and data platforms and we are always on the lookout for great talent who are intrinsically motivated by the desire to solve hard problems.As a data engineer, you will be responsible for ideating, designing, developing and maintaining all the engineering building blocks which are required to keep the data consistent, reliable and consumable.We expect our data engineers to
  • Architect the Data lake and Data warehouse infrastructure to enable the users to execute business intelligence, data analytics, data science and ML/AI workloads
  • Design, develop and maintain data pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Build workflow orchestration tools to enable users to run periodic jobs on our data infrastructure
  • Build frameworks for data processing jobs to run decision science workloads such as personalisation, fraud detection, optimisation algorithms and more
  • Building observability over the data pipelines to maintain consistent data with an agreed upon latency
  • Ideate processes to maintain the health of the infrastructure such as cpu, memory monitoring, query monitoring, workload monitoring and educate the teams to follow the best practices. Set the standards high.
  • Work closely with decision scientists, data analysts and product managers to understand their data needs, their technical issues and help them in performance tuning.
  • Keep the data secure from the external world and have fine grained access control within the organization to make sure that only relevant data is available to every user.
  • Create or integrate with tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
To cater to the above responsibilities, we need our data engineers to be equipped with
  • Proven experience in Data engineering role with at least 1-5 years of experience
  • High sense of ownership and strong decision making skills backed by first principles thinking
  • Strong analytical skills to break down the complex problems and build the right solutions
  • Good knowledge on data engineering concepts such as ETL pipelines, building data lake, building data warehouses/ data marts, Stream and event processing, distributed processing of large scale data.
  • Experience building and optimising big data data pipelines, architectures and data sets.
  • In depth knowledge in data warehousing concepts and familiarity with at least one of the warehousing tools such as Amazon Redshift, Snowflake and more.
  • Strong SQL knowledge and understanding of performance tuning techniques
  • Good knowledge of big data tools such as Hadoop, Apache Spark, Apache Druid, S3, Glue, Athena, Flink, Airflow, etc.
  • Good exposure on streaming technologies like Kafka, SQS, Kinesis
  • Good understanding of SQL and NoSql databases
  • Experience with Amazon web services or Google Cloud Platform.
  • Proficient in Java, Scala or Python.
  • Experience in machine learning workloads is a plus
  • Experience in supporting and working with product managers, decision scientists and data analysts in a dynamic environment
Why is this role important to us?Jumbotail has always been a technology-first organization. Over the years, we have built many products to help our retailers, our sellers, our supply chain, and logistics heroes, our credit partners, and a lot of internal teams.Till January 2021, we were completely focused on helping retailers in Bangalore and strengthening our business model. Over the last year, we started scaling across the geographies, and currently, we are present in tens of cities across India. Our systems had to scale 7X to support this and we had to build a lot of new products to cater to increased scale.With the recent round of $85m, we are set to scale across India and we need to scale our systems by building next-generation technology to cater to the hyper-scale . We need to invest heavily in our Search systems, Recommendation engines, Offer & Merch systems, Order processing systems, Seller Platforms, Pricing Engines, Supply chain & logistics systems, financial systems, new J24 retail platforms, and Credit systems to make sure we are providing the best experience to our customers. Currently we are serving lakhs of retailers across the nation and delivering millions of shipments every month and we need to scale them atleast to 10X further.Jumbotail as an organization is committed to data democratization and all the product, business decisions happen through drawing insights from data. We have tens of applications, hundreds of microservices that are generating data every second. Thus, having consistent, reliable data which is stored and made available in a way that it can be analyzed (real-time and historical) from various dimensions is a must for us.As we are rapidly scaling across India to hundreds of cities, the volume of data we are collecting, processing, and analyzing is growing exponentially. We need to be prepared for the scale, future proof our systems and build the essential building blocks to help our decision science & data analytics teams and product teams derive meaningful insights and make impactful decisions.

Skills

AnalyticsBusiness IntelligenceData AnalyticsData ProcessingData ScienceData WarehousingDesigningEtlMachine LearningPythonSnowflakeSqlTransformation

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Jumbotail is an online platform for wholesale buyers/retailers to procure their groceries, fruits, and vegetables from producers/manufacturers. The product is yet to be launched, claims to be developing the backend operations, sourcing, and logistics. Raised $2M from Nexus VP in its seed round of funding in Jul'16 and raised another $8.5M in its Series A round of funding in Jul'17 from Nexus VP and Kalaari Capital

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.