Data Engineer II

Department Icon Data Science Analytics & Machine Learning
149+ Applicants
Posted: 2 years ago
2-4 years
Bengaluru, Karnataka, India
Work From Office

Posted: 2 years ago
|
Applicants: 149+
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

Were looking for motivated and self-managing Data Engineers who will work on Data Pipelines, Feature Stores, and Machine Learning Inference Pipelines.

Responsibilities

  • Create/contribute to System Design.
  • Design, build and manage Data Ingestion, and transformation pipelines designed for high throughput/low latency.
  • Own a range of data engineering pipelines in production.
  • Work with Backend Engineers, Data Analysts/Data Scientists to plan Data and API contracts, and final dashboards and viz. available to the end users.
  • Stick to a focused build-and-ship approach with a razor-sharp focus on end-user experience.
  • Communicate potential roadblocks and trade-offs between performance and complexity upfront.

Requirements

    Looking to get Placed? Try our Placement Guarantee Plan

  • Strong hands-on working knowledge of Spark/PySpark and building ETL/ELT pipelines, with a focus on best practices such as Idempotence, Incremental data scans, etc.
  • Good understanding of databases, and the pros and cons of different storage patterns.
  • Hands-on experience with Airflow.
  • Knowledge of AWS or GCP is mandatory.
  • Knowledge of Rest APIs is preferred/is a plus.

This job was posted by Soumanta Das from Yugen.ai.

Skills

DashboardsEtlMachine LearningTransformation

If an employer asks you to pay any kind of fee, please notify us immediately. Jobaaj does not charge any fee from the applicants and we do not allow other companies also to do so.

About Company

Yugen is building a comprehensive data platform for the modern enterprise. We are solving the biggest problem that plagues enterprises today – fragmented and siloed data. Our platform enables enterprises to unify their data from various sources, transform it into a consistent format, and derive actionable insights.

Important dates & deadlines?

Application Deadline

03 Oct 23, 09:56 AM IST

Similar Jobs

View All
Loading...
Bag Logo
Jobaaj
Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

Data Engineer II

Share with