Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
3-5 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Requirements
  • Must be from data engineering - background with 3+ years of experience
  • Experience in advanced Apache Spark processing framework, and spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting.
  • Experience in working with Core Spark, Spark Structured Streaming, Data Frame API, Data set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data. Specifically, this experience must be in writing "Big Data data engineering jobs for large-scale data integration in AWS.
  • Experience in writing spark streaming jobs integrating with streaming frameworks such as Apache Kafka or AWS Kinesis.
  • Knowledge of using, setting up and tuning resource management frameworks for spark.
  • Experience working with external job schedulers such as autosys, aws data pipeline, airflow etc.
  • Experience in AWS services such as EMR, Glue, S3 Athena, IAM, Lambda and Cloud watch is required.
This job was posted by Gajendiran M from Dish Network Technologies.

Skills

Data IntegrationSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

DISH Network Corporation, connects people and things through its ecosystem of digital entertainment and smart technology. We’re driven by curiosity, pride, adventure and a desire to win – it’s in our DNA. We’re delivering solutions that give our customers control over their lives, connecting them to what they care about most. The DISH Network’s India center, DISH Network Technologies (DNT) was established in Bangalore in 2007. DNT today employs over 1400 talented individuals and has built capabilities that span across all technology and product verticals. We believe in creating an environment where talented and passionate people are empowered to achieve their full potential.
Read More

Similar Jobs

View all
Loading...
Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.