Interesting Job Opportunity: Big Data Engineer - Spark/Hadoop

Aos Products
  • 1 month ago
  • Bengaluru East, Karnataka, India
  • Full Time
Please verify your account first! Send OTP

Job Overview

Functional Area

Data

Work preferred

Work from Office

Experience

Min Experience

3 Years

Max Experience

8 Years

Description

Role: Big Data Engineer


Type: Full Time


Job Description


Role and responsibilities :


  • Front Door (Requirements, Metadata collection, classification & security clearance)
  • Data pipeline template development
  • Data pipeline Monitoring development & support (operations)


Technical Skills Requirements


  • Two years of experience building production-quality software infrastructure
  • Ability to own and deliver on large, multi-faceted projects
  • Fluency in SQL and experience with RDBMSs (BigData, Spark, PySpark, Flink, sparkML, NiFi, Hive, Python, NoSql DBs)
  • Experience designing and building big data pipelines
  • Experience working on large scale, distributed systems
  • Scala/Java/Python for micro-services and APIs
  • Docker and Kubernetes to package and run services
  • HDP, Oracle skills & Sql; Spark, Scala, Hive and Oozie DataOps (DevOps, CDC)


Nice To Have Skills


  • Docker/Kubernetes knowledge
  • Jenkins, K8S
  • Google Cloud certification
  • Unix or Shell scripting


(ref:hirist.com)

Skills

DesigningOraclePythonSqlUnix
Apply Now