Interesting Job Opportunity: Data Engineer - Big Data/Hive
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
- Experience in database programming using multiple aspects of SQL and Python
- Understand and translate data, analytical requirements, and functional needs into technical requirements
- Build, maintain and deploy scalable data pipelines to support large scale data management projects
- Ensure alignment with data strategy and standards of data processing
- Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
- Experience in Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL
- Experience in any orchestration/workflow tool such as Airflow/Oozie for scheduling pipelines
- Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
- Understand and execute in memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
- Hands-on experience in using Spark Streaming, Kafka and Hbase
- BCA/B.Sci/BE/BS/MTech/MS in computer science or equivalent work experience.
Skills
Data ManagementData ProcessingEtlPythonSqlStrategyIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allNew Data Science Analytics & Machine Learning roles in Bengaluru East.
One email a day. Unsubscribe any time.

