An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
- BE/BS/MTech/MS in computer science or equivalent work experience.
- 14+ years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming
- 5+ years of experience in building scalable enterprise data warehousing and modelling on prem and/or cloud (AWS, GCP, Azure)
- Expertise in data structures, distributed computing, manipulating and analyzing complex high-volume data from variety of internal and external sources
- Experience in developing ETL designs and data models for structured/ unstructured and streaming data sources
- Experienced in SQL performance tuning & recommendations
- Experience in building large scale data pipelines in batch and real time mode
- Experience in data migration to cloud (AWS/GCP/Azure)
- Proficient in programming language such as Python/Scala
- Good understanding of in relational/dimensional modelling and ETL concepts
- Good understanding of data analysis techniques
- Solid working knowledge of SQL and scripting
- Strong experience in database, data warehouse & data lake design & architecture
- Able to train & mentor team members
- Experience in Database programming using multiple flavor of SQL
- Deploy scalable data pipelines for analytical needs
- Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
- Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL
- Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
- Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
- Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
- Hands-on experience in using Spark Streaming, Kafka and Hbase
- Experience in any orchestration tool such as Airflow/Oozie
- Experience working in an Agile/Scrum development process
Skills
AgileData AnalysisData ManagementData MigrationData ProcessingData WarehousingEtlPharmaPythonSqlIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bengaluru.
One email a day. Unsubscribe any time.

