Interesting Job Opportunity: Data Engineer - Python/Big Data

HuQuo
  • 1 month ago
  • Pune, Maharashtra, India
  • Full Time
Please verify your account first! Send OTP

Job Overview

Functional Area

Data

Work preferred

Work from Office

Experience

Min Experience

3 Years

Max Experience

8 Years

Description

Basic Understanding Of


  • Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar
  • Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
  • Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
  • Agile Process (Scrum cadences, Roles, deliverables) & basic understanding in either Azure DevOps, JIRA, or Similar
  • Architecture and data modeling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
  • Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt, or Similar


Strong In


  • Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
  • Big Data Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), SparkScala or SparkSQL) or Similar
  • Data warehouse working experience of concepts and development using SQL on single (SQL Server, Oracle or Similar) and parallel platforms (Azure SQL Data Warehouse or Snowflake)
  • Code Management & working experience in GIT Hub, Azure DevOps, or Similar
  • End to End Architecture and ETL processes & working experience in ETL Tool or Similar
  • Reading Data Formats & working experience in JSON, XML, or Similar
  • Data integration processes (batch & real- time) using tools & working experience in either Informatica PowerCenter and/or Cloud, Microsoft SSIS,
  • MuleSoft, DataStage, Sqoop, or Similar
  • Writing requirement, functional & technical documentation & working experience in the Integration design document, architecture documentation, data testing plans or Similar
  • SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
  • Database & working experience in any of the database like MS SQL, Oracle, or Similar
  • Analytical Problem- Solving skills & working experience in resolving complex problems or Similar
  • Communication (read & write in English), Collaboration & Presentation skills & working experience as a team player or Similar.


Good To Have


  • Stream Processing & working experience in either Databricks Streaming, Azure Stream Analytics or HD Insight or Kinesis Data Analytics or Similar
  • Analytical Warehouse & working experience in either SQL Data Warehouse or Amazon Athena or AWS Redshift or Big Query or Similar
  • Real- Time Store & working experience in either Azure Cosmos DB or Amazon Dynamo- DB or Cloud Bigdata or Similar
  • Batch Ingestion & working experience in Data Factory or Amazon Kinesis or Lambda or Cloud Pub/Sub or Similar Storage & working experience in Azure Data Lake Storage
  • GEN1/GEN2 or Amazon S3 or Cloud Storage or Similar
  • Batch Data Processing & working experience in either Azure Databricks or HD Insight or Amazon EMR or AWS Glue or Similar
  • Orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar


(ref:hirist.com)

Skills

AgileAnalyticsData AnalyticsData IntegrationData ModelingData ProcessingEtlEtl ToolJiraOraclePresentationPythonSqlTechnical DocumentationXml
Apply Now