Data Engineer

What You Will Do :Bachelors Master&rsquos degree in information technology/Computer Science, Engineering (or equivalent) ? 7-10 years of experience in Azure Data Engineering.

• Experience working with Hadoop or other Big Data platform and building solutions that deliver value through leveraging data as an asset


• ETL technologies: at least one of the following: SSIS, Talend, Pentaho, Informatica, etc.


• End-to-end Microsoft BI &amp Data stack: Analytics Platform Server, HD Insight, Stream Insight, SharePoint BI, PowerPivot, Power View


• Applied experience in Reporting Tools like Power BI , Tableau etc.


• Applied experience and skills with API Development


• Applied experience with Cloud platforms including AWS and/or Azure


• Experience working with various types of data sources such as SAP, JDE, legacy ERP systems

Mandatory Skills

• Big Data stack: Spark, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka, Storm


• Develop data pipelines using Azure Data Factory.


• Develop data storage layer using Azure SQL DB &amp Azure Data Lake.


• Develop dashboards &amp Reports using Power BI.


• Knowledge of developing real-time data ingestion pipelines.


• Design &amp develop data platform using Azure Databricks to process data.


• Develop notebooks &amp jobs using Python language.


• Understanding of messaging infrastructure like event hub, service bus &amp notification hub.


• Should have good understanding on Azure Cosmos DB, Azure DW Duties and Responsibilities


• Work with the application development team to implement data strategies, build data flows


• Should have expertise across the database. Responsible for gathering and analyzing data requirements and data flows to other systems


• Lead multiple scrum teams Preferred Interpersonal Skills


• Good verbal and written communication skill


• Team Player


• Team-working &ndash being able to work with others in groups and teams


• Problem solving and decision-making &ndash working with others to identify, define and solve problems, which includes making decisions about the best course of action


• Strong conceptual strength, strategic thinking, problem solving, technical, and analytical skills.


• Ability to ask next level questions anticipating business inquiries and performing root cause analysis What You Need :

Bachelors Master&rsquos degree in information technology/Computer Science, Engineering (or equivalent) ? 7-10 years of experience in Azure Data Engineering.

• Experience working with Hadoop or other Big Data platform and building solutions that deliver value through leveraging data as an asset


• ETL technologies: at least one of the following: SSIS, Talend, Pentaho, Informatica, etc.


• End-to-end Microsoft BI &amp Data stack: Analytics Platform Server, HD Insight, Stream Insight, SharePoint BI, PowerPivot, Power View


• Applied experience in Reporting Tools like Power BI , Tableau etc.


• Applied experience and skills with API Development


• Applied experience with Cloud platforms including AWS and/or Azure


• Experience working with various types of data sources such as SAP, JDE, legacy ERP systems

Mandatory Skills

• Big Data stack: Spark, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka, Storm


• Develop data pipelines using Azure Data Factory.


• Develop data storage layer using Azure SQL DB &amp Azure Data Lake.


• Develop dashboards &amp Reports using Power BI.


• Knowledge of developing real-time data ingestion pipelines.


• Design &amp develop data platform using Azure Databricks to process data.


• Develop notebooks &amp jobs using Python language.


• Understanding of messaging infrastructure like event hub, service bus &amp notification hub.


• Should have good understanding on Azure Cosmos DB, Azure DW Duties and Responsibilities


• Work with the application development team to implement data strategies, build data flows


• Should have expertise across the database. Responsible for gathering and analyzing data requirements and data flows to other systems


• Lead multiple scrum teams Preferred Interpersonal Skills


• Good verbal and written communication skill


• Team Player


• Team-working &ndash being able to work with others in groups and teams


• Problem solving and decision-making &ndash working with others to identify, define and solve problems, which includes making decisions about the best course of action


• Strong conceptual strength, strategic thinking, problem solving, technical, and analytical skills.


• Ability to ask next level questions anticipating business inquiries and performing root cause analysis