Interesting Job Opportunity: Big Data Engineer - Azure/Python

SEA
  • 1 month ago
  • Navi Mumbai, Maharashtra, India
  • Full Time
Please verify your account first! Send OTP

Job Overview

Functional Area

Data

Work preferred

Work from Office

Experience

Min Experience

1 Years

Max Experience

3 Years

Description

Profile : Big Data Engineer


Type : Full Time


Experience : 1+ Years


Job Responsibilities


  • You will be involved in the Azure Data platform implementation.
  • Responsible for assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms
  • Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL
  • Work with version control GitHub and CI/CD pipelines using Azure DevOps
  • Total Years of Experience 5 years in IT industry
  • 2 years current and deep experience with Azure Data platform implementation. Proven experience managing projects through the entire project lifecycle.
  • Relevant years of experience 2 years in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure DataBricks, AzureSQL
  • Proficient in Azure Data Integration, Azure Data Architecture
  • Proven experience using the Microsoft Azure Data Stack (ADFv2, Azure SQL DB, Azure SQL Datawarehouse, Azure Data Lake, Azure Databricks, Analysis Services, Cosmos DB)
  • Experience in Azure data migration patterns
  • Experience in Python, C# is mandatory
  • Agile methodology experience essential
  • 3 years experience assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms
  • Hands on experience Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL


(ref:hirist.com)

Skills

AgileAgile MethodologyData ArchitectureData IntegrationData MigrationDesigningImplementationPythonSqlTransformation
Apply Now