Azure Data Engineer

Role: Azure Data Engineer
Exp.: 4-7 years
Competencies
1. Experience in data warehouse environment, which includes developing ETL/ELT pipelines, database designs, writing SQL transformation logic.
2. Strong hands-on experience with Microsoft Azure Data & Analytics PaaS Services, including Azure Synapse, Azure Data Factory, Azure Data Lake Storage and other services within the Azure data analytics framework.
3. Deep knowledge or expert level experience in Databricks.
4. Works with Architects, Technical Leads and Business Teams and contributes to the development of technical designs.
5. Secure data migrations & transformations to/from clients, customers, and vendors.
6. Develops, constructs, tests, and maintains Azure Data factory flows/pipelines
7. Working experience on PySpark, Spark SQL, Serverless SQL pool, Dedicated SQL pools
8. Strong knowledge of various data structures and the ability to extract data from various data sources (such as Cognos, Informatica, Hyperion, etc.).
9. Expose data to end users for consumption such as Power BI or other data integration sources ensuring that the proper security permissions are in place.
10. Experience in writing complex SQL queries and creating data models.
11. Proven experience performing large data migration and transformation efforts would be helpful.
12. Excellent Analytical skill to analyze the issues and ability to backtrack them until root cause
13. Design, implement, and continuously expand ETL pipelines by performing extraction, transformation, and loading activities
14. Candidate should be aware of Release management, Change management, CI/CD pipelines