Azure Data Engineer

• Exp.: 4-7 years
• Competencies
• 1. Experience in data warehouse environment, which includes developing ETL/ELT pipelines, database designs, writing SQL transformation logic.

2. Strong hands-on experience with Microsoft Azure Data & Analytics PaaS Services, including Azure Synapse, Azure Data Factory, Azure Data Lake Storage and other services within the Azure data analytics framework.

• 3. Deep knowledge or expert level experience in Databricks.
• 4. Works with Architects, Technical Leads and Business Teams and contributes to the development of technical designs.
• 5. Secure data migrations & transformations to/from clients, customers, and vendors.
• 6. Develops, constructs, tests, and maintains Azure Data factory flows/pipelines
• 7. Working experience on PySpark, Spark SQL, Serverless SQL pool, Dedicated SQL pools
• 8. Strong knowledge of various data structures and the ability to extract data from various data sources (such as Cognos, Informatica, Hyperion, etc.).
• 9. Expose data to end users for consumption such as Power BI or other data integration sources ensuring that the proper security permissions are in place.
• 10. Experience in writing complex SQL queries and creating data models.
• 11. Proven experience performing large data migration and transformation efforts would be helpful.
• 12. Excellent Analytical skill to analyze the issues and ability to backtrack them until root cause
• 13. Design, implement, and continuously expand ETL pipelines by performing extraction, transformation, and loading activities

14. Candidate should be aware of Release management, Change management, CI/CD pipelines