Azure Data Engineer

Core Skills (Main):

• Python Strong proficiency in writing efficient, clean, and scalable code.
  
• PySpark Hands-on experience developing distributed data processing pipelines.
  

Supplementary Skill:

• Azure Databricks – Working knowledge of building, deploying, and managing data workflows in Databricks.
  

Additional Expectations:

• Solid understanding of data concepts including ETL/ELT processes, data modeling, and data quality.
  
• Proven experience performing data transformations using Python and PySpark within Databricks environments.
  
• Ability to work with large datasets, optimize Spark jobs, and troubleshoot performance issues.