Job Description:

We are seeking a highly experienced Senior Data Engineer with over 10 years of industry experience to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and ETL (Extract, Transform, Load) processes. You will be responsible for building scalable and efficient data pipelines on the Azure platform, enabling data-driven decision-making across the organization.

Qualifications and Skills:

1. Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
2. Proven track record of 10+ years in data engineering, ETL development, and data warehousing.
3. Strong expertise in building ETL workflows on the Azure cloud platform using services like Azure Data Factory, Azure Databricks, and Azure Synapse Analytics (formerly Azure SQL Data Warehouse).
4. Proficiency in programming languages such as Python, SQL, and data manipulation libraries (e.g., pandas, PySpark).
5. Extensive experience in data modeling, data integration, and data transformation techniques.
6. In-depth knowledge of data storage and retrieval technologies like SQL databases, NoSQL databases, and data lakes.
7. Hands-on experience with version control systems (e.g., Git) and CI/CD pipelines for automated deployments.
8. Familiarity with data visualization and BI tools like Power BI, Tableau, or similar.
9. Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
10. Excellent communication skills, both verbal and written, with the ability to communicate technical concepts to non-technical stakeholders.

Preferred:

1. Microsoft Azure certifications related to data engineering or data analytics.
2. Experience with big data technologies such as Hadoop, Spark, or Kafka.
3. Knowledge of containerization and orchestration tools like Docker and Kubernetes.