Data Engineer

Job Title: Data Engineer

Location: Hyderabad

Experience Required: 5+ Years (Minimum 3+ Years Relevant in PySpark, Azure Data Factory, and Python)

Company:- WalikingTree Technologies

Interview Rounds

1?? Assessment Test 1 hour 30 minutes

2?? Technical Panel Interview (Face-to-Face Hyderabad)

About The Role

We are looking for an experienced and passionate Data Engineer to join our growing analytics and data team. The ideal candidate will have hands-on experience in PySpark, Azure Data Factory (ADF), and Python, with a strong background in designing and maintaining scalable data solutions on Azure.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
• Collaborate with business stakeholders, data analysts, and data scientists to understand requirements and deliver reliable solutions.
• Optimize ETL workflows for performance, scalability, and reliability.
• Implement best practices for data ingestion, transformation, and integration across multiple sources.
• Ensure data quality, governance, and security across all stages of the data lifecycle.
• Troubleshoot and resolve data pipeline, storage, and performance issues.

Required Skills & Qualifications

5+ years of total experience with 3+ years of relevant experience in PySpark, Azure Data Factory, and Python.

• Proven experience in building large-scale data pipelines and ETL workflows.
• Strong expertise in PySpark for data processing and transformation.
• Proficiency in Azure Data Factory (ADF) for orchestrating workflows.
• Advanced Python programming skills for data handling and automation.
• Strong command over SQL and experience with both relational and non-relational databases.
• Good understanding of data warehousing concepts and performance optimization techniques.
• Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) is a plus.
• Excellent problem-solving, analytical, and communication skills.

Nice to Have

• Experience with CI/CD pipelines for data solutions.
• Knowledge of data governance, security, and compliance frameworks.
• Familiarity with real-time data streaming tools (Kafka, Event Hubs, etc.).