An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Data Engineer role at Sutherland in Hybrid - Hyderabad, Chennai, Bengaluru for people with 4–9 years of experience. You'll build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines. You'll develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks.
- Hyderabad
- Work from office
- 4–9 years
What you'll do
- Build batch ingestion pipelines
- Develop Silver- and Gold-layer transformations
- Implement dimensional models
Good fit if you
- Have advanced SQL, Python and PySpark/Spark skills
- Bring hands-on experience with Azure Data Factory
- Possess strong understanding of Lakehouse/Medallion architecture
AI-generated from the job description. Check the full description before you apply.
Job Description
Data Engineer
Location:Chennai | Bangalore | Hyderabad | Mumbai
Engagement model: Full-time
Immediate Joiners Preferred
Role Summary
Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer
builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers. They ensure that the pipelines are automated, performant, secure and governed.
- The role works alongside the data architect, data quality engineer, business analysts and AI engineers. Its
- job is to deliver production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage
- captured in Microsoft Purview.
Key Responsibilities on the Client Engagement
Pipeline development: Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
Transformation: Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
Data modelling implementation: Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
Embedded quality controls: Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
Metadata and lineage: Ensure that pipelines publish metadata and lineage to Microsoft Purview.
Orchestration and automation: Implement scheduling, dependency management, parameterization, error handling and alerting.
- ¢ Performance and cost: Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
- ¢ Security: Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
- ¢ DevOps / DataOps: Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
¢ Operations and knowledge transfer: Support production operations, incident resolution and runbooks, and coach SUTHERLAND engineers so that the pipelines can be sustained after
handover.
Qualifications and Experience
- ¢ 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
- ¢ Advanced SQL, Python and PySpark/Spark skills.
- ¢ Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
- ¢ Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and
- dimensional modelling, including SCDs and surrogate keys.
- ¢ Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
- ¢ Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
- ¢ Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
- ¢ Excellent English communication and documentation skills; Arabic proficiency is an advantage.
Skills
Continuous IntegrationCdDataPythonData EngineeringMachinePysparkPythonImplementationData EngineerAnalyticsAiSqlDatabricksIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Sutherland is an experience-led digital transformation company that stands at the forefront of delivering exceptionally engineered experiences for both customers and employees. With a mission rooted in ensuring sustained delight, Sutherland leverages over 35 years of expertise in caring for its customers' clients, consistently delivering measurable results and driving growth. The company's foundation in proprietary, AI-based products and platforms is strengthened by its robust intellectual property and a focus on automation.
As a global team of professionals, Sutherland prides itself on operational effectiveness and a strong cultural cohesion. Its commitment to clients and to each other is a testament to its collaborative ethos. The organization's dedication to innovation and excellence has established it as a leader in its field, continually pushing the boundaries of digital transformation to meet the evolving needs of businesses and consumers alike.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Hybrid - Hyderabad.
One email a day. Unsubscribe any time.

