Data Engineer – Microsoft Fabric Lead / Architect

Department Icon Data Science Analytics & Machine Learning
Posted: 2 weeks ago
8-15 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 1 Jan 2027

Posted: 2 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

About the job Data Engineer – Microsoft Fabric Lead / Architect Experience: 8-15 Years Work locations Bangalore/ Hyderabad Hybrid work mode ( 2 days work from office) About the Role We are looking for a hands-on Microsoft Fabric Lead Data Engineer with strong Data Engineering fundamentals and proven Microsoft Fabric implementation experience. The ideal candidate should have worked on end-to-end data engineering projects involving Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, PySpark, SQL, and enterprise-scale data platforms. The role requires professionals who can design data ingestion frameworks, build scalable ETL pipelines, develop PySpark notebooks, handle large-volume data processing, optimize performance, and modernize enterprise data platforms using Microsoft Fabric. Candidates should be able to clearly explain the architecture, transformations, and business logic implemented in their projects. Key Responsibilities Microsoft Fabric & Data Engineering Design and implement enterprise data solutions using Microsoft Fabric. Build and support Lakehouse, Warehouse, OneLake, Shortcuts, and Medallion Architecture. Develop data ingestion frameworks from ERP and enterprise applications such as SAP, Dynamics, and other business systems. Build scalable batch and incremental ETL/ELT pipelines. PySpark & Notebook Development Develop complex data transformation logic using PySpark. Build Fabric Notebooks for ingestion, cleansing, validation, and transformation. Implement reusable frameworks for: Data Quality, Error Handling, Logging, Incremental Processing Develop business logic to process data from multiple sources and formats. Data Processing & Transformation Work with structured, semi-structured, and unstructured data. Transform and standardize enterprise data for analytics consumption. Implement Lakehouse and data warehousing best practices. Performance Optimization Optimize large-volume data processing workloads. Improve PySpark, SQL, and pipeline performance. Handle scalability, partitioning, data volume, and processing bottlenecks. Migration & Modernization Support Azure Synapse to Microsoft Fabric migration initiatives. Assess existing Azure data platforms and recommend Fabric-based target architectures. Must-Have Skills Strong hands-on Data Engineer with implementation experience. Can explain end-to-end project architecture and transformation design. Strong understanding of Fabric concepts. Experienced in building and optimizing ETL pipelines for enterprise-scale datasets. Comfortable handling structured and unstructured data. Strong problem-solving mindset with a focus on development rather than support activities. Able to independently design, develop, optimize, and troubleshoot Fabric solutions. Should have handled large data set data processing 1-2+ Microsoft Fabric implementation projects. Deep understanding of Fabric architecture and core concepts. Worked with any of the ERP system like SAP, Salesforce for building data pipeline Azure Data Factory (Mandatory) Fabric Notebooks PySpark (Mandatory) Azure Synapse Analytics Enterprise Data Platform Modernization Good to have Skills Microsoft Fabric : Lakehouse OneLake Data Pipelines Warehouse Shortcuts Fabric Mirroring Fabric Warehouse Synapse to Fabric Migration Experience Medallion Architecture Data Engineering PySpark (Mandatory) Python ETL/ELT Development Data Transformation Development Data Quality & Validation Error Handling Frameworks Incremental Processing Azure Technologies ADLS Cloud Data Engineering Fundamentals Enterprise Integration ERP connectivity and data ingestion. SAP, Dynamics, or similar enterprise application integrations. Performance Engineering Large-scale data processing. Performance tuning. Optimization of notebooks, transformations, and pipelines. Preferred Certifications DP-600: Fabric Analytics Engineer Associate DP-700: Microsoft Fabric Data Engineer Associate

Skills

PythonSQLData EngineeringPySparkETLData WarehousingAzureSAPSalesforce

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Sonata is a global technology company, that enables successful platform based digital transformation initiatives for enterprises, to create businesses that are connected, open, intelligent and scalable. Sonata’s Platformation™ methodology brings together industry expertise, platform technology excellence, design thinking-led innovation and strategic engagement models to deliver sustained long term value to customers. A trusted partner of world leaders in the Retail, Manufacturing & Distribution, Travel and Software industries, Sonata’s solution portfolio includes its own digital platform such as Brick & Click Retail Platform©, Modern Distribution Platform©, Rezopia Digital Travel Platform©, RAPID DevOps Platform©, Kartopia E-commerce Platform© , Halosys Mobility Platform©, and Commodity CTRM Platform©, best-in-class capabilities on ISV digital technology platforms such as Microsoft Dynamics 365, Microsoft Azure, SAP Hybris, Cloud Engineering and Managed Services, as well as new digital applications like IoT, Artificial Intelligence, Machine Learning, Robotic Process Automation, Chatbots, Block Chain and Cyber Security. Sonata’s people and systems are nurtured to bring together the depth of thought leadership, customer commitment and execution excellence to make a difference to business with technology.
Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.