Data Engineer

• Job Title-Data Engineer
• Exp-6-8 Yeras
• Location- Mumbai

Job Responsibilities-

Actionable

• Designing and implementing data storage solutions on Azure
• Building and maintaining data pipelines for data integration and processing
• Optimizing data processing performance through tuning and monitoring
• Developing and maintaining data models and schemas
• Ensuring data security and privacy prerequisites are followed
• Designing and developing BI reports and dashboards

Collect data from various sources, transform into a practical format, and load into the appropriate data storage solution on Azure using tools such as Azure Data Factory and Azure Databricks.

• Develop and maintain data models and schemas optimized for specific use cases.
• Ensure that the data stored and processed on Azure conforms with applicable data security and privacy requirements
• Develop operational and functional reports
• Build automated reports and dashboards with the help of Power BI and other reporting tools
• Understand business requirements to set functional specifications for reporting applications
• Be experienced in tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, PowerBI
• Be able to quickly shape data into reporting and analytics solutions

Educational Qualifications (examples listed below)

Key Skills(examples listed below)

• Bachelors degree in Computer Science, IT or related area
• 5 - 8 years of experience in design and development particularly in databases and reporting ( relational and otherwise)
• Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations
• Proficiency in reporting tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, MDX, PowerBI
• Proficiency in Azure Data Factory (ADF) , Azure Data Lake and Databricks
• Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.
• Extensive knowledge on big data concepts like Hive, and spark framework.
• Should be able to write complex SQL queries. Sound understanding of DWH concepts.
• Strong hands-on experience on Python and/or Scala.