Data Engineer

: Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team.

Primary Responsibilities:

• Use knowledge to architect data warehousing and BI solutions that solve problems that cut across multiple business functions
• Interact with business customers, gathering requirements and delivering complete Data Engineering, Data Warehousing, and Analytics solutions.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources

Job Requirements:

• Minimum 5 years of end-to-end data engineering development experience
• 4 to 5 years of hands-on experience with Azure (ADF, Synapse Workspace, Databricks, Azure Functions, Logic Apps)
• Experience working with both batch and streaming data
• Strong professional experience in Python and SQL
• Hands on experiences with CI/CD implementation in ADF & Azure Data Bricks and manage it
• Experience with dimensional modeling, including dimension/fact and snapshot fact tables
• Hands-on experience with Databricks (optimization techniques, DLT, Unity Catalog)
• Hands-on experience with Power BI (DAX queries, data modeling, RLS)
• Microsoft Certified: Azure Data Engineer Associate (DP-203) is required
• Experience working with Synapse Dedicated and Serverless Pools
• Hands-on experience implementing privacy database solutions
• Experience working with multiple source and target systems, such as Oracle Database, SQL Server, Blob Storage, and Azure Data Lake Storage using Azure Data Factory
• Experience with Azure services for storage and data transfer
• Hands-on experience with data pipelines and data flows in ADF
• Ability to read data from sources using APIs and web services
• Experience performing data transformations during ETL processes
• Experience with data cleanup, data cleansing, and performance optimization
• Experience working with unstructured and semi-structured data in Azure is an advantage
• Experience with analytics tools such as Power BI and Azure Analysis Services is an advantage
• Experience with both private and public cloud architectures

Excellent written and verbal communication skills.

Qualifications:

• M.Tech / B.E. / B.Tech (Computer Science, Information systems, IT) / MCA / MCS

Key Requirements:

• Azure (ADF, Synapse Workspace, Databricks, Azure Functions, Logic Apps)
• Databricks (Unity Catalog, Declarative Pipeline, PySpark)
• Working Experience with Azure DevOps (CI/CD), Power BI
• Certification - Microsoft Certified: Azure Data Engineer Associate (DP-203)