Data Engineer - Databricks

• Dear Applicant,
• Please find following Job Details.
• Title - Data Engineer
• Location - Abu Dhabi
• Work Mode - onsite
• Type - Contract until December

Engagement Overview

• Scope: finishing leftover platform work, migrating to new standards
• Data models not yet in catalog structure
• Clusters not managed per policy
• Ingestion patterns not adhering to new standards
• ADF to Medallion/Autoloader migration
• Code not yet deployed via DABs, to be moved; Spark declarative pipelines likely in scope
• Budget already allocated, must be spent by year-end

Candidate Requirements

• 5 years Databricks experience preferred; Spark or general data engineering also acceptable
• ADF experience a plus (actively migrating off it)
• SQL and Python: mandatory
• Strong data modeling a strong plus: Kimball, dim models, etc.
• Not a hard requirement, but candidates must be able to critically review their own code against reference models
• Autonomous workers: minimal back-and-forth expected; problems will be well-framed