Data Engineer

We are looking for a Data Engineer to enhance our internal data engineering capability from the UAE and play a key role in developing the data infrastructure and systems alongside our UK Team, ensuring that our data pipelines are reliable, scalable, and efficient.
Reporting into the Executive Director - Middle East, but working under the direction of the Head of Data & Spatial Intelligence, you will be responsible for designing data infrastructure to support modelling and data analytics, and work with stakeholders to understand their data needs and help design data solutions. Competence and experience in Snowflake, Data Bricks and Python highly desirable.
The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real-world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making, with a focus on our Middle East customers. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.
Responsibilities/ deliverables:
These are the key things that you are responsible for delivering within your role. There will be activities and tasks in addition to this list that are expected from you but the majority of your time will be:

• Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
• Identifying improvements to our current data processes and implementing solutions.
• Implementing data flows to connect operational systems, data for analytics, and business intelligence systems
• Creation and development of data pipelines
• Documenting source-to-target mappings
• Re-engineering manual data flows to enable scaling and repeatable use
• Support the build of data streaming systems
• Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use
  
• Develop business intelligence reports that can be used for multiple audiences
• Build accessible data for analysis
• Automate data processing tasks and workflows
• Collaborate with cross functional teams to advocate for high-quality data solutions
  

Requirements
You will have previous proven experience:

• Building, modelling, and maintaining data pipelines
• With a range of Amazon Web Service products and technologies such as EC2, S3, Lambda, ECS and Redshift
• Designing data infrastructure to support modelling and data analytics
• As an AWS Solutions Architect or Lead, or similar
• Strong Python experience or other object oriented or a functional programming language such as Java, Scala, C#, or R

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired
• Data warehousing - building operation ETL data pipelines across several sources, and constructing relation and dimensional data models
• Built and maintained scalable infrastructure through IaC frameworks (e.g., Terraform, CloudFormation) and CI/CD workflows
• If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.
• Familiarity with Apache Spark or Databricks
• Excellent communication and collaboration skills
  

Benefits
What we offer here at Prevail:

• Health insurance as standard.
• Flexible hybrid working arrangements.
• Competitive tax-free income
• Work visa for the UAE