Data Engineer MMH241129-3

Role Purpose

The Data Engineer is tasked with overseeing the full life-cycle of back-end development of the businesss data requirements/products. The Data Engineer is responsible for the development of ETL processes and various administration and data structural designs. The Data Engineer works closely with various internal stakeholders, including, but not limited to data analysts, data scientists and business members in order to power insight and avail meaningful data products for the business and enable consistently informed management decisions.

Requirements

Total Experience

• 4+ years

• 3-5 years of experience in a similar role
• Experience into PowerBI is mandatory
• Experience with Databases (Postgres, SQL Server, Oracle, MySQL)
• Experience with cloud software (Amazon Web Services - primary, Azure).
• Data Engineering/Warehousing experience (current)
• SQL advanced coding

Duties and Responsibilities

Key Accountabilities / Kras / Kpis

ETL: Develop and maintain the ETL processes:

• Identify, analyse, design and maintain the data sources and pipelines.
• Do necessary checks to ensure that the tables loaded balances back to the operational

system in terms of control totals and record counts as per Audit requirements.

• Develop and maintain procedures and standards for processes e.g. (Extraction and loading of data, Coding and naming standards, Scheduling of data related scripts and jobs, Develop Change control standards)

• Identifying potential improvements to the design of the database and warehouses & ETL processes.
• Maintain security and access to the database.
• Monitor the database and tables space usage.
• Archive historical data and delete unused tables.
• DB performance monitoring and performance.
• Data Statistics and Reporting.

• Participate in Metropolitan Health projects: e.g: Migration Upgrades
• New system developments and projects.
• Internal and external auditing if required.
• Effective project delivery - Delivery of projects on time within the agreed budgets.
• Ensure Continuous Service Improvement (CSI).
• Achieving Operational Excellence.

• Promote new techniques and Data tools that shape the future of the Data in the business, i.e. Unstructured data, Data Lakes, Apache Hadoop/ Spark/Hive/Kafka.

• Team Relationship management - Engaging and partnering with other IT and Business teams.
• Ensuring effective service delivery to our Business Partners.
• Manage own performance and development.
• Learn, grow, and enjoy contributing to a platform and team which aims at growing the business and solving complex problems.

• 3-5+ years’ experience in IT.
• Experience into PowerBI is mandatory
• Experience with Databases (Postgres, SQL Server, Oracle, MySQL)
• Experience with cloud software (Amazon Web Services - primary, Azure or Google - secondary but acceptable).
• Data Engineering/Warehousing experience (current).
• Engagement with internal stakeholders with regards to setting up controls (processes and standards).
• Bigger picture and attention to detail orientation.
• SQL advanced coding.
• Python or Java coding (advantageous)
• Understanding of data.
• Ability to present information best aligned to business needs.
• Database administration (advantageous).
• Basic Linux shell scripting (advantageous).
• Analytical skills, problem solving.
• Initiative, take responsibility for challenges, persistence
• Flexibility with regards to thinking (different perspectives).

As an applicant, please verify the legitimacy of this job advert on our company career page.-346021306