Senior Python Data Engineer

Role Summary:

We are seeking a highly skilled Senior Python Data Engineer to join our Data & Analytics team. This role is focused on designing, building, and maintaining enterprise-grade data pipelines, integrations, data warehouse solutions, and reporting datasets that support operational reporting, business intelligence, analytics, and decision-making across the organization. The ideal candidate combines strong software engineering practices with deep data engineering expertise and is comfortable working across the full data lifecycle, from source system integration and ETL development to data warehousing and reporting enablement

Key Responsibilities

Data Engineering & Integration:

• Design, develop, and maintain scalable ETL/ELT pipelines using Python.
• Build integrations with a variety of data sources including APIs, relational databases, flat files, and third-party systems.
• Implement data extraction, transformation, validation, and loading processes. Develop incremental loading and change-tracking mechanisms.
• Troubleshoot, optimize, and enhance existing data pipelines.

Data Platform Development

• Develop reusable and maintainable data processing components.
• Build and enhance internal data integration and orchestration capabilities.
• Participate in solution design, architecture reviews, and technical discussions.
• Produce well-structured, testable, and documented code. Contribute to engineering standards and best practices.

Workflow Orchestration

• Design and implement Apache Airflow DAGs.
• Build reliable workflow orchestration and scheduling processes.
• Monitor pipeline execution and resolve operational issues.
• Improve observability, reliability, and performance of data workflows.

Data Warehousing & Reporting

• Design, build, and maintain data warehouse structures that support reporting and analytics requirements.
• Develop reporting-ready datasets and data models.
• Optimize SQL queries and warehouse performance.
• Support the delivery of operational, management, and analytical reporting requirements.
• Collaborate with business stakeholders, analysts, and reporting teams to ensure data accuracy and usability.
• Assist in troubleshooting reporting and data quality issues when required

Engineering Excellence

• Build and maintain Docker images and containerized applications.
• Participate in code reviews and technical knowledge sharing.
• Develop unit tests and integration tests.
• Utilize Git-based development workflows and version control best practices.
• Support CI/CD and deployment processes where required

Requirements:

• Has 5+ years of experience, good understanding of Python, Apache Airflow – Power BI – APIs (Rest API) and database
• Candidates should already be based in the UAE
• Strong influencing, leadership, and communication skills with the ability to operate effectively across both technical and non-technical audiences
• Excellent attention to detail, problem-solving, and analytical skills.
• Strong communication skills and ability to work effectively in a remote environment.

Preferred Qualifications:

Good understanding of the stock market, database systems with an understanding of trading systems, MT Platforms (MT4, MT5) and accounts.