Lead Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 10 months ago
5-7 years
Abu Dhabi, United Arab Emirates
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 10 months ago
This job's closing date (18 Feb 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Role Description And Responsibilities

We're looking for a skilled Lead Data Engineer to contribute to the Python services that power our data platform. You'll help build and maintain high-throughput ETL pipelines that ingest real-time market data and expose it through secure CRUD APIs. Working alongside other backend and data engineers, you'll make sure data flows smoothly from external sources into our internal data platform.

  • Leadership: Lead a team of 2-3 Data Engineers to deliver production ready ETL pipelines and APIs exposing RAG and Agents capabilities
  • Market-Data ETL Pipelines: Implement, test, and improve scalable ETL workflows that handle large volumes of data
  • Async Orchestration & Scheduling: Develop and maintain task queues with Async tools, helping the team meet SLAs and surface operational metrics
  • API Implementation: Build REST endpoints with FastAPI Framework, providing clean CRUD access to market data and configuration entities
  • Observability & Reliability: Add structured logs, traces, and metrics; contribute alerts and dashboards (Prometheus/Grafana, OpenTelemetry) that keep services at 99.9 % + availability
  • Code Quality & Best Practices: Write type-safe, well-tested code, participate in code reviews, and help maintain CI/CD workflows
  • Cross-Functional Collaboration: Work closely with data scientists, and product managers to translate data requirements into robust backend capabilities

Requirements
  • Education - Master's degree in Computer Science, Software Engineering, or a related field (or equivalent practical experience)
  • Experience - 5+ years building production Python backends for data-intensive applications
  • Python Mastery - Modern Python (3.10 +) with asyncio, typing, dependency injection, and packaging best practices
  • ETL Skills - Experience designing batch or streaming pipelines; comfort with Kafka, RabbitMQ, or similar tools
  • Database Skills - Strong Postgres knowledge: migrations (Alembic, Django ORM), query tuning, partitioning, backup/restore
  • Async Orchestration - Hands-on with async tools like Airflow, Dagster, or Celery for scheduling and monitoring jobs
  • API Engineering - Proven ability to implement secure, versioned REST/GraphQL APIs with auth, rate-limiting, and RBAC
  • Testing & DevOps - Familiarity with Pytest, Docker, Kubernetes, Terraform, and GitHub Actions (or similar)
  • Soft Skills - Clear written and verbal communication; collaborative mindset

Nice-to-Haves
  • Time-series or columnar DBs (TimescaleDB, ClickHouse, InfluxDB)
  • Knowledge of financial market-data protocols (FIX, FAST) or regulatory feeds

Skills

PythonEtlImplementationDjangoData Engineer

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

We are a B2B WealthTech startup based in Abu Dhabi and backed by BNY Mellon (America's oldest bank and first company to list on NYSE) and Lunate (a new $50B AUM alternative asset management firm based in Abu Dhabi, UAE). The company has raised $300M to build a state of the art wealth technology platform.

Our mission is to power and grow our clients Wealth franchises through differentiated experiences, financial solutions, and insights. Our digital wealth management platform- will enable banks and other financial institutions in the Middle East to grow and further penetrate affluent, HNW and UHNW investor segments.

While still leveraging the capabilities and knowledge of large organizations, our fintech is a startup with truly cross-functional and agile teams.

For more information, please visit www.alpheya.com

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Abu Dhabi.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.