Data Engineer COE Platforms

Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.

Key Responsibilities

• Identify, create, maintain and support data model/data aggregation model base on business requirements and implement ETL for those models accordingly.
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Implementing, establishing standards, and maintaining company data lake (UDP), regional platforms data streaming from Apache Kafka topics.
• Develop and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Writes unit/integration tests, contributes to engineering wiki, and documents work.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts.
• Define company data assets (data models), Azure SQL, MongoDB.
• Design data integrations and data quality framework.
• Design and evaluates open source and vendor tools for data lineage.
• Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.
• Plan, create, and maintain data architectures while also keeping it aligned with business requirements.
• Work closely with business and application delivery team on new digital project/implementation to understand solution and implemented data structure so that all relevant data engineer work including reports and various data-related enhancement can be implemented accordingly as part of the project.
• Develop report/dashboard/dataset for business user base on request.
• Assist to support existing reports/dashboard/dataset and also maintain report/dashboard/dataset repository.

Experience/Skill

• Bachelor’s Degree in Computer Science / Engineering with Business degree is a bonus.
• Experience working as data engineer.
• Experience building and maintaining ETL job, data warehouse / data lake using Azure service such Azure Data Factory or Azure Databricks
• Experience with or knowledge of Agile Software Development methodologies
• Excellent problem solving and troubleshooting skills
• Process oriented with great documentation skills
• Excellent oral and written communication skills with a keen sense of customer service
• 2 years of SQL experience (No-SQL experience is a plus)
• Experience building and maintaining ETL job, data warehouse / data lake
• Experience building data visualization on Microsoft PowerBI

Knowledge/Skill

• Advanced SQL query
• Azure Database & Analytic services (Azure Data Factory, Azure Databricks, Azure Analysis Services, Azure Synapse Analytics, Data Lake Analytics)
• Source code version control: Bitbucket
• Data warehousing
• Data architecture
• Coding (Java/C#)
• Databases: SQL Server, DB2, Couchbase, MySQL, Oracle, SQLITE
• Operating Systems: Windows / Linux
• Visual Studio, Visual Studio Code, SQL Server Management Studio
• Data replication with SQL Server Integration Services (SSIS). ETL with SQL script running on SQL Agent or SSIS Job.
• Change Data Capture (CDC) with SSIS or other technology.
• Apache Kafka topic streaming
• Data documentation
• Data dictionary, data flow diagram, data architecture
• Service Bus Explorer, Azure Storage Explorer, Postman, Fiddler

Bonus

• Microsoft Office 365 suite
• Big Data handling experience (Hadoop, NoSQL, Document DB, Azure Data Lake, etc.,) a big plus
• Knowledge OS Window Server, Linux, UNIX and VMware.
• Data migrations and systems integrations

Core Competencies

• Problem solving
• Creative Thinking
• Strong passion in technology
• Effective communication
• Leadership
• Strategic thinking – a great deal of analyzation is required to be a technical business analyst. So, capability in strategic thinking essential.

Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.