Data Engineer

Data Engineer

As a Data Engineer you will be a member of the Data Governance and Technology development team, with specific focus developing data solutions for Non-Financial Risk Technology. In this role you will be primarily responsible for the development of data workflows, pipelines, views, and stored procedures, in addition to performing data analysis, and monitoring and tuning queries and data loads. You will be working closely with data providers, data scientists, data developers, and data analytics teams to facilitate the implementation of client-specific business requirements and requests.

YOUR KEY RESPONSIBILITIES:

Develop ETLs to source data from various source system to DB2 target and hive tables.

Create stored procedures, triggers, and views on our DB2-based Data mart

Write complex SQL queries to analyze data and de-bug data related issues

Create informatica and talend jobs to do various data transformation from source to target

Debug Production issues and perform RCA to provide permanent solution to bugs

Communicate with downstream users to understand the Data servicing requirements

Use GIT and Jenkins for Automated code deployment to higher env

Should have good knowledge in Hadoop/Big Data platform

Experience with Cloud Data Platforms like Snowflake , Databricks, AWS or Azure is a plus

Experience with Reporting tool like Tableau ,cognos is a plus

SKILLS / QUALIFICATIONS

Bachelors degree in Computer Science, Software Engineering, Information Technology, or related field required

At least 5+ years of experience in data development and solutions in highly complex data environments with large data volumes

At least 5+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis

At least 5+ years of experience developing complex stored procedures, triggers, MQTs and views on IBM DB2 (experience with v10.5 a plus)

Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions

Experience with both Waterfall and Agile development methodologies

Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.

Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.

Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements and priorities.