Senior Data Engineer (Customer & Market Insights)

IMPORTANT Skill Set Requirement:

Primary Skill

• Strong analytical and problem-solving skills

• Attention to detail and accuracy.

• 7+ years’ experience in the data warehousing, ETL and SQL area

• ETL Tools and processes

• Strong experience in supporting, developing, and enhancing data pipelines using SQL and any high-level language, such as Python, Go, JavaScript, Java, etc.

Secondary Skill

• Exp in Apache Airflow/Spark, AWS Glue are preferable.

• Exp in AWS

• Exp in Data modelling & design

• Agile SW Dev methodology

• DevOps/ CICD

Complete :

Senior Data Engineer

Are you a passionate technologist looking to use advanced technology to save lives?

Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others?

About our Team

Elsevier is transforming its technology to put the right data into our business operations and customers’ hands. Deploying the latest software engineering practices, we’re pushing everyone’s comfort zone, while maintaining the highest standards. We are now recruiting talented Data/Software Engineers to fill an open position in one of our existing squads looking after our vitally important Customer and Market Insights team.

As part of Digital Business Solutions team, we work closely in a technology partnership with the Customer & Market Insights business team to provide timely customer insight that allows Elsevier to take action and meet existing and emerging customer needs and expectations. This includes day-to-day support as well as developing long-term solutions for sustained high quality data and analytics.

This role will be based in the Chennai, India office working alongside the technical lead and business stakeholders based in the Oxford, UK office (although everyone is currently working remotely). The business consumers of the insights are based around the globe.

About the Role

As a Senior Data Engineer in Digital Business Solutions, you will be part of a collaborative development team supporting the Customer & Market Insights business unit. You will be responsible for developing new data pipelines, new database schemas and supporting existing data pipelines that load data from around Elsevier to third party systems.

You will be deeply involved in migrating from a MS SQL Server, MS Access and MS SSIS solution to an AWS hosted Snowflake, Airflow and Spark/Glue environment, as well as supporting the current technologies during the transition.

This is a challenging role where noticing nuances is an important skill that will allow us to vastly improve the functionality and supportability of the current solution, bringing it into the 21st century and offering increased value to the business.

Responsibilities

• Operate in an agile working environment while collaborating with key stakeholders.

• Work closely with the Technical Lead and Product Owner to design and develop complex data pipelines.

• Notice subtleties in the existing solutions and ensure a full technical/business understanding of their need.

• Ensure solutions are resilient and fault tolerant.

• Ensure all solutions have the appropriate level of documentation and meet Elsevier’s architectural standards.

• Follow development processes, coding best practices, and perform code reviews.

• Collaborate with other engineering teams in understanding the data and translating requirements.

• Ensure maintainable and high-performance code.

• Contribute towards achieving.

Requirements

Overall Work Experience: 5-10 Years

• 5+ years’ experience in the data warehousing, ETL and SQL area

• Strong experience in supporting, developing, and enhancing data pipelines using SQL and any high-level language, such as Python, Go, JavaScript, Java, etc

• ETL Tools and processes (Apache Airflow/Spark, AWS Glue are preferable)

• Knowledge of cloud services and architecture (preferably AWS)

• DevOps: Terraform, Database provisioning (e.g Flyway) is desirable.

• Database modelling & design (desirable)

• Understanding of release management using CI/CD

Your most important qualities

• Strong analytical and problem-solving skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.

• Good communication skills that allow for effective communication across all levels of the organization, both technical and business representatives.

• Ability to understand technical issues at a high level.

• Broad understanding of software development methodologies, platforms, tools, and languages.

• Ability to work on your own as well as part of a small team.

Work in a way that works for you

We promote a healthy work/life balance across the organization. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

Working with us

We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.

Working for you

At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Group Health Insurance Policy (covering self and family)

• Group Life insurance/accident policy

• Generous long-service awards

• New Baby gift

• Subsidised food provided (applies to India- Chennai)

• Casual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, Gazetted Public Holiday and Maternity/Paternity Leave

• Free Transport provided to and from the office (applies to India-Chennai)

About Us

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

Join Us

Purposeful Work

When you work with us, your work matters. You are part of an organization that nurtures your curiosity to stimulate innovation for the communities that we serve.

Growing Every Day

Like the communities we serve, you are on a constant path of discovery to shape your career and personal development.

Colleagues Who Care

You will be part of the Elsevier family. We will support your well-being and provide the flexibility you need to thrive at work and home.

Together, we create possibilities.

Join us