Senior Data Engineer And Modeler

LSEG (London Stock Exchange Group)

Data Science Analytics & Machine Learning

149+ Applicants

Posted: 1 year ago

5-9 years

Karnataka

Work from Office

Posted: 1 year ago

Applicants: 149+

Job Description

About Company

Similar Jobs

Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

You will be responsible for leading the development of foundational components for a lakehouse architecture on AWS and overseeing the migration of existing data processing workflows to the new lakehouse solution. Your role will involve collaborating with the Data Engineering team to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. The primary objective of this position is to ensure a successful migration and establish robust data quality governance across the new platform to enable reliable and efficient data processing. To excel in this position, you will need to demonstrate deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.
Your key responsibilities will include leading complex projects independently, fostering an inclusive and open culture within development teams, and setting high standards for technical contributions. You will provide strategic guidance on best practices in design, development, and implementation to ensure that solutions meet business requirements and technical standards. Additionally, you will be involved in writing high-quality, efficient code, developing tools and applications to address complex business needs, and leading the development of innovative tools and frameworks to enhance data engineering capabilities.
Collaboration with architects, Product Owners, and Dev team members will be essential to decompose solutions into Epics, lead the design and planning of these components, and drive the migration of existing data processing workflows to the Lakehouse architecture leveraging Iceberg capabilities. You will establish and enforce best practices for coding standards, design patterns, and system architecture, utilizing existing design patterns to develop reliable solutions while also recognizing when to adapt or avoid patterns to prevent anti-patterns.
In terms of qualifications and experience, a Bachelor's degree in computer science, Software Engineering, or a related field is essential. A master's degree or relevant certifications such as AWS Certified Solutions Architect or Certified Data Analytics is advantageous. Proficiency in advanced programming, system architecture, and solution design is required. You should possess key skills in advanced software development practices, Python and Spark expertise, automation and CI/CD pipelines, cross-functional collaboration and communication, technical leadership and mentorship, domain expertise in AWS Cloud Services, and quality assurance and continuous improvement practices.

Looking to get Placed? Try our Placement Guarantee Plan

Your role would involve working within a culture committed to continuous learning, mentoring, career growth opportunities, and inclusion for all employees. You will be part of a collaborative and creative environment where new ideas are encouraged, and sustainability is a key focus. The values of Integrity, Partnership, Excellence, and Change underpin the organization's purpose of driving financial stability, empowering economies, and enabling sustainable growth.
LSEG offers various benefits, including healthcare, retirement planning, paid volunteering days, and wellbeing initiatives.,

Skills

Data AnalyticsPythonData ProcessingImplementationQuality AssuranceAnalyticsData EngineerAthenaAWSGlueStep FunctionsPySparkFinancial ServicesPythonAWS GlueSQSDynamoDBAurora PostgresEquityIndicesAWS LambdaAPI GatewayEMR ServerlessIAMAWS Step FunctionsFixed Income Asset ClassesIcebergCICD PipelinesRDSGlue Data Catalog

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

The London Stock Exchange Group (LSEG) is a global financial markets infrastructure business that sits at the heart of the world's financial community. We provide a diverse range of information services, technology, and data analytics solutions across the globe.

Important dates & deadlines?

Application Deadline

25 Oct 25, 11:30 AM IST

Similar Jobs

View All

Jobaaj

Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert

Google hiring for Specific Roles Apply Now!

1 min ago

New Opportunity

Amazon is hiring freshers Apply Now!

5 min ago

Featured Jobs

Microsoft opening 50+ positions Apply Now!

10 min ago