Senior Big Data Engineer

Please note that we will be communicating with you using the email address associated with your LinkedIn application. It is important that you check this email regularly for updates on your application status.We are looking for the candidates with 4+ years of relevant experience.Are you a tech professional looking for remote work in a global setting? If yes, this job is for you.Welcome to EPAM Anywhere - a global job platform offering remote work opportunities in the technology sector. Join us to build a career around your lifestyle working on modern projects for global brands and exciting startups. Our customer exposes an API for other businesses to be able to access risks associated with a person, e.g. understand their credit score. Behind the scene there is sophisticated decisioning system and large data volumes. Currently back-end of this API has number of legacy versions, serving hundreds of clients, with individual installations for most clients.We need to create a data lake for one of the biggest data analytics company working with personal information both domestically and internationally. In a nutshell, this includes replatforming of on-premises Enterprise Data Hub from Hadoop cluster into GCP. Day to day tasks include but not limited to creating spark application which manipulate with data from different sources including Oracle, Google Cloud Storage, BigQuery; creating pipelines via GCP Dataflow; working with Jenkins and AirFlow.Requirements

• 5+ years of experience as a Java Developer
• Proficiency in data engineering
• Expertise in Big Data: Hadoop, Spark, Kafka
• Strong knowledge of Scala
• Expertise in Microservices Architecture
• Ability to work with high volumes of data
• Experience in working with AWS
• Experience in working with GCP: Dataproc (Apache Spark), Dataflow (Apache Beam), BigQuery, Cloud Storage
• Good understanding of Design Patterns, Clean Code, Unit testing
• Experience working in Agile environment
• Data modelling skills would be a plus
• Experience in Jenkins, AirFlow with Groovy and Python
• Excellent written and verbal communication skills
• Intermediate or higher English level, both verbal and written (B1+)

We offer

• Insurance Coverage
• Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves.
• Financial assistance for medical crisis
• Retiral Benefits – VPF and NPS
• Customized Mindfulness and Wellness programs
• EPAM Hobby Clubs
• Hybrid Work Model
• Soft loans to set up workspace at home
• Stable workload
• Relocation opportunities with ‘EPAM without Borders’ program
• Certification trainings for technical and soft skills
• Access to unlimited LinkedIn Learning platform
• Access to internal learning programs set up by world class trainers
• Community networking and idea creation platforms
• Mentorship programs
• Self-driven career progression tool

This is a remote position and we welcome applications from anywhere in IndiaOnce you apply, youll receive a confirmation email with a link to EPAM Anywhere platform. Sign up with this link to automate your prescreening, be able to monitor your application statuses, and enjoy a faster job application process.We accept CVs only in English.Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.EPAM Anywhere is a part of EPAM Systems, Inc. (NYSE: EPAM). Since 1993, EPAM has leveraged its advanced software engineering heritage to become the foremost global digital transformation services provider.