Principal - Data Engineering

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
14-16 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
This job's closing date (9 Sep 2023) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Role DescriptionAs Principal, Data Engineering, India, you will be leading the Data Management & Data Engineering delivery of the Pharma business at TheMathCompany.Required QualificationsWe are looking for individuals who are curious, excited about learning, and navigating through the uncertainties and complexities that are associated with growing a company. Some qualifications that we think would help you thrive in this role are:
  • BE/BS/MTech/MS in computer science or equivalent work experience.
  • 14+ years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming
  • 5+ years of experience in building scalable enterprise data warehousing and modelling on prem and/or cloud (AWS, GCP, Azure)
Preferred Qualifications
  • Expertise in data structures, distributed computing, manipulating and analyzing complex high-volume data from variety of internal and external sources
  • Experience in developing ETL designs and data models for structured/ unstructured and streaming data sources
  • Experienced in SQL performance tuning & recommendations
  • Experience in building large scale data pipelines in batch and real time mode
  • Experience in data migration to cloud (AWS/GCP/Azure)
  • Proficient in programming language such as Python/Scala
  • Good understanding of in relational/dimensional modelling and ETL concepts
  • Good understanding of data analysis techniques
  • Solid working knowledge of SQL and scripting
  • Strong experience in database, data warehouse & data lake design & architecture
  • Able to train & mentor team members
  • Experience in Database programming using multiple flavor of SQL
  • Deploy scalable data pipelines for analytical needs
  • Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
  • Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL
  • Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
  • Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow
  • Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
  • Hands-on experience in using Spark Streaming, Kafka and Hbase
  • Experience in any orchestration tool such as Airflow/Oozie
  • Experience working in an Agile/Scrum development process

Skills

AgileData AnalysisData ManagementData MigrationData ProcessingData WarehousingEtlPharmaPythonSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

TheMathCompany is a global data analytics and data engineering firm that helps organizations realize value from their data.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.