Senior Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
2-4 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
This job's closing date (2 Oct 2023) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Data Engineer, Level 4 – Job OverviewWe are seeking candidates with 9+ years of experience in building data products. Candidate must have extensive experience in extracting data from multiple systems, building reliable data pipelines and transforming data so that it can easily be analysed or consumed by downstream consumers and systems. Candidate should also have the ability to visualize and analyse data in dashboards or build custom data applications. The hire should be able to mentor junior team members and take larger responsibilities in the team deliverables.Required Technical Skill Set
  • Minimum 2+ years of working experience in MS Azure PaaS Services - Data Bricks, Data Factory, & Analysis Service.
  • Extensive experience in using BI tools / Big data solutions on MS Azure cloud (Spark / PySpark / Spark SQL / Scala).
  • Expert in SQL programming & advanced knowledge of NoSQL concepts and technologies such as Mongo DB, Cassandra, Hbase, Cosmos DB.
  • Experience in data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data.
  • Experience with enterprise-class data modelling tools including: PowerDesigner, ER/Studio, Erwin Data Modeler, Sparx Enterprise Architect.
  • Good knowledge of Hadoop 2.x, HDInsight, Scala, Hive, Pig, Sqoop, HDFS.
  • Hands-on experience in Power BI to visualise data.
  • 5+ years of experience in the field of enabling connectivity or supporting the integration of applications and processes - API Management, Robotic Process Automation, Job/Batch Scheduling (using Jenkins) etc.
  • Exceptional in data analysis & data modelling.
  • Ability to work with parametric & non-parametric mathematical models to solve machine learning (ML) problems.
  • Practical understanding of ML models linear regression, logistic regression, time series forecasting, decision trees, random forest etc.
  • 5+ years of experience of delivering analytics solution from start to finish.
Job Responsibilities
  • Utilize the deep understanding & knowledge about data storage and compute to deliver complex data solutions from start to finish.
  • Design DWH model ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.
  • Build optimal data pipeline for extraction, transformation, and loading of data from a wide variety of data sources. Performance tuning of complex ETL mappings for relational and non-relational workloads.
  • Perform cleansing, manipulation and analysis of large datasets, both structured and Unstructured.
  • Visualise and analyse data in dashboards or build custom data application.
  • Identify, design, and roll-out internal process improvements: automating manual processes, optimizing data delivery, etc.
  • Build & enhance data & statistical models.
  • Ensure that data transformations are well documented, follows best practices and are understood by business users and other members of scrum team.
  • Work with stakeholders to identify the best solution for any given problem.

Skills

AnalyticsAutomationDashboardsData AnalysisEtlForecastingLinear RegressionLogistic RegressionMachine LearningPower BiProcess AutomationRobotic Process AutomationScrumSqlTransformation

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Maersk is a global leader in integrated container logistics, offering end-to-end solutions to customers across industries worldwide. With a legacy spanning over a century, Maersk is renowned for its reliability, efficiency, and commitment to sustainability. Operating a fleet of container vessels, terminals, and logistics services, Maersk facilitates global trade, enabling businesses to connect and thrive. Maersk Careers provide diverse opportunities for individuals to be part of this innovative and dynamic organization, driving impactful change in the maritime and logistics sector. Join Maersk to embark on a rewarding journey, shaping the future of trade and logistics while advancing your career aspirations.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.