Senior Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
3-5 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
Work From Office
Full Time

Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Company: A Large Global Organization

Key Skills: Azure Databricks, Azure Datafactory, Pyspark

Roles and Responsibilities:

  • Building and optimizing complex data pipelines using Microsoft Azure technologies.
  • Ensuring optimal extraction, transformation, and loading of data from various sources to Azure.
  • Collaborating with data analysts and data scientists to provide structured data for insights.
  • Provisioning resources on Azure and maintaining end-to-end data security.
  • Improving and evaluating existing data analytics solutions.
  • Expanding your competences through learning new tools and ways of working.

Skills Required:

  • Minimum of 3+ years of relevant experience in data engineering with a strong educational background.
  • Hands-on expertise in Azure Data Analytics, Spark, and Azure Databricks.
  • Strong ETL skills and experience building data pipelines using Databricks and Azure Data Factory.
  • Proficiency in real-time streaming/transactional data handling (Spark-Streaming, Kafka, EventHubs, Stream Analytics, etc.).
  • Experience with scripting languages like Python, Pyspark, and Scala.
  • Familiarity with Git and Git workflow for code management.
  • Proficiency in databases like SQL Server or Netezza.
  • Comfortable with DevOps practices and provisioning resources in Azure.
  • Adaptability to a diverse, complex, and rapidly changing landscape of data sources.
  • Excellent communication skills in English, proactive problem-solving abilities, and strong team collaboration.
  • Familiarity with AGILE project methodology and ARM Templates/Bicep on DevOps.
  • Understanding of DevOps Architecture and Azure Networking model.
  • Experience with data visualization tools like Microsoft Power BI, Qlik, SAP Business Objects.
  • Knowledge of ETL workflows using tools like Informatica IICS.
  • Familiarity with business intelligence platforms like Microsoft SSIS/SSAS/SSRS, Teradata, IBM Netezza.
  • Understanding of database management systems and online analytical processing (OLAP).

Education: Bachelor’s Degree/ Masters Degree in related field

Skills

AgileAnalyticsBusiness IntelligenceBusiness ObjectsData AnalyticsData VisualizationEtlManagement SystemsMicrosoft Power BiPower BiPythonSapSqlSql ServerTeradataTransformationVisualization

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

CareerNet Consulting, a premier recruitment and staffing solutions firm, specializes in connecting talented individuals with their dream roles across various industries. With a strong emphasis on innovation and quality, CareerNet Consulting careers offer professionals the chance to be part of a team that shapes the future workforce. The company's expertise in understanding market trends and individual career aspirations allows for personalized and strategic career guidance. Joining CareerNet Consulting means engaging in a culture that values integrity, collaboration, and excellence, providing an ideal platform for recruitment professionals to excel and grow. It's an opportunity to transform lives by matching the right talent with the right opportunity, making a significant impact in the professional world.

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.