Interesting Job Opportunity: Data Engineer - Python/Big Data

HuQuo
Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
3-8 years
Greater Kolkata Area
Data Science Analytics & Machine Learning
Work From Office
Full Time
Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Basic Understanding Of
  • Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar
  • Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
  • Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
  • Agile Process (Scrum cadences, Roles, deliverables) & basic understanding in either Azure DevOps, JIRA, or Similar
  • Architecture and data modeling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
  • Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt, or Similar
Strong In
  • Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
  • Big Data Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), SparkScala or SparkSQL) or Similar
  • Data warehouse working experience of concepts and development using SQL on single (SQL Server, Oracle or Similar) and parallel platforms (Azure SQL Data Warehouse or Snowflake)
  • Code Management & working experience in GIT Hub, Azure DevOps, or Similar
  • End to End Architecture and ETL processes & working experience in ETL Tool or Similar
  • Reading Data Formats & working experience in JSON, XML, or Similar
  • Data integration processes (batch & real- time) using tools & working experience in either Informatica PowerCenter and/or Cloud, Microsoft SSIS,
  • MuleSoft, DataStage, Sqoop, or Similar
  • Writing requirement, functional & technical documentation & working experience in the Integration design document, architecture documentation, data testing plans or Similar
  • SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
  • Database & working experience in any of the database like MS SQL, Oracle, or Similar
  • Analytical Problem- Solving skills & working experience in resolving complex problems or Similar
  • Communication (read & write in English), Collaboration & Presentation skills & working experience as a team player or Similar.
Good To Have
  • Stream Processing & working experience in either Databricks Streaming, Azure Stream Analytics or HD Insight or Kinesis Data Analytics or Similar
  • Analytical Warehouse & working experience in either SQL Data Warehouse or Amazon Athena or AWS Redshift or Big Query or Similar
  • Real- Time Store & working experience in either Azure Cosmos DB or Amazon Dynamo- DB or Cloud Bigdata or Similar
  • Batch Ingestion & working experience in Data Factory or Amazon Kinesis or Lambda or Cloud Pub/Sub or Similar Storage & working experience in Azure Data Lake Storage
  • GEN1/GEN2 or Amazon S3 or Cloud Storage or Similar
  • Batch Data Processing & working experience in either Azure Databricks or HD Insight or Amazon EMR or AWS Glue or Similar
  • Orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar
(ref:hirist.com)

Skills

AgileAnalyticsData AnalyticsData IntegrationData ModelingData ProcessingEtlEtl ToolJiraOraclePresentationPythonSqlTechnical DocumentationXml

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Greater Kolkata Area.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.