Senior Data Engineer

Role- Senior Data Engineer

Experience- 8-10 years

Location- Remote

Notice Period- Only Immediate joiners

Job Overview:

We are looking for an experienced Lead Data Engineer with 8-10 years of experience to join

the Professional Services team.

Key Responsibilities:

1. Data Integration and Management:

oLead initiatives for integrating, transforming, and managing large datasets.

oEnsure optimal data availability and performance.

2. Advanced SQL Queries:

oAnalyze and resolve data issues using complex SQL queries.

oProficient in writing ETL code.

3. Azure Data Factory:

oUse Azure Data Factory for orchestrating data workflows and pipelines.

oImplement cloud-based integration best practices.

4. Azure Pipelines Deployment:

oManage CI/CD pipelines to automate and streamline deployment processes.

5. Kubernetes Deployment:

oOversee deployment and management of data solutions in Kubernetes.

oEnsure application scalability, reliability, and security.

6. Python and Shell Scripting:

oDevelop scripts for data processing, automation, and system integration.

Qualifications:

Bachelors degree in Computer Science, Information Technology, or a related field.

8-10 years of experience in data engineering and configuration management.

Expertise in SQL, data warehousing, and cloud environments, preferably Microsoft

Azure.

Hands-on experience with Azure Data Factory, Azure pipelines, Kubernetes, Python,

shell scripting, and Snowflake or similar technologies.

Experience with extensive datasets and ETL code development for data import.

Immediate availability is preferred.