Senior Data Engineer

Role: Senior Data Engineer

Total Experience Range: 6+ yrs

Relevant experience in Azure Databricks, Azure Data Factory, SQL, ADLS, Medallion Architecture, Python, SCD Concepts and implementation, DevOps CI/CD - 4+ yrs (Must have)

Location: Trivandrum

What is the expectation from the candidates current role/profile

? Design and develop warehouse solutions using Databricks, ADF, ADLS etc.

? Should be proficient in SQL and Query optimization.

? Should have worked in onshore offshore model managing challenging scenarios.

? Expertise in working with large amounts of data (structured and unstructured), building data pipelines for ETL workloads and generate insights utilizing Data Science, Analytics.

? Expertise in Azure cloud services, and DevOps/CI/CD frameworks.

? Ability to work with ambiguity and vague requirements and transform them into deliverables.

? Good combination of technical and interpersonal skills with strong written and verbal communication; detail-oriented with the ability to work independently.

? Drive automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins.

? Help build define architecture frameworks, best practices & processes. Collaborate on Data warehouse architecture and technical design discussions.

? Expertise in Azure Data factory and should be familiar with building pipelines for ETL projects.

? Expertise in SQL knowledge and experience working with relational databases.

? Expertise in Python and ETL projects

? Experience in data bricks will be of added advantage.

? Should have expertise in data life cycle, data ingestion, transformation, data loading, validation, and performance tuning.