Senior Data Engineer - AI & Data

• Senior Data Engineer - AI & Data
• Company: Lead Data Analytics US Based company
• Job Location: Ahmedabad, Gujarat, India
• Employment Type: Full-time
• Experience Required: 5 - 8 years
• Job Title: Senior Data Engineer
• Company Description
• Company: Lead Data Analytics US Based company
• Job Location and Employment Details
• Location: Hyderabad (Max Budget: 22 LPA) | Ahmedabad (Max Budget: 20 LPA)
• Work Mode: 5 Days Work From Office (No Hybrid/Remote)
• Notice Period: Immediate to 15 Days Max
• Location Criteria: Strictly Local Candidates Only. (Candidates must currently reside in Hyderabad or Ahmedabad. Relocating candidates will not be considered).
• Role Summary

We are seeking a highly skilled Senior Data Engineer to lead the design and implementation of scalable, high-performance data pipelines. In this role, you will define architectural best practices and drive data transformation at scale using Snowflake, dbt, Python, and SQL. You will own end-to-end project delivery, mentor junior engineers, and enforce data governance standards. While cloud-agnostic experience is welcome, a strong preference is given to candidates with Azure (ADF and Databricks) expertise.

Key Responsibilities

Pipeline Architecture: Architect and implement modular, test-driven ELT pipelines using dbt on Snowflake, leveraging advanced capabilities like macros, packages, custom tests, and version control.

Data Ingestion & Transformation: Lead the ingestion of structured and semi-structured data from APIs, cloud storage, and databases. Write robust Python scripts for data transformation, automation, and integrations.

Project Ownership & Leadership: Manage end-to-end project delivery in a consulting setup. Mentor small teams of junior engineers, lead code reviews, and establish reusable frameworks.

• Cloud Orchestration: Orchestrate workflows using dbt Cloud, Azure Data Factory (ADF), Airflow, or similar tools, integrated with CI/CD pipelines.
• Data Modeling: Design layered data models (medallion architecture: Bronze/Silver/Gold) and apply dimensional modeling principles (Star/Snowflake schemas, SCDs).
• Performance & Optimization: Optimize Snowflake for performance and cost, managing warehouse sizing, clustering, materializations, and query profiling.
• Governance & Security: Enforce data governance, compliance practices, RBAC, secure data sharing, and encryption strategies.
• Required Qualifications & Skills
• Experience: 5 to 8 years overall in data engineering, with 3+ years of mandatory hands-on experience in Snowflake and dbt in production environments.
• Core Tech Stack (Mandatory): Expert-level proficiency in SQL (querying/tuning), Python, Snowflake, and dbt.
• Cloud Experience: Strong hands-on experience with at least one major cloud platform. Azure (with ADF and Databricks) is highly preferred.
• Leadership: Proven experience as a Project Owner, including end-to-end delivery and handling/mentoring small teams.
• Education: Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
• Preferred/Bonus Skills (Nice to Have)
• Exposure to AI/ML data pipelines, feature stores, or MLflow.
• Previous experience with Matillion (Data Productivity Cloud or Matillion ETL).
• Certifications: Snowflake SnowPro Advanced, dbt Certified Developer, or equivalent Cloud certifications.
• Key Skills: Snowflake, DBT, Azure, ADF, Databricks, Python, SQL .