Senior Engineering Manager - Data Engineering
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
Lead / Engineering Manager — Data Platform
Experience: 15+ years
Location: Bengaluru, India | Employment Type: Full-time
About the Role
The Data Platform Engineering Manager leads Client's platform team through a complex transition — decommissioning Snowflake, replacing Confluent with RedPanda, maturing the Redshift Bronze/Silver/Gold architecture, and resolving SQL Server data accumulation debt. Legacy knowledge holders are departing. The handover will be lean. Proactive knowledge capture is essential.
Client Data Environment
4 x production SQL Server environments → CDC → Confluent (RedPanda under evaluation) → Redshift (Bronze/Silver/Gold) via DBT. Snowflake being retired. EC2, DynamoDB. ~90% internal, ~10% external data mix.
Key Responsibilities
-
Lead Staff and Senior Data and AI Engineers through the active platform transition
-
Own the Snowflake decommission programme — migrate remaining workloads to Redshift
-
Manage the Confluent-to-RedPanda evaluation and migration — own the decision, the plan, and the execution
-
Drive maturity of the Bronze/Silver/Gold Redshift architecture — standardise ingestion, transformation, and consumption patterns
-
Resolve SQL Server data accumulation and retention issues in collaboration with the DBA Lead
-
Lead knowledge capture from departing legacy team members proactively
-
Define and enforce data platform SLAs, observability standards (Coralogix, Grafana), and engineering practices
-
Collaborate with Data Governance Lead on policy implementation within platform pipelines
-
Manage hiring, onboarding, and development of the Bengaluru platform engineering team
Required Skills & Experience
-
15+ years in data engineering or platform engineering, with at least 5 years in engineering management
-
Deep SQL Server expertise — multi-environment production estate and CDC pipeline management
-
Strong Redshift expertise — Bronze/Silver/Gold medallion architecture design and operations at scale
-
Proven experience decommissioning data platforms — Snowflake migration experience valued
-
Hands-on experience evaluating and migrating streaming platforms — Confluent, RedPanda, or Kafka
-
DBT proficiency at scale
-
Familiarity with EC2, DynamoDB, and AWS data services
-
Experience managing lean knowledge-transfer situations in legacy system environments
-
PCI DSS compliance experience across data platform operations
-
Proven ability to build and scale distributed engineering teams
Mindset & Culture Fit
Must be genuinely proactive — able to drive knowledge retention, build structure in ambiguity, and take ownership in a transitioning environment without waiting for direction.
Skills
SQLData EngineeringKafkaDbtSnowflakeRedshiftSQL ServerDynamoDBAWSEC2GrafanaComplianceOnboardingLeanTeamsIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bangalore.
One email a day. Unsubscribe any time.

