An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
- 12+ years of Data Engineering and Architecture experience with at least 5+ years of Databricks architecture experience.
- Strong experience in large-scale cloud data platform modernization programs.
- Proven experience migrating on-premises or Synapse-based platforms to Databricks Lakehouse.
- Experience designing enterprise-scale Data Mesh and Data Product architectures.
- Banking and Financial Services domain experience preferred.
- Experience leading architecture governance, design reviews, and technical strategy discussions.
Success Measures
- Successful modernization of legacy data platforms onto Databricks Lakehouse.
- Improved platform scalability, performance, and cost efficiency.
- Establishment of reusable architecture patterns and engineering standards.
- Accelerated delivery through automation, DataOps, and CI/CD adoption.
- Secure, governed, and compliant enterprise data platform implementation.
- Increased adoption of Data Products and self-service analytics capabilities.
Key Skills Required
Databricks & Lakehouse
- Databricks Lakehouse Platform
- Delta Lake
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks SQL
- Databricks Workflows
- Serverless Compute
- MLflow
Data Engineering & Processing
- PySpark
- Spark SQL
- Python
- Structured Streaming
- Auto Loader
- Change Data Capture (CDC)
- Delta Change Data Feed (CDF)
- Data Product Design
Architecture & Modernization
- Lakehouse Architecture
- Medallion Architecture
- Data Mesh Principles
- Enterprise Data Architecture
- Migration Strategy & Modernization
- Data Modeling
- Distributed Computing
Performance & Optimization
- Liquid Clustering
- Partitioning Strategies
- Z-Ordering
- Query Performance Tuning
- Workload Optimization
- Cost Optimization
- Capacity Planning
DevOps & Automation
- Git Integration
- Databricks Asset Bundles (DAB)
- Terraform
- Azure DevOps
- CI/CD Pipelines
- Infrastructure as Code (IaC)
Cloud & Platform
- Microsoft Azure
- Azure Data Lake Storage Gen2
- Azure Data Factory
- Azure Entra ID
- Event Hub
- Monitoring & Observability Frameworks
Skills
Azure DatabricksAzure Data LakeData LakeBricksData ArchitectureAzure Data FactoryDataMicrosoft AzurePythonData ArchitectureData ModelingImplementationAnalyticsData ProductSqlMlflowDatabricksIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allNew Data Science Analytics & Machine Learning roles in Chennai.
One email a day. Unsubscribe any time.

