Azure Databricks Architect - ETL/PySpark

Department Icon Data Science Analytics & Machine Learning
Posted: 3 weeks ago
8-20 years
Chennai
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 25 Dec 2026

Posted: 3 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Job Description

  • Azure Databricks Architect - ETL/PySpark
  • Company: SP Staffing Servcies
  • Job Location: Chennai, Tamil Nadu, India
  • Employment Type: Full-time
  • Experience Required: 8 - 20 years
  • Work Location : Pan India
  • Total Experience : 8 - 20 years
  • Role Overview :Design and implement end-to-end data architecture using Azure Databricks and Microsoft Azure services.
  • Key Responsibilities :
  • Architect scalable data lakehouse solutions using Delta Lake and medallion architecture (Bronze, Silver, Gold).
  • Define data ingestion, transformation, integration, and orchestration strategies.
  • Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.
  • Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
  • Implement data governance, security, access control, and compliance using Unity Catalog, RBAC, and Azure security services.
  • Optimize Spark workloads, cluster configurations, job performance, and cloud costs.
  • Integrate Databricks with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and other enterprise data sources.
  • Establish CI/CD, deployment automation, monitoring, and data quality standards. (ref:hirist.tech) .

Skills

EtlDatabricksDelta LakeETLAccess ControlSecurityAzure DatabricksSpark SQLPythonData GovernancePySparkAzure Data Factory

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Chennai.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.