Azure Databricks Architect - ETL/PySpark
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
- Azure Databricks Architect - ETL/PySpark
- Company: SP Staffing Servcies
- Job Location: Chennai, Tamil Nadu, India
- Employment Type: Full-time
- Experience Required: 8 - 20 years
- Work Location : Pan India
- Total Experience : 8 - 20 years
- Role Overview :Design and implement end-to-end data architecture using Azure Databricks and Microsoft Azure services.
- Key Responsibilities :
- Architect scalable data lakehouse solutions using Delta Lake and medallion architecture (Bronze, Silver, Gold).
- Define data ingestion, transformation, integration, and orchestration strategies.
- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.
- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Implement data governance, security, access control, and compliance using Unity Catalog, RBAC, and Azure security services.
- Optimize Spark workloads, cluster configurations, job performance, and cloud costs.
- Integrate Databricks with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and other enterprise data sources.
- Establish CI/CD, deployment automation, monitoring, and data quality standards. (ref:hirist.tech) .
Skills
EtlDatabricksDelta LakeETLAccess ControlSecurityAzure DatabricksSpark SQLPythonData GovernancePySparkAzure Data FactoryIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Chennai.
One email a day. Unsubscribe any time.

