Data Engineer - Databricks, Pyspark, SQL
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Data Engineer - Databricks, Pyspark, SQL role at Sigma Allied Services private Limited in Bangalore for people with 3–5 years of experience. You'll build ETL pipelines, design data workflows using Databricks and PySpark, and manage datasets with SQL, Delta Lake, and Azure Data Factory.
- Bangalore
- Work from office
- 3–5 years
What you'll do
- Design and develop ETL pipelines
- Orchestrate workflows with Azure Data Factory
- Monitor data processing jobs
Good fit if you
- Have 3–5 years of experience
- Know data processing and integration technologies
- Want to deepen data engineering expertise
AI-generated from the job description. Check the full description before you apply.
Job Description
Join a forward-thinking organization as a Data Engineer and leverage your skills in data processing and integration technologies. This role is perfect for individuals with experience in designing, developing, and maintaining ETL pipelines to support data-driven decision-making across the organization.
In this position, you will utilize Databricks and PySpark to create efficient data workflows that enhance analytics capabilities. Your expertise in SQL will be vital for querying and managing large datasets while ensuring high standards of data quality and integrity. You will also work with Azure Data Factory to orchestrate data movements, implementing storage solutions with Delta Lake to facilitate seamless access to robust datasets.
Key responsibilities include:
- Designing, developing, and maintaining ETL pipelines for effective data integration.
- Collaborating with data scientists and analysts to understand their data needs and deliver suitable solutions.
- Optimizing existing data workflows while overseeing the quality of processed data.
- Implementing and managing storage using Delta Lake and orchestrating workflows with Azure Data Factory.
- Monitoring data processing jobs to troubleshoot issues and ensure timely delivery.
This role offers the chance to deepen your expertise in advanced data engineering practices, as well as exposure to evolving technologies in the field. You will have opportunities for professional growth while contributing meaningfully to organizational success through your work with data.
Skills
Data EngineerSqlDatabricksEtl PipelinesDelta LakePysparkAzure Data FactoryIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bangalore.
One email a day. Unsubscribe any time.

