An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Data Engineer role at STALWART MANAGEMENT CONSULTING in Bangalore, Mumbai City, Pune for people with 4–8 years of experience. You'll build and maintain data infrastructure using PySpark, Azure Databricks, SQL, and ADLS. You'll design robust data pipelines and collaborate with data scientists.
- Bangalore
- Work from office
- 4–8 years
What you'll do
- Design robust data pipelines using PySpark
- Implement data storage solutions using ADLS
- Write complex SQL queries
Good fit if you
- Have strong experience in data engineering
- Be proficient in PySpark and Azure Databricks
- Possess solid understanding of SQL
AI-generated from the job description. Check the full description before you apply.
Job Description
We are seeking a skilled Data Engineer to join our dynamic team in Karnataka or Maharashtra. The ideal candidate will have a strong background in data engineering and be proficient in utilizing tools such as PySpark and Azure Databricks. This role is crucial for building and maintaining our data infrastructure, ensuring that our data pipelines are efficient, reliable, and scalable.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines using PySpark and Azure Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Implement data storage solutions using Azure Data Lake Storage (ADLS) and ensure data integrity and security.
- Write complex SQL queries to extract, transform, and load data from various sources.
- Monitor and optimize data workflows for performance and reliability.
- Troubleshoot and resolve data-related issues in a timely manner.
- Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives.
Required Skills:
- Strong experience in data engineering principles and practices.
- Proficiency in PySpark and Azure Databricks.
- Experience with Azure Data Lake Storage (ADLS).
- Solid understanding of SQL and experience in writing complex queries.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Strong problem-solving skills and attention to detail.
If you are passionate about data and eager to work in a fast-paced environment, we encourage you to apply for this exciting opportunity to make a significant impact on our data strategy.
Skills
Data EngineerAzure DatabricksPysparkSqlAdlsData EngineeringIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
The Stalwart Group has grown rapidly since its inception in 2009. In laying the seeds of an enterprise, The Stalwart Group continues to partner and work closely with individuals, businesses, educational institutes and organizations through the below companies. - Stalwart Business Consortium LLP ( www.stalwartsbcl.com ) - Stalwart Management Consulting ( www.stalwartmanagement.com ) - Magic of Mind Power ( www.magicofmindpower.com ) - Stalwart Learning Solutions Stalwart Management Consulting (SMC) is a part of the Stalwart Group and has been recognized and profiled as one of the 10-Most Admired Corporate Recruitment Companies – by Insights Success Magazine http://magazines.insightssuccess.in/The-10-Most-Admired-Corporate-Recruitment-Companies-March2018/ (Pl view pages 32/33)
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bangalore.
One email a day. Unsubscribe any time.

