An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Data Engineer role at STALWART MANAGEMENT CONSULTING in Bangalore, Mumbai City, Pune for people with 5–8 years of experience. You'll build PySpark, Azure Databricks, ADLS, and SQL pipelines.
- Bangalore
- Work from office
- 5–8 years
What you'll do
- Develop robust data pipelines using PySpark
- Implement data models and ETL processes
- Optimize SQL queries for performance
Good fit if you
- Have strong experience with PySpark
- Know Azure Data Lake Storage
- Have problem-solving skills
AI-generated from the job description. Check the full description before you apply.
Job Description
We are seeking a skilled Data Engineer to join our dynamic team in Karnataka or Maharashtra. The ideal candidate will have a strong background in data engineering, with expertise in PySpark, Azure Databricks, ADLS, and SQL. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and maintain robust data pipelines using PySpark and Azure Databricks to ensure efficient data processing and storage.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
- Implement data models and ETL processes to support data integration from various sources, including ADLS.
- Optimize SQL queries for performance and scalability, ensuring data accessibility for end-users.
- Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
- Stay updated with the latest trends and technologies in data engineering to continuously enhance our data infrastructure.
Required Skills:
- Proficiency in data engineering concepts and practices.
- Strong experience with PySpark and Azure Databricks.
- Familiarity with Azure Data Lake Storage (ADLS) and SQL.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Problem-solving skills and a proactive approach to challenges.
If you are passionate about data engineering and eager to contribute to innovative data solutions, we encourage you to apply for this exciting opportunity.
Skills
Data EngineerAzure DatabricksPysparkSqlAdlsData EngineeringIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
The Stalwart Group has grown rapidly since its inception in 2009. In laying the seeds of an enterprise, The Stalwart Group continues to partner and work closely with individuals, businesses, educational institutes and organizations through the below companies. - Stalwart Business Consortium LLP ( www.stalwartsbcl.com ) - Stalwart Management Consulting ( www.stalwartmanagement.com ) - Magic of Mind Power ( www.magicofmindpower.com ) - Stalwart Learning Solutions Stalwart Management Consulting (SMC) is a part of the Stalwart Group and has been recognized and profiled as one of the 10-Most Admired Corporate Recruitment Companies – by Insights Success Magazine http://magazines.insightssuccess.in/The-10-Most-Admired-Corporate-Recruitment-Companies-March2018/ (Pl view pages 32/33)
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Bangalore.
One email a day. Unsubscribe any time.

