.webp){kind=logo}
Azure Data Engineer (ADF, Databricks, Python, PySpark)
Data Science Analytics & Machine Learning
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
:
Position:ADF, Databricks, PySpark Engineer
Experience:7 to 9 years
Location:Bangalore, Trivandrum
Roles & Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
- Build scalable data processing solutions using Azure Databricks, Python, and PySpark.
- Develop ETL/ELT workflows for data ingestion, transformation, and loading.
- Work with Azure Data Lake Storage (ADLS), Azure SQL, and other Azure data services.
- Optimize Spark jobs and Databricks notebooks for performance and scalability.
- Implement data quality checks, validation rules, and monitoring processes.
- Create and manage end-to-end data integration solutions across multiple data sources.
- Collaborate with business stakeholders and data teams to understand data requirements.
- Troubleshoot and resolve data pipeline and performance issues.
- Follow coding standards, version control, and CI/CD best practices.
- Support data warehousing and analytics initiatives.
- Prepare technical documentation and maintain deployment artifacts.
Skills
PySparkAzure DatabricksAzure Data Factory (ADF)ETL/ELT DevelopmentSQLApache SparkGitAzure Data Lake Storage (ADLS)PythonData IntegrationData WarehousingEtlData ProcessingAnalyticsSqlDatabricksData EngineerIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Infosys Limited is an Indian multinational information technology company that provides business consulting, information technology and outsourcing services. The company was founded in Pune and is headquartered in Bangalore.
Infosys is a global leader in next-generation digital services and consulting. We enable clients in 45 countries to navigate their digital transformation. With over three decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through the many nexts of their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change.
We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise and ideas from our innovation ecosystem.
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Hybrid - Bengaluru.
One email a day. Unsubscribe any time.
