Lead Data Engineer
Apexon- 2 months ago
- Hyderabad, Telangana, India
- Full Time
Please verify your account first! Send OTP
Job Overview
Functional Area
Data
Work preferred
Work from Office
Experience
Min Experience
17 Years
Max Experience
19 Years
Description
Description
- Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse
- Advanced SQL knowledge, capable to write optimized queries for faster data work flows.
- Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
- Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices
- Bachelors Degree or master’s degree in Computer Science.
- 10+ years of hands-on software engineering experience.
- Proven work experience in Spark , Python ,SQL , Any RDBMS.
- Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
- Strong database fundamentals including SQL, performance and schema design.
- Understanding of CI/CD framework is an added advantage.
- Ability to interpret/write custom shell scripts. Python scripting is a plus.
- Experience with any cloud is desired (Azure platform and Synapse/ AWS).
- Experience with Git / Azure DevOps
- To be able to work in a fast-paced agile development environment.
Skills
AgileBusiness TransformationDesigningEtlInnovationPythonReportingSqlTransformationWord