Data Engineer
Hotfoot Technology Solut...- 2 months ago
- Chennai, Tamil Nadu, India
- Full Time
Job Overview
Functional Area
Data
Work preferred
Work from Office
Experience
Min Experience
3 Years
Max Experience
8 Years
Description
Key Responsibilities:
- Design, develop and maintain scalable data pipelines to collate raw data from various sources
- Design, develop and maintain ETL processes utilizing various tools and technologies and ensure processes are optimized for performance and for meeting agreed upon SLAs
- Collaborate with the data science team to integrate advanced analytics solutions
- Work with cross-functional teams to design and implement sustainable data solutions
- Design, construct, test, and maintain data architectures and solutions
- Develop and enforce data governance policies
- Transform complex data sets into organized, usable data for further analysis
- Identify and troubleshoot data-related issues
- Conduct extensive testing on all components before going live
Required Skills and Experience:
- Minimum qualification - Bachelor’s degree in Engineering or Computer Applications
- Proven experience in data engineering, warehousing and ETL processes
- Experienced in tools like Apache Nifi, AWS Glue (ETL); Apache Airflow, Luigi (Orchestration), Talend, Kafka (Integration), Aapched Doris, Apache Hudi (DW)
- Knowledge of cloud based data solutions and on-prem
- Demonstrated ability to design, implement and maintain highly scalable and efficient data systems
- Exposure to Fintech domain is preferred(not compulsory)
- At Least 3 years of experience in the above
Qualification - BE/B.Tech
Experience - 3 years to 8 years
Notice Period- Immediate joiner/less than 30 days
Location : Chennai/Bangalore
Skills
AnalyticsData GovernanceData ScienceEtlImmediate Joiner