Interesting Job Opportunity: Senior Lead Data Engineer - Python/Spark

HuQuo
Department Icon Data Science Analytics & Machine Learning
Posted: 3 years ago
10-12 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
Work From Office
Full Time
Posted: 3 years ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Must-Have :
  • 10+ years of experience in software development and delivery.
  • 5 to 7 years of relevant work experience on large-scale Data applications
  • Good aptitude, strong problem-solving abilities, and analytical skills
  • Should have team handling experience , leading team of 6-7 members OR handle 2-3 smaller teams
  • Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
Should Have Good Working Experience On
  • Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet
  • Spark - Batch Processing
  • Setting ETL pipelines
  • Python or Java programming language is mandatory.
  • Worked in data Lake , Data warehousing Domain in Cloud Environment
  • Exposure to Snowflake , Redshift or other Distributed Data Warehousing System
  • Experience working in Agile Methodology
  • Ability to learn and help the team learn new technologies quickly
  • Take up the complete of the project with strong sense of owenership.
  • Excellent communication and coordination skills
  • Knowledgeable (and preferred hands-on) - UNIX environments, different CICD tools, Scheduling tools like Autosys , Airflow etc.
  • Must be able to integrate quickly into the team and work independently towards team goals.
Nice To Have
  • Experience in any of the cloud (AWS/Azure/GCP) , preferred is AWS
  • Good to have experience in Snowflake
Role & Responsibilities
  • Take the complete responsibility for the project execution
  • Be accountable for the delivery of the project in the defined timelines with good quality
  • Define and follow the processes for project execution and delivery.
  • Drive and motivate the team to be agile and follow agile methodology
  • Guide the team technically and give the team a direction on how to plan, design, implement and deliver the projects.
  • Define the architecture and discuss the pros-cons of the same with the team
  • Involve the team during the brainstorming sessions as appropriate.
  • Work with other team leads to get the architecture reviewed.
  • Work with the clients and counterparts (in the US) to drive the project execution.
  • Keep all the stakeholders updated about the project status/risks/issues if there are any.
  • Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.
  • Should be comfortable travel to Pune as and when required
Key Skills : Java / Python , Spark, Snowflake, AWSEducation : BE/B.Tech from a reputed institute.(ref:hirist.com)

Skills

AgileAgile MethodologyData WarehousingEtlPythonQualitySnowflakeSoftware DevelopmentTeam HandlingUnix

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.