Lead Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 5 days ago
8-15 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 10 Jan 2027

Posted: 5 days ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

Opportunity Overview:

We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams.

What you’ll do:

  • Lead Data Engineering Initiatives 
  • Lead delivery of complex data engineering projects across multiple teams 
  • Drive technical execution from design through production deployment 
  • Establish scalable implementation patterns Build and Optimize Data Platforms 
  • Design and implement batch and near-real-time pipelines 
  • Build reusable ingestion, transformation, validation, and publishing frameworks 
  • Support modernization of legacy workloads Lakehouse Engineering 
  • Lead Apache Iceberg implementation and optimization 
  • Define standards for schema evolution, partitioning, compaction, and metadata management 
  • Ensure efficient storage and query performance Data Quality and Reliability 
  • Implement data quality frameworks 
  • Drive observability and monitoring practices 
  • Improve operational excellence and reliability Technical Leadership 
  • Review architecture and design proposals 
  • Conduct code reviews and engineering reviews 
  • Mentor engineers and establish best practices
  • Mentor engineers across levels, providing feedback, support, and growth opportunities aligned with career progression frameworks
  • Collaborate with Staff Engineers and Managers to define and evolve platform architecture, technical strategy, and system reliability goals
  • Act as a technical liaison between data platform engineering, analytics, and product teams—translating requirements into scalable, maintainable solutions

ISMS roles and responsibilities:

  • Good knowledge of Information practices.
  • Assist the manager in all the information security activities implementation and maintenance process.
  • Ensuring the  team and imparted with Competence related to Information security
  • Responsible for implementation of security policies and procedures and report any issues to the Information Security Manager.

What you’ll need:

Must-haves

  • 8–12 years of Data Engineering experience.
  • Healthcare claims and authorization datasets.(Insurance)
  • Experience leading enterprise-scale data initiatives Cloud Technologies 
  • AWS S3, Glue, Athena, Lake Formation 
  • IAM and security controls Modern Data Stack 
  • Apache Iceberg (preferred) 
  • Delta Lake / Hudi • dbt • Airflow or Step FunctionsProgramming 
  • Python 
  • SQL 
  • PySpark / Spark

Nice-to-haves

  • Kafka / AWS MSK 
  • SageMaker 
  • Atlan or similar catalogs 
  • Multi-tenant data platforms 
  • Data contracts and Data Mesh concepts
  • DBT

Ability to commute/relocate:

  • Hyderabad, Telangana: Reliably commute or planning to relocate before starting work (Preferred)

Interview Process*:

  1. Connect with Talent Acquisition 
  2. Meet with the Hiring Manager
  3. Behavioral Interview(s)
  4. Case Study
  5. Interview with Senior Leadership

*Subject to change

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement: 

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all.  To us, it’s personal.

Skills

PythonSQLData EngineeringPySparkKafkaAirflowDbtAWSApacheS3IAMReconciliationTalent AcquisitionLeadershipTeams

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Cohere Health is connecting healthcare payers and providers to improve the experience for patients and clinicians, reduce wasteful spending, and raise the quality of care. Our platform is a comprehensive prior authorization (PA) solution that is intelligent, collaborative, and supportive. This reduces the administrative burden on doctors and patients, and it lowers costs for healthcare payers. We are looking for team members who are mission-driven, collaborative, and ready to continuously learn and grow.
Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.