Data Engineer

Role: Data Engineering Lead/ Databricks / Cloud / Pharma Domain

Job Overview:

We are hiring a Data Engineering Lead to design and deliver scalable, secure, and high-performance data solutions using Databricks and cloud platforms (AWS / Azure / GCP). The role involves leading a team of data engineers and collaborating with analytics and business teams within the pharma commercial data domain.

Key Responsibilities:

• Architect and maintain data lakes, warehouses, and pipelines using Databricks, Apache Spark, and Airflow / ADF.
  
• Implement Medallion architecture, ensure governed and optimized data flow.
  
• Establish data governance, lineage tracking, and security controls (HIPAA, GDPR).
  
• Integrate Databricks with cloud storage and CRM platforms such as Salesforce / Veeva.
  
• Partner with data scientists and analysts to translate requirements into actionable data models.
  
• Drive innovation and continuous improvement in data engineering practices.
  
• Lead and mentor a team, enforcing coding standards and best practices.
  

Required Skills:

• 8+ years total experience, 5+ years in Databricks & Apache Spark.
  
• Strong in Python, Scala, SQL, and cloud data platforms (AWS / Azure / GCP).
  
• Hands-on with ETL/ELT tools (Airflow, ADF, Glue) and data modeling (Medallion architecture).
  
• Experience in pharma commercial data, HCP/HCO, and syndicated data integration.
  
• Proven leadership, communication, and stakeholder management skills.
  
• Education: B.E/B.Tech or M.Tech or any Graduate.
  
• Certifications: Databricks, AWS, or Azure preferred.