Lead Engineer - Azure Data Platform

As a Lead Consultant in Azure Data Platform Engineering & Ops, you will be responsible for designing, implementing, and managing data solutions on the Azure cloud platform. Your primary focus will be on architecting, building, and optimizing data pipelines, data storage, and data processing systems using Azure services. You will work closely with clients, project teams, and other stakeholders to understand business requirements and provide expert guidance on leveraging Azures data platform capabilities.

• Architect and design Azure data solutions
• Collaborate with clients and stakeholders to understand business requirements and design scalable, reliable, and cost-effective data solutions on Azure.
• Define data architectures, data models, and data integration patterns that align with business goals and best practices.
• Evaluate and recommend appropriate Azure services and components to meet specific data processing and storage needs.
• Lead data platform engineering and development
• Lead the design, development, and implementation of data pipelines, ETL/ELT processes, and data transformation workflows using Azure Data Factory, Azure Databricks, and other relevant tools.
• Implement data governance and security measures to ensure data privacy and compliance.
• Develop data monitoring and alerting mechanisms to proactively identify and address issues.
• Optimize and tune data systems
• Optimize data storage and retrieval systems for performance, scalability, and cost efficiency.
• 
  Identify and resolve performance bottlenecks and optimize query performance in Azure SQL Database, Azure Synapse Analytics, or other data storage solutions.
• Implement data caching, partitioning, and indexing strategies for improved performance.
• Implement data integration and streaming solutions
• Design and implement real-time and batch data integration solutions using Azure Event Hubs, Azure Data Lake Storage, Azure Stream Analytics, or other relevant technologies.
• Develop and maintain data ingestion and streaming pipelines for efficient data processing and analytics.
• Collaborate with cross-functional teams
• Collaborate with architects, data engineers, data scientists, and other stakeholders to ensure the successful implementation of data solutions.
• Work closely with project managers to ensure timely delivery of projects, manage risks, and meet client expectations.
• Provide technical leadership, guidance, and mentoring to junior team members.
• Stay up-to-date with Azure and data platform trends
• Keep abreast of the latest trends, updates, and advancements in Azure data services and platform capabilities.
• Evaluate and recommend new tools, frameworks, and technologies that can enhance the data platform engineering and operations.

• Looking to get Placed? Try our Placement Guarantee Plan

  Get Hired
  Bachelors or master’s degree in computer science, Information Technology, or a related field.
• Minimum 10 years of experience in data platform engineering, development, and operations.
• Strong expertise in architecting and implementing data solutions on Azure cloud platform.
• In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Azure Event Hubs, etc.
• Proficiency in data integration techniques and technologies, including ETL/ELT processes, data transformation, and streaming.
• Strong SQL querying skills and experience with data modeling and database design.
• Understanding of data governance, security, and compliance requirements.
• Experience with data visualization and analytics tools such as Power BI or Azure Analysis Services.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and interpersonal skills.
• Leadership experience and ability to lead and mentor teams.
• Azure certifications related to data services (e.g., Azure Data Engineer, Azure Solutions Architect) preferred.