Senior Data Platform Engineer
Telstra- 1 month ago
- Hyderabad, Telangana, India
- Full Time
Job Overview
Functional Area
Data
Work preferred
Work from Office
Experience
Min Experience
Fresher
Max Experience
1 Years
Description
We are seeking a highly skilled Senior Data Platform Engineer with a strong data engineering background to join our team for a greenfield Data Platform as a Service (PaaS) project. As a Senior Data Platform Engineer, you will play a crucial role in designing, developing, and maintaining our Azure-based data platform. You will work closely with the lead architect and cross-functional teams to implement scalable and efficient data solutions. Your expertise in data engineering, Azure data services, and software development will contribute to the success of the project.
This role can be based out of Hyderabad, Pune or Bangalore.
The Role of a Senior Data Platform Engineer:
- Collaborate with the lead architect and stakeholders to understand business requirements and translate them into technical solutions.
- Design and develop scalable data solutions using Azure data services such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and Azure Cosmos DB.
- Implement data ingestion patterns using technologies like Azure EventHub, Azure Function App or Azure Data Factory.
- Develop and maintain infrastructure-as-code (IaC) configurations using technologies like Terraform or Bicep or ARM Templates for automated and reproducible deployments.
- Ensure data security and privacy by implementing access controls, encryption mechanisms, and compliance standards.
- Optimise data pipelines and queries for performance and scalability.
- Collaborate with the testing team to implement automated tests and ensure the quality of the data platform.
- Participate in code reviews and provide constructive feedback to maintain code quality and adherence to best practices.
- Troubleshoot and resolve issues related to data pipelines, platform components, and integrations.
- Mentor and provide guidance to junior engineers, fostering their professional growth.
What youll need to succeed:
- Proven experience as a data engineer or software engineer with a focus on data platforms and Azure technologies.
- Strong expertise in data engineering concepts and technologies, including data ingestion, ETL/ELT processes, and data integration techniques.
- Strong expertise in Azure data services, including Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and Azure Cosmos DB.
- Experience with big data processing frameworks such as Apache Spark or Azure Databricks.
- Proficiency in programming languages such as Python, SQL, or Scala.
- Familiarity with infrastructure-as-code (IaC) technologies like Terraform or Bicep or ARM Templates.
- Knowledge of data security, encryption, and compliance standards.
- Experience with version control systems like Git and collaborative development methodologies.
- Strong problem-solving and analytical skills, with the ability to troubleshoot complex data issues.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
Why join us?
A career in one of our technology teams will give you the exciting responsibility of using technology, automation and innovation to try and solve the worlds biggest technological challenges in areas such as Internet of Things (IoT), 5G, Artificial Intelligence (AI), Machine Learning, and more.
We love to work in a collaborative way; youll have the chance to come into the office from time to time, to work with other areas of Data and even other business units, sharing ideas, talking Data and tech, with Brown Bag sessions/ lunch and learns and just generally bonding with your teammates.
When joining Telstra, youll have the chance to professionally develop, as we have dedicated People Development days and we have just won a Cloud Innovator Award from Nasscom. Now really is a great time to join the Data team, as weve seen growth of around 40% in the last year, with similar growth to follow in this new financial year; giving you the chance to be part of something really special.
Were committed to building a diverse and inclusive workforce in all its forms. We encourage applicants from diverse gender, cultural and linguistic backgrounds and applicants who may be living with a disability. We also offer flexibility in all our roles, to ensure everyone can participate.
To learn more about how we support our people, including accessibility adjustments we can provide you through the recruitment process, visit tel.st/thrive.
Skills
AnalyticsArtificial IntelligenceAutomationData IntegrationData ProcessingDesigningEtlInnovationMachine LearningPythonQualityRecruitmentSoftware DevelopmentSql