Systems Engineer III

Key Responsibilities As System Engineer III
Kafka Administration:
- Install configure and maintain Kafka clusters ensuring high availability and reliability.
- Manage Kafka brokers topics partitions and configurations to optimize performance.
- Implement and manage Kafka security protocols including SSL/SASL encryption and access control lists (ACLs)as well Manage Kafka quotas
- Monitor Kafka clusters for performance issues troubleshoot problems and implement solutions.
- Perform regular Kafka upgrades patching and maintenance to ensure stability and security.
Monitoring & Alerting:
- Set up comprehensive monitoring systems to track Kafka cluster health performance and resource usage.
- Implement real-time alerting mechanisms for critical Kafka metrics such as lag throughput broker performance and disk usage.
- Use monitoring tools such as Prometheus Grafana Splunk or Datadog to create dashboards and alerts.
- Continuously refine and improve alert thresholds to minimize false positives and ensure timely issue detection.
Performance Tuning & Optimization:
- Analyse and optimize Kafka performance including tuning broker configurations producer/consumer settings and JVM parameters.
- Conduct capacity planning and ensure Kafka infrastructure can handle growing data volumes.
- Troubleshoot and resolve Kafka performance issues including slow consumers high latency and broker instability.
Apicurio Administration:
- Install configure and maintain Apicurio Registry and associated tools in various environments (development testing production).
- Manage and maintain API schemas and versions in the Apicurio Registry.
- Implement security protocols for Apicurio including authentication authorization and encryption.
- Monitor the performance and health of the Apicurio Registry troubleshooting any issues that arise.
- Plan and execute upgrades patches and enhancements for the Apicurio environment.

Azure Cloud Management:
- Manage and maintain Azure cloud resources including virtual machines storage accounts virtual networks databases and other Azure services.
- Implement and manage security measures including identity and access management network security groups and encryption.
- Monitor and optimize Azure performance ensuring scalability reliability and cost-effectiveness.
- Plan and execute Azure resource provisioning scaling and disaster recovery strategies.
Middleware Platform Administration:
- Deep technical knowledge in Biztalk RTI SFG Ab Initio kafka Azure Administration Hadoop & Tibco ( capacity planning troubleshooting performance optimisation deployment & management of application
- Very good experience with system automation and deployment tools (Chef Puppet Ansible)
- Very good understanding of Unix /Linux command Shell scripting & power shell scripting
- Deep technical knowledge of networking (VPN subnet firewall SSH GTM LTM etc.)
- Technical knowledge of modern build tools like Jenkins Ant
- Deep Technical knowledge in architecting designing and integrating new solutions in a large scale enterprise of highly distributed applications (i.e. having an architectural sense for ensuring availability reliability maintainability scalability etc.)
- Technical knowledge on working of virtual machine & Physical machine
- Deep technical knowledge on Hardware configurations and setup like racks disk topology RAID etc.
- Sound knowledge on back up and restoration using Veeam or networker
Capacity Planning & Scaling:
- Perform capacity planning and forecasting to ensure that Kafka /Apicurio clusters can handle growth and increasing data volumes.
- Implement horizontal and vertical scaling strategies to meet business needs.
- Work closely with infrastructure teams to optimize hardware resources for Kafka deployments.
Automation & Scripting:
- Develop and maintain automation scripts for Kafka / Apicurio administration tasks using tools like Ansible Terraform or custom scripts.
- Create and maintain monitoring and alerting scripts to ensure the health and performance of Kafka clusters.
- Implement and manage CI/CD pipelines for API deployment and management.
- Automate routine maintenance tasks.
Incident Management & Support:
- Act as the primary point of contact for Kafka /Apicurio/Azure-related incidents ensuring quick resolution and minimal downtime.
- Collaborate with development DevOps and SRE teams to diagnose and resolve Kafka-related issues.
- Participate in on-call rotations to provide 24/7 support for Kafka environments.
Documentation & Training:
- Document configurations best practices and troubleshooting procedures in confluence page.
- Provide training and mentorship to junior team members on Platform administration
- Develop and maintain runbooks for incident response
Collaboration:
- Collaborate with Infrastructure development DevOps and IT teams to implement and support Kafka-based solutions.
- Participate in on-call rotations and provide support for critical issues outside of regular business hours as needed.
- Engage with stakeholders to understand requirements and design solutions that align with business goals.

Qualifications

We are seeking a skilled and experienced Senior Administrator to join our IT team. . The ideal candidate will have in-depth knowledge and hands-on experience with Apache Kafka responsible for managing and maintaining the Apicurio Registry and associated API management tools. He/she should have a sound knowledge and experience in Azure cloud infrastructure. In addition experience with middleware technologies such as Ab Initio TIBCO SFG BizTalk and RTI is highly desirable. This role requires strong analytical skills a deep understanding of data streaming and the ability to manage and scale Kafka clusters effectively.

Additional Information

Important Notice:

On behalf of Tesco Bengaluru, we must caution all job seekers and educational institutions that Tesco Bengaluru does not authorise any third parties to release employment offers or conduct recruitment drives via a third party. Hence, beware of inauthentic and fraudulent job offers or recruitment drives from any individuals or websites purporting to represent Tesco. Further, Tesco Bengaluru does not charge any fee or other emoluments for any reason (including without limitation, visa fees) or seek compensation from educational institutions to participate in recruitment events.

Accordingly, please check the authenticity of any such offers before acting on them and where acted upon, you do so at your own risk. Tesco Bengaluru shall neither be responsible for honouring or making good the promises made by fraudulent third parties, nor for any monetary or any other loss incurred by the aggrieved individual or educational institution.

In the event that you come across any fraudulent activities in the name of Tesco Bengaluru, please feel free report the incident at [HIDDEN TEXT]