MS Data Engineer

Job Purpose:

The MS Data Engineer is responsible for maintaining, optimizing, and supporting data platforms and pipelines for managed services clients. The role focuses on operational excellence, system stability, continuous improvement, SLA adherence, and proactive monitoring of data environments across cloud platforms.

Key Accountabilities:

Data Engineering & Operations (Managed Service Focus):

• Monitor, maintain, and support existing data pipelines, ETL processes, and data platforms for managed services clients.
• Ensure high availability, performance, and reliability of data systems across cloud environments (Azure, AWS, GCP).
• Perform ongoing optimization and tuning of data workflows to improve efficiency and cost-effectiveness.
• Troubleshoot and resolve data pipeline failures, integration issues, and performance bottlenecks within defined SLAs.
• Implement enhancements and minor change requests within client-managed environments.
• Maintain secure data environments, ensuring compliance with data governance, regulatory, and cross-border data requirements.
• Manage incident response, root cause analysis (RCA), and preventive action planning.
• Support backup, disaster recovery, and business continuity processes for data platforms.
• Collaborate with cloud, security, and infrastructure teams to ensure seamless operations.

Datawarehouse & Data Lake:

• Support schema updates, partition management, indexing strategies, and performance improvements.
• Ensure data integrity, accuracy, and consistency across systems.
• Monitor storage utilization and implement optimization strategies.

Monitoring, Governance & Compliance:

• Implement and maintain monitoring solutions for data pipelines and platforms.
• Create automated validation checks to ensure data quality and accuracy.
• Maintain documentation of data architecture, workflows, and operational procedures.
• Ensure compliance with client SLAs, internal policies, and security standards.

Reporting & Analytics Support:

• Support BI teams in maintaining dashboards (Power BI, Tableau, QuickSight, etc.).
• Troubleshoot data source connectivity and refresh issues.
• Assist in performance optimization of reporting queries and datasets.

Job Specification:

Education:

Bachelor's degree in computer science, information

technology, data engineering, or any related field

Professional Certification:

• Cloud platform certifications
• ITIL Foundation
• Data engineering or database certifications are an advantage

Working Experience:

• 3-6 years of experience in Data Engineering
• Strong hands-on experience with cloud data services
• Strong hands-on experience with cloud data services (Azure Data Factory, Synapse, AWS Glue, BigQuery, etc.).

Knowledge:

• Proficiency in SQL and scripting languages (Python preferred)
• Experience with ETL/ELT processes and data pipeline troubleshooting
• Familiarity with monitoring tools and incident management system
• Understanding of data governance, security, and compliance principles
• Experience working under SLAs and structured support frameworks

Compliance:

• Comply with the company's Information Security Management System (ISMS) and ISO 27001 requirements, and actively participate in regular training and audits to ensure continuous alignment with the standard.

Key Expectations:

• Embrace a dedication to excellence and actively seek opportunities for improvement and innovation.
• Contribute to a positive and collaborative environment that encourages effective teamwork and support.
• Collaborate with colleagues to adapt and achieve shared goals, driving success together.
• Serve as a role model for peers by embodying the Bespin Motto and upholding the behaviors and ethics that define our organization.
• Help create a vibrant and inspiring workplace for all employees