Data QA Analyst (Machine Learning)

Description

We are seeking a Machine Learning QA Analyst to join our dynamic analytics team. In this role, youll lead comprehensive testing of our AI/ML products, algorithms, and data analytics products, ensuring data quality, system integration, and End-to-End testing. With extensive experience in AI, machine learning, and agile development, youll drive innovation by developing and maintaining an automation framework integrated into the DevOps pipeline. Your deep industry knowledge will contribute to the teams growth, and youll collaborate with cross-functional teams to ensure top-quality testing. This is an opportunity to play a pivotal role in advancing our data analytics capabilities. Networks with senior internal and external personnel in the area of expertise and some key contacts outside the area of expertise.

Key Responsibilities

• Showcase expertise in AI, ML techniques, and statistical models while possessing a strong grasp of the pharmaceutical industry, digital healthcare products, and the challenges that can be addressed through Data and Analytics
• Facilitate and champion the use of cutting-edge machine-learning testing techniques
• Promote and establish best practices in machine learning engineering, MLOps, and AlgoOps testing
• Develop and implement test automation strategies for MLOps, including the creation of scalable testing frameworks for complex data science workflows and machine learning algorithms
• Implement/lead the development of reusable frameworks, models, and components for comprehensive end-to-end test automation
• Stay up to date with evolving ML modelling methodologies, maintaining proficiency in applying new and diverse techniques and effectively justifying the chosen methods
• Serve as a test advisor, leading and supervising data science testing teams, and offering guidance, direction, and mentorship
• Demonstrate a readiness to swiftly acquire knowledge of emerging technologies
• Understand product requirements and contribute to design processes
• Execute test cases and scenarios, and report results
• Identify and troubleshoot issues, and meticulously report defects
• Drive innovation through a good understanding of data, business drivers, and business needs
• Perform technical walk-throughs to ensure effective communication of system architecture and the testing environment within the team
• Work with data and analytics experts to strive for greater functionality in our data systems and products

• A minimum of 10-12 years of relevant experience in testing ETL/software products, and machine learning model testing, with at least 3 years of dedicated involvement in data science and ML projects
• Solid understanding of foundational machine learning concepts and algorithms
• Expert knowledge and substantial coding experience in Python, R, and machine learning frameworks such as Scikit-learn, TensorFlow, Keras, PyTorch, and similar tools
• Experience in working with DevOps principles and familiarity with industry best practices using CI/CD tools, as well as infrastructure as code (e.g., Docker, Kubernetes, Terraform)
• Extensive experience in at least one cloud platform (e.g. AWS, GCP, Azure) and associated machine learning services, e.g. Amazon SageMaker, Azure ML, etc
• Strong SQL skills, including the ability to write and interpret complex SQL queries
• Experience in building extensible, configuration-driven, pluggable, and modular test automation frameworks
• Experience in end-to-end automated test case management, reporting, and bug tracking is an added advantage
• Should be aware of Security compliances and design practice
• Adept in performance testing and test optimization
• Solid understanding of Test Driven Development (TDD)
• Adept in impact analysis, test estimations, and test planning for projects
• Ability to work closely with application development, architecture, and infrastructure teams for automation, performance evaluation, and application analysis initiatives
• Expertise in test management and defect tracking tools like HP Quality Center, and JIRA
• Strong comprehension, analytical, and problem-solving skills
• Familiarity with Agile software development practices
• Strong interpersonal and communication skills, including the ability to explain and discuss machine learning concepts with colleagues and teams

• Experience in the Healthcare Laboratory domain is a plus
• Demonstrated ability to collaborate effectively with cross-functional teams in a fast-paced and dynamic environment
• Proven track record of conducting root cause analyses on both internal and external data and processes to address specific business inquiries and identify areas for enhancement
• Sound knowledge of REST /SOAP web service, integration, vulnerabilities, and web service security mechanisms

Who we are

At Roche, more than 100,000 people across 100 countries are pushing back the frontiers of healthcare. Working together, we’ve become one of the world’s leading research-focused healthcare groups. Our success is built on innovation, curiosity and diversity.

Roche is an Equal Opportunity Employer.