Quality Auditor (Freelancer)

About Us

Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems.

About the Role

We are seeking a Quality Auditor (Freelancer) to support advanced AI evaluation initiatives focused on quality assurance, audit methodologies, annotation quality, operational excellence, and AI-generated output evaluation.

In this role, you will evaluate AI-generated outputs, annotation tasks, reviewer performance, audit reports, and quality metrics. Your expertise will help improve AI systems designed for quality management, process compliance, operational audits, and continuous improvement.

This position is ideal for professionals with experience in Quality Assurance (QA), Quality Control (QC), Audit Operations, Process Excellence, Business Operations, BPO Quality, AI data quality, or compliance auditing.

Responsibilities

• Create deliverables addressing real-world quality assurance and audit scenarios.
• Annotate and evaluate AI-generated audit reports, quality reviews, reviewer assessments, and operational documentation.
• Assess AI outputs for accuracy, completeness, consistency, compliance, and adherence to quality standards.
• Perform audit sampling by selecting statistically or risk-based representative samples to evaluate process quality, annotation accuracy, and operational compliance.
• Develop and apply error taxonomies by classifying quality issues into standardized categories, identifying recurring error patterns, and maintaining consistency across audit reviews.
• Conduct root-cause analysis to identify underlying causes of quality defects, process failures, reviewer inconsistencies, and operational deviations using structured problem-solving methodologies.
• Track and evaluate corrective actions by monitoring remediation plans, preventive measures, follow-up activities, and continuous improvement initiatives.
• Prepare and review accuracy reports, dashboards, quality scorecards, audit summaries, trend analyses, and key performance indicators (KPIs) to measure operational performance.
• Identify quality gaps, compliance issues, process inefficiencies, recurring defects, and opportunities for improvement.
• Provide structured feedback to improve AI performance, annotation quality, audit processes, and operational workflows.
• Review peer-developed deliverables to maintain quality and consistency standards.

Requirements

• Bachelors degree in Business Administration, Quality Management, Engineering, Statistics, Operations Management, Computer Science, or a related field.
• 3+ years of hands-on experience in Quality Assurance, Quality Auditing, Process Excellence, Operations, Compliance, AI Data Quality, or Business Process Outsourcing (BPO).
• Performing audit sampling using statistical, random, or risk-based sampling techniques.
• Developing and maintaining error taxonomies for quality issues, annotation defects, operational errors, and compliance findings.
• Conducting root-cause analysis using methodologies such as 5 Whys, Fishbone (Ishikawa), Pareto Analysis, or similar structured approaches.
• Tracking corrective and preventive actions (CAPA), remediation activities, and continuous improvement initiatives.
• Preparing accuracy reports, quality dashboards, audit scorecards, trend analyses, and performance metrics.
• Evaluating reviewer performance, audit consistency, quality benchmarks, and operational compliance.
• Proficiency with Microsoft Excel, Google Sheets, Power BI, Tableau, or similar reporting tools.
• Familiarity with quality frameworks such as ISO 9001, Six Sigma, Lean, COPC, or internal quality management systems is preferred.
• Strong analytical thinking, problem-solving abilities, and exceptional attention to detail.
• Excellent written English communication skills.
• Ability to critically evaluate AI-generated outputs for quality, consistency, and compliance.
• Ability to work independently in a remote, fast-paced environment.

Preferred Qualifications

• Experience working in AI data annotation, trust and safety, customer operations, BPO quality, compliance auditing, or enterprise quality assurance teams.
• Experience designing audit frameworks, quality scorecards, reviewer calibration programs, or quality governance processes.
• Familiarity with AI evaluation methodologies, annotation platforms, human-in-the-loop review workflows, or benchmarking projects.
• Knowledge of SQL, Python, or data analytics for quality reporting is an advantage.
• Professional certifications such as Lean Six Sigma Green Belt/Black Belt, ISO 9001 Lead Auditor, ASQ Certified Quality Auditor (CQA), or COPC Certification are highly desirable.

Why Join Us

• Competitive hourly pay: 1,500 - 2,000/hour
• Fully remote with flexible working hours.
• Opportunity to contribute to cutting-edge AI quality assurance and evaluation initiatives.
• Exposure to advanced AI systems focused on quality management, operational excellence, and AI benchmarking.
• Flexible project-based opportunities with global teams.
• Work on next-generation AI solutions supporting high-quality, reliable, and scalable AI systems.