Data Annotator Specialist

Its never been a more exciting time to join Vistra.

At Vistra our purpose is progress. We believe that our clients have the power to change the world and to do great things for global progress, and we exist to remove the friction that comes from the complexity of global business to help our clients achieve progress without friction. But progress only happens when people come together and take action. And were absolutely committed to building a culture where our people can do just that.

We are seeking a highly skilled and motivated Data Annotator Specialist to join our dynamic and innovative team. Reporting to the Engineering Lead, this full-time and permanent position is based in India.

The ideal candidate will have approximately 3+ years of hands-on experience in data annotation/labelling, preferably in document AI or OCR projects. This role requires a proven ability to lead annotation teams, ensure quality assurance, and deliver high accuracy annotations in a fast-paced environment.

Key responsibilities:

Lead data annotation initiatives for document processing, ensuring high-quality labeled datasets for machine learning model training and evaluation

Develop and maintain comprehensive annotation guidelines and training materials for complex document structures

Perform quality assurance on annotated data, identifying inconsistencies and implementing corrective measures

Collaborate with AI/ML engineers to understand model performance issues and refine annotation strategies

Manage annotation workflows and optimize processes for efficiency and accuracy

Create and maintain documentation for annotation processes and quality metrics

Participate in cross-functional meetings to align annotation efforts with project goals

Continuously research and evaluate emerging annotation tools and techniques to enhance productivity and quality

Exceptional attention to detail with 99%+ accuracy in complex annotation tasks

Strong analytical and problem-solving skills for root cause analysis

Excellent documentation and communication skills for creating guidelines and training materials

Ability to balance speed and quality while meeting production targets

Leadership skills to mentor junior annotators and drive quality improvements

Systematic approach to process optimization and continuous improvement

Key requirements:

3+ years of data annotation/labelling experience, preferably in document AI or OCR projects

Proven track record of leading annotation teams or quality assurance initiatives

Deep understanding of table structures, document layouts, and data extraction challenges

Experience with financial documents, invoices, compliance reports, or corporate filings

Demonstrated ability to identify patterns in ML model failures and recommend improvements

Advanced proficiency with Excel, CSV, JSON, and structured data formats

Strong understanding of OCR technologies, confidence scores, and bounding box coordinates

Experience with annotation tools, quality metrics, and inter-annotator agreement calculations

Ability to write basic scripts (Python preferred) for data validation and analysis

Additional Experience:

Experience with OCR/document extraction services

Background in AI quality assurance

Knowledge of LLM prompt engineering and evaluation

Familiarity with financial terminology and compliance document structures

Experience with annotation platforms (Label Studio, Prodigy, Amazon SageMaker Ground Truth)

Company Benefits: At Vistra, we believe in putting our employees well-being first! We offer a flexible hybrid working arrangement and birthday leave. General Additionally, we provide comprehensive medical insurance and dental coverage, wellness allowance and competitive annual leave entitlement to support your well being and time to recharge or explore your passions out of work. As advocates of continuous learning and professional development, we provide an internal mentorship program and reimburse professional membership fees for certifications like CA, or ACCA, ensuring you stay ahead in your field. If you are excited about working with us, we encourage you to apply or have a confidential chat with one of our Talent Acquisition team members. Our goal is to make this a great place to work where all our people can thrive. We hope you join us on this exciting journey!