Machine Learning Evaluation Specialist

Department Icon Data Science Analytics & Machine Learning
Posted: 2 weeks ago
0-1 years
Bengaluru / Bangalore, Karnataka
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 1 Jan 2027

Posted: 2 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Machine Learning Evaluation Specialist role at Alignerr in Bengaluru for people with 0–1 years of experience. You'll design complex machine learning problems, assess AI-generated solutions, and document expected failure modes using skills in machine learning, ai, ml, llms, nlp, and feature engineering.

  • Bengaluru
  • Work from office
  • 0–1 years
  • MS or PhD

What you'll do

  • Design complex, original machine learning problems
  • Assess AI-generated ML solutions for correctness
  • Document expected failure modes

Good fit if you

  • Hold a graduate degree in a technical field
  • Have strong working knowledge of ML fundamentals
  • Communicate complex ideas with clarity
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

Machine Learning Evaluation Specialist (AI Training)

About The Role

What if your years of research expertise could directly shape the trajectory of AI development Were looking for elite machine learning specialists to design the kinds of problems that push state-of-the-art AI systems to their absolute limits — and help the field understand precisely where they break down.

This is a rare, high-impact opportunity to put your hard-earned domain knowledge to work at the frontier of AI evaluation and safety. Your contributions wont collect dust in a journal — theyll actively influence how the next generation of AI models is built, tested, and improved.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Location: Remote
  • Commitment: 10–40 hours/week

What Youll Do

  • Design complex, original machine learning problems rooted in your specialized domain of expertise
  • Craft evaluation tasks that demand advanced knowledge far beyond standard ML pipelines
  • Draw from your own research to create challenges that would stump even the most capable LLMs
  • Define precise problem statements, gold-standard solutions, and robust evaluation criteria
  • Assess AI-generated ML solutions for correctness, creativity, and methodological rigor
  • Document expected failure modes, difficulty levels, and the domain knowledge required to solve each problem
  • Collaborate asynchronously with a global network of top researchers and engineers

Who You Are

  • You hold a graduate degree (MS or PhD) in a scientific or technical field that intersects with machine learning
  • You have strong working knowledge of ML fundamentals — model selection, feature engineering, evaluation metrics, and pipeline design
  • Youre deeply embedded in active research problems in your field and know where the hard edges are
  • You can identify precisely where general ML knowledge falls short and specialized domain expertise becomes essential
  • You have experience publishing or conducting original research (highly valued)
  • You communicate complex ideas with clarity and precision in writing
  • Youre self-directed, intellectually curious, and thrive on genuinely challenging work

Example Domains (Not Exhaustive)

  • Computational biology, genomics, or bioinformatics
  • Climate science and environmental modeling
  • Medical imaging and healthcare ML
  • Materials science and computational chemistry
  • Astrophysics and signal processing
  • NLP for low-resource or specialized corpora
  • Robotics, control theory, or reinforcement learning
  • Financial modeling and quantitative analysis

Why Join Us

  • Work at the frontier — contribute directly to AI evaluation and safety research alongside top research labs
  • Make your expertise count — put your specialized knowledge to use in a way that creates real, measurable impact on how AI develops
  • Full autonomy — set your own schedule and work entirely remotely on your terms
  • Intellectually stimulating work — no routine tasks; every challenge requires genuine deep thinking
  • Global collaboration — connect and work asynchronously with a world-class community of researchers and engineers
  • Ongoing opportunity — strong performers gain access to extended contracts and deeper research involvement
  • Build your profile — become a recognized contributor to cutting-edge AI development

Skills

Machine LearningAiMlLlmsNlpFeature Engineering

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Align Technology is a global medical device company that is changing lives by improving smiles. We reimagine and reinvent the way orthodontic and restorative treatment is driven with technology. We are the makers of the Invisalign clear aligner system, iTero intraoral scanners, and exocad CAD/CAM software and services.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru / Bangalore.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.