An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
Weekly Hours: 15 – 20 hours per week (Flexible & Asynchronous)
- what suits you.
- • Start: Immediately. The client has sample work that needs turning around this week, with a
- substantially larger programme expected to follow.
About the Role
We are seeking exceptional Software Engineers to join our team as AI Trainer In this role, you will not simply write standard feature code; you will design, engineer, and author complex, production-grade software evaluation environments used to benchmark frontier Artificial Intelligence models (such as GPT-5, Claude, and Gemini).
You will build realistic multi-module code repositories, author ambiguous real-world issue specifications, and write hidden automated test suites designed to stress-test model reasoning, edge-case handling, and architectural correctness.
Key Responsibilities
- Repository Fixture Engineering: Design and build self-contained, dependency-light, multi-module software codebases (1,000–2,000 lines of code) in languages like Python, TypeScript, C++, Java, or Go.
- Specification Authoring: Write clear issue descriptions framing problems or feature requirements from an end-user perspective—without revealing the exact code paths or files that need modification.
- Hidden Test Suite Authoring: Construct comprehensive hidden unit and integration test suites (pytest, Jest, etc.) that evaluate exact functional correctness, boundary conditions, edge cases, and refusal honesty.
- Gold & Partial Solution Authoring: Implement 100% correct Gold reference solutions alongside plausible, imperfect partial credit implementations to ensure test suites measure a gradient of model understanding.
- Quality & Contamination Assurance: Ensure all authored fixtures are clean, leak-free, and deterministic with zero network or wall-clock dependencies.
Key Requirements & Qualifications
- Core Backend Proficiency: Strong hands-on development experience in at least one primary backend language (Python, Node.js/TypeScript, Java, C#, C++, or Go).
- Rigorous Testing Mindset: Deep experience writing unit, integration, and edge-case test suites. You know how to break code and catch silent failures, race conditions, or lossy state conversions.
- Architectural Literacy: Ability to understand emergent system behaviors, data pipeline transformations, and complex algorithms.
- Autonomous & Asynchronous: Ability to work independently without hand-holding, document assumptions clearly, and manage project deliverables self-sufficiently.
- Fluency in English: Strong written and verbal communication skills for writing technical task specifications and collaborating asynchronously.
Skills
Artificial IntelligencePythonAiGptIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allNew Data Science Analytics & Machine Learning roles in India.
One email a day. Unsubscribe any time.

