Bengali Linguist - AI Training & Evaluation

About Us

Krutrim (Ola) is a leading innovator in the field of artificial intelligence and machine learning. We are committed to pushing the boundaries of AI technology and its applications. We are seeking enthusiastic language specialists to join our dynamic team.

What we are looking for:

Krutrim is seeking a Linguist-AI Training & Evaluation for LLM Evaluation to curate high-quality datasets, evaluate language models, and fine-tune performance using Reinforcement Learning from Human Feedback (RLHF). You will work on evaluating model outputs, DPO Data Set creation, performing comparative analysis, and benchmarking Krutrims AI models against industry standards.

Desired Skills & Qualifications:

• Linguistic Expertise: Native-level fluency in Bengali language with excellent command over English. Proficiency in multilingual linguistics is a plus.
• AI & NLP Knowledge: Basic understanding of Natural Language Processing (NLP), machine learning models and large language models (LLMs).
• Model Evaluation Skills: Proven experience in evaluating AI models, including benchmarking, fine-tuning, and model assessment.
• Attention to Detail: Strong ability to identify linguistic nuances, model errors, and biases in AI model outputs.
• Analytical Mindset: Ability to perform quantitative and qualitative assessments of AI model performance, including the development of evaluation metrics.
• Web Savvy, Tech Savvy: Good computer skills for managing large-scale data (Kannada typing, Microsoft office suite etc.)

Qualifications

• Min. Bachelors or Masters degree in Journalism/ Literature/ Linguistics, or a related field from a reputed Indian university.
• 1 to 3 years of experience in translation, localisation, content writing, NLP, or AI model evaluation.

Location: Bangalore, Work From Office.

Role : Full-time

Immediate Joiners Preferred!