An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Senior Software Engineer role at joblet-ai in India for people with 0–1 years of experience. You'll analyze GitHub issues, set up code repositories, and evaluate unit test coverage. You will also modify codebases locally to assess LLM performance.
- Work from office
- 0–1 years
What you'll do
- Analyze and triage GitHub issues
- Configure code repositories with Dockerization
- Modify and run codebases locally
Good fit if you
- Have experience with Python, JavaScript, or Java
- Know Git and Docker
- Navigate complex codebases
AI-generated from the job description. Check the full description before you apply.
Job Description
- Role Title: Senior Software Engineer – LLM Evaluation & Repository Validation
- Role Type: Contractor assignment (no medical/paid leave)
- Location: Remote
What does day-to-day look like:
- 1. Analyze and triage GitHub issues across trending open-source libraries.
- 2. Set up and configure code repositories, including Dockerization and environment setup.
- 3. Evaluating unit test coverage and quality.
- 4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- 5. Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
- 6. Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
- 1. Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
- 2. Proficiency with Git, Docker, and basic software pipeline setup.
- 3. Ability to understand and navigate complex codebases.
- 4. Comfortable running, modifying, and testing real-world projects locally.
- 5. Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
1. Previous participation in LLM research or evaluation projects.
2. Experience building or testing developer tools or automation agents.
Offer details:
- 1. Commitment required: 20 hours per week with some overlap with PST
- 2. Employment type: Contractor assignment (no medical/paid leave)
- 3. Duration of contract: 3 months with expected start date as next week
What Youll Do
- 1. Analyze and triage GitHub issues across trending open-source libraries.
- 2. Set up and configure code repositories, including Dockerization and environment setup.
- 3. Evaluating unit test coverage and quality.
- 4. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- 5. Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Apply Now!
Skills
CPythonJavaJavascriptTestingDeveloperSoftware EngineerIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New IT / Software Development & Related roles in India.
One email a day. Unsubscribe any time.

