Reviewer and rate AI-generated code - Python
Remote freelance role (India) for engineers with 2+ years of Python experience to review and rate AI/LLM-generated code: triaging GitHub issues, Dockerizing and setting up repos, running codebases locally, and evaluating unit test coverage and quality alongside researchers.
- Compensation
- Not disclosed
- Location
- India
- Work setup
- Remote
- Seniority
- Lead
- Employment
- Contract
- Experience
- 2+ years
- Category
- Not specified
- Posted
Skills
Must have
- Minimum 2+ years of overall experience
- Strong experience with Python
- Proficiency with Git, Docker, and basic software pipeline setup
- Ability to understand and navigate complex codebases
- Comfortable running, modifying, and testing real-world projects locally
- Minimum 8 hours/day and 40 hours/week availability
- Minimum 4 hours overlap with PST
- LinkedIn profile link included in resume
- Strong communication and ability to work independently in a remote environment
Nice to have
- Experience contributing to or evaluating open-source projects
- Previous participation in LLM research or evaluation projects
- Experience building or testing developer tools or automation agents
Full description
Hello,
Greetings from ZettaMine!!!Freelancing Opportunity :- We are currently having multiple opportunities in freelancing for Reviewer and rate AI-generated code - Python across India.Role:Reviewer and rate AI-generated code - PythonExperience: 2+ Years
Mode: Remote (Freelance)
Start: Immediate
We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality.
Required Skills:
- Minimum 2+ years of overall experience
- Strong experience with at least one of the following languages: Python
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.
What Youll Work On:
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluating unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Availability:
- Minimum 8 hours/day and 40 hours/week.
- Minimum 4 hours overlap with PST.
- Immediate availability preferred.
Others:
- LinkedIn profile is mandatory for review. Please ensure the LinkedIn profile link is included in the resume.
- Strong communication and ability to work independently in a remote environment.
Interested can reach out at: Swetha.p@zettamine.comThanks & Regards,Swetha PZettaMine