Data Annotation Specialist - Software Engineer (OpenClaw Trajectory Evaluation)
Five-week contractor (freelance) role as an S3 annotator creating and validating OpenClaw agent trajectories for research-style tasks like data analysis, web research, and document synthesis. You run multi-tool workflows in Python/Bash and document the reasoning behind each step to help train AI agents.
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Remote
- Seniority
- Not specified
- Employment
- Contract
- Experience
- 5+ years
- Category
- Software engineering
- Posted
Skills
Must have
- Background in research, data science, engineering, or related fields (academic or industry)
- 5+ years of experience in Python / Bash, including notebooks and data wrangling
- Experience with OpenClaw or similar advanced environments
- Experience with web research, scraping tools, or data analysis workflows
- Ability to articulate reasoning behind decisions and steps
- Experience handling multi-step workflows across tools or platforms
- Exposure to LLM-based tools, AI systems, or agentic workflows
Nice to have
- Academic research experience (thesis, publications, lab work)
- Familiarity with evaluation methodologies or experimental design
- Experience in AI evaluation, RLHF, or advanced annotation workflows
Full description
Role Overview:
We are looking for highly analytical professionals to join as S3 Annotators, responsible for producing and validating advanced OpenClaw trajectories for research-oriented tasks involving ambiguous goals, multi-step reasoning, and long-context workflows. This role requires strong problem-solving ability, research thinking, and the capability to justify decisions while executing complex, multi-tool workflows used to train sophisticated AI agents.
What does day-to-day look like
- Create and validate OpenClaw trajectories for complex, research-oriented tasks
- Work on tasks such as data analysis, web research, and document synthesis
- Operate under underspecified or ambiguous goals, making logical and defensible decisions
- Use Python (notebooks, scripts) for data processing, automation, and analysis
- Perform workflows spanning multiple tools, environments, and applications
- Clearly document both what actions were taken and why they were taken
- Review and improve trajectory quality for reasoning depth and correctness
- Collaborate with teams to refine evaluation standards and annotation frameworks.
Requirements
- Background in research, data science, engineering, or related fields (academic or industry)
- 5+ years of experience in Python / Bash, including experience with notebooks and data wrangling
- Experience with OpenClaw or similar advanced environments
- Experience with web research, scraping tools, or data analysis workflows
- Ability to articulate reasoning behind decisions and steps
- Experience handling multi-step workflows across tools or platforms
- Exposure to LLM-based tools, AI systems, or agentic workflows
Nice to have
- Academic research experience (thesis, publications, lab work)
- Familiarity with evaluation methodologies or experimental design
- Experience in AI evaluation, RLHF, or advanced annotation workflow
Offer Details:
- Engagement type: Contractor assignment/freelancer (no medical/paid leave)
- Duration: 5 weeks
Evaluation Process:
- Resume screening
- Take home assessment (60 mins)