Business Analyst: US Raters
Fully remote 16-week contract evaluating and comparing responses from multiple AI chatbots against predefined quality criteria (accuracy, relevance, clarity). Day-to-day is structured rating, documentation, and reporting; requires 3+ years of business analysis experience and tools like Excel, SQL, Power BI, or Tableau.
- Compensation
- $30 / hr
- Location
- US
- Work setup
- Remote
- Seniority
- Not specified
- Employment
- Contract
- Experience
- 3+ years
- Category
- Business analysis
- Posted
Skills
Must have
- Bachelor's degree in Business Administration, Finance, Computer Science, or a related field
- At least 3 years of experience as a Business Analyst or in a similar analytical role
- Strong analytical thinking, problem-solving, and decision-making skills
- Excellent written and verbal communication skills
- Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools
- Experience with requirement gathering, process mapping, and business documentation
- Ability to work effectively with cross-functional teams and manage multiple priorities
- Strong attention to detail and ability to make consistent, objective assessments
- Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment
- Must be based in the United States
- Full-time availability of 8 hours per day, five days per week for the 16-week contract
- At least 4 hours of overlap with US Pacific Time (PST)
Nice to have
- Familiarity with Agile or Scrum methodologies
Full description
This role is for one of our clients
We are looking for detail-oriented and analytical Business Analysts – US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments.
The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule.
Job Details
- Role: Business Analyst – US Raters
- Experience: 3+ years
- Location: United States only
- Employment Type: Short-term contract
- Contract Duration: 16 weeks
- Compensation: USD 30 per hour
- Start Date: Immediate
- Work Mode: Fully remote
- Availability: Full-time commitment of 8 hours per day
- Time Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)
- Work Schedule: Five working days per week, including weekends as required, with two weekdays off
Requirements
Key Responsibilities
- Review, analyze, and compare responses generated by multiple AI chatbots.
- Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
- Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
- Conduct structured assessments and provide objective, evidence-based judgments.
- Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
- Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
- Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
- Track task progress, quality metrics, and deliverables to ensure timely completion.
- Identify recurring issues in chatbot responses and share actionable observations.
- Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.
Required Qualifications and Skills