AI Summarization Quality Reviewer (Remote) Job at Scale AI, Honolulu, HI

MmdpZmxOSzNnM3REbkp1UThobGRmOE4rUVE9PQ==
  • Scale AI
  • Honolulu, HI

Job Description

Salary: $31,200 - 78,000 per year Requirements:

  • Fluent in English, with strong written communication skills and comfort with natural, everyday conversation.
  • Strong attention to detail and patience when reviewing media, including replaying audio or zooming in on images and videos.
  • Ability to think on your feet and discuss realistic scenarios naturally.
  • Experience writing concise, evidence-based explanations or reviews.
  • Ability to make a clear choice when both options have flaws.
  • A bachelors degree or higher is a plus.
  • To sign up, provide a valid ID and mobile phone from your country of residence, an up-to-date resume highlighting your expertise, and a LinkedIn profile showing your education and work experience.
  • Applicants must be authorized to work in their country of residence. Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Responsibilities:
  • Hold live, scenario-based conversations in English with AI voice models and rate their naturalness, usefulness, and clarity.
  • Compare AI-generated images and videos and determine which better follows the prompt.
  • Inspect media closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
  • Rate outputs for criteria such as prompt adherence, quality, and realism, and write specific explanations in English based on what you observed or heard.
  • Compare generated images for instruction-following, visual quality, and AI artifacts; some tasks involve comparing edited images with originals.
  • Evaluate generated videos against prompts or compare edited videos with their source clips.
  • Label first-person videos of people or robots performing hands-on tasks by dividing clips into actions and writing precise captions, revising AI-generated drafts as needed.
  • Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks involve recording a short spoken explanation.
Technologies:
  • AI
  • Mobile

More:

We are Outlier, an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI models, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote freelance opportunity offers flexible scheduling with no minimum hours, and contributors can choose their own workload. Project work pays up to USD $15 per hour; rates vary by expertise, assessment results, location, project needs, and other factors. Additional incentives may be available, and payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. Contributors receive free access to leading LLMs and can collaborate with experts working on pre-release models. Outlier has more than 900,000 experts across 52 countries and reports over $600 million paid to experts. This is a 1099 independent-contractor opportunity, not employment; internships, sponsorship, and employment are not offered. To apply, create an Outlier account and upload a resume and valid ID.

last updated 44 week of 2026

Job Tags

Hourly pay, Full time, For contractors, Work experience placement, Freelance, Remote work, Visa sponsorship, Flexible hours

Similar Jobs

NTT DATA, Inc.

Desktop Support Engineer Job at NTT DATA, Inc.

 ...If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Desktop Support Engineer to join our team in Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur (MY-14), Malaysia (MY). Job Responsibilities:... 

Confidential

German Teacher needed Job at Confidential

German Teacher Wanted Location: Vocational and Technical School in Zhengzhou, Henan Province Working hours: 12 teaching hours per week Project term: Tentatively one semester, expected to finish at the end of December. Full-time or part-time available. Remuneration... 

CUT Beverly Hills

Pastry Cook Job at CUT Beverly Hills

 ...Understand and maintain all standard pastry recipes. Ensure all food supplies necessary for service are in appropriate supply on a...  ...and correct storage standards Support procedures for food & beverage portion and waste controls Follows proper handling and right... 

Our National Conversation

Content Creator Intern Job at Our National Conversation

 ...Description The Content Creator Intern contributes to ONCs mission of providing...  ...not limited to, the recording of podcasts, editing of podcasts, ensuring the research and...  ...strategies to drive engagement in regard to ONCs video content Applying social media and... 

Lundbeck

Sr. Manager, Quality Assurance Job at Lundbeck

Purpose of the job:The aim of the position is to ensure adequate local Quality Managing System and to act as the official Qualified Person Delegate in Lundbeck Japan. Responsibilities: The Quality Assurance Senior Manager interacts with partners to accomplish Quality Technical...