LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

MlF5VmxkSzBqbnhCbEppVTlSbGZmY0o3UXc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description



 

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications



 

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Master's or PhD required (PhD candidates strongly preferred).
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Ardent Health

Registered Nurse / RN Cardiac Cath Recovery Job at Ardent Health

Overview Join our team as a day shift, full-time, Cardiac Cath Lab Registered Nurse in Amarillo, TX. Why Join Us? Thrive in a People-First Environment and Make Healthcare Better Thrive : We empower our team with career growth opportunities, tuition assistance,... 

Asbury Communities

LPN Job at Asbury Communities

 ...commitment to care, stability, and supporting you both at work and at home. Asbury Solomons has been recognized as one of the nation's...  ...experience during schooling is preferred. Current Maryland LPN License Current CPR Certification Additional Information... 

Gallagher

Claims Adjuster-Workers Comp Subrogation Job at Gallagher

 ...handling lost time workers compensation subrogation and 3rd party negligence Jurisdictional Experience: Multi-Jurisdiction Active Adjusters' licenses: Not required, but preferred to have either all lines or workers compensation adjuster license Location: This role... 

IntellaTriage

Remote Hospice Triage RN PT 3p-12a + rotating Sat & Sun 7:30a-4p CST Job at IntellaTriage

 ...empathy. You will help ensure timely interventions and...  ...nurse triage for hospice and home health providers since 200...  ...Supportive clinical team ~ Work from home allows you to...  ...differential for weekends (Friday evening, Saturday & Sunday). All part-time and full-time nurses... 

Everglades Equipment Group

Parts Counter Salesperson Job at Everglades Equipment Group

Founded in 1963, Everglades Equipment Group is a family owned and operated full-service John Deere dealership with 19 locations covering central and south Florida. Everglades Equipment Group serves a wide range of customers from some of the largest agricultural producers...