LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

dzAxOEZqc0Eyb0hERmhudWxyekV0WjA2OWc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Nilssen's Foods

Bookkeeper & Pricing Associate Job at Nilssen's Foods

 ...team in a support role with flexibility in positions to include bookkeeper and pricing, grocery, and front-end for our Cumberland...  ...multiple departments and is full-time with mornings/days/every-other-weekend availability needed. Tasks include data entry, banking/... 

Brentwood Hospital

Counselor / Social Worker - PRN Job at Brentwood Hospital

 ...Brentwood Hospital is looking for a dynamic Counselor / Social Worker to join our team of professionals who are dedicated to providing...  ...Identifies and assesses family or community resources such as, group homes, or mental health practitioners to meet patients aftercare... 

Groundswell Contact LLC

Political Canvasser - PHX Job at Groundswell Contact LLC

 ...Groundswell Contact is seeking energetic and passionate individuals for a paid political canvasser position. As a canvasser, you will be responsible for talking to voters and engaging with them on political causes. This might mean knocking on a voter's door, standing outside... 

Sunridge Management

Lead Maintenance Technician - Multifamily Job at Sunridge Management

Position: Lead Maintenance Technician - Multifamily -$1,000 Sign-On Bonus Location: On-Site Reports To: Property Manager Industry: Multifamily Property Management Job Type: Full-Time | Must be available for occasional weekend needs SunRidge Management Group...

Cambridge Real Estate Services

Assistant Property Manager Job at Cambridge Real Estate Services

 ...difference and be a team member at one of Central Oregons premier property management companies? If so, and you are an experienced, energetic,...  ...of the knowledge, skill and/or ability required. Some Experience in the Field of Real Estate, Resort Management, Retail or...