Remote | Bilingual Italian Generalist Evaluator Expert — Up to $30/hr Job at 24-MAG, San Francisco, CA

U3NtY2xLalFrZTFrTnYyS2pTdzIwTEtFeVE9PQ==
  • 24-MAG
  • San Francisco, CA

Job Description

We are sharing a specialised remote opportunity for bilingual Italian language experts from Switzerland or Italy who have strong writing skills and deep familiarity with local linguistic and cultural context. This role supports a leading AI research lab by contributing high-quality multilingual training data used to improve advanced large language models.

Experts will create Italian–English prompt and answer pairs, evaluate AI outputs, and help ensure that AI systems produce culturally accurate, fluent, and contextually appropriate responses for Italian-speaking users.

Key Responsibilities

Create detailed prompts in Italian and/or English that reflect real-world usage in Switzerland and Italy
Design multilingual prompt–response pairs that train and evaluate advanced AI models
Evaluate AI-generated responses for linguistic accuracy, tone, and cultural alignment
Develop evaluation rubrics that capture Italian linguistic nuance and regional conventions
Test AI outputs and assess model performance across Italian and English contexts
Contribute to quality assurance processes for Italian-language benchmarks

Ideal Profile

Strong candidates may have:

Native-level Italian proficiency specific to Switzerland or Italy usage
Deep familiarity with local language tone, cultural context, and regional linguistic conventions (including Swiss Italian)
Strong reading and writing ability in English
Bachelors degree (completed or in progress) from a reputable institution
Strong analytical, writing, and critical thinking skills
Ability to work independently and meet deadlines

Preferred experience:

Teaching, research, editing, or academic writing
Experience developing evaluation rubrics or grading frameworks
Familiarity with large language models, prompting, or model evaluation

Why This Opportunity

Contribute to frontier AI research focused on multilingual language understanding
Help shape how AI systems interpret and generate Italian-language content
Collaborate with a leading AI research lab on high-impact projects
Flexible remote work with competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Experts typically contribute around 20 hours per week
Project duration is approximately 2–4 months
Weekly payments via Stripe or Wise
Projects may be extended or adjusted depending on performance and demand

About the Platform

This opportunity is available through a leading AI-driven work platform.

Job Tags

Remote job, Weekly pay, Contract work, For contractors, Local area, Flexible hours

Similar Jobs

Omni Inclusive

EDI Specialist Job at Omni Inclusive

 ...Mapping requirement specification document creation. EDI map development using GXS / Open Text Application Integrator. Candidate should have knowledge on ANSI X12, EDIFACT. End to end interface analysis, includes VAN connection. Mandatory Skills GXS / OpenText... 

Specialized Talent Solutions, LLC

Workers' Compensation Attorney (Remote hybrid!!) Job at Specialized Talent Solutions, LLC

 ...with a hybrid schedule that offers attorneys the ability to work remotely from home part of the week! You must be an attorney licensed...  ...portable business ! Benefits offered: Paid time off Health insurance Dental insurance Healthcare spending or... 

Hilton

Room Attendant - The Duniway Portland, a Hilton Hotel Job at Hilton

 ...Come join the team atThe Duniway - Boutique Hotel in Downtown Portland ( you will be part of a team that was ranked #1 on Great Places...  ...perks such as a best-in-class benefits, free meal during shift PLUS Hilton room discounts for you and your family worldwide through our Go... 

Grede Holdings LLC

Maintenance Electrician Job at Grede Holdings LLC

 ...Maintenance Electrician Hiring Immediately! Foundry, Manufacturing, and Industrial workers are encouraged to apply today! $1,500 Sign-On Bonus! Join our team as a 2nd or 3rd shift Maintenance Electrician and earn a competitive hourly wage starting at $27.04-$40.69 PER... 

Housekeeper.com

Housekeeper Wanted - Housekeeper Wanted In Suwanee, Ga Earn $15 $20 Per Hour! Join Our Friendly Team Today! Job at Housekeeper.com

 ...thorough cleaning of countertops, appliances, and ensuring the area is free of grease and grime.I offer a competitive wage of $15 per hour for this role. This position is ideal for someone looking for a flexible schedule with the chance to work in a welcoming household...