Remote Data Annotation Jobs Madrid (Full-Time, Remote) Join production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems. You will follow strict...
Remote Data Annotation Jobs Madrid (Full-Time, Remote)
Join production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems. You will follow strict rubrics and maintain strong annotation guidelines compliance to protect training data quality for LLM training pipelines.
Key Responsibilities
Join production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems. You will follow strict rubrics and maintain strong annotation guidelines compliance to protect training data quality for LLM training pipelines.
Key Responsibilities
- Execute structured annotation tasks: classification, ranking, span labeling, and named entity recognition (NER)
- Perform LLM evaluation and prompt evaluation (helpfulness, factuality, groundedness, instruction-following)
- Contribute to RLHF workflows via preference judgments, rationale writing, and comparative response evaluation
- Run QA evaluation through self-checks, peer reviews, and audit responses
- Document edge cases, track error patterns, and propose guideline clarifications to reduce variance
- Multilingual NER and text labeling
- Content safety labeling aligned to policy taxonomies
- Computer vision annotation (bounding boxes, segmentation, image-text alignment) as needed
- Calibration sets and inter-review agreement improvement activities
- Experience with guideline-based labeling, evaluation frameworks, QA, data operations, or similar rubric-driven work
- Ability to interpret complex guidelines and apply consistent decisions at scale
- Comfort with web-based annotation tools, task queues, and documentation of edge cases
- Strong written English for rationale-based RLHF comparisons and clear communication
- Competitive hourly rate: $30–$50/hr
- Fully remote, full-time structured workflows with calibration and quality checkpoints
- Work on real-world LLM evaluation and multimodal annotation programs
Ver más
¡No te pierdas nada!
Únete a la comunidad de wijobs y recibe por email las mejores ofertas de empleo
Nunca compartiremos tu email con nadie y no te vamos a enviar spam
Suscríbete AhoraÚltimas ofertas de empleo en Madrid
I
Ignite
Madrid, ES
Salary: Total gross €1,850 – €2,100 / month (€1,500 base + €4.00/hr language pay + up to €3.00/hr quality incentive + 20%...
C
Paid Media Specialist
26 oct.Civitatis
Madrid, ES
¿Te apasionan los viajes🛫, la cultura🗽, el ocio🎡 y tienes ganas de participar en el crecimiento de la empresa Nº 1 en...
E
Exhibition Project Manager
26 oct.ES Group
Acerca del empleo En ES Group nos especializamos en el diseño y construcción de espacios personalizados, con foco en...
M
Account Executive - FoodTech
26 oct.Mainder
Account Executive B2B SaaS | FoodTech 🚀 📍 Barcelona (híbrido) o remoto desde España 💰 40.000 € fijos + variable | OTE...
A
ACENTO
Madrid, ES
At Kids&Us, we are the trigger that ignites the new generations to discover the world through their senses. We are...
A
English Teacher
25 oct.ACENTO
Torrejón de Ardoz, ES
At Kids&Us, we believe learning English should feel as natural as learning your mother tongue. That's why we've created...
F
Becario de marketing
25 oct.Familia La Ancha
Madrid, ES
📢 ¡Buscamos Diseñador/a Gráfico/a en Practicas! 🎨✨ En Familia La Ancha seguimos creciendo y queremos incorporar un/a...
F
CoOp/Intern Operations
25 oct.Flowserve Corporation
Pozuelo de Alarcón, ES
Company Overview: Flowserve is a global manufacturer of pumps, valves, seals, and aftermarket services, delivering...
R
RemoteJobsOne
IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not...
C
Colección Talento
Zarzalejo, ES
Requisitos Para Aplicar a La Vacante 1 año de experiencia, Técnico hasta Profesional $ 1.800.000 Madrid - Facatativá - El...
