Ara Zeta Project - AI Safety Evaluator - Korean (Korea) at Welocalize
South Korea
$0.022k+
<p>Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span: </p><p><br></p><p>ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling. </p><p>ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking. </p><p>DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection. </p><p>RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output. </p><p><br></p><p>Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.</p><p><br></p><p><strong>Project Overview</strong></p> <p>We are seeking experienced bilingual evaluators to support a multilingual AI safety project focused on evaluating model responses across culturally specific prompt-image datasets.</p> <p> </p> <p>This project involves applying a structured safety rubric to assess AI-generated responses for appropriateness, safety, and reliability within the target locale’s cultural context.</p> <p> </p> <p>Each language stream will process approximately 1,000 prompt-image pairs. Every item will receive two independent evaluations, with arbitration applied in cases of disagreement. Evaluations will primarily be documented in English, with a defined in-language sample.</p> <p> </p> <p><strong>Project Details</strong></p> <p><u>Location</u>: Remote – South Korea</p> <p><u>Team</u>: Welo Data – AI Services</p> <p><u>Engagement Type</u>: Freelance – Remote</p> <p><u>Start Date</u>: As soon as possible</p> <p><u>Duration</u>: 2-3 weeks</p> <p><u>Weekly Commitment</u>: 20–40 hours per week</p> <p><u>Schedule Options</u>:</p> <p>• 4 hours per day, Monday–Friday</p> <p>OR</p> <p>• 2 hours per day, Monday–Friday + 10 weekend hours</p> <p><u>Hourly rate</u>: 22 USD</p> <p> </p> <p><strong>Responsibilities</strong></p> <p>- Evaluate AI-generated responses using a structured safety rubric</p> <p>- Complete two independent evaluations per item</p> <p>- Provide concise, well-structured rationales in English</p> <p>- Participate in calibration sessions</p> <p>- Support arbitration when evaluation discrepancies occur</p> <p>- Maintain quality and throughput targets during the evaluation window</p> <p> </p> <p><strong>Qualifications</strong></p> <p>- Fluency in the target language and English</p> <p>- Deep cultural understanding of the target locale</p> <p>- Strong written English skills for documentation and rationales</p> <p>- Prior experience in safety evaluation, policy review, content moderation, or rubric-based assessment preferred</p> <p>- Ability to apply detailed guidelines consistently</p> <p>- Strong analytical skills and attention to nuance</p> <p>- Reliable availability during the production window</p> <p>- Priority may be given to contributors who previously worked on prompt-image or similar evaluation projects to reduce onboarding time and maintain continuity.</p> <p> </p> <p><strong><u>Disclaimer:</u> This role involves working with explicit and sensitive content. Applicants should be comfortable working with adult material in a professional capacity. Please apply only if you fully understand and are prepared for the nature of this role.</strong></p>\n<p></p><p><br></p><p></p>\n<p><strong>Why Join Welo Data? </strong></p> <p><strong>✨ Limitless Flexibility </strong></p> <p>Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy. </p> <p>🌱<strong> Limitless Growth </strong></p> <p>Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise. </p> <p>🌍<strong> Limitless Support </strong></p> <p>Be part of a global contributor community with responsive guidance and support. </p> <p>💡<strong> Real Impact </strong></p> <p>Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills. </p> <p> </p> <p><strong>How to Apply? </strong></p> <p>Apply now by answering a few quick questions to join our database and become part of our growing community. </p> <p> </p> <p><strong>About Welo Data </strong></p> <p>Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. </p> <p>At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms. </p>
Apply Now