Internet-Native Bilingual Evaluator Expert (Japanese)

Internet-Native Bilingual Evaluator Expert (Japanese) $30-$40 per hour Mercor is seeking Internet-Native Bilingual Evaluator Experts (Japanese–English) to contribute to advanced AI research focused on multilingual communication, internet culture, and contemporary digital language use. This role is ideal for individuals who actively participate in both Japanese- and English-language online communities and understand how internet culture, slang, humor, and social norms differ across languages. Job Responsibilities • Analyse content from social media, forums, video platforms, gaming communities, and digital communication channels. • Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity. • Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching. Develop Evaluation Standards • Create evaluation rubrics for internet-native bilingual communication. • Document linguistic and cultural edge cases specific to Japanese and English online communities. • Establish standards for tone, appropriateness, and contextual understanding. Conduct Model Testing and Feedback • Test AI systems using bilingual prompts and real-world internet scenarios. • Evaluate outputs in Japanese and English. • Provide detailed feedback to improve multilingual model performance. Support Quality Assurance • Participate in benchmark development and QA reviews. • Ensure consistency and quality across evaluation datasets. Minimum Qualifications • Native or near-native fluency in Japanese and professional fluency in English. • Deep familiarity with Japanese and English internet culture. • Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems. • Strong writing, analytical, and critical thinking skills. • Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages. • Available to commit 10–20 hours per week. Preferred Qualifications • Background in linguistics, translation, localization, journalism, social media, humanities, or AI evaluation. • Experience evaluating user-generated content or online communities. • Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends. • Interest in AI, language models, and multilingual communication research. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request. Contract and Payment Terms • You will be engaged as an independent contractor. • This is a fully remote role that can be completed on your own schedule. • Projects can be extended, shortened, or concluded early depending on needs and performance. • Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution. • Payments are weekly on Stripe or Wise based on services rendered. • Please note: We are unable to support H1-B or STEM OPT candidates at this time. About Mercor Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise. Earn up to $160 by referring Share the referral link below, and earn up to $160 for each successful referral through this unique link. There's no limit on how many people you can refer. Restrictions may apply. Learn more Don't know who to refer? Find relevant LinkedIn connections here. One Interview, Real Results AI experts share how Mercor made hiring faster, fairer, and easier — with just one interview.