Catalogue update: this role is no longer listed in the current Mercor catalogue. Browse current AI Training opportunities.
About the role
Use your in-house legal experience to compare how two AI tools handle practical legal questions for Japan. Your assessments will contribute to a benchmark of legal answer quality.
Skills and focus areas
Benchmarking · Japanese · Written Feedback · Logistics · Attention to Detail · Written Communication
What you will do
- Submit identical legal questions to both systems and compare their responses.
- Assign scores using the provided evaluation framework.
- Explain the strengths, omissions and errors behind each assessment in concise written comments.
Experience and requirements
- At least five years of in-house legal practice in the specified jurisdiction.
- Strong knowledge of the applicable law, particularly contracts and commercial work.
- Ability to make consistent independent judgments and deliver to deadlines.
Working arrangements
- The first assignment is approximately ten hours; additional work may follow.
- The engagement is subject to a confidentiality agreement.
Similar jobs
Explore related opportunities on Sporterer.
In-House Counsel
Legal · $90–$130/h
Global
General Counsel
Legal · $90–$130/h
Bangladesh / Hong Kong / India / Indonesia / Japan / Kazakhstan / Kyrgyzstan / Malaysia / Pakistan / Philippines / Singapore / Sri Lanka / Taiwan / Thailand / Uzbekistan / Vietnam / Austria / Belarus / Belgium / Denmark / France / Germany / Greece / Italy / Netherlands / Portugal / Russia / Spain / Switzerland / United Kingdom / Argentina / Brazil / Chile / Colombia / Mexico / Peru / Algeria / Bahrain / Egypt / Iraq / Jordan / Kuwait / Lebanon / Libya / Morocco / Oman / Palestine / Qatar / Saudi Arabia / Tunisia / United Arab Emirates / United States / Canada / Nigeria / Kenya / South Africa / Ghana / Ethiopia
Transactional Attorney
Legal · $90–$130/h
Bangladesh / Hong Kong / India / Indonesia / Japan / Kazakhstan / Kyrgyzstan / Malaysia / Pakistan / Philippines / Singapore / Sri Lanka / Taiwan / Thailand / Uzbekistan / Vietnam / Austria / Belarus / Belgium / Denmark / France / Germany / Greece / Italy / Netherlands / Portugal / Russia / Spain / Switzerland / United Kingdom / Argentina / Brazil / Chile / Colombia / Mexico / Peru / Algeria / Bahrain / Egypt / Iraq / Jordan / Kuwait / Lebanon / Libya / Morocco / Oman / Palestine / Qatar / Saudi Arabia / Tunisia / United Arab Emirates / United States / Canada / Nigeria / Kenya / South Africa / Ghana / Ethiopia
Intellectual Property Counsel
Legal · $100–$200/h
Bangladesh / Hong Kong / India / Indonesia / Japan / Kazakhstan / Kyrgyzstan / Malaysia / Pakistan / Philippines / Singapore / Sri Lanka / Taiwan / Thailand / Uzbekistan / Vietnam / Austria / Belarus / Belgium / Denmark / France / Germany / Greece / Italy / Netherlands / Portugal / Russia / Spain / Switzerland / United Kingdom / Argentina / Brazil / Chile / Colombia / Mexico / Peru / Algeria / Bahrain / Egypt / Iraq / Jordan / Kuwait / Lebanon / Libya / Morocco / Oman / Palestine / Qatar / Saudi Arabia / Tunisia / United Arab Emirates / United States / Canada / Nigeria / Kenya / South Africa / Ghana / Ethiopia