61 Downloads view our datasets

Taraaz

About Taraaz

Taraaz is a nonprofit research and advisory organization working at the intersection of technology and human rights.

Datasets

Taraaz

Multilingual Humanitarian Response Eval (MHRE)

This multilingual humanitarian dataset contains 655 annotated datapoints evaluating AI chatbot safety and quality in migration and asylum scenarios across four language pairs (English–Farsi (Iranian Persian), Arabic, Kurdish (Sorani), Pashto). Built from 120 expert prompts, it includes outputs from GPT-4o, Gemini 2.5 Flash, and Mistral Small. The dataset provides both human evaluations from Respond Crisis Translation native-speaker evaluators and LLM-as-judge assessments (Gemini 2.5 Flash).
License Icon

License: CC-BY-NC-SA-4.0

Locale Icon

Locale: mul

Task Icon
Task: LLM
Format Icon

Format: csv

Size Icon

Size: 2.15 MB