Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “paiwan”

100 Datasets

Chana

Iskonawa: Personal Narratives

Eighteen autobiographical and descriptive Iskonawa narratives recorded in Ucayali, Peru, in 2013, documenting spontaneous discourse and everyday life.

License: Chana 2.0

Locale: isc

Task: N/A

Format: WAV, MPG, EAF, MD, CSV

Size: 1.64 GB

Community

Demakan Dialect of JAV-IND-ENG-ARB Parallel Corpus

The Demakan dialect is a regional dialect of the Javanese language spoken by the people of the Demak regency in Central Java, Indonesia

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 555.42 KB

Chana

Kakataibo: Fieldwork 2006-2007

54 Kakataibo fieldwork sessions recorded in 2006–2007, documenting eight speakers in elicitation, narrative, and conversation, with Transcriber annotations.

License: Chana 2.0

Locale: cbr

Task: N/A

Format: WAV, TRS, XLS, PDF

Size: 1.93 GB

Common Voice

Common Voice Scripted Speech 27.0 - Pahari-Pothwari

A collection of read speech recordings in Pahari-Pothwari.

License: CC0-1.0

Locale: phr

Task: ASR

Format: MP3

Size: 276.61 MB

Common Voice

Common Voice Scripted Speech 27.0 - Loja Highland Kichwa

A collection of read speech recordings in Loja Highland Kichwa.

License: CC0-1.0

Locale: qvj

Task: ASR

Format: MP3

Size: 221.75 MB

Chana

Shiwilu: Narratives and Songs

Sixteen Shiwilu narratives and songs from Loreto, Peru, with detailed ELAN annotations and time-aligned Shiwilu, Spanish, and English materials.

License: Chana 2.0

Locale: jeb

Task: N/A

Format: WAV, EAF, TextGrid, MD, CSV

Size: 1014.22 MB

Common Voice

Common Voice Scripted Speech 27.0 - Quechua Jauja Wanka

A collection of read speech recordings in Quechua Jauja Wanka.

License: CC0-1.0

Locale: qxw

Task: ASR

Format: MP3

Size: 262.42 MB

MDC Curators

CoVoST 2 Chinese (China) - English

The dataset includes audio files in Chinese (China) and their translations in English.

License: CC-BY-NC-4.0

Locale: zh-CN, en

Task: MT

Format: MP3, TSV

Size: 713.86 MB

Common Voice

Common Voice Scripted Speech 27.0 - Quechua Chanka

A collection of read speech recordings in Quechua Chanka.

License: CC0-1.0

Locale: quy

Task: ASR

Format: MP3

Size: 33.84 MB

Common Voice

Common Voice Spontaneous Speech 5.0 - Western Penan

A collection of spontaneous responses to questions in Western Penan.

License: CC0-1.0

Locale: pne

Task: ASR

Format: MP3

Size: 248.07 MB

Chana

Iskonawa: Traditional Stories

Eight traditional Iskonawa stories recorded in Ucayali, Peru, in 2013, with time-aligned transcriptions, normalized texts, and Spanish translations.

License: Chana 2.0

Locale: isc

Task: N/A

Format: WAV, MPG, EAF, TXT, MD, CSV

Size: 1.61 GB

Community

JAV IKRAR - Craft and Cultural Heritage Multimodal Corpus

A collection of annotated images capturing public space activities, traditional handicrafts, historical and cultural heritage exhibits in Java.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 1.13 GB

Common Voice

Common Voice Spontaneous Speech 5.0 - Mon

A collection of spontaneous responses to questions in Mon.

License: CC0-1.0

Locale: mnw

Task: ASR

Format: MP3

Size: 386.10 KB

CLEAR Global

TWB Parallel Sentence kits - Kanuri (5k)

5,000 English–Kanuri parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: kau

Task: MT

Format: TSV

Size: 358.46 KB

MDC DatasetsCompensated

🚧 Northern Pashto Multimodal Dataset 🚧

A Northern Pashto multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: pbu

Task: NLP

Format: MP4, WAV, EAF

Size: 251.41 GB

MirasAI

Associated Press Pakistan 74.4 Million Urdu Corpus

A 74.4M-word, 267,887-article Urdu news corpus from Associated Press Pakistan (2015-2026), released for non-commercial research with APP permission.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 143.39 MB

MirasAI

Associated Press Pakistan 16.9 Million Balochi Corpus

A 16.9M-word Balochi news corpus from Associated Press of Pakistan, covering 59,172 articles published between 2016 and 2026.

License: CC-BY-NC-SA-4.0

Locale: bal

Task: NLP

Format: TXT

Size: 22.85 MB

Common Voice

Common Voice Scripted Speech 27.0 - Quechua Yanahuanca

A collection of read speech recordings in Quechua Yanahuanca.

License: CC0-1.0

Locale: qur

Task: ASR

Format: MP3

Size: 186.52 MB

Chana

Kakataibo: Traditional songs

Nine traditional Kakataibo songs from four musical genres, recorded in Yamino, Peru (2010–2012), with time-aligned transcriptions and translations.

License: Chana 2.0

Locale: cbr

Task: N/A

Format: WAV, EAF, PDF, MD, CSV

Size: 340.66 MB

Forum for Language Initiatives

Kohistani Shina Word List

A UTF-8 encoded Kohistani Shina dictionary and word list corpus with lexical entries, meanings, and annotations for linguistic research and NLP use.

License: CC-BY-NC-4.0

Locale: plk

Task: NLP

Format: TXT

Size: 394.05 KB

Common Voice

Common Voice Spontaneous Speech 5.0 - Heng Hua

A collection of spontaneous responses to questions in Heng Hua.

License: CC0-1.0

Locale: cpx

Task: ASR

Format: MP3

Size: 225.75 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

49k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 2.93 MB

Common Voice

Common Voice Scripted Speech 27.0 - Tshivenda

A collection of read speech recordings in Tshivenda.

License: CC0-1.0

Locale: ve

Task: ASR

Format: MP3

Size: 1.33 MB

Common Voice

Common Voice Scripted Speech 27.0 - Quechua Chiquián

A collection of read speech recordings in Quechua Chiquián.

License: CC0-1.0

Locale: qxa

Task: ASR

Format: MP3

Size: 198.15 MB