Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “paiwan”

100 Datasets

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

Common Voice

Common Voice Scripted Speech 27.0 - Chinese (China)

A collection of read speech recordings in Chinese (China).

License: CC0-1.0

Locale: zh-CN

Task: ASR

Format: MP3

Size: 21.40 GB

MDC Curators

Common Voice Scripted Speech 26.0 - Wu Chinese

Chinese Common Voice scripted speech 26.0 segment of Wu Chinese accents.

License: CC0-1.0

Locale: zh-CN-shanghai

Task: ASR

Format: MP3, TSV

Size: 191.22 MB

OpenCSG

smoltalk-chinese

SmolTalk-Chinese: A multi-task Chinese conversational dataset covering 19 typical dialogue task scenarios.

License: Apache-2.0

Locale: zh

Task: LLM

Format: parquet

Size: 879.81 MB

Chana

Huni Kuin: Narratives

Three Huni Kuin narratives recorded in Pucallpa, Peru, in 2025, with ELAN annotations, Spanish and English translations, and Praat TextGrids.

License: Chana 2.0

Locale: cbs

Task: N/A

Format: WAV, MP4, EAF, TextGrid, MD, CSV

Size: 387.04 MB

Common Voice

Common Voice Scripted Speech 27.0 - Huarijio

A collection of read speech recordings in Huarijio.

License: CC0-1.0

Locale: var

Task: ASR

Format: MP3

Size: 236.21 MB

PROXIMA

PII Redact Urdu UOPF

Curated Urdu dataset of 100,000 records with fabricated PII spans, for training and evaluating privacy span detection across 12 domains.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: JSONL

Size: 5.77 MB

Chana

Aymara: Phonetic Word Lists

150 isolated lexical items with WAV recordings and Praat TextGrids, part of a controlled comparative phonetic dataset of three Peruvian languages.

License: Chana 2.0

Locale: aym

Task: N/A

Format: WAV, TextGrid, MD, CSV

Size: 54.60 MB

Bahasa Bahana

BAHANA-Betawi TTS

This dataset consists of various texts involving Indonesian and English code-mixing and read by Betawi speakers of West Java Province, Indonesia.

License: CC-BY-SA-4.0

Locale: bew

Task: TTS

Format: WEBM, TSV

Size: 316.13 MB

Common Voice

Common Voice Scripted Speech 27.0 - Punjabi

A collection of read speech recordings in Punjabi.

License: CC0-1.0

Locale: pa-IN

Task: ASR

Format: MP3

Size: 104.81 MB

Open Home Foundation

Chitwan 1.0

Text to speech dataset for Nepali, male speaker, approximately 1 hour of read speech.

License: CC0-1.0

Locale: ne-NE

Task: TTS

Format: WEBM

Size: 61.68 MB

Chana

Iskonawa: Life and Craftsmanship

Audiovisual documentation of Iskonawa life histories, crafts, and traditional designs, recorded in Ucayali, Peru, primarily with Nelita Campos.

License: Chana 2.0

Locale: isc

Task: N/A

Format: MP4, WAV, EAF, MD, CSV

Size: 6.15 GB

RFE/RL

RFE/RL Afghan Pashto News Text Corpus

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

MirasAI

Punjabi 10 Hours TTS

10-hour Punjabi TTS dataset in Shahmukhi script with paired audio and transcripts, designed for speech synthesis and Punjabi language technology.

License: CC-BY-NC-SA-4.0

Locale: pnb

Task: TTS

Format: WEBM, TSV

Size: 481.96 MB

Chana

Kakataibo: Traditional Stories

Six traditional Kakataibo stories recorded between 2007 and 2012, featuring forest animals and tsikiu mano, with transcriptions and Spanish translations.

License: Chana 2.0

Locale: cbr

Task: N/A

Format: PDF, WAV, MPEG, MP3, MD, CSV

Size: 508.47 MB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Chana

Iskonawa: Oral Tradition and Conversations

Nine Iskonawa recordings from 2013 documenting collective oral traditions and multi-speaker conversations, with transcriptions and Spanish translations.

License: Chana 2.0

Locale: isc

Task: N/A

Format: WAV, MPG, EAF, MD, CSV

Size: 1.54 GB

Common Voice

Common Voice Scripted Speech 27.0 - Chinese (Hong Kong)

A collection of read speech recordings in Chinese (Hong Kong).

License: CC0-1.0

Locale: zh-HK

Task: ASR

Format: MP3

Size: 3.43 GB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

PT Pancaran Semangat Jaya

Corpus of Panjebar Semangat Javanese-Language Magazine

This dataset is a TXT-format collection compiled from three years of popular articles published in the Javanese-language weekly magazine Panjebar Semangat. It compiles widely read, non-academic Javanese texts reflecting contemporary themes and language use.

License: CC-BY-SA-4.0

Locale: Jav

Task: OTH

Format: TXT

Size: 4.31 MB

Common Voice

Common Voice Spontaneous Speech 5.0 - Pashto

A collection of spontaneous responses to questions in Pashto.

License: CC0-1.0

Locale: ps

Task: ASR

Format: MP3

Size: 772.19 MB

Community

JAV-Culture: Gresik–Surabaya Multimodal Corpus

A corpus of annotated photographs of cultural objects described in the Gresik dialect of Javanese language.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 713.73 MB

AImpower.org

Mandarin Stuttered Speech (StammerTalk)

The StammerTalk dataset contains 43 hours of spontenous conversations and reading of voice commands by 66 Mandarin Chinese speakers who stutter.

License: CC-BY-NC-SA-4.0

Locale: cn

Task: ASR

Format: WAV, TXT

Size: 4.61 GB

Chana

Iskonawa: Traditional Songs

Thirteen traditional Iskonawa songs recorded in Ucayali, Peru, in 2013, with time-aligned transcriptions and Spanish translations in ELAN.

License: Chana 2.0

Locale: isc

Task: N/A

Format: WAV, MPG, MP4, EAF, MD, CSV

Size: 464.21 MB