Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

support@mozilladatacollective.com

Terms

FAQs

Participation Guidelines

Responsible Disclosure

support@mozilladatacollective.com

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “paiwan”

100 Datasets

Common Voice

Common Voice Scripted Speech 26.0 - Quechua Yauyos

A collection of read speech recordings in Quechua Yauyos.

License: CC0-1.0

Locale: qux

Task: ASR

Format: MP3

Size: 249.38 MB

Common Voice

Common Voice Scripted Speech 26.0 - Quechua Sihuas Ancash

A collection of read speech recordings in Quechua Sihuas Ancash.

License: CC0-1.0

Locale: qws

Task: ASR

Format: MP3

Size: 201.43 MB

Common Voice

Common Voice Scripted Speech 26.0 - Western Highland Purepecha

A collection of read speech recordings in Western Highland Purepecha.

License: CC0-1.0

Locale: pua

Task: ASR

Format: MP3

Size: 216.40 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

Collaborative Action For Research & Development (CARD)

Gawri (گاؤری) Magazine Corpus

The Gawri (گاؤری) Magazine Corpus is a curated collection of monthly Gawri magazine text (~67,724 tokens) that supports research and language technology.

License: CC-BY-NC-4.0

Locale: gwc

Task: NLP

Format: TXT

Size: 146.71 KB

Forum for Language Initiatives

Khowar Word List

A UTF-8 encoded Khowar lexical corpus containing alphabet definitions and a structured word list for linguistic research and language technology development.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 64.22 KB

Pro Svizra Rumantscha

Putèr Newspaper Corpus

1.3 million tokens in the Putèr variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-puter

Task: OTH

Format: TSV

Size: 8.94 MB

Common Voice

Common Voice Scripted Speech 26.0 - Nüpode Huitoto

A collection of read speech recordings in Nüpode Huitoto.

License: CC0-1.0

Locale: hux

Task: ASR

Format: MP3

Size: 230.39 MB

Common Voice

Common Voice Scripted Speech 26.0 - Japanese

A collection of read speech recordings in Japanese.

License: CC0-1.0

Locale: ja

Task: ASR

Format: MP3

Size: 14.35 GB

MDC Curators

CoVoST 2 Japanese - English

The dataset includes audio files in Japanese and their translations in English.

License: CC-BY-NC-4.0

Locale: ja, en

Task: MT

Format: MP3, TSV

Size: 82.06 MB

Community

Bojonegoro Javanese TTS

This dataset contains synthetic speech data covering a variety of everyday-life topics in the Bojonegoro dialect of Javanese, spoken in East Java, Indonesia.

License: CC-BY-SA-4.0

Locale: jav

Task: TTS

Format: .tar.gz, WEBM

Size: 469.50 MB

MDC Curators

CoVoST 2 English - Chinese (China)

The dataset includes audio files in English and their translations in Chinese (China).

License: CC-BY-NC-4.0

Locale: en, zh-CN

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Balochistan Educational and Cultural Organization

Talar (تلار) Barahui Magazine Corpus

A ~150,000-word Brahui corpus from the monthly magazine Talar, covering editorials, essays, fiction, poetry, and socio-cultural commentary.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 317.22 KB

Common Voice

Common Voice Spontaneous Speech 4.0 - Sabah Bisaya

A collection of spontaneous responses to questions in Sabah Bisaya.

License: CC0-1.0

Locale: bsy

Task: ASR

Format: MP3

Size: 221.30 MB

Common Voice

Common Voice Scripted Speech 26.0 - Nepali

A collection of read speech recordings in Nepali.

License: CC0-1.0

Locale: ne-NP

Task: ASR

Format: MP3

Size: 40.42 MB

CLEAR Global

TWB Parallel Sentence kits - Rohingya (5k)

5,000 English–Rohingya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: rhg

Task: MT

Format: TSV

Size: 358.88 KB

Common Voice

Common Voice Scripted Speech 26.0 - Quechua Corongo Ancash

A collection of read speech recordings in Quechua Corongo Ancash.

License: CC0-1.0

Locale: qwa

Task: ASR

Format: MP3

Size: 209.90 MB

Anjuman e Katib

Anjuman-e-Katib Farsi/Persian Literature Corpus

This corpus is a collection of more than one million tokens of Farsi/Persian language. The corpus contains work of literature including novels, fictional and non-fictional, poems and many more. the data is shared with the approval of the authors and aims to support linguistic research, language technology development and its preservation.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 2.82 MB

Balochistan Educational and Cultural Organization

Brahui Research Work Corpus

This corpus consists of research works, academic theses, and scholarly papers, comprising approximately 185,000 tokens. It covers a range of academic topics and formal registers, reflecting standardized writing practices and disciplinary conventions. The corpus is intended to support linguistic analysis, discourse studies, and computational research on academic and research-oriented text.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.13 MB

Common Voice

Common Voice Spontaneous Speech 4.0 - Javanese

A collection of spontaneous responses to questions in Javanese.

License: CC0-1.0

Locale: jv

Task: ASR

Format: MP3

Size: 28.17 MB

Common Voice

Common Voice Scripted Speech 26.0 - Toki Pona

A collection of read speech recordings in Toki Pona.

License: CC0-1.0

Locale: tok

Task: ASR

Format: MP3

Size: 471.44 MB

Common Voice

Common Voice Scripted Speech 26.0 - Torwali

A collection of read speech recordings in Torwali.

License: CC0-1.0

Locale: trw

Task: ASR

Format: MP3

Size: 374.55 MB

CLEAR Global

TWB Parallel Sentence kits - Hausa (30k)

30,000 English–Hausa parallel sentences from CLEAR Global's Gamayun kits, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: hau

Task: MT

Format: TSV

Size: 1.68 MB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 2.0

This dataset is an extended and updated version of the "Bamun-French Parallel Corpus 1.1", a parallel corpus of 4,444 lines in Bamun and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 184.29 KB