Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “rukai”

100 Datasets

Common Voice

Common Voice Scripted Speech 27.0 - Chinese (China)

A collection of read speech recordings in Chinese (China).

License: CC0-1.0

Locale: zh-CN

Task: ASR

Format: MP3

Size: 21.40 GB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Balochistan Educational and Cultural Organization

Western Balochi Literature Cropus

A cleaned literary corpus in Western Balochi (Rakhshani) including articles, research, translations, and creative literature. (~1.1 m tokens)

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 2.26 MB

Community

JAV IKRAR - Craft and Cultural Heritage Multimodal Corpus

A collection of annotated images capturing public space activities, traditional handicrafts, historical and cultural heritage exhibits in Java.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 1.13 GB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

49k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 2.93 MB

Common Voice

Common Voice Scripted Speech 27.0 - Kalkoti

A collection of read speech recordings in Kalkoti.

License: CC0-1.0

Locale: xka

Task: ASR

Format: MP3

Size: 190.04 MB

Common Voice

Common Voice Scripted Speech 27.0 - Loja Highland Kichwa

A collection of read speech recordings in Loja Highland Kichwa.

License: CC0-1.0

Locale: qvj

Task: ASR

Format: MP3

Size: 221.75 MB

Common Voice

Common Voice Scripted Speech 27.0 - Taiwanese (Minnan)

A collection of read speech recordings in Taiwanese (Minnan).

License: CC0-1.0

Locale: nan-tw

Task: ASR

Format: MP3

Size: 471.51 MB

Common Voice

Common Voice Spontaneous Speech 5.0 - Bukusu

A collection of spontaneous responses to questions in Bukusu.

License: CC0-1.0

Locale: bxk

Task: ASR

Format: MP3

Size: 261.93 MB

MDC DatasetsCompensated

🚧 Southeast Asian Hokkien TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech from a single speaker of Southeast Asian Hokkien.

License: MDC DLA-1.0

Locale: nan

Task: TTS

Format: WAV, TSV

Size: 194 B

Common Voice

Common Voice Scripted Speech 27.0 - Kichwa

A collection of read speech recordings in Kichwa.

License: CC0-1.0

Locale: qvi

Task: ASR

Format: MP3

Size: 250.70 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

100k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 4.49 MB

Common Voice

Common Voice Scripted Speech 27.0 - Sakizaya

A collection of read speech recordings in Sakizaya.

License: CC0-1.0

Locale: szy

Task: ASR

Format: MP3

Size: 280.80 MB

Common Voice

Common Voice Scripted Speech 27.0 - Mungaka

A collection of read speech recordings in Mungaka.

License: CC0-1.0

Locale: mhk

Task: ASR

Format: MP3

Size: 219.99 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

Common Voice

Common Voice Scripted Speech 27.0 - Tshivenda

A collection of read speech recordings in Tshivenda.

License: CC0-1.0

Locale: ve

Task: ASR

Format: MP3

Size: 1.33 MB

Common Voice

Common Voice Scripted Speech 27.0 - Pa'O

A collection of read speech recordings in Pa'O.

License: CC0-1.0

Locale: blk

Task: ASR

Format: MP3

Size: 463.99 KB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

Kaleem Art Press

Saraiki Literature Corpus

This contains multiple Saraiki Language books of Stories, Short Stories, Novel, Travelogue, Sentences and collection of articles.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

MirasAI

Kannada Text Corpus

A curated Kannada text corpus containing diverse written content for natural language processing, linguistic research, and language technology development.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: NLP

Format: TXT

Size: 2.61 MB

OpenCSG

chinese-cosmopedia

A large-scale high-quality Chinese text dataset developed by OpenCSG, containing ~15 million entries (≈60B tokens) covering multi-domain content (encyclopedia, education, etc.). Cleaned and deduplicated to remove low-quality content, it is optimized for large language model pretraining, text generation, and other Chinese NLP downstream tasks, compatible with mainstream toolchains (Hugging Face Datasets, PyTorch).

License: Apache-2.0

Locale: zh

Task: LLM

Format: parquet

Size: 6.09 GB

MirasAI

Ormuri Literature corpus by Rozi Burki

Ormuri Literature Corpus is a collection of Ormuri literary texts by Rozi Burki, supporting research and preservation of this under-resourced language.

License: CC-BY-NC-SA-4.0

Locale: oru

Task: NLP

Format: PDF, DOCX

Size: 18.92 MB

Community

JAV-Culture: Gresik–Surabaya Multimodal Corpus

A corpus of annotated photographs of cultural objects described in the Gresik dialect of Javanese language.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 713.73 MB

Common Voice

Common Voice Scripted Speech 27.0 - Kinyarwanda

A collection of read speech recordings in Kinyarwanda.

License: CC0-1.0

Locale: rw

Task: ASR

Format: MP3

Size: 57.18 GB