Datasets | Mozilla Data Collective

Common Voice

Common Voice Scripted Speech 26.0 - Rukai

A collection of read speech recordings in Rukai.

License: CC0-1.0

Locale: dru

Task: ASR

Format: MP3

Size: 213.64 MB

Community

Kokoro Speech Dataset

Kokoro Speech Dataset is a public domain Japanese speech dataset. (https://github.com/kaiidams/Kokoro-Speech-Dataset)

License: libribox

Locale: ja

Task: TTS

Format: FLAC

Size: 3.98 GB

Common Voice

Common Voice Scripted Speech 26.0 - Japanese

A collection of read speech recordings in Japanese.

License: CC0-1.0

Locale: ja

Task: ASR

Format: MP3

Size: 14.35 GB

MirasAI

Rangpuri (অংপুরি Ôṅgpuri) Text Corpus

A 500K token corpus of Rangpuri literature and drama provided in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: rkt

Task: NLP

Format: TXT

Size: 3.68 MB

Common Voice

Common Voice Scripted Speech 26.0 - Huarijio

A collection of read speech recordings in Huarijio.

License: CC0-1.0

Locale: var

Task: ASR

Format: MP3

Size: 236.19 MB

Common Voice

Common Voice Spontaneous Speech 4.0 - Ruuli

A collection of spontaneous responses to questions in Ruuli.

License: CC0-1.0

Locale: ruc

Task: ASR

Format: MP3

Size: 365.90 MB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

Common Voice

Common Voice Scripted Speech 26.0 - Cantonese

A collection of read speech recordings in Cantonese.

License: CC0-1.0

Locale: yue

Task: ASR

Format: MP3

Size: 5.99 GB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Common Voice

Common Voice Scripted Speech 26.0 - Chinese (Taiwan)

A collection of read speech recordings in Chinese (Taiwan).

License: CC0-1.0

Locale: zh-TW

Task: ASR

Format: MP3

Size: 2.95 GB

Digital Divide Data

ddd-kenya-luhya-70hrs-asr

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Luhya language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: luy

Task: ASR

Format: WAV, XLSX, TSV

Size: 13.90 GB

OpenCSG

Finweb-Edu-Chinese-v2.2

Fineweb-Edu-Chinese v2.2: Updated Chinese educational web dataset (Fineweb series) — access via www.opencsg.com.

License: Apache-2.0

Locale: zh

Task: LLM

Format: parquet

Size: 624.68 MB

Common Voice

Common Voice Scripted Speech 26.0 - Parkari Koli

A collection of read speech recordings in Parkari Koli.

License: CC0-1.0

Locale: kvx

Task: ASR

Format: MP3

Size: 219.50 MB

Tamazight NLP

AmaWar

Amawal Warayni - ⴰⵎⴰⵡⴰⵍ ⴰⵙⵏⵎⴰⵍⴰⵢ ⵏ ⵉⵏⵓⵎⴰⴽ ⵏ ⵡⴰⵙⵙⴰⵖⵏ ⴷ ⵉⵎⵢⴰⴳⵏ ⵏ ⵜⵎⴰⵣⵉⵖⵜ ⵏ ⴰⵢⵜ ⵡⴰⵔⴰⵢⵏ

License: Apache-2.0

Locale: rif

Task: MT

Format: TSV

Size: 100.28 KB

Common Voice

Common Voice Scripted Speech 26.0 - Saraiki

A collection of read speech recordings in Saraiki.

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.49 MB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

Common Voice

Common Voice Spontaneous Speech 4.0 - Rutoro

A collection of spontaneous responses to questions in Rutoro.

License: CC0-1.0

Locale: ttj

Task: ASR

Format: MP3

Size: 274.05 MB

Common Voice

Common Voice Scripted Speech 26.0 - Kichwa

A collection of read speech recordings in Kichwa.

License: CC0-1.0

Locale: qvi

Task: ASR

Format: MP3

Size: 250.63 MB

CLEAR Global

TWB Parallel Sentence kits - Kanuri (5k)

5,000 English–Kanuri parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: kau

Task: MT

Format: TSV

Size: 358.46 KB

Common Voice

Common Voice Spontaneous Speech 4.0 - Rakhine

A collection of spontaneous responses to questions in Rakhine.

License: CC0-1.0

Locale: rki

Task: ASR

Format: MP3

Size: 11.83 MB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Common Voice

Common Voice Scripted Speech 26.0 - Chinese (China)

A collection of read speech recordings in Chinese (China).

License: CC0-1.0

Locale: zh-CN

Task: ASR

Format: MP3

Size: 21.39 GB

All Datasets

Not sure where to start?

Common Voice Scripted Speech 26.0 - Rukai

Kokoro Speech Dataset

Common Voice Scripted Speech 26.0 - Japanese

Rangpuri (অংপুরি Ôṅgpuri) Text Corpus

Common Voice Scripted Speech 26.0 - Huarijio

Common Voice Spontaneous Speech 4.0 - Ruuli

Baloch Publishers Saraiki Literature Corpus

Common Voice Scripted Speech 26.0 - Cantonese

Saraiki-English Parallel Corpus

Kaleem Art Press Saraiki Literature Corpus

RFE/RL Tajik News Text Corpus

Common Voice Scripted Speech 26.0 - Chinese (Taiwan)

ddd-kenya-luhya-70hrs-asr

Finweb-Edu-Chinese-v2.2

Common Voice Scripted Speech 26.0 - Parkari Koli

AmaWar

Common Voice Scripted Speech 26.0 - Saraiki

NAWA-E-WATAN Balochi Newspaper Corpus

Common Voice Spontaneous Speech 4.0 - Rutoro

Common Voice Scripted Speech 26.0 - Kichwa

TWB Parallel Sentence kits - Kanuri (5k)

Common Voice Spontaneous Speech 4.0 - Rakhine

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

Common Voice Scripted Speech 26.0 - Chinese (China)