Datasets | Mozilla Data Collective

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Finnish

A collection of read speech recordings in Finnish.

License: CC0-1.0

Locale: fi

Task: ASR

Format: MP3

Size: 477.16 MB

Taruen

Finnish Public Domain 20th Century Literature Text Corpus

A 69.1M-word early 20th-century literature corpus from Project Lönnrot. Predominantly Finnish, with a supplementary Swedish collection.

License: CC0-1.0

Locale: fi, sv

Task: NLP

Format: TXT

Size: 205.76 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Estonian

A collection of read speech recordings in Estonian.

License: CC0-1.0

Locale: et

Task: ASR

Format: MP3

Size: 1.55 GB

MDC Curators

CoVoST 2 Estonian - English

The dataset includes audio files in Estonian and their translations in English.

License: CC-BY-NC-4.0

Locale: et, en

Task: MT

Format: MP3, TSV

Size: 239.07 MB

MDC Curators

CoVoST 2 English - Estonian

The dataset includes audio files in English and their translations in Estonian.

License: CC-BY-NC-4.0

Locale: en, et

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Community

Oro_Word

Afaan Oromoo word-level speech dataset collected to support open-source speech recognition and text-to-speech technology.

License: CC0-1.0

Locale: om

Task: TTS

Format: .WAV, CSV

Size: 1.28 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Afaan Oromo

A collection of spontaneous responses to questions in Afaan Oromo.

License: CC0-1.0

Locale: om

Task: ASR

Format: MP3

Size: 4.04 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Latvian

A collection of spontaneous responses to questions in Latvian.

License: CC0-1.0

Locale: lv

Task: ASR

Format: MP3

Size: 12.03 MB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Ruuli

A collection of spontaneous responses to questions in Ruuli.

License: CC0-1.0

Locale: ruc

Task: ASR

Format: MP3

Size: 365.90 MB

Institute of African Digital Humanities

Afaan Oromoo-TTS-Dataset

1,737 read-speech recordings from a single Afaan Oromo speaker, with MP3 audio and TSV sentence mappings. Suitable for TTS and ASR.

License: NOODL-1.0

Locale: gax

Task: TTS

Format: MP3, TSV

Size: 258.48 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Afaan Oromo

A collection of read speech recordings in Afaan Oromo.

License: CC0-1.0

Locale: om

Task: ASR

Format: MP3

Size: 528.32 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Esperanto

A collection of spontaneous responses to questions in Esperanto.

License: CC0-1.0

Locale: eo

Task: ASR

Format: MP3

Size: 25.13 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Shona

A collection of spontaneous responses to questions in Shona.

License: CC0-1.0

Locale: sn

Task: ASR

Format: MP3

Size: 1.53 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part1

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for Somali language, produced by Digital Divide Data

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 7.68 GB

Open Home Foundation

Lili 1.0

Text to speech dataset for Slovak, female speaker, approximately 2 hours of read speech.

License: CC0-1.0

Locale: sk-SK

Task: TTS

Format: WEBM

Size: 72.38 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Svan

A collection of read speech recordings in Svan.

License: CC0-1.0

Locale: sva

Task: ASR

Format: MP3

Size: 353.39 MB

Community

Şalom Ladino Corpus

Text corpus of 176,843 words compiled from 397 Judeo-Espanyol articles from Şalom newspaper.

License: CC-BY-4.0

Locale: lad

Task: LM

Format: TXT

Size: 403.16 KB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Sinhala

A collection of spontaneous responses to questions in Sinhala.

License: CC0-1.0

Locale: si

Task: ASR

Format: MP3

Size: 8.14 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part3

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 1.33 GB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part2

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 8.07 GB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

All Datasets

Common Voice Scripted Speech 27.0 - Finnish

Finnish Public Domain 20th Century Literature Text Corpus

Common Voice Scripted Speech 27.0 - Estonian

CoVoST 2 Estonian - English

CoVoST 2 English - Estonian

Oro_Word

Weekly dataset digest

Saraiki-English Parallel Corpus

Common Voice Spontaneous Speech 5.0 - Afaan Oromo

Common Voice Spontaneous Speech 5.0 - Latvian

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

Common Voice Spontaneous Speech 5.0 - Ruuli

Afaan Oromoo-TTS-Dataset

Common Voice Scripted Speech 27.0 - Afaan Oromo

Common Voice Spontaneous Speech 5.0 - Esperanto

Common Voice Spontaneous Speech 5.0 - Shona

ddd-kenya-somali-68hrs-asr-part1

Lili 1.0

Common Voice Scripted Speech 27.0 - Svan

Şalom Ladino Corpus

Kaleem Art Press Saraiki Literature Corpus

Common Voice Spontaneous Speech 5.0 - Sinhala

ddd-kenya-somali-68hrs-asr-part3

ddd-kenya-somali-68hrs-asr-part2

Baloch Publishers Saraiki Literature Corpus