Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “support”

199 Datasets

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

MDC Curators

CoVoST 2 English - Chinese (China)

The dataset includes audio files in English and their translations in Chinese (China).

License: CC-BY-NC-4.0

Locale: en, zh-CN

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Community

Synthetic Ladino Parallel Corpus

Synthetically produced parallel sentences for Ladino paired with English, Spanish, and Turkish, generated using rule-based translation.

License: CC-BY-4.0

Locale: lad, en, es, tr

Task: MT

Format: TSV

Size: 898.32 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Sorbian, Upper

A collection of read speech recordings in Sorbian, Upper.

License: CC0-1.0

Locale: hsb

Task: ASR

Format: MP3

Size: 325.96 MB

Institute of African Digital Humanities

Mvele_ALCAM-MultimodalDataset

A multimodal dataset comprising example sentences in Mvele and their French translation, together with audio recordings and an audio mapping file.

License: NOODL-1.0

Locale: ewo

Task: NLP

Format: MP3, TSV

Size: 14.13 MB

NaijaVoices (Lanfrica Labs)

Future-proofing Gbagyi: A community centered approach

This dataset comprises 360 audio recordings of the Gbagyi language, comprising approximately 7 hours 52 minutes of speech data, with paired transcripts.

License: CC-BY-NC-SA-4.0

Locale: gbr

Task: NLP

Format: WAV

Size: 18.88 GB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Weekly Kaleem Magazine Multan

Kaleem Magazine Urdu Corpus

This corpus is a collection of around 1.4 million tokens of Urdu language. The data was extracted from the archives of a famous Urdu magazine "Kaleem" published weekly from last 30 years. This corpus contains work of literature including stories, short stories, news, poetry, literary reports, fiction, non-fiction, and travelogues. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 2.74 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Melanau

A collection of spontaneous responses to questions in Melanau.

License: CC0-1.0

Locale: mel

Task: ASR

Format: MP3

Size: 209.11 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

Prompsit Language Engineering

Prompsit D4 - Document-structure Integrity

Checks whether translated HTML documents preserve their element structure, tables, links and images.

License: CC-BY-4.0

Locale: mul

Task: MT

Format: JSONL

Size: 233.49 KB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Cypriot Greek

A collection of spontaneous responses to questions in Cypriot Greek.

License: CC0-1.0

Locale: el-CY

Task: ASR

Format: MP3

Size: 211.49 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Kelabit

A collection of spontaneous responses to questions in Kelabit.

License: CC0-1.0

Locale: kzi

Task: ASR

Format: MP3

Size: 194.34 MB

Digital Divide Data

ddd-kenya-luhya-70hrs-asr

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Luhya language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: luy

Task: ASR

Format: WAV, XLSX, TSV

Size: 13.90 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Svan

A collection of read speech recordings in Svan.

License: CC0-1.0

Locale: sva

Task: ASR

Format: MP3

Size: 353.39 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part1

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for Somali language, produced by Digital Divide Data

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 7.68 GB

MDC DatasetsCompensated

🚧 Southeast Asian Cantonese TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text in Southeast Asian Cantonese, from a single speaker.

License: MDC-DLA-1.0

Locale: yue

Task: TTS

Format: WAV, TSV

Size: 202 B

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part2

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 8.07 GB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Sinhala

A collection of spontaneous responses to questions in Sinhala.

License: CC0-1.0

Locale: si

Task: ASR

Format: MP3

Size: 8.14 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part3

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 1.33 GB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - English

A collection of spontaneous responses to questions in English.

License: CC0-1.0

Locale: en

Task: ASR

Format: MP3

Size: 519.05 MB

Institute of African Digital Humanities

Adamawa Fulfulde-French Parallel Corpus of Narratives 1.2

This dataset is an updated version of the 'Adamawa Fulfulde–French Parallel Corpus of Narratives 1.1'.

License: NOODL-1.0

Locale: fub

Task: MT

Format: TSV

Size: 112.17 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Brahui

A collection of read speech recordings in Brahui.

License: CC0-1.0

Locale: brh

Task: ASR

Format: MP3

Size: 198.07 MB