Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “support”

199 Datasets

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Eastern Min

A collection of spontaneous responses to questions in Eastern Min.

License: CC0-1.0

Locale: cdo

Task: ASR

Format: MP3

Size: 191.80 MB

Balochistan Educational and Cultural Organization

Western Balochi Literature Cropus

A cleaned literary corpus in Western Balochi (Rakhshani) including articles, research, translations, and creative literature. (~1.1 m tokens)

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 2.26 MB

Rerooted Archive

Rerooted: Speech Corpus of Testimonials from Armenian Refugees and Immigrants

Rerooted is an open-access online YouTube corpus of interviews with Armenian refugees and immigrants. As of now, the online corpus has over 80hrs of recordings on YouTube, alongside subtitles in Western Armenian. The current dataset is 20 hours from the corpus that we have curated with corrected and finely-annotated transcripts. The dataset is for use in NLP research, and we hope to continuously update the dataset with more curated transcripts.

License: GPL-3.0

Locale: hy; hyw

Task: ASR

Format: WAV, TEXTGRID

Size: 6.21 GB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

MDC Curators

CoVoST 2 Japanese - English

The dataset includes audio files in Japanese and their translations in English.

License: CC-BY-NC-4.0

Locale: ja, en

Task: MT

Format: MP3, TSV

Size: 82.06 MB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Forum for Language Initiatives

Kohistani Shina Word List

A UTF-8 encoded Kohistani Shina dictionary and word list corpus with lexical entries, meanings, and annotations for linguistic research and NLP use.

License: CC-BY-NC-4.0

Locale: plk

Task: NLP

Format: TXT

Size: 394.05 KB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Chiga

A collection of spontaneous responses to questions in Chiga.

License: CC0-1.0

Locale: cgg

Task: ASR

Format: MP3

Size: 234.20 MB

Forum for Language Initiatives

Khowar Word List

A UTF-8 encoded Khowar lexical corpus containing alphabet definitions and a structured word list for linguistic research and language technology development.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 64.22 KB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Nubi

A collection of spontaneous responses to questions in Nubi.

License: CC0-1.0

Locale: kcn

Task: ASR

Format: MP3

Size: 300.91 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Rukai

A collection of read speech recordings in Rukai.

License: CC0-1.0

Locale: dru

Task: ASR

Format: MP3

Size: 213.65 MB

LocaleNLP

English Hausa Parallel Corpus

An English–Hausa dataset with 5,000 sentence pairs useful for machine translation and basic language processing tasks.

License: CC-BY-NC-4.0

Locale: eng, hau

Task: MT

Format: csv

Size: 164.32 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Iñupiaq

A collection of read speech recordings in Iñupiaq.

License: CC0-1.0

Locale: ipk

Task: ASR

Format: MP3

Size: 146.36 MB

CLEAR Global

TWB Voice 1.0 - Kanuri

Read speech corpus of 52 hours of Kanuri audio with transcriptions, collected by CLEAR Global for ASR development.

License: CC-BY-NC-4.0

Locale: kau

Task: ASR

Format: WAV, TSV

Size: 10.98 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Sorbian, Lower

A collection of read speech recordings in Sorbian, Lower.

License: CC0-1.0

Locale: dsb

Task: ASR

Format: MP3

Size: 798.40 KB

MEDIAMEN

Mediamen Punjabi Literature Corpus

This corpus is a collection of one million tokens of Western Punjabi language. The data was produced under the Mediamen publishing agency over the last ten years. The corpus contains work of literature including short stories, novels, fiction, non-fiction, and dramas. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.82 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Slovenian

A collection of read speech recordings in Slovenian.

License: CC0-1.0

Locale: sl

Task: ASR

Format: MP3

Size: 488.98 MB

MirasAI

Gujarati News and Blogs Corpus

A collection of Gujarati news articles and blog posts compiled for natural language processing and text analysis tasks.

License: CC-BY-NC-4.0

Locale: guj

Task: NLP

Format: TXT

Size: 18.93 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Croatian

A collection of read speech recordings in Croatian.

License: CC0-1.0

Locale: hr

Task: ASR

Format: MP3

Size: 890.40 KB

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

Open Home Foundation

Gosia 1.0

Text to speech dataset for Polish, female speaker, approximately 2 hours of read speech.

License: CC0-1.0

Locale: pl-PL

Task: TTS

Format: WEBM

Size: 39.75 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Khmer

A collection of read speech recordings in Khmer.

License: CC0-1.0

Locale: km

Task: ASR

Format: MP3

Size: 20.23 MB