Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Dari 1 Million Text Corpus”

100 Datasets

MDC Curators

CoVoST 2 Indonesian - English

The dataset includes audio files in Indonesian and their translations in English.

License: CC-BY-NC-4.0

Locale: id, en

Task: MT

Format: MP3, TSV

Size: 79.77 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Dolgan Speech Corpus

A 13-hour supervised Speech-to-Text dataset for Dolgan, an endangered Turkic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: dlg

Task: ASR

Format: TSV, MP3

Size: 583.34 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Evenki Speech Corpus

A 2.5-hour supervised Speech-to-Text dataset for Evenki, an endangered Tungusic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: evn

Task: ASR

Format: TSV, MP3

Size: 103.03 MB

Community

Mandar Balanipa Speech Corpus

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Community

Indonesia Lip-Record Speech Dataset

This dataset consists of lip-only video recordings paired with audio and transcribed text in Indonesian.

License: CC-BY-NC-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 897.43 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Selkup Speech Corpus

A 1.6-hour supervised Speech-to-Text dataset for Selkup, an endangered Samoyedic language. Features sentence-level audio-text alignments.

License: CC-BY-NC-SA-4.0

Locale: sel

Task: ASR

Format: TSV, MP3

Size: 45.46 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Kalmyk Speech Corpus

A 3-hour supervised Speech-to-Text dataset for Kalmyk, a Mongolic language. Features sentence-level audio aligned with scientific text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: xal

Task: ASR

Format: TSV, MP3

Size: 138.31 MB

Community

Indonesian-Multidialect Lip-Record Speech Corpus

This dataset contains Indonesian speech data designed for lip-reading research and development.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 981.20 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Yoruba) 🚧

100k native-reviewed colloquial sentences translated from US English into Yoruba for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: yo-NG, en-US

Task: MT

Format: TSV

Size: 5.02 MB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 2.0

This dataset is an extended and updated version of the "Bamun-French Parallel Corpus 1.1", a parallel corpus of 4,444 lines in Bamun and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 184.29 KB

Institute of African Digital Humanities

Mada-French Parallel Corpus 1.0

This dataset comprises a parallel corpus of 2,154 lines of translations of literary texts from Mada (mxu) to French.

License: NOODL-1.0

Locale: mxu

Task: MT

Format: TSV

Size: 122.37 KB

Community

Bahasa Indonesia Lip-Reading Dataset

This dataset contains video recordings of Indonesian speakers' lip movements.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 982.50 MB

Common Voice

Common Voice Scripted Speech 26.0 - Indonesian

A collection of read speech recordings in Indonesian.

License: CC0-1.0

Locale: id

Task: ASR

Format: MP3

Size: 1.42 GB

PT Pancaran Semangat Jaya

Corpus of Panjebar Semangat Javanese-Language Magazine

This dataset is a TXT-format collection compiled from three years of popular articles published in the Javanese-language weekly magazine Panjebar Semangat. It compiles widely read, non-academic Javanese texts reflecting contemporary themes and language use.

License: CC-BY-SA-4.0

Locale: Jav

Task: OTH

Format: TXT

Size: 4.31 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

100k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 4.49 MB

Community

Manggarai Language for NLP

The dataset consists of responses to various prompts written in the Manggarai language. These responses were subsequently read aloud and recorded.

License: CC-BY-NC-SA-4.0

Locale: mqy

Task: TTS

Format: WEBM, TSV

Size: 287.61 MB

CLEAR Global

TWB Parallel Sentence kits - Tigrinya (5k)

5,000 English–Tigrinya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: tig

Task: MT

Format: TSV

Size: 404.75 KB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 1.1

This dataset is an updated version of the "Bamun-French Parallel Corpus", a parallel corpus of texts in Bamun (Shupament) and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 99.78 KB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

Community

Jombang Dialect-Javanese TTS

This dataset comprises audio recordings of scripted speech in Javanese of Jombang Dialect from Jombang city in East Java of Indonesia.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: TTS

Format: WEBM, TSV

Size: 281.30 MB

Common Voice

Common Voice Spontaneous Speech 4.0 - Serian Bidayuh

A collection of spontaneous responses to questions in Serian Bidayuh.

License: CC0-1.0

Locale: sdo

Task: ASR

Format: MP3

Size: 201.27 MB

Sujaak Adbi Sangat

Saraiki Quarterly Magazine Wasson Wehray Corpus

This corpus contains 11,79,200 tokens, from a Saraiki Quarterly Magazine "Wasson Wehray"

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 2.09 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Nenets Speech Corpus

A supervised Speech-to-Text dataset for Nenets, a Samoyedic language. Features sentence-level audio aligned with Cyrillic text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: yrk

Task: ASR

Format: TSV, MP3

Size: 8.35 MB