Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “Dari 1 Million Text Corpus”

100 Datasets

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC-DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

MDC Curators

CoVoST 2 English - Indonesian

The dataset includes audio files in English and their translations in Indonesian.

License: CC-BY-NC-4.0

Locale: en, id

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Balochistan Educational and Cultural Organization

Talar (تلار) Barahui Magazine Corpus

A ~150,000-word Brahui corpus from the monthly magazine Talar, covering editorials, essays, fiction, poetry, and socio-cultural commentary.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 317.22 KB

MDC Curators

CoVoST 2 Indonesian - English

The dataset includes audio files in Indonesian and their translations in English.

License: CC-BY-NC-4.0

Locale: id, en

Task: MT

Format: MP3, TSV

Size: 79.77 MB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Dolgan Speech Corpus

A 13-hour supervised Speech-to-Text dataset for Dolgan, an endangered Turkic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: dlg

Task: ASR

Format: TSV, MP3

Size: 583.34 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Evenki Speech Corpus

A 2.5-hour supervised Speech-to-Text dataset for Evenki, an endangered Tungusic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: evn

Task: ASR

Format: TSV, MP3

Size: 103.03 MB

Community

Mandar Balanipa Speech Corpus

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Community

Pemalang Dialect of JAV-IND-ENG-ARB Parallel Corpus

The languages represented in the corpus include Javanese (Pemalang dialect), Indonesian, English, and Arabic.

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 555.62 KB

Community

Indonesia Lip-Record Speech Dataset

This dataset consists of lip-only video recordings paired with audio and transcribed text in Indonesian.

License: CC-BY-NC-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 897.43 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Selkup Speech Corpus

A 1.6-hour supervised Speech-to-Text dataset for Selkup, an endangered Samoyedic language. Features sentence-level audio-text alignments.

License: CC-BY-NC-SA-4.0

Locale: sel

Task: ASR

Format: TSV, MP3

Size: 45.46 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Kalmyk Speech Corpus

A 3-hour supervised Speech-to-Text dataset for Kalmyk, a Mongolic language. Features sentence-level audio aligned with scientific text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: xal

Task: ASR

Format: TSV, MP3

Size: 138.31 MB

Community

Indonesian-Multidialect Lip-Record Speech Corpus

This dataset contains Indonesian speech data designed for lip-reading research and development.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 981.20 MB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 2.0

This dataset is an extended and updated version of the "Bamun-French Parallel Corpus 1.1", a parallel corpus of 4,444 lines in Bamun and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 184.29 KB

Institute of African Digital Humanities

Mada-French Parallel Corpus 1.0

This dataset comprises a parallel corpus of 2,154 lines of translations of literary texts from Mada (mxu) to French.

License: NOODL-1.0

Locale: mxu

Task: MT

Format: TSV

Size: 122.37 KB

Community

Bahasa Indonesia Lip-Reading Dataset

This dataset contains video recordings of Indonesian speakers' lip movements.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 982.50 MB

PT Pancaran Semangat Jaya

Corpus of Panjebar Semangat Javanese-Language Magazine

This dataset is a TXT-format collection compiled from three years of popular articles published in the Javanese-language weekly magazine Panjebar Semangat. It compiles widely read, non-academic Javanese texts reflecting contemporary themes and language use.

License: CC-BY-SA-4.0

Locale: Jav

Task: OTH

Format: TXT

Size: 4.31 MB

Community

JAV-Culture: Gresik–Surabaya Multimodal Corpus

A corpus of annotated photographs of cultural objects described in the Gresik dialect of Javanese language.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: CV

Format: JPEG, WEBM, JSON

Size: 713.73 MB

Community

Manggarai Language for NLP

The dataset consists of responses to various prompts written in the Manggarai language. These responses were subsequently read aloud and recorded.

License: CC-BY-NC-SA-4.0

Locale: mqy

Task: TTS

Format: WEBM, TSV

Size: 287.61 MB

CLEAR Global

TWB Parallel Sentence kits - Tigrinya (5k)

5,000 English–Tigrinya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: tig

Task: MT

Format: TSV

Size: 404.75 KB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 1.1

This dataset is an updated version of the "Bamun-French Parallel Corpus", a parallel corpus of texts in Bamun (Shupament) and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 99.78 KB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB