Datasets | Mozilla Data Collective

Kaler Kontho

Kaler Kantho Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Kaler Kantho provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 33.11 MB

Pro Svizra Rumantscha

Putèr Newspaper Corpus

1.3 million tokens in the Putèr variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-puter

Task: OTH

Format: TSV

Size: 8.94 MB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

Pro Svizra Rumantscha

Sutsilvan Newspaper Corpus

1.3 million tokens in the Sutsilvan variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-sutsilv

Task: OTH

Format: TSV

Size: 8.87 MB

Pro Svizra Rumantscha

Surmiran Newspaper Corpus

2.9 million tokens in the Surmiran variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-surmiran

Task: OTH

Format: TSV

Size: 11.89 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

Sindh Sujag Newspaper Agency

Sindh Sujag Newspaper Corpus

The corpus contains approximately 1.2 million tokens from the Sindh Sujag Newspaper Agency published between 2024 and 2025. It includes complete newspaper content such as headlines, editorials, finance news, and advertisements. The newspaper is published daily in Karachi, Pakistan, and represents a comprehensive collection of contemporary Sindhi journalistic writing.

License: CC-BY-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.63 MB

Protham Alo

Prothom Alo Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Prothom Alo provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 42.36 MB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

Pro Svizra Rumantscha

Sursilvan Newspaper Corpus

14.6 million tokens in the Sursilvan variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-sursilv

Task: OTH

Format: TSV

Size: 37.80 MB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Pro Svizra Rumantscha

Vallader Newspaper Corpus

6.2 million tokens in the Vallader variety of Romansh from the daily newspaper ”La Quotidiana”.

License: CC0-1.0

Locale: rm-vallader

Task: OTH

Format: TSV

Size: 18.71 MB

Sindh Line Publishers

The corpus contains 1.029 million tokens from the Sindh Line a Sindhi Newspaper published from the year 2024-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.22 MB

Tamir News Agency

Tamir Sindhi News Corpus

The corpus contains 1.1 million tokens from the Tamir Sindhi Newspaper published from the year 2022-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.56 MB

Pro Svizra Rumantscha

Rumantsch Grischun Newspaper Corpus

6.1 million tokens in the Rumantsch Grischun variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-rumgr

Task: OTH

Format: TSV

Size: 19.03 MB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

CLEAR Global

TWB Parallel Sentence kits - Kanuri (5k)

5,000 English–Kanuri parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: kau

Task: MT

Format: TSV

Size: 358.46 KB

Sujaak Adbi Sangat

Saraiki Quarterly Magazine Wasson Wehray Corpus

This corpus contains 11,79,200 tokens, from a Saraiki Quarterly Magazine "Wasson Wehray"

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 2.09 MB

Community

Kanuri Lexicon

A structured Kanuri lexical resource containing headwords, grammatical labels, English definitions, and source entry information.

License: CC-BY-NC-4.0

Locale: kau

Task: N/A

Format: CSV, JSONL, TXT, MD

Size: 577.46 KB

RFE/RL

RFE/RL Kazakh News Text Corpus

Longitudinal Kazakh news corpus from Radio Azattyq (2003-2026) with over 139,000 articles and 35M tokens.

License: CC-BY-NC-SA-4.0

Locale: kk

Task: NLP

Format: TXT

Size: 126.81 MB

Chana

Kakataibo: Phonetic Word List

150 Kakataibo lexical items with WAV recordings and Praat TextGrids, including botanically identified items and comparable Aymara and Awajún data.

License: Chana 2.0

Locale: cbr

Task: N/A

Format: WAV, TextGrid, MD, CSV

Size: 65.10 MB

Balochistan Educational and Cultural Organization

Talar (تلار) Barahui Magazine Corpus

A ~150,000-word Brahui corpus from the monthly magazine Talar, covering editorials, essays, fiction, poetry, and socio-cultural commentary.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 317.22 KB

Balochi Academy

Balochi Academy Text Corpus

This corpus contains approximately 500k tokens of text from novels, poetry, articles, riddles, and proverbs, covering both literary and traditional genres. It is intended for linguistic research, NLP tasks (e.g., language modeling and text analysis), and cultural documentation.

License: CC-BY-NC-SA-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.88 MB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC-DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

All Datasets

Kaler Kantho Bengali Newspaper Corpus

Putèr Newspaper Corpus

NAWA-E-WATAN Balochi Newspaper Corpus

Sutsilvan Newspaper Corpus

Surmiran Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Weekly dataset digest

Sindh Sujag Newspaper Corpus

Prothom Alo Bengali Newspaper Corpus

Jazab Sindhi Newspaper Corpus

Sursilvan Newspaper Corpus

Kanuri Books Corpus

Vallader Newspaper Corpus

Sindh Line Publishers

Tamir Sindhi News Corpus

Rumantsch Grischun Newspaper Corpus

The Daily Jugantor Bengali Language Corpus

TWB Parallel Sentence kits - Kanuri (5k)

Saraiki Quarterly Magazine Wasson Wehray Corpus

Kanuri Lexicon

RFE/RL Kazakh News Text Corpus

Kakataibo: Phonetic Word List

Talar (تلار) Barahui Magazine Corpus

Balochi Academy Text Corpus

🚧 Khowar-English Parallel Corpus 🚧