Datasets | Mozilla Data Collective

A literary corpus of Dameli texts preserving the language’s literary traditions, cultural heritage, narratives, and diverse forms of written expression.

Dameli Literature Corpus

License: CC-BY-NC-4.0

Locale: dml

Task: NLP

Format: TXT, DOCX

Size: 9.83 MB

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

Balochi Academy

Eastern Balochi Literature Corpus

A UTF-8 normalized Eastern Balochi literature corpus (~1.9M tokens) covering poetry, folklore, novels, and cultural texts for linguistic research and NLP.

License: CC-BY-NC-4.0

Locale: bgp

Task: NLP

Format: TXT

Size: 949.67 KB

6.1 million tokens in the Rumantsch Grischun variety of Romansh from the daily newspaper “La Quotidiana”.

Rumantsch Grischun Newspaper Corpus

License: CC0-1.0

Locale: rm-rumgr

Task: OTH

Format: TSV

Size: 19.03 MB

A diverse Hindi text corpus spanning literary works and news article blogs, curated for NLP research and language modeling tasks.

Hindi Literature & News Corpus

License: CC-BY-NC-SA-4.0

Locale: hin

Task: NLP

Format: TXT

Size: 19.52 MB

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

RFE/RL Afghan Pashto News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

Sylheti Text Corpus by Haque Publishers

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

2.9 million tokens in the Surmiran variety of Romansh from the daily newspaper “La Quotidiana”.

Surmiran Newspaper Corpus

License: CC0-1.0

Locale: rm-surmiran

Task: OTH

Format: TSV

Size: 11.89 MB

Kaleem Art Press

Kaleem Art Press Urdu Literature Corpus

This corpus is a collection of 1.44 million tokens of Urdu language . The data was produced under the Kaleem Art Press over the last fifteen years . The corpus contains work of literature including Stories, Short Stories, Novels, fiction, non-fiction, Travelogues, Poetry, Biography, and History. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.85 MB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

RFE/RL Tajik News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

A rare 613.5 K token Rohingya corpus written in the Myanmar script, featuring cultural articles and folklore for advanced NLP research and preservation.

Rohingya Literature Corpus

License: CC-BY-NC-4.0

Locale: rhg

Task: NLP

Format: TXT, DOCX

Size: 7.01 MB

Bismillah Graphics Publishers

Urdu Literature Corpus

This corpus contains 16,17,074 tokens of multiple Urdu literature books published by Bismillah Graphics Publishers.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.86 MB

A 16.9M-word Balochi news corpus from Associated Press of Pakistan, covering 59,172 articles published between 2016 and 2026.

Associated Press Pakistan 16.9 Million Balochi Corpus

License: CC-BY-NC-SA-4.0

Locale: bal

Task: NLP

Format: TXT

Size: 22.85 MB

Longitudinal Pakistani Pashto news corpus from Radio Mashaal (2010-2026) with over 52,000 articles and 14.5M tokens.

RFE/RL Pashto (Pakistani) News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 39.26 MB

This dataset is longitudinal news corpus for the Tatar and Bashkir languages, sourced from Azatliq Radiosi, from 2001 to 2025, it contains over 105,000 articles (30M tokens).

RFE/RL Tatar-Bashkir News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: tt,ba,ru

Task: NLP

Format: TXT

Size: 102.44 MB

Longitudinal Afghan Dari news corpus from Radio Azadi (2000-2026) featuring over 212,000 articles and 50M tokens.

RFE/RL Afghan Dari News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 115.70 MB

14.6 million tokens in the Sursilvan variety of Romansh from the daily newspaper “La Quotidiana”.

Sursilvan Newspaper Corpus

License: CC0-1.0

Locale: rm-sursilv

Task: OTH

Format: TSV

Size: 37.80 MB

A 690K token corpus of raw Chittagonian text covering drama, poetry, and folklore for linguistic research and NLP development.

Chittagonian (চাটগাঁইয়া, saṭgãia) Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ctg

Task: NLP

Format: TXT

Size: 6.59 MB