Datasets | Mozilla Data Collective

Longitudinal Pakistani Pashto news corpus from Radio Mashaal (2010-2026) with over 52,000 articles and 14.5M tokens.

RFE/RL Pashto (Pakistani) News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 39.26 MB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

Sylheti Text Corpus by Haque Publishers

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

Anjuman e Katib

Persian Literature Corpus by Najwai Sukhan

A curated Persian literary corpus of ~1.26M tokens spanning literature, poetry, educational writing, and culturally significant texts.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 38.62 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

1.3 million tokens in the Sutsilvan variety of Romansh from the daily newspaper “La Quotidiana”.

Sutsilvan Newspaper Corpus

License: CC0-1.0

Locale: rm-sutsilv

Task: OTH

Format: TSV

Size: 8.87 MB

14.6 million tokens in the Sursilvan variety of Romansh from the daily newspaper “La Quotidiana”.

Sursilvan Newspaper Corpus

License: CC0-1.0

Locale: rm-sursilv

Task: OTH

Format: TSV

Size: 37.80 MB

Balochistan Educational and Cultural Organization

Brahui Research Work Corpus

This corpus consists of research works, academic theses, and scholarly papers, comprising approximately 185,000 tokens. It covers a range of academic topics and formal registers, reflecting standardized writing practices and disciplinary conventions. The corpus is intended to support linguistic analysis, discourse studies, and computational research on academic and research-oriented text.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.13 MB

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

1.3 million tokens in the Putèr variety of Romansh from the daily newspaper “La Quotidiana”.

Putèr Newspaper Corpus

License: CC0-1.0

Locale: rm-puter

Task: OTH

Format: TSV

Size: 8.94 MB

The Associated Press of Pakistan 78.1 Million English Corpus is a large-scale English text released for non-commercial research with APP's permission.

Associated Press Pakistan 78.1 Million English Corpus

License: CC-BY-NC-SA-4.0

Locale: eng

Task: NLP

Format: TXT

Size: 178.01 MB

A Chinese-language corpus of about 1.8 million Associated Press Pakistan news articles, useful for NLP and language model training.

Associated Press Pakistan 1.8 Million Chinese Corpus

License: CC-BY-NC-SA-4.0

Locale: zho

Task: NLP

Format: TXT

Size: 2.76 MB

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

RFE/RL Afghan Pashto News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

A 16.4-million-word Sindhi-language corpus of 58,815 Associated Press Pakistan (APP) news articles (2015–2026).

Associated Press Pakistan 16.4 Million Sindhi Corpus

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 23.23 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

A 10-hour Saraiki text-to-speech dataset consisting of recorded speech and aligned transcripts, designed for speech synthesis research and development.

Saraiki 10 Hours TTS Dataset

License: CC-BY-NC-SA-4.0

Locale: srk

Task: TTS

Format: WEBM, TSV

Size: 584.44 MB

6.1 million tokens in the Rumantsch Grischun variety of Romansh from the daily newspaper “La Quotidiana”.

Rumantsch Grischun Newspaper Corpus

License: CC0-1.0

Locale: rm-rumgr

Task: OTH

Format: TSV

Size: 19.03 MB

Community

Sindhi to English Parallel Corpus

A Sindhi–English parallel corpus in JSONL format, designed for machine translation and cross-lingual NLP tasks across diverse real-world domains.

License: CC-BY-NC-4.0

Locale: snd, eng

Task: MT

Format: JSONL

Size: 2.50 MB

PT Pancaran Semangat Jaya

Corpus of Panjebar Semangat Javanese-Language Magazine

This dataset is a TXT-format collection compiled from three years of popular articles published in the Javanese-language weekly magazine Panjebar Semangat. It compiles widely read, non-academic Javanese texts reflecting contemporary themes and language use.

License: CC-BY-SA-4.0

Locale: Jav

Task: OTH

Format: TXT

Size: 4.31 MB

Longitudinal Afghan Dari news corpus from Radio Azadi (2000-2026) featuring over 212,000 articles and 50M tokens.

RFE/RL Afghan Dari News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 115.70 MB

Longitudinal Chechen news corpus from Radio Marsho (2006-2026) with over 30,000 articles and 8.4M tokens.

RFE/RL Chechen News Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ce

Task: NLP

Format: TXT

Size: 28.29 MB

A 690K token corpus of raw Chittagonian text covering drama, poetry, and folklore for linguistic research and NLP development.

Chittagonian (চাটগাঁইয়া, saṭgãia) Text Corpus

License: CC-BY-NC-SA-4.0

Locale: ctg

Task: NLP

Format: TXT

Size: 6.59 MB