Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Weekly Kaleem Magazine Corpus”

100 Datasets

RFE/RL

RFE/RL Afghan Pashto News Text Corpus

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

RFE/RL

RFE/RL Pashto (Pakistani) News Text Corpus

Longitudinal Pakistani Pashto news corpus from Radio Mashaal (2010-2026) with over 52,000 articles and 14.5M tokens.

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 39.26 MB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

RFE/RL

RFE/RL Chechen News Text Corpus

Longitudinal Chechen news corpus from Radio Marsho (2006-2026) with over 30,000 articles and 8.4M tokens.

License: CC-BY-NC-SA-4.0

Locale: ce

Task: NLP

Format: TXT

Size: 28.29 MB

Community

Şalom Ladino Corpus

Text corpus of 176,843 words compiled from 397 Judeo-Espanyol articles from Şalom newspaper.

License: CC-BY-4.0

Locale: lad

Task: LM

Format: TXT

Size: 403.16 KB

Bismillah Graphics Publishers

Urdu Literature Corpus

This corpus contains 16,17,074 tokens of multiple Urdu literature books published by Bismillah Graphics Publishers.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.86 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

MirasAI

Ormuri Literature corpus by Rozi Burki

Ormuri Literature Corpus is a collection of Ormuri literary texts by Rozi Burki, supporting research and preservation of this under-resourced language.

License: CC-BY-NC-SA-4.0

Locale: oru

Task: NLP

Format: PDF, DOCX

Size: 18.92 MB

Pro Svizra Rumantscha

Surmiran Newspaper Corpus

2.9 million tokens in the Surmiran variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-surmiran

Task: OTH

Format: TSV

Size: 11.89 MB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

Chishti Sons

Chishti Sons Punjabi Literature Corpus

This corpus is a collection of more than one million tokens of Western Punjabi language. The data was produced under the Chishti Sons publishing agency. The corpus contains work of literature including short stories, stories, fiction, non-fiction, and other literary books. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.65 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Tamahi Suneha Magazine

Punjabi Literature Corpus

This corpus contains 10,39,430 tokens of Punjabi Shahmukhi script.

License: CC-BY-NC-4.0

Locale: pa-PK

Task: OTH

Format: TXT

Size: 1.83 MB

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

Anjuman e Katib

Persian Literature Corpus by Najwai Sukhan

A curated Persian literary corpus of ~1.26M tokens spanning literature, poetry, educational writing, and culturally significant texts.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 38.62 MB

Common Voice

Common Voice Scripted Speech 26.0 - Wadiyara Koli

A collection of read speech recordings in Wadiyara Koli.

License: CC0-1.0

Locale: kxp

Task: ASR

Format: MP3

Size: 221.10 MB

Pro Svizra Rumantscha

Putèr Newspaper Corpus

1.3 million tokens in the Putèr variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-puter

Task: OTH

Format: TSV

Size: 8.94 MB