Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Gawri Magazine Corpus”

100 Datasets

Balochistan Educational and Cultural Organization

BECO Brahui Literature Corpus

A ~355k-token Brahui literary corpus of short stories, novels, and other creative works for linguistic research and NLP.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.19 MB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

MirasAI

Wakhi Literature Corpus

A literature corpus of Wakhi language texts, preserving the language’s literary, cultural, and linguistic heritage for research and low-resource NLP.

License: CC-BY-ND-4.0

Locale: wbl

Task: NLP

Format: DOCX, TXT

Size: 74.83 KB

MirasAI

Gawar-Bati Literature Corpus

Gawarbati-language literature corpus featuring Diwan Abu Fazl, a poetry collection for documentation and NLP research.

License: CC-BY-NC-SA-4.0

Locale: gwt

Task: NLP

Format: TXT, DOCX

Size: 876.83 KB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Protham Alo

Prothom Alo Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Prothom Alo provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 42.36 MB

Balochistan Educational and Cultural Organization

Brahui Research Work Corpus

This corpus consists of research works, academic theses, and scholarly papers, comprising approximately 185,000 tokens. It covers a range of academic topics and formal registers, reflecting standardized writing practices and disciplinary conventions. The corpus is intended to support linguistic analysis, discourse studies, and computational research on academic and research-oriented text.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.13 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

Common Voice

Common Voice Scripted Speech 26.0 - Gawarbaiti

A collection of read speech recordings in Gawarbaiti.

License: CC0-1.0

Locale: gwt

Task: ASR

Format: MP3

Size: 249.85 MB

Common Voice

Common Voice Scripted Speech 26.0 - Gujari

A collection of read speech recordings in Gujari.

License: CC0-1.0

Locale: gju

Task: ASR

Format: MP3

Size: 210.21 MB

MirasAI

Rangpuri (অংপুরি Ôṅgpuri) Text Corpus

A 500K token corpus of Rangpuri literature and drama provided in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: rkt

Task: NLP

Format: TXT

Size: 3.68 MB

Kaleem Art Press

Saraiki Literature Corpus

This contains multiple Saraiki Language books of Stories, Short Stories, Novel, Travelogue, Sentences and collection of articles.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Chishti Sons

Chishti Sons Punjabi Literature Corpus

This corpus is a collection of more than one million tokens of Western Punjabi language. The data was produced under the Chishti Sons publishing agency. The corpus contains work of literature including short stories, stories, fiction, non-fiction, and other literary books. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.65 MB

Pro Svizra Rumantscha

Putèr Newspaper Corpus

1.3 million tokens in the Putèr variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-puter

Task: OTH

Format: TSV

Size: 8.94 MB

Tamahi Suneha Magazine

Punjabi Literature Corpus

This corpus contains 10,39,430 tokens of Punjabi Shahmukhi script.

License: CC-BY-NC-4.0

Locale: pa-PK

Task: OTH

Format: TXT

Size: 1.83 MB

Anjuman e Katib

Persian Literature Corpus by Najwai Sukhan

A curated Persian literary corpus of ~1.26M tokens spanning literature, poetry, educational writing, and culturally significant texts.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 38.62 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

PT Pancaran Semangat Jaya

Corpus of Panjebar Semangat Javanese-Language Magazine

This dataset is a TXT-format collection compiled from three years of popular articles published in the Javanese-language weekly magazine Panjebar Semangat. It compiles widely read, non-academic Javanese texts reflecting contemporary themes and language use.

License: CC-BY-SA-4.0

Locale: Jav

Task: OTH

Format: TXT

Size: 4.31 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

Sindh Line Publishers

The corpus contains 1.029 million tokens from the Sindh Line a Sindhi Newspaper published from the year 2024-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.22 MB

MirasAI

Associated Press Pakistan 21.4 Million Pashto Corpus

Pashto news corpus from the Associated Press of Pakistan, containing 99,495 articles and 21.4 million words from 2015–2026.

License: CC-BY-NC-SA-4.0

Locale: pus

Task: NLP

Format: TXT

Size: 38.81 MB

MirasAI

Gujarati News and Blogs Corpus

A collection of Gujarati news articles and blog posts compiled for natural language processing and text analysis tasks.

License: CC-BY-NC-4.0

Locale: guj

Task: NLP

Format: TXT

Size: 18.93 MB