Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Sindh Sujag Newspaper Corpus”

100 Datasets

Community

Sindhi Named Entity Recognition-SiNER Dataset

A Sindhi named entity recognition dataset for building NLP tools in an underrepresented South Asian language.

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.51 MB

Chishti Sons

Chishti Sons Punjabi Literature Corpus

This corpus is a collection of more than one million tokens of Western Punjabi language. The data was produced under the Chishti Sons publishing agency. The corpus contains work of literature including short stories, stories, fiction, non-fiction, and other literary books. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.65 MB

Balochistan Educational and Cultural Organization

Western Balochi Literature Cropus

A cleaned literary corpus in Western Balochi (Rakhshani) including articles, research, translations, and creative literature. (~1.1 m tokens)

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 2.26 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Pro Svizra Rumantscha

Sutsilvan Newspaper Corpus

1.3 million tokens in the Sutsilvan variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-sutsilv

Task: OTH

Format: TSV

Size: 8.87 MB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

Common Voice

Common Voice Scripted Speech 26.0 - Sindhi

A collection of read speech recordings in Sindhi.

License: CC0-1.0

Locale: sd

Task: ASR

Format: MP3

Size: 1.04 GB

RFE/RL

RFE/RL Afghan Pashto News Text Corpus

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Balochistan Educational and Cultural Organization

Talar (تلار) Barahui Magazine Corpus

A ~150,000-word Brahui corpus from the monthly magazine Talar, covering editorials, essays, fiction, poetry, and socio-cultural commentary.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 317.22 KB

Ali Nawaz

Sindhi Sentiment Analysis Dataset

4,420 labeled Sindhi sentences for 3-class sentiment classification (positive, negative, neutral) — a low-resource NLP dataset.

License: CC-BY-NC-4.0

Locale: sd

Task: NLP

Format: CSV, XLSX

Size: 252.75 KB

Tamahi Suneha Magazine

Punjabi Literature Corpus

This corpus contains 10,39,430 tokens of Punjabi Shahmukhi script.

License: CC-BY-NC-4.0

Locale: pa-PK

Task: OTH

Format: TXT

Size: 1.83 MB

Kaleem Art Press

Kaleem Art Press Urdu Literature Corpus

This corpus is a collection of 1.44 million tokens of Urdu language . The data was produced under the Kaleem Art Press over the last fifteen years . The corpus contains work of literature including Stories, Short Stories, Novels, fiction, non-fiction, Travelogues, Poetry, Biography, and History. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.85 MB

PROXIMA

Sindhi OCR by Proxima AI

Synthetically generated Sindhi OCR dataset of 278,000 text image pairs using dictionary words and multi word phrases.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: CV

Format: PARQUET

Size: 1.34 GB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

Community

Sindhi Figurative Language Dataset (SiNFluD)

A Sindhi figurative language dataset for identifying and classifying idioms, metaphors, and proverbs, similies in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 90.65 KB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

PROXIMA

Sindhi Names by Proxima AI

Curated collection of 10,300 Sindhi personal names in Arabic script for NLP and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLG

Format: CSV

Size: 57.15 KB

Pro Svizra Rumantscha

Surmiran Newspaper Corpus

2.9 million tokens in the Surmiran variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-surmiran

Task: OTH

Format: TSV

Size: 11.89 MB

Bismillah Graphics Publishers

Urdu Literature Corpus

This corpus contains 16,17,074 tokens of multiple Urdu literature books published by Bismillah Graphics Publishers.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.86 MB

MirasAI

Associated Press Pakistan 78.1 Million English Corpus

The Associated Press of Pakistan 78.1 Million English Corpus is a large-scale English text released for non-commercial research with APP's permission.

License: CC-BY-NC-SA-4.0

Locale: eng

Task: NLP

Format: TXT

Size: 178.01 MB

MirasAI

Hindi Literature & News Corpus

A diverse Hindi text corpus spanning literary works and news article blogs, curated for NLP research and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: NLP

Format: TXT

Size: 19.52 MB

Pro Svizra Rumantscha

Sursilvan Newspaper Corpus

14.6 million tokens in the Sursilvan variety of Romansh from the daily newspaper “La Quotidiana”.

License: CC0-1.0

Locale: rm-sursilv

Task: OTH

Format: TSV

Size: 37.80 MB