Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Khowar Literature Corpus (FLI)”

100 Datasets

Tamir News Agency

Tamir Sindhi News Corpus

The corpus contains 1.1 million tokens from the Tamir Sindhi Newspaper published from the year 2022-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.56 MB

Sindh Sujag Newspaper Agency

Sindh Sujag Newspaper Corpus

The corpus contains approximately 1.2 million tokens from the Sindh Sujag Newspaper Agency published between 2024 and 2025. It includes complete newspaper content such as headlines, editorials, finance news, and advertisements. The newspaper is published daily in Karachi, Pakistan, and represents a comprehensive collection of contemporary Sindhi journalistic writing.

License: CC-BY-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.63 MB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

MirasAI

Dameli Literature Corpus

A literary corpus of Dameli texts preserving the language’s literary traditions, cultural heritage, narratives, and diverse forms of written expression.

License: CC-BY-NC-4.0

Locale: dml

Task: NLP

Format: TXT, DOCX

Size: 9.83 MB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

MirasAI

Rohingya Literature Corpus

A rare 613.5 K token Rohingya corpus written in the Myanmar script, featuring cultural articles and folklore for advanced NLP research and preservation.

License: CC-BY-NC-4.0

Locale: rhg

Task: NLP

Format: TXT, DOCX

Size: 7.01 MB

Community

Sindhi Parts Of Speech (SiPOS)

A large-scale Sindhi Part-of-Speech (SiPOS) tagging dataset for developing and evaluating NLP models in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 874.04 KB

PROXIMA

Synthetic Urdu 2

Synthetic Urdu sentences audio dataset of 85,327 verse style audio-text pairs.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: TTS

Format: Parquet

Size: 14.80 GB

PROXIMA

Urdu AI Generated Quotes & Aphorisms

A collection of 3,317 AI-generated Urdu quotes and aphorisms for text-generation and language modeling research.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLG

Format: JSON

Size: 174.90 KB

Taruen

Dolgan Folklore Text Corpus

A 15.6k-word corpus of 19 Dolgan fairy tales, digitized to catalyze NLP research and revitalization for this highly endangered Siberian Turkic language.

License: CC0-1.0

Locale: dlg

Task: NLP

Format: TXT

Size: 57.16 KB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Kaleem Art Press

Saraiki Literature Corpus

This contains multiple Saraiki Language books of Stories, Short Stories, Novel, Travelogue, Sentences and collection of articles.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

Community

Sindhi Figurative Language Dataset (SiNFluD)

A Sindhi figurative language dataset for identifying and classifying idioms, metaphors, and proverbs, similies in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 90.65 KB

Community

Biomedical Urdu Named Entity Recognition (BioUNER)

Biomedical Urdu Named Entity Recognition dataset for advancing healthcare and clinical NLP research in Urdu.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: CSV

Size: 336.69 KB

Kaler Kontho

Kaler Kantho Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Kaler Kantho provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 33.11 MB

Sujaak Adbi Sangat

Saraiki Quarterly Magazine Wasson Wehray Corpus

This corpus contains 11,79,200 tokens, from a Saraiki Quarterly Magazine "Wasson Wehray"

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 2.09 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Wordlist

The IBT Torwali Wordlist contains approximately 20,000 unique entries in Torwali (ISO 639-3: trw), an under-documented Indo-Aryan language spoken in northern Pakistan. The dataset comprises standardized lexical entries covering core vocabulary, function words, and culturally salient terms, with consistent orthography and normalization suitable for linguistic and computational use. Entries are aligned with English and Urdu glosses, and include part-of-speech tag.

License: CC-BY-SA-4.0

Locale: trw

Task: NLP

Format: CSV

Size: 312.87 KB

Taruen

Kazakh Proverbs Text Corpus

A corpus of traditional Kazakh proverbs from the Babalar sözi series (vols 65-69), designed for NLP and LLM cultural competence evaluations.

License: CC0-1.0

Locale: kk

Task: NLP

Format: TXT

Size: 592.14 KB

RFE/RL

RFE/RL Crimean Tatar News Text Corpus

Longitudinal Crimean Tatar news corpus from Qırım.Aqiqat (2014-2026) with over 32,000 articles and 7.5M tokens.

License: CC-BY-NC-SA-4.0

Locale: crh

Task: NLP

Format: TXT

Size: 18.35 MB

RFE/RL

RFE/RL Tatar-Bashkir News Text Corpus

This dataset is longitudinal news corpus for the Tatar and Bashkir languages, sourced from Azatliq Radiosi, from 2001 to 2025, it contains over 105,000 articles (30M tokens).

License: CC-BY-NC-SA-4.0

Locale: tt,ba,ru

Task: NLP

Format: TXT

Size: 102.44 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Community

Sindhi Word Segmentation (SdSEG)

A sentence-level annotated dataset for training and evaluating sequence labeling models such as CRF, BiLSTM, and transformer-based architectures.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 1.13 MB

Community

Urdu Multi-Speaker TTS Dataset

An Urdu multi-speaker TTS dataset distributed in 36 zip files, each containing audio files and a TSV mapping file, with approximately 10 hours of speech.

License: CC-BY-NC-4.0

Locale: urd

Task: TTS

Format: WEBM, TSV

Size: 514.54 MB