Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Khowar Word List”

100 Datasets

Common Voice

Common Voice Scripted Speech 26.0 - Urdu

A collection of read speech recordings in Urdu.

License: CC0-1.0

Locale: ur

Task: ASR

Format: MP3

Size: 5.79 GB

Common Voice

Common Voice Scripted Speech 26.0 - Wadiyara Koli

A collection of read speech recordings in Wadiyara Koli.

License: CC0-1.0

Locale: kxp

Task: ASR

Format: MP3

Size: 221.10 MB

Common Voice

Common Voice Scripted Speech 26.0 - Kalkoti

A collection of read speech recordings in Kalkoti.

License: CC0-1.0

Locale: xka

Task: ASR

Format: MP3

Size: 189.92 MB

Forum for Language Initiatives

Gojri Literature Corpus

A curated Gojri (Gujari) text corpus of approximately 60K tokens covering poetry, stories, short stories, and literary prose.

License: CC-BY-NC-4.0

Locale: gju

Task: NLP

Format: TXT

Size: 117.97 KB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

Common Voice

Common Voice Scripted Speech 26.0 - Saraiki

A collection of read speech recordings in Saraiki.

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.49 MB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

Common Voice

Common Voice Scripted Speech 26.0 - Northern Hindko

A collection of read speech recordings in Northern Hindko.

License: CC0-1.0

Locale: hno

Task: ASR

Format: MP3

Size: 206.29 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

PROXIMA

Urdu AI Generated Quotes & Aphorisms

A collection of 3,317 AI-generated Urdu quotes and aphorisms for text-generation and language modeling research.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLG

Format: JSON

Size: 174.90 KB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Kaleem Art Press

Kaleem Art Press Urdu Literature Corpus

This corpus is a collection of 1.44 million tokens of Urdu language . The data was produced under the Kaleem Art Press over the last fifteen years . The corpus contains work of literature including Stories, Short Stories, Novels, fiction, non-fiction, Travelogues, Poetry, Biography, and History. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.85 MB

MEDIAMEN

Mediamen Punjabi Literature Corpus

This corpus is a collection of one million tokens of Western Punjabi language. The data was produced under the Mediamen publishing agency over the last ten years. The corpus contains work of literature including short stories, novels, fiction, non-fiction, and dramas. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.82 MB

Common Voice

Common Voice Scripted Speech 26.0 - Marwari

A collection of read speech recordings in Marwari.

License: CC0-1.0

Locale: mve

Task: ASR

Format: MP3

Size: 204.27 MB

Common Voice

Common Voice Scripted Speech 26.0 - Khakas

A collection of read speech recordings in Khakas.

License: CC0-1.0

Locale: kjh

Task: ASR

Format: MP3

Size: 2.30 MB

Common Voice

Common Voice Scripted Speech 26.0 - Pahari-Pothwari

A collection of read speech recordings in Pahari-Pothwari.

License: CC0-1.0

Locale: phr

Task: ASR

Format: MP3

Size: 276.61 MB

Common Voice

Common Voice Scripted Speech 26.0 - Brahui

A collection of read speech recordings in Brahui.

License: CC0-1.0

Locale: brh

Task: ASR

Format: MP3

Size: 198.07 MB

Common Voice

Common Voice Scripted Speech 26.0 - Kurmanji Kurdish

A collection of read speech recordings in Kurmanji Kurdish.

License: CC0-1.0

Locale: kmr

Task: ASR

Format: MP3

Size: 1.92 GB

Common Voice

Common Voice Scripted Speech 26.0 - Kachhi

A collection of read speech recordings in Kachhi.

License: CC0-1.0

Locale: gjk

Task: ASR

Format: MP3

Size: 219.03 MB

Common Voice

Common Voice Scripted Speech 26.0 - Pashto

A collection of read speech recordings in Pashto.

License: CC0-1.0

Locale: ps

Task: ASR

Format: MP3

Size: 101.84 GB

Balochistan Educational and Cultural Organization

Western Balochi Literature Cropus

A cleaned literary corpus in Western Balochi (Rakhshani) including articles, research, translations, and creative literature. (~1.1 m tokens)

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 2.26 MB

CLEAR Global

TWB Voice 1.0 - Shuwa Arabic

Read speech corpus of 15 hours of Shuwa Arabic audio with transcriptions, collected by CLEAR Global for ASR development.

License: CC-BY-NC-4.0

Locale: shu, ar

Task: ASR

Format: WAV, TSV

Size: 3.17 GB

MirasAI

Associated Press Pakistan 74.4 Million Urdu Corpus

A 74.4M-word, 267,887-article Urdu news corpus from Associated Press Pakistan (2015-2026), released for non-commercial research with APP permission.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 143.39 MB

Community

Sindhi Word Segmentation (SdSEG)

A sentence-level annotated dataset for training and evaluating sequence labeling models such as CRF, BiLSTM, and transformer-based architectures.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 1.13 MB