Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “Punjabi Dataset-03”

100 Datasets

Community

Sindhi Question-Answering Dataset (SdQuAD)

A benchmark Sindhi question answering dataset for advancing machine reading comprehension and NLP research in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: LLM

Format: JSON

Size: 500.50 KB

Community

Sindhi Named Entity Recognition-SiNER Dataset

A Sindhi named entity recognition dataset for building NLP tools in an underrepresented South Asian language.

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.51 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

Community

Mandar Balanipa Speech Corpus

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Anjuman e Katib

Anjuman-e-Katib Farsi/Persian Literature Corpus

This corpus is a collection of more than one million tokens of Farsi/Persian language. The corpus contains work of literature including novels, fictional and non-fictional, poems and many more. the data is shared with the approval of the authors and aims to support linguistic research, language technology development and its preservation.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 2.82 MB

MirasAI

Multispeaker Hindi ASR Dataset

A Hindi audio dataset with corresponding transcriptions, designed for speech recognition and transcription tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: ASR

Format: OGG , SRT

Size: 63.03 MB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part3

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 1.33 GB

PROXIMA

Sindhi Names by Proxima AI

Curated collection of 10,300 Sindhi personal names in Arabic script for NLP and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLG

Format: CSV

Size: 57.15 KB

MDC DatasetsCompensated

🚧 Khowar Corpus for Speech Recognition 🚧

A Khowar ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC-DLA-1.0

Locale: khw

Task: ASR

Format: MP3, TSV

Size: 245.00 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Dhivehi

A collection of read speech recordings in Dhivehi.

License: CC0-1.0

Locale: dv

Task: ASR

Format: MP3

Size: 1.32 GB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Brahui

A collection of read speech recordings in Brahui.

License: CC0-1.0

Locale: brh

Task: ASR

Format: MP3

Size: 198.07 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Gawri

A collection of read speech recordings in Gawri.

License: CC0-1.0

Locale: gwc

Task: ASR

Format: MP3

Size: 310.05 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Saraiki

A collection of read speech recordings in Saraiki.

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.50 MB

Community

Biomedical Urdu Named Entity Recognition (BioUNER)

Biomedical Urdu Named Entity Recognition dataset for advancing healthcare and clinical NLP research in Urdu.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: CSV

Size: 336.69 KB

MDC Community Concierge

VoxForge - Persian

16 minutes (157 utterances) of read speech of ‭فارسی‬ (Persian).

License: GPL-3.0

Locale: fa

Task: ASR

Format: WAV, TSV

Size: 58.20 MB

Open Home Foundation

Chitwan 1.0

Text to speech dataset for Nepali, male speaker, approximately 1 hour of read speech.

License: CC0-1.0

Locale: ne-NE

Task: TTS

Format: WEBM

Size: 61.68 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Persian

A collection of read speech recordings in Persian.

License: CC0-1.0

Locale: fa

Task: ASR

Format: MP3

Size: 10.46 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Kateviri

A collection of read speech recordings in Kateviri.

License: CC0-1.0

Locale: bsh

Task: ASR

Format: MP3

Size: 202.62 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Kalkoti

A collection of read speech recordings in Kalkoti.

License: CC0-1.0

Locale: xka

Task: ASR

Format: MP3

Size: 190.04 MB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB