Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Punjabi Dataset-03”

100 Datasets

MirasAI

Multispeaker Hindi ASR Dataset

A Hindi audio dataset with corresponding transcriptions, designed for speech recognition and transcription tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: ASR

Format: OGG , SRT

Size: 63.03 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part3

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 1.33 GB

PROXIMA

Sindhi Names by Proxima AI

Curated collection of 10,300 Sindhi personal names in Arabic script for NLP and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLG

Format: CSV

Size: 57.15 KB

MDC DatasetsCompensated

🚧 Khowar Corpus for Speech Recognition 🚧

A Khowar ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: khw

Task: ASR

Format: MP3, TSV

Size: 245.00 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Common Voice

Common Voice Scripted Speech 26.0 - Brahui

A collection of read speech recordings in Brahui.

License: CC0-1.0

Locale: brh

Task: ASR

Format: MP3

Size: 198.07 MB

Common Voice

Common Voice Scripted Speech 26.0 - Gawri

A collection of read speech recordings in Gawri.

License: CC0-1.0

Locale: gwc

Task: ASR

Format: MP3

Size: 310.03 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

Common Voice

Common Voice Scripted Speech 26.0 - Dhivehi

A collection of read speech recordings in Dhivehi.

License: CC0-1.0

Locale: dv

Task: ASR

Format: MP3

Size: 1.32 GB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Common Voice

Common Voice Scripted Speech 26.0 - Saraiki

A collection of read speech recordings in Saraiki.

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.49 MB

Community

Biomedical Urdu Named Entity Recognition (BioUNER)

Biomedical Urdu Named Entity Recognition dataset for advancing healthcare and clinical NLP research in Urdu.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: CSV

Size: 336.69 KB

MDC Community Concierge

VoxForge - Persian

16 minutes (157 utterances) of read speech of ‭فارسی‬ (Persian).

License: GPL-3.0

Locale: fa

Task: ASR

Format: WAV, TSV

Size: 58.20 MB

Common Voice

Common Voice Scripted Speech 26.0 - Kateviri

A collection of read speech recordings in Kateviri.

License: CC0-1.0

Locale: bsh

Task: ASR

Format: MP3

Size: 202.62 MB

Common Voice

Common Voice Scripted Speech 26.0 - Persian

A collection of read speech recordings in Persian.

License: CC0-1.0

Locale: fa

Task: ASR

Format: MP3

Size: 10.45 GB

Open Home Foundation

Chitwan 1.0

Text to speech dataset for Nepali, male speaker, approximately 1 hour of read speech.

License: CC0-1.0

Locale: ne-NE

Task: TTS

Format: WEBM

Size: 61.68 MB

Common Voice

Common Voice Scripted Speech 26.0 - Kalkoti

A collection of read speech recordings in Kalkoti.

License: CC0-1.0

Locale: xka

Task: ASR

Format: MP3

Size: 189.92 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

Community

Sindhi to English Parallel Corpus

A Sindhi–English parallel corpus in JSONL format, designed for machine translation and cross-lingual NLP tasks across diverse real-world domains.

License: CC-BY-NC-4.0

Locale: snd, eng

Task: MT

Format: JSONL

Size: 2.50 MB

Institute of African Digital Humanities

Bati-MultiDialectalASR-Dataset

This dataset contains paired audio and text resources for three Bati dialects (Kelleng, Mbougue, and Nyambat), which belong to the Yambasa group of Bantu languages found in Cameroon. It contains 13,344 audio clips totalling 6 hours, 8 minutes and 12.286 seconds and 44 audio/text mapping files totalling 13,346 lines. Due to its cross-dialectal nature, the dataset is suitable for multilingual automatic speech recognition tasks.

License: NOODL-1.0

Locale: btc

Task: ASR

Format: WAV, TSV

Size: 3.27 GB

Forum for Language Initiatives

Khowar Word List

A UTF-8 encoded Khowar lexical corpus containing alphabet definitions and a structured word list for linguistic research and language technology development.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 64.22 KB

MirasAI

Pakistan Traffic Signs Dataset

A dataset of Pakistani traffic signs designed for computer vision tasks such as traffic sign detection, classification, and autonomous driving research.

License: CC-BY-NC-4.0

Locale: urd, eng

Task: CV

Format: JPEG, JSON

Size: 2.64 GB

Common Voice

Common Voice Scripted Speech 26.0 - Torwali

A collection of read speech recordings in Torwali.

License: CC0-1.0

Locale: trw

Task: ASR

Format: MP3

Size: 374.55 MB