Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “Punjabi Dataset-02”

100 Datasets

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC-DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Pahari-Pothwari

A collection of read speech recordings in Pahari-Pothwari.

License: CC0-1.0

Locale: phr

Task: ASR

Format: MP3

Size: 276.61 MB

PROXIMA

Urdu-Sindhi Grapheme-to-Phoneme Dataset

A bilingual Urdu and Sindhi grapheme-to-phoneme dataset for G2P, TTS, ASR, and speech technology research.

License: CC-BY-NC-SA-4.0

Locale: ur, sd

Task: TTS

Format: PARQUET

Size: 1.92 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Dhatki

A collection of read speech recordings in Dhatki.

License: CC0-1.0

Locale: mki

Task: ASR

Format: MP3

Size: 187.84 MB

Community

Urdu Multi-Speaker TTS Dataset

An Urdu multi-speaker TTS dataset distributed in 36 zip files, each containing audio files and a TSV mapping file, with approximately 10 hours of speech.

License: CC-BY-NC-4.0

Locale: urd

Task: TTS

Format: WEBM, TSV

Size: 514.54 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Northern Hindko

A collection of read speech recordings in Northern Hindko.

License: CC0-1.0

Locale: hno

Task: ASR

Format: MP3

Size: 206.27 MB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Sindhi

A collection of read speech recordings in Sindhi.

License: CC0-1.0

Locale: sd

Task: ASR

Format: MP3

Size: 1.33 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Gujari

A collection of read speech recordings in Gujari.

License: CC0-1.0

Locale: gju

Task: ASR

Format: MP3

Size: 210.14 MB

Kaleem Art Press

Multilingual Religious Parallel Corpus (Kaleem Art Press)

This dataset is a multilingual parallel sentences corpus containing 6,465 aligned sentence units with approximately 0.98 million words, curated from Kaleem Art Press archives. It includes parallel religious text data in Arabic, Urdu, Saraiki (standard and dialectal), Punjabi (Shahmukhi), and English, supporting research in machine translation, comparative linguistics, digital humanities, and low-resource language studies.

License: CC-BY-SA-4.0

Locale: mul

Task: MT

Format: CSV

Size: 2.27 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Urdu

A collection of read speech recordings in Urdu.

License: CC0-1.0

Locale: ur

Task: ASR

Format: MP3

Size: 5.79 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Eastern Balochi

A collection of read speech recordings in Eastern Balochi.

License: CC0-1.0

Locale: bgp

Task: ASR

Format: MP3

Size: 260.43 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Gawarbaiti

A collection of read speech recordings in Gawarbaiti.

License: CC0-1.0

Locale: gwt

Task: ASR

Format: MP3

Size: 249.85 MB

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Balti

A collection of read speech recordings in Balti.

License: CC0-1.0

Locale: bft

Task: ASR

Format: MP3

Size: 347.01 MB

MDC Curators

CoVoST 2 Persian - English

The dataset includes audio files in Persian and their translations in English.

License: CC-BY-NC-4.0

Locale: fa, en

Task: MT

Format: MP3, TSV

Size: 1.52 GB

RFE/RL

RFE/RL Afghan Pashto News Text Corpus

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB

Aim Foundation

Dari Literature Corpus by Anjuman e Adabi Nayestan

A ~1 M-token Dari (Afghan Persian) literary corpus compiled by Anjuman e Adabi Nayestan, covering prose, poetry, and cultural texts in Perso-Arabic script.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 12.67 MB

Pashto AI

Pashto Multi-Speaker Informational Speech Corpus

Pashto multi-speaker corpus with 3,880 clips (8.914 hours) from five male presenters across Afghanistan and Pakhtunkhwa for TTS and ASR.

License: CC0-1.0

Locale: ps

Task: ASR

Format: FLAC, TSV, JSONL, JSON, MD

Size: 782.08 MB

Weekly Kaleem Magazine Multan

Kaleem Magazine Urdu Corpus

This corpus is a collection of around 1.4 million tokens of Urdu language. The data was extracted from the archives of a famous Urdu magazine "Kaleem" published weekly from last 30 years. This corpus contains work of literature including stories, short stories, news, poetry, literary reports, fiction, non-fiction, and travelogues. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 2.74 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Brahui

A collection of read speech recordings in Brahui.

License: CC0-1.0

Locale: brh

Task: ASR

Format: MP3

Size: 198.07 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Gawri

A collection of read speech recordings in Gawri.

License: CC0-1.0

Locale: gwc

Task: ASR

Format: MP3

Size: 310.05 MB

Community

Sindhi Named Entity Recognition-SiNER Dataset

A Sindhi named entity recognition dataset for building NLP tools in an underrepresented South Asian language.

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.51 MB