Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “Punjabi Dataset-02”

100 Datasets

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Kateviri

A collection of read speech recordings in Kateviri.

License: CC0-1.0

Locale: bsh

Task: ASR

Format: MP3

Size: 202.62 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Dhivehi

A collection of read speech recordings in Dhivehi.

License: CC0-1.0

Locale: dv

Task: ASR

Format: MP3

Size: 1.32 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Saraiki

A collection of read speech recordings in Saraiki.

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.50 MB

Anjuman e Katib

Anjuman-e-Katib Farsi/Persian Literature Corpus

This corpus is a collection of more than one million tokens of Farsi/Persian language. The corpus contains work of literature including novels, fictional and non-fictional, poems and many more. the data is shared with the approval of the authors and aims to support linguistic research, language technology development and its preservation.

License: CC-BY-NC-4.0

Locale: fas

Task: NLP

Format: TXT

Size: 2.82 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Kalkoti

A collection of read speech recordings in Kalkoti.

License: CC0-1.0

Locale: xka

Task: ASR

Format: MP3

Size: 190.04 MB

Pashto AI

Pashto Audio-Visual Speech Corpus

Pashto audio-visual corpus with 9,421 recordings (12.67 hours), pairing speech, mouth-region video and text for lip reading, ASR and multimodal AI.

License: CC0-1.0

Locale: ps

Task: ASR

Format: WEBM, TSV, JSON, JSONL, MD, TXT

Size: 1.33 GB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Persian

A collection of read speech recordings in Persian.

License: CC0-1.0

Locale: fa

Task: ASR

Format: MP3

Size: 10.46 GB

Community

Sindhi Question-Answering Dataset (SdQuAD)

A benchmark Sindhi question answering dataset for advancing machine reading comprehension and NLP research in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: LLM

Format: JSON

Size: 500.50 KB

Community

Sindhi to English Parallel Corpus

A Sindhi–English parallel corpus in JSONL format, designed for machine translation and cross-lingual NLP tasks across diverse real-world domains.

License: CC-BY-NC-4.0

Locale: snd, eng

Task: MT

Format: JSONL

Size: 2.50 MB

MDC Curators

CoVoST 2 English - Persian

The dataset includes audio files in English and their translations in Persian.

License: CC-BY-NC-4.0

Locale: en, fa

Task: MT

Format: MP3, TSV

Size: 12.56 GB

MirasAI

Multispeaker Hindi ASR Dataset

A Hindi audio dataset with corresponding transcriptions, designed for speech recognition and transcription tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: ASR

Format: OGG , SRT

Size: 63.03 MB

Forum for Language Initiatives

Hussain Faizy Indus Kohistani Corpus

The Indus Kohistani corpus contains around 500k tokens of folktales, stories, poetry, biographies, and conversational texts, all transcribed with a consistent community orthography. Reviewed by native speakers, the corpus offers a representative snapshot of the language’s vocabulary and grammar for linguistic and computational research.

License: CC-BY-SA-4.0

Locale: mvy

Task: NLP

Format: TXT

Size: 14.70 MB

Sindh Sujag Newspaper Agency

Sindh Sujag Newspaper Corpus

The corpus contains approximately 1.2 million tokens from the Sindh Sujag Newspaper Agency published between 2024 and 2025. It includes complete newspaper content such as headlines, editorials, finance news, and advertisements. The newspaper is published daily in Karachi, Pakistan, and represents a comprehensive collection of contemporary Sindhi journalistic writing.

License: CC-BY-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.63 MB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Khowar

A collection of read speech recordings in Khowar.

License: CC0-1.0

Locale: khw

Task: ASR

Format: MP3

Size: 376.04 MB

Pashto AI

Pashto Book Summaries and Reviews TTS Corpus

Pashto TTS corpus with 1,810 recordings (5.478 hours) of summaries and reviews of multiple books, paired with transcripts for speech synthesis research.

License: CC0-1.0

Locale: ps

Task: ASR

Format: FLAC, TSV, JSONL, JSON, MD

Size: 449.70 MB

Kaleem Art Press

Kaleem Art Press Urdu Literature Corpus

This corpus is a collection of 1.44 million tokens of Urdu language . The data was produced under the Kaleem Art Press over the last fifteen years . The corpus contains work of literature including Stories, Short Stories, Novels, fiction, non-fiction, Travelogues, Poetry, Biography, and History. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.85 MB

Community

Mandar Balanipa Speech Corpus

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

PROXIMA

Sindhi Names by Proxima AI

Curated collection of 10,300 Sindhi personal names in Arabic script for NLP and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLG

Format: CSV

Size: 57.15 KB

Forum for Language Initiatives

Khowar Word List

A UTF-8 encoded Khowar lexical corpus containing alphabet definitions and a structured word list for linguistic research and language technology development.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 64.22 KB

Ali Nawaz

Sindhi Sentiment Analysis Dataset

4,420 labeled Sindhi sentences for 3-class sentiment classification (positive, negative, neutral) — a low-resource NLP dataset.

License: CC-BY-NC-4.0

Locale: sd

Task: NLP

Format: CSV, XLSX

Size: 252.75 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Torwali

A collection of read speech recordings in Torwali.

License: CC0-1.0

Locale: trw

Task: ASR

Format: MP3

Size: 374.53 MB