Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Punjabi Dataset-03”

100 Datasets

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part2

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 8.07 GB

Keblagh e Azergi

Keblagh-e-Azergi Hazargi literature corpus

This corpus is a collection of more than one hundred thousand tokens of Hazargi language. The corpus contains work of literature, poems, folk and short stories and dramas. The data is being shared with the approval of the authors. It claims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 193.28 KB

Community

Sindhi Figurative Language Dataset (SiNFluD)

A Sindhi figurative language dataset for identifying and classifying idioms, metaphors, and proverbs, similies in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 90.65 KB

MDC DatasetsCompensated

Conversational Speech in Gujarati in the Finance Domain

25 hours of Conversational Speech in the Gujarati Language in the Finance Domain

License: MDC DLA-1.0

Locale: gu

Task: ASR

Format: WAV, JSON

Size: 6.20 GB

MirasAI

Wakhi Literature Corpus

A literature corpus of Wakhi language texts, preserving the language’s literary, cultural, and linguistic heritage for research and low-resource NLP.

License: CC-BY-ND-4.0

Locale: wbl

Task: NLP

Format: DOCX, TXT

Size: 74.83 KB

MDC DatasetsCompensated

Conversational Speech in Gujarati in the Medical Domain

25 hours of Conversational Speech in the Gujarati Language in the Medical Domain

License: MDC-DLA 1.0

Locale: gu

Task: ASR

Format: WAV, JSON

Size: 6.18 GB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

MDC Curators

Common Voice Scripted Speech 26.0 - South Asian English (India, Pakistan, Sri Lanka)

A closed-form South-Asian-English-accent subset of Mozilla Common Voice Scripted Speech 26.0 (English, validated). MP3 audio + TSV metadata.

License: CC0-1.0

Locale: en

Task: ASR

Format: TSV, MP3

Size: 3.83 GB

Institute of African Digital Humanities

Afaan Oromoo-TTS-Dataset

1,737 read-speech recordings from a single Afaan Oromo speaker, with MP3 audio and TSV sentence mappings. Suitable for TTS and ASR.

License: NOODL-1.0

Locale: gax

Task: TTS

Format: MP3, TSV

Size: 258.48 MB

MirasAI

Chittagonian (চাটগাঁইয়া, saṭgãia) Text Corpus

A 690K token corpus of raw Chittagonian text covering drama, poetry, and folklore for linguistic research and NLP development.

License: CC-BY-NC-SA-4.0

Locale: ctg

Task: NLP

Format: TXT

Size: 6.59 MB

DDD-Cambodia

Khmer ASR Cultural Dataset (Version 3 - Part 1)

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 45.10 GB

MDC DatasetsCompensated

🚧 Southeast Asian Tamil TTS Dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text from a single speaker of Southeast Asian Tamil.

License: MDC DLA-1.0

Locale: ta

Task: TTS

Format: WAV, TSV

Size: 193 B

Institute of African Digital Humanities

Tupuri-Bango_TTS-Dataset (female voice)

Tupuri-Bango (tui) scripted TTS dataset: 2,034 clips (3h 53m 42s), single female speaker, AGLC orthography. Female-voice complement to the male-voice dataset.

License: NOODL-1.0

Locale: tui

Task: TTS

Format: MP3, TSV

Size: 169.22 MB

PROXIMA

Urdu AI Generated Quotes & Aphorisms

A collection of 3,317 AI-generated Urdu quotes and aphorisms for text-generation and language modeling research.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLG

Format: JSON

Size: 174.90 KB

MirasAI

Associated Press Pakistan 1.8 Million Chinese Corpus

A Chinese-language corpus of about 1.8 million Associated Press Pakistan news articles, useful for NLP and language model training.

License: CC-BY-NC-SA-4.0

Locale: zho

Task: NLP

Format: TXT

Size: 2.76 MB

MirasAI

Noakhalian (নোয়াখাইল্লা) Text Corpus

A 500K token corpus of Noakhalian linguistic data including drama scripts and cultural texts for professional NLP research and language preservation.

License: CC-BY-NC-4.0

Locale: oak

Task: NLP

Format: TXT, DOCX

Size: 3.61 MB

MDC DatasetsCompensated

Conversational Speech in Manipuri in the Finance Domain

25 hours of Manipuri Language Conversational Speech in the Finance Domain

License: MDC DLA-1.0

Locale: mni

Task: ASR

Format: WAV, JSON

Size: 6.50 GB

Kaleem Art Press

Kaleem Art Press Saraiki Literature Corpus

This corpus contains approximately one million tokens of Saraiki text curated over the past ten years by Kaleem Art Press. It features a wide range of literary genres, including stories, short stories, novels, fiction, non-fiction, travelogues, poetry, biographies, and historical writings. All content is shared with full author approval. The dataset is intended to support linguistic research, Saraiki language technology development, and the preservation of cultural and literary heritage.

License: CC-BY-NC-4.0

Locale: skr

Task: OTH

Format: TXT

Size: 1.84 MB

MDC Curators

CoVoST 2 Persian - English

The dataset includes audio files in Persian and their translations in English.

License: CC-BY-NC-4.0

Locale: fa, en

Task: MT

Format: MP3, TSV

Size: 1.52 GB

DDD-Cambodia

Khmer ASR Cultural Dataset (Version 3 - Part 5)

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 33.14 GB

RFE/RL

RFE/RL Persian News Text Corpus

This dataset is a longitudinal news corpus for the Persian language sourced from Radio Farda from 2001 to 2026. It contains over 350,000 articles (51M tokens).

License: CC-BY-NC-SA-4.0

Locale: fa

Task: NLP

Format: TXT

Size: 307.78 MB

DDD-Cambodia

Khmer ASR Cultural Dataset (Version 3 - Part 2)

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 34.07 GB

Kaler Kontho

Kaler Kantho Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Kaler Kantho provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 33.11 MB

MirasAI

Kannada Text Corpus

A curated Kannada text corpus containing diverse written content for natural language processing, linguistic research, and language technology development.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: NLP

Format: TXT

Size: 2.61 MB