Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “IBT Torwali Wordlist”

100 Datasets

MirasAI

Associated Press Pakistan 16.9 Million Balochi Corpus

A 16.9M-word Balochi news corpus from Associated Press of Pakistan, covering 59,172 articles published between 2016 and 2026.

License: CC-BY-NC-SA-4.0

Locale: bal

Task: NLP

Format: TXT

Size: 22.85 MB

MDC DatasetsCompensated

🚧 Khowar Speech Translation Corpus 🚧

A Khowar-English speech translation dataset with approximately 9.5 hours of Khowar audio with English text translations.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: MP3, TSV

Size: 244.96 MB

Institute of African Digital Humanities

Sample Tupuri-Bango_TTS-Dataset (male voice)

Tupuri-Bango (tui) scripted TTS dataset: 983 clips (≈1h 06m) from 10 sessions, AGLC orthography. Kaele & Mayo-Danay, Far-North, Cameroon.

License: NOODL-1.0

Locale: tui

Task: TTS

Format: MP3, TSV

Size: 46.93 MB

Kaler Kontho

Kaler Kantho Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Kaler Kantho provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 33.11 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Evenki Speech Corpus

A 2.5-hour supervised Speech-to-Text dataset for Evenki, an endangered Tungusic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: evn

Task: ASR

Format: TSV, MP3

Size: 103.03 MB

MirasAI

Sylheti Text Corpus by Haque Publishers

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

MirasAI

Kannada Time Aligned Speech Corpus

A 5-hour Kannada speech dataset with time-aligned transcriptions, designed for ASR, forced alignment, and speech research.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: ASR

Format: OGG, SRT

Size: 355.77 MB

Forum for Language Initiatives

Gojri Literature Corpus

A curated Gojri (Gujari) text corpus of approximately 60K tokens covering poetry, stories, short stories, and literary prose.

License: CC-BY-NC-4.0

Locale: gju

Task: NLP

Format: TXT

Size: 117.97 KB

Community

Sindhi Named Entity Recognition-SiNER Dataset

A Sindhi named entity recognition dataset for building NLP tools in an underrepresented South Asian language.

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.51 MB

Rana Printers Multan

Rana Printers Urdu Literature Corpus

This corpus comprises 1.68 million tokens of high-quality Urdu text collected over the past decade through Rana Printers. It includes a diverse range of literary genres such as stories, short stories, novels, fiction, non-fiction, poetry, and historical works. All content is shared with the authors’ approval. The dataset is intended to support linguistic research, Urdu language technology development, and the preservation of literary and cultural heritage.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 3.00 MB

Community

Sindhi Figurative Language Dataset (SiNFluD)

A Sindhi figurative language dataset for identifying and classifying idioms, metaphors, and proverbs, similies in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 90.65 KB

Institute of African Digital Humanities

Suundi-TTS-Dataset

The dataset consists of paired audio and text data on Suundi (sdj), a language spoken in Congo. The audio corpus consists of 4,187 clips read by one speaker totaling 188 min 22.68 sec. The dataset also contains a mapping file of audio and text with 4,185 lines. Each line begins with the name of an audio file, followed by a tab and then the corresponding text excerpt. This dataset is suitable for TTS tasks.

License: NOODL-1.0

Locale: sdj

Task: TTS

Format: WAV, TSV

Size: 240.50 MB

MDC DatasetsCompensated

Single Speaker Urdu TTS dataset (Female Speaker, South Punjab)

A high-quality single-speaker Urdu text-to-speech (TTS) dataset with 25 hours of paired speech recordings and transcriptions for speech synthesis.

License: MDC DLA-1.0

Locale: ur

Task: TTS

Format: WAV, TSV

Size: 6.02 GB

MDC Community Concierge

IsiZulu Second Language Learner Speech Corpus

Gold standard recordings from isiZulu teachers and recordings from L2 learners annotated by isiZulu teachers for phonemic and tonal pronunciation errors .

License: CC-BY-SA-4.0

Locale: zu

Task: CALL

Format: WAV, SQLITE

Size: 5.26 GB

RFE/RL

RFE/RL Pashto (Pakistani) News Text Corpus

Longitudinal Pakistani Pashto news corpus from Radio Mashaal (2010-2026) with over 52,000 articles and 14.5M tokens.

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 39.26 MB

PROXIMA

Synthetic Urdu 2

Synthetic Urdu sentences audio dataset of 85,327 verse style audio-text pairs.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: TTS

Format: Parquet

Size: 14.80 GB

MirasAI

Multispeaker Hindi ASR Dataset

A Hindi audio dataset with corresponding transcriptions, designed for speech recognition and transcription tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: ASR

Format: OGG , SRT

Size: 63.03 MB

Institute of African Digital Humanities

Bati-MultiDialectalASR-Dataset

This dataset contains paired audio and text resources for three Bati dialects (Kelleng, Mbougue, and Nyambat), which belong to the Yambasa group of Bantu languages found in Cameroon. It contains 13,344 audio clips totalling 6 hours, 8 minutes and 12.286 seconds and 44 audio/text mapping files totalling 13,346 lines. Due to its cross-dialectal nature, the dataset is suitable for multilingual automatic speech recognition tasks.

License: NOODL-1.0

Locale: btc

Task: ASR

Format: WAV, TSV

Size: 3.27 GB

Institute of African Digital Humanities

Bulu-TTS-Dataset 1.0

The dataset consists of 3 hours and 16 minutes of denoised audio clips, each paired with text and read by a single Bulu speaker.

License: NOODL-1.0

Locale: bum

Task: TTS

Format: MP3, TSV

Size: 87.40 MB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

Institute of African Digital Humanities

Kekem-ALCAM-MultimodalDataset

Multimodal dataset for Kekem (mbo): IPA-transcribed lexical datasheet, 277 audio clips (≈18m 47s) across 4 sessions, with audio alignment files.

License: NOODL-1.0

Locale: mbo-kekem

Task: NLP

Format: MP3, TSV

Size: 12.88 MB

RFE/RL

RFE/RL Tatar-Bashkir News Text Corpus

This dataset is longitudinal news corpus for the Tatar and Bashkir languages, sourced from Azatliq Radiosi, from 2001 to 2025, it contains over 105,000 articles (30M tokens).

License: CC-BY-NC-SA-4.0

Locale: tt,ba,ru

Task: NLP

Format: TXT

Size: 102.44 MB

Institute of African Digital Humanities

Bulu-ASR-Dataset

Bulu (bum) scripted speech dataset: 819 clips from 8 speakers (predominantly female) across 9 recording sessions.

License: NOODL-1.0

Locale: bum

Task: ASR

Format: MP3, TSV

Size: 42.11 MB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB