Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “IBT Torwali Wordlist”

100 Datasets

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

MirasAI

Marathi Blog & Literature Corpus

A curated Marathi text corpus containing diverse written content for natural language processing, linguistic research, and language modeling tasks.

License: CC-BY-NC-4.0

Locale: mar

Task: NLP

Format: TXT

Size: 4.20 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

Institute of African Digital Humanities

Mbosi-TTS-Dataset

The dataset consists of paired audio and text data on Mbosi (mdw), a language spoken in Congo. The audio corpus consists of 2,575 clips read by one speaker totaling 275 min 48.35 sec. The dataset also contains a mapping file of audio and text with 2,597 lines. Each line begins with the name of an audio file, followed by a tab and then the corresponding text excerpt. This dataset is suitable for TTS tasks.

License: NOODL-1.0

Locale: mdw

Task: TTS

Format: WAV, TSV

Size: 644.39 MB

Kaleem Art Press

Saraiki-English Parallel Corpus

English–Saraiki parallel corpus: 51,447 aligned sentence pairs (~0.89M words), translated by Kaleem Art Press for MT and Saraiki NLP research.

License: CC-BY-NC-4.0

Locale: mul

Task: MT

Format: CSV

Size: 1.92 MB

Common Voice

Common Voice Scripted Speech 26.0 - Wadiyara Koli

A collection of read speech recordings in Wadiyara Koli.

License: CC0-1.0

Locale: kxp

Task: ASR

Format: MP3

Size: 221.10 MB

Jamuna Printing and Publishing Ltd.

The Daily Jugantor Bengali Language Corpus

Monolingual Bengali corpus of 10.6 million words from Daily Jugantor, a major Bengali news source.

License: CC-BY-NC-SA-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 40.49 MB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

PROXIMA

Sindhi Transliteration Dataset by Proxima AI

Sindhi transliteration dataset containing Sindhi sentences paired with Roman Sindhi transliterations for NLP research and model development.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: CSV

Size: 5.09 MB

Institute of African Digital Humanities

Laari-TTS-Dataset

The dataset contains audio and text resources on Laari, a Bantu language spoken in the Congo. The resources, which are suitable for TTS tasks and possibly ASR tasks, consist of the following: - 6,311 audio clips totalling 241 minutes and 44.97 seconds; - an audio mapping file with 5,321 lines, each beginning with the name of an audio file, followed by a tab and then the corresponding text excerpt; - two raw audio files totalling 120 minutes and 54.90 seconds; - two long audio files with their original, non-split transcription files, for a total duration of 120 minutes and 41.90 seconds.

License: NOODL-1.0

Locale: ldi

Task: ASR

Format: WAV, TRJS, TSV

Size: 568.26 MB

MirasAI

Hindi Literature & News Corpus

A diverse Hindi text corpus spanning literary works and news article blogs, curated for NLP research and language modeling tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: NLP

Format: TXT

Size: 19.52 MB

Institute of African Digital Humanities

Sample Mbo-TTS-Dataset

Mbo (mbo) scripted TTS dataset: 982 clips (≈1h04m) from 10 sessions, transcribed with AGLC-compliant orthography. Moungo Division, Littoral Region of Cameroon.

License: NOODL-1.0

Locale: mbo

Task: TTS

Format: MP3, TSV

Size: 43.03 MB

Common Voice

Common Voice Scripted Speech 26.0 - Parkari Koli

A collection of read speech recordings in Parkari Koli.

License: CC0-1.0

Locale: kvx

Task: ASR

Format: MP3

Size: 219.50 MB

CLEAR Global

TWB Parallel Sentence kits - Rohingya (5k)

5,000 English–Rohingya parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: rhg

Task: MT

Format: TSV

Size: 358.88 KB

MirasAI

Telugu Text Corpus

A Telugu text corpus for NLP research, containing diverse written content for language modeling, text analysis, and linguistic studies.

License: CC-BY-NC-SA-4.0

Locale: tel

Task: NLP

Format: TXT

Size: 19.87 MB

Chishti Sons

Chishti Sons Punjabi Literature Corpus

This corpus is a collection of more than one million tokens of Western Punjabi language. The data was produced under the Chishti Sons publishing agency. The corpus contains work of literature including short stories, stories, fiction, non-fiction, and other literary books. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.65 MB

Balochi Academy

Eastern Balochi Literature Corpus

A UTF-8 normalized Eastern Balochi literature corpus (~1.9M tokens) covering poetry, folklore, novels, and cultural texts for linguistic research and NLP.

License: CC-BY-NC-4.0

Locale: bgp

Task: NLP

Format: TXT

Size: 949.67 KB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

Community

Sindhi Parts Of Speech (SiPOS)

A large-scale Sindhi Part-of-Speech (SiPOS) tagging dataset for developing and evaluating NLP models in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 874.04 KB

MirasAICompensated

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A high-quality Noakhali TTS dataset with paired speech recordings and text transcriptions for speech synthesis, linguistic research, and language preservation.

License: MirasAI Data License

Locale: oak

Task: TTS

Format: WAV, TSV

Size: 2.87 GB

Tamahi Suneha Magazine

Punjabi Literature Corpus

This corpus contains 10,39,430 tokens of Punjabi Shahmukhi script.

License: CC-BY-NC-4.0

Locale: pa-PK

Task: OTH

Format: TXT

Size: 1.83 MB

Institute of African Digital Humanities

Bomitaba-TTS-Dataset

The dataset comprises three components: audio clips, an audio mapping file, and raw audio of Bomitaba, a Bantu language spoken in the Congo. Each audio clip is paired with its corresponding transcription. There are 2,613 transcribed audio clips, totalling 182 minutes and 4 seconds. There are two raw audio files totalling 121 minutes and 14.24 seconds. The audio mapping file contains 2,610 lines. Each line begins with the name of an audio file, followed by a tab, then the corresponding text exce

License: NOODL-1.0

Locale: zmx

Task: TTS

Format: WAV, TSV

Size: 1.00 GB

CLEAR Global

TWB Parallel Sentence kits - Swahili (5k)

5,000 English–Swahili parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: swa

Task: MT

Format: TSV

Size: 347.61 KB

CLEAR Global

TWB Parallel Sentence kits - Hausa (30k)

30,000 English–Hausa parallel sentences from CLEAR Global's Gamayun kits, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: hau

Task: MT

Format: TSV

Size: 1.68 MB