Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Brahui Dataset 2”

101 Datasets

MEDIAMEN

Mediamen Punjabi Literature Corpus

This corpus is a collection of one million tokens of Western Punjabi language. The data was produced under the Mediamen publishing agency over the last ten years. The corpus contains work of literature including short stories, novels, fiction, non-fiction, and dramas. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.82 MB

Kaleem Art Press

Jhoke Publisher Multan’s Saraiki Newspaper Corpus

Jhoke Publisher Multan’s Saraiki Newspaper Corpus (~1.25M tokens) is a normalized UTF-8 collection of Saraiki newspaper.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.30 MB

THA_ATLAS

StackOverflow Vector Dataset - Erlang

Language-specific StackOverflow vector dataset for Erlang.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 588.72 MB

MDC DatasetsCompensated

🚧 Hazargi Multimodal Dataset 🚧

A Hazargi multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: haz

Task: NLP

Format: MP4, EAF

Size: 44.00 GB

Community

Sindhi Question-Answering Dataset (SdQuAD)

A benchmark Sindhi question answering dataset for advancing machine reading comprehension and NLP research in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: LLM

Format: JSON

Size: 500.50 KB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part1

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for Somali language, produced by Digital Divide Data

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 7.68 GB

Bahasa Bahana

BAHANA-Betawi TTS

This dataset consists of various texts involving Indonesian and English code-mixing and read by Betawi speakers of West Java Province, Indonesia.

License: CC-BY-SA-4.0

Locale: bew

Task: TTS

Format: WEBM, TSV

Size: 316.13 MB

MirasAI

Saraiki 10 Hours TTS Dataset

A 10-hour Saraiki text-to-speech dataset consisting of recorded speech and aligned transcripts, designed for speech synthesis research and development.

License: CC-BY-NC-SA-4.0

Locale: srk

Task: TTS

Format: WEBM, TSV

Size: 584.44 MB

Balochi Academy

Eastern Balochi Literature Corpus

A UTF-8 normalized Eastern Balochi literature corpus (~1.9M tokens) covering poetry, folklore, novels, and cultural texts for linguistic research and NLP.

License: CC-BY-NC-4.0

Locale: bgp

Task: NLP

Format: TXT

Size: 949.67 KB

THA_ATLAS

StackOverflow Vector Dataset - Python

Language-specific StackOverflow vector dataset for Python.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 20.49 GB

MirasAI

Rohingya Literature Corpus

A rare 613.5 K token Rohingya corpus written in the Myanmar script, featuring cultural articles and folklore for advanced NLP research and preservation.

License: CC-BY-NC-4.0

Locale: rhg

Task: NLP

Format: TXT, DOCX

Size: 7.01 MB

THA_ATLAS

StackOverflow Vector Dataset - Julia

Language-specific StackOverflow vector dataset for Julia.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 599.51 MB

THA_ATLAS

StackOverflow Vector Dataset - Dart

Language-specific StackOverflow vector dataset for Dart.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 913.32 MB

Balochistan Educational and Cultural Organization

NAWA-E-WATAN Balochi Newspaper Corpus

A ~1.02M-token Balochi newspaper corpus from NAWA-E-WATAN, representing contemporary journalistic and public discourse.

License: CC-BY-NC-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.43 MB

THA_ATLAS

StackOverflow Vector Dataset - Swift

Language-specific StackOverflow vector dataset for Swift.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 9.30 GB

Institute of African Digital Humanities

Laari-TTS-Dataset

The dataset contains audio and text resources on Laari, a Bantu language spoken in the Congo. The resources, which are suitable for TTS tasks and possibly ASR tasks, consist of the following: - 6,311 audio clips totalling 241 minutes and 44.97 seconds; - an audio mapping file with 5,321 lines, each beginning with the name of an audio file, followed by a tab and then the corresponding text excerpt; - two raw audio files totalling 120 minutes and 54.90 seconds; - two long audio files with their original, non-split transcription files, for a total duration of 120 minutes and 41.90 seconds.

License: NOODL-1.0

Locale: ldi

Task: ASR

Format: WAV, TRJS, TSV

Size: 568.26 MB

Forum for Language Initiatives

Khowar Literature Corpus by FLI

A multi-genre Khowar language corpus designed for linguistic research, NLP applications, and cultural documentation.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 244.85 KB

Open Home Foundation

Chitwan 1.0

Text to speech dataset for Nepali, male speaker, approximately 1 hour of read speech.

License: CC0-1.0

Locale: ne-NE

Task: TTS

Format: WEBM

Size: 61.68 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Nganasan Speech Corpus

A 38.5-hour Speech-to-Text dataset for Nganasan, an endangered Samoyedic language. Features audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: nio

Task: ASR

Format: TSV, MP3

Size: 1.29 GB

GriôTech

Territórios Digitais

Dataset on community-driven responses to disinformation and AI in marginalized territories in Brazil, based on participatory research.

License: CC-BY-4.0

Locale: pt, en

Task: N/A

Format: DOCX, PDF, XLSX

Size: 4.24 MB

MDC Curators

CoVoST 2 English - Persian

The dataset includes audio files in English and their translations in Persian.

License: CC-BY-NC-4.0

Locale: en, fa

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Institute of African Digital Humanities

Sample Mbo-TTS-Dataset

Mbo (mbo) scripted TTS dataset: 982 clips (≈1h04m) from 10 sessions, transcribed with AGLC-compliant orthography. Moungo Division, Littoral Region of Cameroon.

License: NOODL-1.0

Locale: mbo

Task: TTS

Format: MP3, TSV

Size: 43.03 MB

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

Chishti Sons

Chishti Sons Punjabi Literature Corpus

This corpus is a collection of more than one million tokens of Western Punjabi language. The data was produced under the Chishti Sons publishing agency. The corpus contains work of literature including short stories, stories, fiction, non-fiction, and other literary books. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: pnb

Task: NLP

Format: TXT

Size: 1.65 MB