Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Brahui Dataset 2”

101 Datasets

MirasAI

Rangpuri (অংপুরি Ôṅgpuri) Text Corpus

A 500K token corpus of Rangpuri literature and drama provided in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: rkt

Task: NLP

Format: TXT

Size: 3.68 MB

THA_ATLAS

StackOverflow Vector Dataset - Java

Language-specific StackOverflow vector dataset for Java.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 47.39 GB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 1.1

This dataset is an updated version of the "Bamun-French Parallel Corpus", a parallel corpus of texts in Bamun (Shupament) and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 99.78 KB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

MDC DatasetsCompensated

🚧 Khowar-English Parallel Corpus 🚧

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

Community

Mandar Balanipa Speech Corpus

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Community

TTS Bugis - Barru Dialect: Language and Identity

This dataset focuses on the Bugis language, specifically the Barru dialect, and encompasses both formal and informal linguistic registers of Bugis.

License: CC-BY-NC-4.0

Locale: bug

Task: TTS

Format: WEBM, TSV

Size: 287.70 MB

MirasAI

Multispeaker Hindi ASR Dataset

A Hindi audio dataset with corresponding transcriptions, designed for speech recognition and transcription tasks.

License: CC-BY-NC-SA-4.0

Locale: hin

Task: ASR

Format: OGG , SRT

Size: 63.03 MB

THA_ATLAS

StackOverflow Vector Dataset - Scala

Language-specific StackOverflow vector dataset for Scala.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 3.27 GB

Digital Divide Data

ddd-kenya-luhya-70hrs-asr

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Luhya language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: luy

Task: ASR

Format: WAV, XLSX, TSV

Size: 13.90 GB

MDC DatasetsCompensated

🚧 Khowar Corpus for Speech Recognition 🚧

A Khowar ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: khw

Task: ASR

Format: MP3, TSV

Size: 245.00 MB

THA_ATLAS

StackOverflow Vector Dataset - LUA

Language-specific StackOverflow vector dataset for LUA.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 701.90 MB

Digital Divide Data

ddd-kenya-somali-68hrs-asr-part2

A collection of high-quality, crowdsourced audio recordings and verified transcriptions for the Somali language, produced by Digital Divide Data.

License: CC-BY-4.0

Locale: som

Task: ASR

Format: WAV, TSV

Size: 8.07 GB

Institute of African Digital Humanities

Tupuri-Bango_TTS-Dataset (female voice)

Tupuri-Bango (tui) scripted TTS dataset: 2,034 clips (3h 53m 42s), single female speaker, AGLC orthography. Female-voice complement to the male-voice dataset.

License: NOODL-1.0

Locale: tui

Task: TTS

Format: MP3, TSV

Size: 169.22 MB

Institute of African Digital Humanities

Sample Tupuri-Bango_TTS-Dataset (male voice)

Tupuri-Bango (tui) scripted TTS dataset: 983 clips (≈1h 06m) from 10 sessions, AGLC orthography. Kaele & Mayo-Danay, Far-North, Cameroon.

License: NOODL-1.0

Locale: tui

Task: TTS

Format: MP3, TSV

Size: 46.93 MB

Collaborative Action For Research & Development (CARD)

IBT Torwali Literature Corpus

A Torwali literature corpus (~233K tokens) covering poetry, folklore, biographies, and cultural texts for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: trw

Task: NLP

Format: TXT

Size: 488.12 KB

Common Voice

Common Voice Scripted Speech 26.0 - Pahari-Pothwari

A collection of read speech recordings in Pahari-Pothwari.

License: CC0-1.0

Locale: phr

Task: ASR

Format: MP3

Size: 276.61 MB

PROXIMA

Helpful and Harmless RLHF Urdu

Urdu translation of Anthropic's HH-RLHF preference dataset for RLHF/reward-model research in Urdu.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: Parquet

Size: 10.37 MB

MDC DatasetsCompensated

🚧 Khowar Multimodal Dataset 🚧

A Khowar multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA 1.0

Locale: khw, en

Task: NLP

Format: MP4, WAV, EAF

Size: 167.23 GB

MDC DatasetsCompensated

🚧 Hazargi Corpus for Speech Recognition 🚧

A Hazargi ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: haz

Task: ASR

Format: MP3, TSV

Size: 511.56 MB

Institute of African Digital Humanities

Sample Batanga-TTS-Dataset

Batanga (bnm) scripted TTS dataset: 1,023 clips (≈1h27m) from 11 sessions, transcribed in AGLC orthography. Ocean Division, South Region, Cameroon.

License: NOODL-1.0

Locale: bnm

Task: TTS

Format: MP3, TSV

Size: 79.13 MB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

PROXIMA

PII Redact Urdu UOPF

Curated Urdu dataset of 100,000 records with fabricated PII spans, for training and evaluating privacy span detection across 12 domains.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: JSONL

Size: 5.77 MB

Institute of African Digital Humanities

Batanga-ALCAM-MultimodalDataset

Multimodal dataset for Batanga : lexical datasheet, audio recordings, and an audio alignment file for Banoho. Bapuku, forthcoming.

License: NOODL-1.0

Locale: bnm

Task: NLP

Format: MP3, TSV

Size: 18.70 MB