Datasets | Mozilla Data Collective

MDC Datasets

🚧 Khowar-English Parallel Corpus 🚧

A Khowar-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.20 KB

Content X LabsCompensated

🚧 Hindi Vintage Scripted Narrative // Rights-Cleared · 20 Hours 🚧

20 hours of premium, rights-cleared vintage Hindi scripted film content, accompanied by structured metadata and English subtitles

License: CXL-DLA-1.0

Locale: HI

Task: N/A

Format: MP4, SRT, CSV

Size: 130.40 GB

Institute of African Digital Humanities

A Malimba Sociocultural Dataset

Sociocultural dataset for the Malimba community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: mzd

Task: OTH

Format: TSV, PDF

Size: 356.90 KB

Community

TTS Sundanese - Sunda Priangan with Bandung Dialect

The dataset is developed using the South Priangan dialect of Sundanese, specifically the variety spoken in Bandung, West Java Province, Indonesia.

License: CC-BY-SA-4.0

Locale: sun

Task: TTS

Format: WEBM, TSV

Size: 278.75 MB

MDC DatasetsCompensated

🚧 Khowar Speech Translation Corpus 🚧

A Khowar-English speech translation dataset with approximately 9.5 hours of Khowar audio with English text translations.

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: MP3, TSV

Size: 244.96 MB

MDC DatasetsCompensated

🚧 Khowar Corpus for Speech Recognition 🚧

A Khowar ASR dataset with approximately 10 hours of audio with transcriptions.

License: MDC DLA-1.0

Locale: khw

Task: ASR

Format: MP3, TSV

Size: 245.00 MB

Bahasa Bahana

Lumajang Dialect-Javanese Parallel Corpus

This dataset consists of a parallel corpus of Javanese translations of the Lumajang dialect from the city of Lumajang in East Java, Indonesia

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: ML

Format: TSV

Size: 523.50 KB

Community

Semarang Dialect-Javanese Parallel Corpus (IND|JAV|ENG|ARB)

The languages represented in the corpus include Javanese in the Semarang dialect, Indonesian, English, and Arabic.

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 552.39 KB

MDC DatasetsCompensated

🚧 Northern Pashto Multimodal Dataset 🚧

A Northern Pashto multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA-1.0

Locale: pbu

Task: NLP

Format: MP4, WAV, EAF

Size: 251.41 GB

MDC Datasets

Lost In Transcription Competition - Development Data (Nahuatl-Spanish)

Nahuatl-Spanish development dataset for the "Lost In Transcription" competition.

License: CC-BY-SA-4.0

Locale: azz, nhi, nhw, es

Task: ASR

Format: MP3, TSV

Size: 35.36 MB

MDC DatasetsCompensated

🚧 Southeast Asian Tamil TTS Dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text from a single speaker of Southeast Asian Tamil.

License: MDC DLA-1.0

Locale: ta

Task: TTS

Format: WAV, TSV

Size: 193 B

MDC DatasetsCompensated

🚧 Southeast Asian Cantonese TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text in Southeast Asian Cantonese, from a single speaker.

License: MDC DLA-1.0

Locale: yue

Task: TTS

Format: WAV, TSV

Size: 202 B

MDC DatasetsCompensated

🚧 Southeast Asian Malay TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text from a single speaker of Southeast Asian Malay.

License: MDC DLA-1.0

Locale: ms

Task: TTS

Format: WAV, TSV

Size: 194 B

MDC DatasetsCompensated

🚧 Moroccan Arabic ASR dataset (180h) 🚧

180 hours of fully segmented and transcribed Moroccan Arabic speech.

License: MDC DLA-1.0

Locale: ary

Task: ASR

Format: MP3, TSV

Size: 214 B

MDC DatasetsCompensated

🚧 Southeast Asian Hokkien TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech from a single speaker of Southeast Asian Hokkien.

License: MDC DLA-1.0

Locale: nan

Task: TTS

Format: WAV, TSV

Size: 194 B

Safi DataCompensated

🚧 Free Form Sheng (Swahili-English Code-Switching) Speech in the Mobile Money Domain 🚧

Sheng free-form, transcribed speech focused on consumer use of mobile money in Kenya, designed for use in mobile money ASR applications.

License: SDL 1.0

Locale: sw

Task: ASR

Format: WAV

Size: 83.42 MB

Community

Indonesian-Spanish Learner Corpus

A corpus of Spanish read speech by Indonesian learners.

License: CC-BY-NC-SA-4.0

Locale: es

Task: CALL

Format: WAV, WEBM, TSV

Size: 1.06 GB

MDC DatasetsCompensated

🚧 Khowar Multimodal Dataset 🚧

A Khowar multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA 1.0

Locale: khw, en

Task: NLP

Format: MP4, WAV, EAF

Size: 167.23 GB

MDC DatasetsCompensated

🚧 Single Speaker Urdu TTS dataset (Female Speaker, South Punjab) 🚧

A high-quality single-speaker Urdu text-to-speech (TTS) dataset with 25 hours of paired speech recordings and transcriptions for speech synthesis.

License: MDC DLA-1.0

Locale: ur

Task: TTS

Format: WAV, TSV

Size: 6.02 GB

MDC Datasets

Lost In Transcription Competition - Development Data (Javanese-Indonesian)

Javanese-Indonesian development dataset for the "Lost In Transcription" competition.

License: CC-BY-SA-4.0

Locale: jv, id

Task: ASR

Format: MP3, TSV

Size: 69.40 MB

Information and Language Processing Research Lab

Nwāchā Munā

A 5.39-hour manually transcribed Devanagari speech corpus for Nepal Bhasha, with an ASR benchmark for low-resource speech research.

License: CC-BY-NC-4.0

Locale: new

Task: ASR

Format: WAV, TSV

Size: 477.62 MB

MirasAICompensated

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A high-quality Noakhali TTS dataset with paired speech recordings and text transcriptions for speech synthesis, linguistic research, and language preservation.

License: MirasAI Data License

Locale: oak

Task: TTS

Format: WAV, TSV

Size: 2.87 GB

Institute of African Digital Humanities

A Bamvele Sociocultural Dataset

Sociocultural dataset for the Bamvele community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: beb

Task: OTH

Format: TSV, PDF

Size: 357.17 KB

Institute of African Digital Humanities

A Bulu Sociocultural Dataset

Sociocultural dataset for the Bulu community of Cameroon: identity, kinship, religion, economy, onomastics and a linguistic component.

License: NOODL-1.0

Locale: bum

Task: OTH

Format: TSV, PDF

Size: 372.87 KB

All Datasets

Compensated datasets

Conversational Speech in Gujarati in the Finance Domain

Conversational Speech in Manipuri in the Finance Domain

Conversational Speech in Manipuri in the Medical Domain

🚧 Khowar-English Parallel Corpus 🚧

🚧 Hindi Vintage Scripted Narrative // Rights-Cleared · 20 Hours 🚧

A Malimba Sociocultural Dataset

TTS Sundanese - Sunda Priangan with Bandung Dialect

🚧 Khowar Speech Translation Corpus 🚧

🚧 Khowar Corpus for Speech Recognition 🚧

Lumajang Dialect-Javanese Parallel Corpus

Semarang Dialect-Javanese Parallel Corpus (IND|JAV|ENG|ARB)

🚧 Northern Pashto Multimodal Dataset 🚧

Lost In Transcription Competition - Development Data (Nahuatl-Spanish)

🚧 Southeast Asian Tamil TTS Dataset 🚧

🚧 Southeast Asian Cantonese TTS dataset 🚧

🚧 Southeast Asian Malay TTS dataset 🚧

🚧 Moroccan Arabic ASR dataset (180h) 🚧

🚧 Southeast Asian Hokkien TTS dataset 🚧

🚧 Free Form Sheng (Swahili-English Code-Switching) Speech in the Mobile Money Domain 🚧

Indonesian-Spanish Learner Corpus

🚧 Khowar Multimodal Dataset 🚧

🚧 Single Speaker Urdu TTS dataset (Female Speaker, South Punjab) 🚧

Lost In Transcription Competition - Development Data (Javanese-Indonesian)

Nwāchā Munā

🚧 Noakhali 10 Hours TTS (Male Speaker) 🚧

A Bamvele Sociocultural Dataset

A Bulu Sociocultural Dataset