Datasets | Mozilla Data Collective

Community

Podcast Hari Minggoean (Indonesia)

This dataset is derived from the "Hari Minggoean" podcast, featuring over ten hours of recorded speech from a single, consistent speaker. The content, tailored for a young Indonesian audience, is presented in Indonesian (Bahasa Indonesia) characterized by code-switching with English and a discernible Javanese accent. The collection is comprised of 42 individual audio files (10+ hours). Sample Tapi dari pelafalan, dari intonasi, dari jedanya dia bicara. That's really good. Dan aku sebenarnya suka banget ketika dia ngomong. Yang btw, soal ekspresif tadi. Aku jadi kepikiran deh.

License: CC-BY-SA-4.0

Locale: id-ID

Task: ASR

Format: mp3

Size: 338.92 MB

RFE/RL

RFE/RL Afghan Dari News Text Corpus

Longitudinal Afghan Dari news corpus from Radio Azadi (2000-2026) featuring over 212,000 articles and 50M tokens.

License: CC-BY-NC-SA-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 115.70 MB

Aim Foundation

Aim Foundation Dari Literature Corpus

This corpus is a collection of more than seven hundred thousand tokens of Dari language. The corpus contains work of literature including poems, stories, novels, fictional and non-fictional and different articles. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development and cultural preservation.

License: CC-BY-NC-4.0

Locale: prs

Task: NLP

Format: TXT

Size: 1.74 MB

Keblagh e Azergi

Elkhani Hazargi Literature Corpus

Hazargi literary corpus (~0.5M tokens) of poetry, folklore, and prose texts representing Hazara linguistic and cultural heritage.

License: CC-BY-NC-4.0

Locale: haz

Task: NLP

Format: TXT

Size: 2.46 MB

Bahasa Bahana

BAHANA-Betawi TTS

This dataset consists of various texts involving Indonesian and English code-mixing and read by Betawi speakers of West Java Province, Indonesia.

License: CC-BY-SA-4.0

Locale: bew

Task: TTS

Format: WEBM, TSV

Size: 316.13 MB

Community

Indonesia Lip-Record Speech Dataset

This dataset consists of lip-only video recordings paired with audio and transcribed text in Indonesian.

License: CC-BY-NC-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 897.43 MB

Community

Bahasa Indonesia Lip-Reading Dataset

This dataset contains video recordings of Indonesian speakers' lip movements.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 982.50 MB

Community

Jombang Dialect-Javanese TTS

This dataset comprises audio recordings of scripted speech in Javanese of Jombang Dialect from Jombang city in East Java of Indonesia.

License: CC-BY-NC-SA-4.0

Locale: jav

Task: TTS

Format: WEBM, TSV

Size: 281.30 MB

Community

Demakan Dialect of JAV-IND-ENG-ARB Parallel Corpus

The Demakan dialect is a regional dialect of the Javanese language spoken by the people of the Demak regency in Central Java, Indonesia

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 555.42 KB

MDC Datasets

Lost In Transcription Competition - Development Data (Javanese-Indonesian)

Javanese-Indonesian development dataset for the "Lost In Transcription" competition.

License: CC-BY-SA-4.0

Locale: jv, id

Task: ASR

Format: MP3, TSV

Size: 69.40 MB

Community

Ngapak Dialect of JAV-IND-ENG-ARB Parallel Corpus

This dataset consists of a parallel corpus of Javanese translations of the Ngapak dialect from the city of Tegal in Central Java, Indonesia.

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 544.29 KB

THA_ATLAS

StackOverflow Vector Dataset - Java

Language-specific StackOverflow vector dataset for Java.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 47.39 GB

Community

Mandar Spontaneous Speech

This dataset is a compilation of spontaneous Mandar speech featuring Indonesian code-switching.

License: CC-BY-NC-4.0

Locale: mdr

Task: ASR

Format: MP3, TSV

Size: 534.45 MB

Community

Indonesian-Learner-English

A corpus of English read speech by Indonesian learners.

License: CC-BY-NC-SA-4.0

Locale: en

Task: CALL

Format: WAV, WEBM, TSV

Size: 1.12 GB

Community

Bojonegoro Javanese TTS

This dataset contains synthetic speech data covering a variety of everyday-life topics in the Bojonegoro dialect of Javanese, spoken in East Java, Indonesia.

License: CC-BY-SA-4.0

Locale: jav

Task: TTS

Format: .tar.gz, WEBM

Size: 469.50 MB

THA_ATLAS

StackOverflow Vector Dataset - Kotlin

Language-specific StackOverflow vector dataset for Kotlin.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 3.40 GB

THA_ATLAS

StackOverflow Vector Dataset - Dart

Language-specific StackOverflow vector dataset for Dart.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 913.32 MB

Digital Divide Data

Khmer ASR Cultural Dataset (V2)

106.53 hours manually curated speech-text pairs by native speakers in Khmer language about Cambodian cultural topics. On average, each recording is 8.42 seconds with the standard deviation of 3.39. Speaker metadata (gender, age group, and origin city) is provided. - Language: Khmer (khm). - Source(s): Native speakers from Cambodia (4 females, 4 males). The utterances were manually generated based on topics and subtopics listed in metadata. - Domain(s): Cultural domain, with a total of 2 topics and 118 subtopics. - Size: 45.57k data instances - WAV file names are formatted as: `{speaker_id}_khm_{sentence_id}.wav`.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 35.86 GB

Community

TTS Central Javanese

This dataset consists of audio recordings and textual data in Central Javanese (Semarang dialect) including Indonesian and English code-switching.

License: CC-BY-SA-4.0

Locale: jav

Task: TTS

Format: WEBM, TSV

Size: 440.11 MB

DDD-Cambodia

Khmer ASR Cultural Dataset (Version 3 - Part 5)

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 33.14 GB

Community

IND-Jabodetabek Signage and Public Places

This dataset contains annotated images of signs and signboards across the Greater Jakarta (Jabodetabek) area.

License: CC-BY-NC-SA-4.0

Locale: ind

Task: CV

Format: JPEG, WEBM, JSON

Size: 1.56 GB

DDD-Cambodia

Khmer ASR Cultural Dataset (Version 3 - Part 7)

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 29.93 GB

Community

Indonesian-Multidialect Lip-Record Speech Corpus

This dataset contains Indonesian speech data designed for lip-reading research and development.

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 981.20 MB

Common Voice

Common Voice Scripted Speech 26.0 - Indonesian

A collection of read speech recordings in Indonesian.

License: CC0-1.0

Locale: id

Task: ASR

Format: MP3

Size: 1.42 GB

All Datasets

Not sure where to start?

Podcast Hari Minggoean (Indonesia)

RFE/RL Afghan Dari News Text Corpus

Aim Foundation Dari Literature Corpus

Elkhani Hazargi Literature Corpus

BAHANA-Betawi TTS

Indonesia Lip-Record Speech Dataset

Bahasa Indonesia Lip-Reading Dataset

Jombang Dialect-Javanese TTS

Demakan Dialect of JAV-IND-ENG-ARB Parallel Corpus

Lost In Transcription Competition - Development Data (Javanese-Indonesian)

Ngapak Dialect of JAV-IND-ENG-ARB Parallel Corpus

StackOverflow Vector Dataset - Java

Mandar Spontaneous Speech

Indonesian-Learner-English

Bojonegoro Javanese TTS

StackOverflow Vector Dataset - Kotlin

StackOverflow Vector Dataset - Dart

Khmer ASR Cultural Dataset (V2)

TTS Central Javanese

Khmer ASR Cultural Dataset (Version 3 - Part 5)

IND-Jabodetabek Signage and Public Places

Khmer ASR Cultural Dataset (Version 3 - Part 7)

Indonesian-Multidialect Lip-Record Speech Corpus

Common Voice Scripted Speech 26.0 - Indonesian