Datasets | Mozilla Data Collective

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

Khmer ASR Cultural Dataset (Version 3 - Part 3)

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 30.80 GB

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

Khmer ASR Cultural Dataset (Version 3 - Part 4)

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 25.05 GB

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

Khmer ASR Cultural Dataset (Version 3 - Part 6)

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 17.57 GB

The languages represented in the corpus include Javanese (Pemalang dialect), Indonesian, English, and Arabic.

Pemalang Dialect of JAV-IND-ENG-ARB Parallel Corpus

License: CC-BY-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 555.62 KB

Khmer ASR Cultural Dataset is licensed under CC-BY-SA-4.0. Please attribute Digital Divide Data when using it.

Khmer ASR Cultural Dataset (Version 3 - Part 2)

License: CC-BY-SA-4.0

Locale: khm

Task: ASR

Format: WAV

Size: 34.07 GB

Language-specific StackOverflow vector dataset for Abap.

StackOverflow Vector Dataset - Abap

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 554.44 MB

This Mandar language dataset is text and audio data paired for languange documentation and linguistic research in technology.

Mandar Balanipa Speech Corpus

License: CC-BY-NC-4.0

Locale: mdr

Task: TTS

Format: WEBM, TSV

Size: 281.70 MB

Covering public facilities, roadways, and transit signages across Bintaro, South Tangerang, and Jakarta, Indonesia.

IND Bintaro-Jakarta: Urban and Mobility Multimodal Dataset

License: CC-BY-NC-SA-4.0

Locale: ind

Task: CV

Format: JPEG, WEBM, JSON

Size: 1.62 GB

The dataset covers a parallel corpus of 5,173 lines of literal translation text in Indonesian, Javanese multi-dialect, English, and Arabic.

Multidialect of JAV-IND-ENG-ARB Parallel Corpus

License: CC-BY-NC-SA-4.0

Locale: ind,jav,eng,arb

Task: MT

Format: TSV

Size: 566.75 KB

An audio-visual dataset of spoken Indonesian, capturing synchronized lip movement and voice recordings from volunteer contributors.

Bahasa Indonesia Audio Visual Speech Dataset

License: CC-BY-NC-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 955.17 MB

A corpus of annotated photographs of public spaces, signs, and signage described in Indonesian language.

IND-Sign: Gresik–Surabaya Public Space Multimodal Corpus

License: CC-BY-NC-SA-4.0

Locale: ind

Task: CV

Format: JPEG, WEBM, JSON

Size: 1.55 GB

A corpus of read speech by learners of English language from Indonesia.

IndoLearner-English Speech Corpus

License: CC-BY-SA-4.0

Locale: en

Task: CALL

Format: WAV, WEBM, TSV

Size: 1.66 GB

Language-specific StackOverflow vector dataset for SQL.

StackOverflow Vector Dataset - SQL

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 15.84 GB

This dataset consists of 6 hours of synchronized text, audio, and video recordings capturing clear Indonesian lip movements.

Indonesian Lip Reading and Visual Speech Dataset

License: CC-BY-SA-4.0

Locale: ind

Task: OTH

Format: WEBM, TSV

Size: 940.42 MB

MDC Curators

CoVoST 2 Indonesian - English

The dataset includes audio files in Indonesian and their translations in English.

License: CC-BY-NC-4.0

Locale: id, en

Task: MT

Format: MP3, TSV

Size: 79.77 MB

This dataset comprises audio recordings of scripted speech in Javanese of Lumajang Dialect from East Java of Indonesia.

TTS Javanese-Lumajang Dialect

License: CC-BY-SA-4.0

Locale: jav

Task: TTS

Format: WEBM, TSV

Size: 684.32 MB

Betawi TTS of Cultural Language (BEKAL) this dataset uses the Betawi dialect of West Java with Indonesian code-mixing and code-switching.

Betawi TTS of Cultural Language (BEKAL)

License: CC-BY-SA-4.0

Locale: bew

Task: TTS

Format: WEBM, TSV

Size: 309.99 MB

Language-specific StackOverflow vector dataset for Python.

StackOverflow Vector Dataset - Python

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 20.49 GB

Language-specific StackOverflow vector dataset for LUA.

StackOverflow Vector Dataset - LUA

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 701.90 MB

MDC Curators

CoVoST 2 English - Indonesian

The dataset includes audio files in English and their translations in Indonesian.

License: CC-BY-NC-4.0

Locale: en, id

Task: MT

Format: MP3, TSV

Size: 12.56 GB

This dataset consists of speech audio clips paired with text in the Javanese language with Gresik Dialect used in daily activities.

TTS Javanese-Gresik Dialect

License: CC-BY-NC-SA-4.0

Locale: jav

Task: TTS

Format: WEBM, TSV

Size: 282.84 MB

Language-specific StackOverflow vector dataset for Erlang.

StackOverflow Vector Dataset - Erlang

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 588.72 MB

MDC DatasetsCompensated

🚧 Southeast Asian Malay TTS dataset 🚧

2 hours of studio-quality, deliberate, read speech and corresponding text from a single speaker of Southeast Asian Malay.

License: MDC DLA-1.0

Locale: ms

Task: TTS

Format: WAV, TSV

Size: 194 B