Datasets | Mozilla Data Collective

Ofis publik ar Brezhoneg (OPAB)

TermOfis terminology database Breton-French

TermOfis is a terminology database for the breton language. it contains over 90 000 terms covering around 160 subject fields.

License: CC-BY-NC-SA-4.0

Locale: br, fr

Task: N/A

Format: CSV

Size: 1.69 MB

Ofis publik ar Brezhoneg (OPAB)

KerOfis toponymic database Breton-French

KerOfis is a database of toponyms and provide the correct forms of Breton place names. The database also contains the Breton forms of foreign place names.

License: ODbL-1.0

Locale: br, fr

Task: N/A

Format: CSV

Size: 1.09 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Breton

A collection of read speech recordings in Breton.

License: CC0-1.0

Locale: br

Task: ASR

Format: MP3

Size: 865.66 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Breton

A collection of spontaneous responses to questions in Breton.

License: CC0-1.0

Locale: br

Task: ASR

Format: MP3

Size: 21.44 MB

Institute of African Digital Humanities

Diboum-ALCAM-MultimodalDataset

Example sentences in Diboum and their French equivalents, with their corresponding audio recordings and a sentence–audio alignment file.

License: NOODL-1.0

Locale: bas

Task: NLP

Format: MP3, TSV

Size: 7.86 MB

Institute of African Digital Humanities

Gbaya-Lay_ALCAM-MultimodalDataset

This dataset comprises example sentences in Gbaya-Lay with French equivalents, audio recordings by a native speaker, and a sentence–audio alignment file.

License: NOODL-1.0

Locale: gya

Task: NLP

Format: MP3, TSV

Size: 9.23 MB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 1.1

This dataset is an updated version of the "Bamun-French Parallel Corpus", a parallel corpus of texts in Bamun (Shupament) and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 99.78 KB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 2.0

This dataset is an extended and updated version of the "Bamun-French Parallel Corpus 1.1", a parallel corpus of 4,444 lines in Bamun and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 184.29 KB

Institute of African Digital Humanities

Ngemba-ALCAM-MultimodalDataset

Multimodal dataset for Ngemba (also known as Ghomala-Ouest): IPA-transcribed lexical datasheet, 257 audio clips, and an audio alignment file.

License: NOODL-1.0

Locale: nge

Task: NLP

Format: MP3, TSV

Size: 8.44 MB

Institute of African Digital Humanities

Ewondo-French Parallel Corpus

A parallel corpus of 3,631 aligned Ewondo–French translation units derived from recorded speech, suitable for machine translation tasks.

License: NOODL-1.0

Locale: ewo

Task: MT

Format: TSV

Size: 137.84 KB

MDC Curators

Common Voice Scripted Speech 26.0 - Irish English

A closed-form Irish-English-accent subset of Mozilla Common Voice Scripted Speech 26.0 (validated, Northern Irish English excluded). MP3 audio + TSV metadata.

License: CC0-1.0

Locale: en-IE

Task: ASR

Format: TSV, MP3

Size: 330.28 MB

Community

Araina Text Corpus (Occitan Aranese)

Text corpus in Aranese variety of Gascon dialect of Occitan

License: CC0-1.0

Locale: oc

Task: LM

Format: txt

Size: 22.97 MB

MDC Curators

Common Voice Scripted Speech 26.0 - French of France

Common Voice scripted speech 26.0 segment of French accents of France.

License: CC0-1.0

Locale: fr-FR

Task: ASR

Format: MP3, TSV

Size: 166.64 MB

MDC Curators

Common Voice Scripted Speech 26.0 - Canadian French

Common Voice scripted speech 26.0 segment of Canadian French accents.

License: CC0-1.0

Locale: fr-CA

Task: ASR

Format: MP3, TSV

Size: 290.66 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Irish

A collection of spontaneous responses to questions in Irish.

License: CC0-1.0

Locale: ga-IE

Task: ASR

Format: MP3

Size: 3.14 MB

MDC Community Concierge

CorCenCC: Corpws Cenedlaethol Cymraeg Cyfoes

Over 11 million words (14.4m tokens) from written, spoken and electronic Welsh language sources, taken from a range of genres, language varieties and contexts

License: CC-BY-NC-SA-4.0

Locale: cy

Task: NLP

Format: TXT, TSV

Size: 147.89 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Irish

A collection of read speech recordings in Irish.

License: CC0-1.0

Locale: ga-IE

Task: ASR

Format: MP3

Size: 363.65 MB

MDC Community Concierge

VoxForge - French

39 hours (23752 utterances) of read speech of Français (French).

License: GPL-3.0

Locale: fr

Task: ASR

Format: WAV, TSV

Size: 9.31 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Occitan

A collection of read speech recordings in Occitan.

License: CC0-1.0

Locale: oc

Task: ASR

Format: MP3

Size: 262.22 MB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - French

A collection of spontaneous responses to questions in French.

License: CC0-1.0

Locale: fr

Task: ASR

Format: MP3

Size: 48.55 MB

Institute of African Digital Humanities

Mada-French Parallel Corpus 1.0

This dataset comprises a parallel corpus of 2,154 lines of translations of literary texts from Mada (mxu) to French.

License: NOODL-1.0

Locale: mxu

Task: MT

Format: TSV

Size: 122.37 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - French

A collection of read speech recordings in French.

License: CC0-1.0

Locale: fr

Task: ASR

Format: MP3

Size: 28.55 GB

Institute of African Digital Humanities

Spoken-Congolese-French-Dataset

The dataset consists of paired audio and text resources on spoken French from the Republic of the Congo. The audio files were extracted from longer recordings of semi-guided interviews conducted in Brazzaville, and orthographic transcriptions were added. The long audio recordings and their corresponding TRJS transcription files were automatically clipped alongside their respective transcriptions. The dataset comprises ten folders containing audio files and ten audio/text mapping files.

License: NOODL-1.0

Locale: fr-CG

Task: NLP

Format: MP3, WAV, TSV

Size: 3.44 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Romansh Sursilvan

A collection of read speech recordings in Romansh Sursilvan.

License: CC0-1.0

Locale: rm-sursilv

Task: ASR

Format: MP3

Size: 303.61 MB

All Datasets

TermOfis terminology database Breton-French

KerOfis toponymic database Breton-French

Common Voice Scripted Speech 27.0 - Breton

Common Voice Spontaneous Speech 5.0 - Breton

Diboum-ALCAM-MultimodalDataset

Gbaya-Lay_ALCAM-MultimodalDataset

Weekly dataset digest

Bamun-French Parallel Corpus 1.1

Bamun-French Parallel Corpus 2.0

Ngemba-ALCAM-MultimodalDataset

Ewondo-French Parallel Corpus

Common Voice Scripted Speech 26.0 - Irish English

Araina Text Corpus (Occitan Aranese)

Common Voice Scripted Speech 26.0 - French of France

Common Voice Scripted Speech 26.0 - Canadian French

Common Voice Spontaneous Speech 5.0 - Irish

CorCenCC: Corpws Cenedlaethol Cymraeg Cyfoes

Common Voice Scripted Speech 27.0 - Irish

VoxForge - French

Common Voice Scripted Speech 27.0 - Occitan

Common Voice Spontaneous Speech 5.0 - French

Mada-French Parallel Corpus 1.0

Common Voice Scripted Speech 27.0 - French

Spoken-Congolese-French-Dataset

Common Voice Scripted Speech 27.0 - Romansh Sursilvan