Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Pricing

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “suomi”

100 Datasets

MirasAI

Kannada Text Corpus

A curated Kannada text corpus containing diverse written content for natural language processing, linguistic research, and language technology development.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: NLP

Format: TXT

Size: 2.61 MB

Center za jezikovne vire in tehnologije Univerze v Ljubljani

SI-NLI

SI-NLI (Slovene Natural Language Inference Dataset) contains 5,937 human-created Slovene sentence pairs (premise and hypothesis) that are manually labeled with the labels "entailment", "contradiction", and "neutral". We created the dataset using sentences that appear in the Slovenian reference corpus ccKres (http://hdl.handle.net/11356/1034). Annotators were tasked to modify the hypothesis in a candidate pair in a way that reflects one of the labels. The dataset is balanced since the annotators created three modifications (entailment, contradiction, neutral) for each candidate sentence pair. The dataset is split into train, validation, and test sets, with sizes of 4,392, 547, and 998. We used Slovenian pre-trained language models to create splits, thereby ensuring that difficult and easy instances are evenly distributed in all three subsets. The dataset is released in a tabular TSV format. The README.txt file contains a description of the attributes. Only the hypothesis and premise are given in the test set (i.e. no annotations) since SI-NLI is integrated into the Slovene evaluation framework SloBENCH (https://slobench.cjvt.si/). If you use the dataset to train your models, please consider submitting the test set predictions to SloBENCH to get the evaluation score and see how it compares to others.

License: CC-BY-NC-SA-4.0

Locale: sl

Task: NLU

Format: TSV

Size: 392.44 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Latvian

A collection of read speech recordings in Latvian.

License: CC0-1.0

Locale: lv

Task: ASR

Format: MP3

Size: 5.90 GB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Swahili

A collection of spontaneous responses to questions in Swahili.

License: CC0-1.0

Locale: sw

Task: ASR

Format: MP3

Size: 6.36 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Swedish

A collection of read speech recordings in Swedish.

License: CC0-1.0

Locale: sv-SE

Task: ASR

Format: MP3

Size: 1.19 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Esperanto

A collection of read speech recordings in Esperanto.

License: CC0-1.0

Locale: eo

Task: ASR

Format: MP3

Size: 39.30 GB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

MDC Curators

CoVoST 2 Swedish - English

The dataset includes audio files in Swedish and their translations in English.

License: CC-BY-NC-4.0

Locale: sv-SE, en

Task: MT

Format: MP3, TSV

Size: 112.38 MB

MirasAI

Sylheti Text Corpus by Haque Publishers

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Latgalian

A collection of read speech recordings in Latgalian.

License: CC0-1.0

Locale: ltg

Task: ASR

Format: MP3

Size: 671.74 MB

MDC Curators

CoVoST 2 Latvian - English

The dataset includes audio files in Latvian and their translations in English.

License: CC-BY-NC-4.0

Locale: lv, en

Task: MT

Format: MP3, TSV

Size: 127.28 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Sansi

A collection of read speech recordings in Sansi.

License: CC0-1.0

Locale: ssi

Task: ASR

Format: MP3

Size: 211.87 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Sorbian, Upper

A collection of read speech recordings in Sorbian, Upper.

License: CC0-1.0

Locale: hsb

Task: ASR

Format: MP3

Size: 325.96 MB

CLEAR Global

TWB Parallel Sentence kits - Swahili (5k)

5,000 English–Swahili parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: swa

Task: MT

Format: TSV

Size: 347.61 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Swahili

A collection of read speech recordings in Swahili.

License: CC0-1.0

Locale: sw

Task: ASR

Format: MP3

Size: 20.89 GB

MirasAI

Kannada Time Aligned Speech Corpus

A 5-hour Kannada speech dataset with time-aligned transcriptions, designed for ASR, forced alignment, and speech research.

License: CC-BY-NC-SA-4.0

Locale: kan

Task: ASR

Format: OGG, SRT

Size: 355.77 MB

Forum for Language Initiatives

Kohistani Shina Word List

A UTF-8 encoded Kohistani Shina dictionary and word list corpus with lexical entries, meanings, and annotations for linguistic research and NLP use.

License: CC-BY-NC-4.0

Locale: plk

Task: NLP

Format: TXT

Size: 394.05 KB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Romansh Sursilvan

A collection of read speech recordings in Romansh Sursilvan.

License: CC0-1.0

Locale: rm-sursilv

Task: ASR

Format: MP3

Size: 303.61 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Norwegian Nynorsk

A collection of read speech recordings in Norwegian Nynorsk.

License: CC0-1.0

Locale: nn-NO

Task: ASR

Format: MP3

Size: 38.95 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Norwegian Bokmål

A collection of read speech recordings in Norwegian Bokmål.

License: CC0-1.0

Locale: nb-NO

Task: ASR

Format: MP3

Size: 52.40 MB

Community

Otomí (Hñähñu) TTS Voz Masculina

4.5 horas de habla leída alineada con texto del hñähñu-otomí del Valle del Mezquital, Hidalgo.

License: CC-BY-SA-4.0

Locale: ote

Task: TTS

Format: MP3, TXT, TSV

Size: 119.54 MB

MDC Curators

CoVoST 2 English - Swedish

The dataset includes audio files in English and their translations in Swedish.

License: CC-BY-NC-4.0

Locale: en, sv-SE

Task: MT

Format: MP3, TSV

Size: 12.56 GB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Slovak

A collection of read speech recordings in Slovak.

License: CC0-1.0

Locale: sk

Task: ASR

Format: MP3

Size: 1.13 GB

Mozilla Common Voice

Common Voice Spontaneous Speech 5.0 - Puno Quechua

A collection of spontaneous responses to questions in Puno Quechua.

License: CC0-1.0

Locale: qxp

Task: ASR

Format: MP3

Size: 700.53 MB

Mozilla Common Voice

Common Voice Scripted Speech 27.0 - Basque

A collection of read speech recordings in Basque.

License: CC0-1.0

Locale: eu

Task: ASR

Format: MP3

Size: 14.49 GB