Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Filtered by

Search results for “english”

151 Datasets

Audio Speech Language Processing lab(ASLP NPU)

UrduSpeech

A 156-hour, multi-domain speech corpus with 12 paralinguistic labels for standard Urdu, code-switched Urdu-English, and Pakistani-accented English.

License: CC-BY-NC-4.0

Locale: ur, en

Task: NLP

Format: .wav, .jsonl

Size: 71.87 GB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

Bahasa Bahana

BAHANA: Parallel Corpus IND-ENG-ARB

The dataset covers a parallel corpus of 5,174 lines of literal translation text in Indonesian, English and Arabic.

License: CC-BY-SA-4.0

Locale: ind,eng,arb

Task: MT

Format: TSV

Size: 437.30 KB

AImpower.org

English Stuttered Speech

The dataset include 39 hours of transcribed and annotated conversational and voice command reading speech from 45 English speakers who stutter.

License: CC-BY-SA-4.0

Locale: en

Task: ASR

Format: WAV, TXT

Size: 9.75 GB

Chana

Shiwilu: Narratives and Songs

Sixteen Shiwilu narratives and songs from Loreto, Peru, with detailed ELAN annotations and time-aligned Shiwilu, Spanish, and English materials.

License: Chana 2.0

Locale: jeb

Task: N/A

Format: WAV, EAF, TextGrid, MD, CSV

Size: 1014.22 MB

MirasAI

Marathi Blog & Literature Corpus

A curated Marathi text corpus containing diverse written content for natural language processing, linguistic research, and language modeling tasks.

License: CC-BY-NC-4.0

Locale: mar

Task: NLP

Format: TXT

Size: 4.20 MB

Weekly dataset digest

Receive a brief weekly digest of new datasets similar to the ones you’ve downloaded.

Yes, notify me

EELLAK - GreekFOSS

ERT Press

Structured digital collection of press releases and news articles from the official platform of ERT, Greece's national public broadcaster.

License: CC BY-NC-ND 4.0

Locale: gr-GR

Task: NLP

Format: PARQUET

Size: 32.60 MB

Community

Synthetic Spanish–English Code-Switching Speech (DS-3)

2,233 synthetic Spanish–English code-switched utterances (5.78 h), synthetic TTS voices only, made for Lost in Transcription.

License: GPL-3.0

Locale: es,en

Task: ASR

Format: WAV, JSONL

Size: 550.01 MB

Community

Kanuri Lexicon

A structured Kanuri lexical resource containing headwords, grammatical labels, English definitions, and source entry information.

License: CC-BY-NC-4.0

Locale: kau

Task: N/A

Format: CSV, JSONL, TXT, MD

Size: 577.46 KB

MDC Curators

Finance Sentences - North American Spanish

A public domain corpus of approximately 80,000 sentences (1.3M tokens) of North American Spanish in the finance domain.

License: CC0-1.0

Locale: es-US

Task: NLP

Format: TSV, JSON

Size: 18.35 MB

CLEAR Global

Hausa Multispeaker Read Speech (6.7h)

4,986 Hausa read-speech audio clips (~6.7 hours) with English source sentences, from CLEAR Global's Gamayun mini-kit.

License: CC-BY-NC-4.0

Locale: hau

Task: ASR

Format: MP3, TSV

Size: 214.61 MB

MDC Curators

CoVoST 2 Russian - English

The dataset includes audio files in Russian and their translations in English.

License: CC-BY-NC-4.0

Locale: ru, en

Task: MT

Format: MP3, TSV

Size: 1.01 GB

MDC Curators

CoVoST 2 English - Mongolian

The dataset includes audio files in English and their translations in Mongolian.

License: CC-BY-NC-4.0

Locale: en, mn

Task: MT

Format: MP3, TSV

Size: 12.56 GB

CLEAR Global

TWB Parallel Sentence kits - Lingala (5k)

5,000 French–Lingala parallel sentences from CLEAR Global's Gamayun mini-kit, translated by professional translators from Tatoeba source sentences.

License: CC-BY-4.0

Locale: lin

Task: MT

Format: TSV

Size: 494.43 KB

Community

Sindhi Word Segmentation (SdSEG)

A sentence-level annotated dataset for training and evaluating sequence labeling models such as CRF, BiLSTM, and transformer-based architectures.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 1.13 MB

MDC Curators

CoVoST 2 Arabic-English

The dataset includes 5736 audio files in Arabic and their translations in English.

License: CC-BY-NC-4.0

Locale: ar, en

Task: MT

Format: MP3, TSV

Size: 148.21 MB

MirasAI

Associated Press Pakistan 1.8 Million Chinese Corpus

A Chinese-language corpus of about 1.8 million Associated Press Pakistan news articles, useful for NLP and language model training.

License: CC-BY-NC-SA-4.0

Locale: zho

Task: NLP

Format: TXT

Size: 2.76 MB

MDC Curators

CoVoST 2 Welsh - English

The dataset includes audio files in Welsh and their translations in English.

License: CC-BY-NC-4.0

Locale: cy, en

Task: MT

Format: MP3, TSV

Size: 95.16 MB

Community

SKAD Ladino Parallel Corpus

Human-authored parallel sentences for Ladino (Judeo-Spanish) paired with English and Turkish, created by the Sephardic Center of Istanbul (SKAD).

License: CC-BY-4.0

Locale: lad, eng, tur

Task: MT

Format: TSV

Size: 74.14 KB

MDC Curators

CoVoST 2 Swedish - English

The dataset includes audio files in Swedish and their translations in English.

License: CC-BY-NC-4.0

Locale: sv-SE, en

Task: MT

Format: MP3, TSV

Size: 112.38 MB

MDC Community Concierge

IsiZulu Second Language Learner Speech Corpus

Gold standard recordings from isiZulu teachers and recordings from L2 learners annotated by isiZulu teachers for phonemic and tonal pronunciation errors .

License: CC-BY-SA-4.0

Locale: zu

Task: CALL

Format: WAV, SQLITE

Size: 5.26 GB

Balochi Academy

Balochi Academy Text Corpus

This corpus contains approximately 500k tokens of text from novels, poetry, articles, riddles, and proverbs, covering both literary and traditional genres. It is intended for linguistic research, NLP tasks (e.g., language modeling and text analysis), and cultural documentation.

License: CC-BY-NC-SA-4.0

Locale: bgn

Task: NLP

Format: TXT

Size: 1.88 MB

MDC Curators

CoVoST 2 Portuguese - English

The dataset includes audio files in Portuguese and their translations in English.

License: CC-BY-NC-4.0

Locale: pt, en

Task: MT

Format: MP3, TSV

Size: 500.02 MB

MDC Curators

CoVoST 2 English - Swedish

The dataset includes audio files in English and their translations in Swedish.

License: CC-BY-NC-4.0

Locale: en, sv-SE

Task: MT

Format: MP3, TSV

Size: 12.56 GB