Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Farsi Dataset”

101 Datasets

MDC DatasetsCompensated

🚧 Khowar Multimodal Dataset 🚧

A Khowar multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

License: MDC DLA 1.0

Locale: khw, en

Task: NLP

Format: MP4, WAV, EAF

Size: 167.23 GB

MDC Curators

Common Voice Scripted Speech 26.0 - Arabic (Female)

Arabic Common Voice scripted speech 26.0 segment of Female speakers.

License: CC0-1.0

Locale: ar

Task: ASR

Format: MP3, TSV

Size: 185.04 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Dolgan Speech Corpus

A 13-hour supervised Speech-to-Text dataset for Dolgan, an endangered Turkic language. Features sentence-level audio aligned with text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: dlg

Task: ASR

Format: TSV, MP3

Size: 583.34 MB

Baloch Publishers Multan

Baloch Publishers Saraiki Literature Corpus

This corpus is a collection of one million tokens of Saraiki language. The data was produced under the Baloch Publishers over the last ten years. The corpus contains work of literature including dictionaries, short stories, novels, fiction, non-fiction, and travelogue. The data is being shared with the approval of the authors. It aims to support linguistic research, language technology development, and cultural preservation.

License: CC-BY-NC-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 2.04 MB

MDC Community Concierge

VoxForge - Albanian

30 minutes (330 utterances) of read speech of Shqip (Albanian).

License: GPL-3.0

Locale: sq

Task: ASR

Format: WAV, TSV

Size: 113.74 MB

Community

Sindhi Question-Answering Dataset (SdQuAD)

A benchmark Sindhi question answering dataset for advancing machine reading comprehension and NLP research in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: LLM

Format: JSON

Size: 500.50 KB

MDC Curators

Common Voice Scripted Speech 26.0 - Arabic (Male)

Arabic Common Voice scripted speech 26.0 segment of Male speakers.

License: CC0-1.0

Locale: ar

Task: ASR

Format: MP3, TSV

Size: 235.91 MB

MirasAI

Pakistan Traffic Signs Dataset

A dataset of Pakistani traffic signs designed for computer vision tasks such as traffic sign detection, classification, and autonomous driving research.

License: CC-BY-NC-4.0

Locale: urd, eng

Task: CV

Format: JPEG, JSON

Size: 2.64 GB

Institute of African Digital Humanities

Afaan Oromoo-TTS-Dataset

1,737 read-speech recordings from a single Afaan Oromo speaker, with MP3 audio and TSV sentence mappings. Suitable for TTS and ASR.

License: NOODL-1.0

Locale: gax

Task: TTS

Format: MP3, TSV

Size: 258.48 MB

Institute of African Digital Humanities

Bamun-French Parallel Corpus 2.0

This dataset is an extended and updated version of the "Bamun-French Parallel Corpus 1.1", a parallel corpus of 4,444 lines in Bamun and French.

License: NOODL-1.0

Locale: bax

Task: MT

Format: TSV

Size: 184.29 KB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

MDC DatasetsCompensated

Conversational Speech in Gujarati in the Finance Domain

25 hours of Conversational Speech in the Gujarati Language in the Finance Domain

License: MDC DLA-1.0

Locale: gu

Task: ASR

Format: WAV, JSON

Size: 6.20 GB

Jazab Publishers

Jazab Sindhi Newspaper Corpus

The corpus contains 1.07 million tokens from the Jazab a Sindhi Newspaper published from the year 2023-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.33 MB

Institute of African Digital Humanities

Hausa-TTS-Dataset

This dataset consists of segmented Hausa speech audio clips paired with text, totalling 5h 25m and 38s.

License: NOODL-1.0

Locale: hau

Task: TTS

Format: MP3, TSV

Size: 276.90 MB

Community

Sindhi Named Entity Recognition-SiNER Dataset

A Sindhi named entity recognition dataset for building NLP tools in an underrepresented South Asian language.

License: CC-BY-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.51 MB

RFE/RL

RFE/RL Tajik News Text Corpus

Longitudinal Tajik & Russian news corpus from Radio Ozodi (2000-2026) with over 166,000 articles and 20M tokens.

License: CC-BY-NC-SA-4.0

Locale: tg,ru

Task: NLP

Format: TXT

Size: 145.27 MB

Community

Sindhi Corpus

SdCorpus is a large scale monolingual Sindhi text corpus collected from publicly available web sources for NLP and language model development.

License: CC-BY-NC-4.0

Locale: snd

Task: LM

Format: TXT

Size: 321.00 MB

Institute of African Digital Humanities

Basaa-ALCAM-MultimodalDataset

This dataset comprises a datasheet of lexical entries in Basaa, accompanied by illustrative sentences, word-by-word glosses, and corresponding translations in French. Each entry is enriched with aligned audio recordings, making the resource suitable for linguistic analysis and speech technology development.

License: NOODL-1.0

Locale: bas

Task: NLP

Format: MP3, TSV

Size: 14.66 MB

Institute of Finno-Ugric/Uralic Studies, University of Hamburg

INEL Nenets Speech Corpus

A supervised Speech-to-Text dataset for Nenets, a Samoyedic language. Features sentence-level audio aligned with Cyrillic text transcriptions.

License: CC-BY-NC-SA-4.0

Locale: yrk

Task: ASR

Format: TSV, MP3

Size: 8.35 MB

Institute of African Digital Humanities

Teke-Laali-TTS-Dataset

The dataset contains paired audio and text resources for Teke-Laali, a Bantu language spoken in the Congo. It consists of seven folders containing a total of 9,069 audio clips from raw audio recordings, with a total duration of 7:01:50.126 (HH:MM:SS.mmm). Additionally, there are seven audio/text mapping files containing a total of 9,069 lines. The dataset is suitable for TTS tasks.

License: NOODL-1.0

Locale: lli

Task: TTS

Format: WAV, TSV

Size: 635.61 MB

Sindh Sujag Newspaper Agency

Sindh Sujag Newspaper Corpus

The corpus contains approximately 1.2 million tokens from the Sindh Sujag Newspaper Agency published between 2024 and 2025. It includes complete newspaper content such as headlines, editorials, finance news, and advertisements. The newspaper is published daily in Karachi, Pakistan, and represents a comprehensive collection of contemporary Sindhi journalistic writing.

License: CC-BY-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.63 MB

THA_ATLAS

StackOverflow Vector Dataset - F#

Language-specific StackOverflow vector dataset for F#.

License: CC-BY-SA-4.0

Locale: en-US

Task: RAG

Format: Parquet

Size: 641.22 MB

MirasAI

Noakhalian (নোয়াখাইল্লা) Text Corpus

A 500K token corpus of Noakhalian linguistic data including drama scripts and cultural texts for professional NLP research and language preservation.

License: CC-BY-NC-4.0

Locale: oak

Task: NLP

Format: TXT, DOCX

Size: 3.61 MB