Datasets | Mozilla Data Collective

All Datasets

Compensated Datasets

API

Contribute Datasets

Loading datasets...

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Terms

FAQs

Participation Guidelines

Responsible Disclosure

News and Documentation

Data and Model Competitions

[email protected]

Mozilla Data Collective is a mission-locked British company, incubated by Mozilla Foundation, and backed by the not-for-profit Mozilla.org

All Datasets

Not sure where to start?

Describe what you are building and the Data Assistant will find the right datasets for you.

Try the Data Assistant

Filtered by

Search results for “Western Balochi Literature Corpus”

100 Datasets

MDC DatasetsCompensated

🚧 Hazargi-English Parallel Text Corpus 🚧

A Hazargi-English parallel corpus derived from transcribed and translated video recordings

License: MDC DLA-1.0

Locale: haz, en

Task: MT

Format: TSV

Size: 434.04 KB

Forum for Language Initiatives

Khowar Word List

A UTF-8 encoded Khowar lexical corpus containing alphabet definitions and a structured word list for linguistic research and language technology development.

License: CC-BY-NC-4.0

Locale: khw

Task: NLP

Format: TXT

Size: 64.22 KB

Community

Sindhi Parts Of Speech (SiPOS)

A large-scale Sindhi Part-of-Speech (SiPOS) tagging dataset for developing and evaluating NLP models in a low-resource language.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 874.04 KB

Protham Alo

Prothom Alo Bengali Newspaper Corpus

A 10+ million token Bengali newspaper corpus from Prothom Alo provided in .docx format for large-scale NLP research and linguistic analysis.

License: CC-BY-NC-4.0

Locale: ben

Task: NLP

Format: DOCX

Size: 42.36 MB

MirasAI

Gawar-Bati Literature Corpus

Gawarbati-language literature corpus featuring Diwan Abu Fazl, a poetry collection for documentation and NLP research.

License: CC-BY-NC-SA-4.0

Locale: gwt

Task: NLP

Format: TXT, DOCX

Size: 876.83 KB

CLEAR Global

Kanuri Books Corpus

Randomized sentences from Kanuri-language books by four authors, containing 10,281 sentences and 90,706 words.

License: CC-BY-4.0

Locale: kr

Task: LM

Format: TXT

Size: 545.68 KB

Taruen

Dolgan Folklore Text Corpus

A 15.6k-word corpus of 19 Dolgan fairy tales, digitized to catalyze NLP research and revitalization for this highly endangered Siberian Turkic language.

License: CC0-1.0

Locale: dlg

Task: NLP

Format: TXT

Size: 57.16 KB

Tamir News Agency

Tamir Sindhi News Corpus

The corpus contains 1.1 million tokens from the Tamir Sindhi Newspaper published from the year 2022-2025. The text consists of the complete newspaper content including headlines, editorials, finance news and advertisements. The newspaper published in Karachi, Pakistan on daily basis.

License: CC-BY-NC-SA-4.0

Locale: snd

Task: NLP

Format: TXT

Size: 2.56 MB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

MirasAI

Noakhalian (নোয়াখাইল্লা) Text Corpus

A 500K token corpus of Noakhalian linguistic data including drama scripts and cultural texts for professional NLP research and language preservation.

License: CC-BY-NC-4.0

Locale: oak

Task: NLP

Format: TXT, DOCX

Size: 3.61 MB

Habib University

Burushaski-English Speech Translation Corpus

A linguistically informed Burushaski speech - English text corpus containing 14,970 short audio recordings paired with corresponding English text translations.

License: CC-BY-NC-SA-4.0

Locale: bsk

Task: MT

Format: WAV, TXT

Size: 921.47 MB

LocaleNLP

English Hausa Parallel Corpus

An English–Hausa dataset with 5,000 sentence pairs useful for machine translation and basic language processing tasks.

License: CC-BY-NC-4.0

Locale: eng, hau

Task: MT

Format: csv

Size: 164.32 KB

Community

Sindhi Word Segmentation (SdSEG)

A sentence-level annotated dataset for training and evaluating sequence labeling models such as CRF, BiLSTM, and transformer-based architectures.

License: CC-BY-NC-4.0

Locale: snd

Task: NLP

Format: JSON

Size: 1.13 MB

MirasAI

Ormuri Bilingual Dictionary by Rozi Khan Burki

A Ormuri dictionary by Rozi Khan Burki documenting Ormuri vocabulary and meanings to support language preservation, linguistic research, and NLP development.

License: CC-BY-ND-4.0

Locale: oru

Task: TTS

Format: JPG, PDF, DOCX

Size: 15.68 MB

MirasAI

Sylheti Text Corpus by Haque Publishers

A 524K token Sylheti corpus featuring drama scripts and cultural texts in UTF-8 format for linguistic research and NLP development.

License: CC-BY-NC-4.0

Locale: syl

Task: NLP

Format: TXT

Size: 3.53 MB

Community

Sindhi to English Parallel Corpus

A Sindhi–English parallel corpus in JSONL format, designed for machine translation and cross-lingual NLP tasks across diverse real-world domains.

License: CC-BY-NC-4.0

Locale: snd, eng

Task: MT

Format: JSONL

Size: 2.50 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

100k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 4.49 MB

TAUSCompensated

🚧 Colloquial Parallel Text (English - Hausa) 🚧

49k native-reviewed colloquial sentences translated from US English into Hausa for fine-tuning conversational MT and AI models.

License: TAUS DUA

Locale: en-US, ha-NG

Task: MT

Format: TSV

Size: 2.93 MB

MirasAI

Associated Press Pakistan 10.4 Million Saraiki Corpus

A 10.4-million-word Saraiki news corpus from Associated Press of Pakistan, covering 2016–2026 for non-commercial Saraiki NLP research.

License: CC-BY-NC-SA-4.0

Locale: skr

Task: NLP

Format: TXT

Size: 19.51 MB

MirasAI

Rohingya Literature Corpus

A rare 613.5 K token Rohingya corpus written in the Myanmar script, featuring cultural articles and folklore for advanced NLP research and preservation.

License: CC-BY-NC-4.0

Locale: rhg

Task: NLP

Format: TXT, DOCX

Size: 7.01 MB

Taruen

Kazakh Proverbs Text Corpus

A corpus of traditional Kazakh proverbs from the Babalar sözi series (vols 65-69), designed for NLP and LLM cultural competence evaluations.

License: CC0-1.0

Locale: kk

Task: NLP

Format: TXT

Size: 592.14 KB

Balochistan Educational and Cultural Organization

Brahui Research Work Corpus

This corpus consists of research works, academic theses, and scholarly papers, comprising approximately 185,000 tokens. It covers a range of academic topics and formal registers, reflecting standardized writing practices and disciplinary conventions. The corpus is intended to support linguistic analysis, discourse studies, and computational research on academic and research-oriented text.

License: CC-BY-NC-SA-4.0

Locale: brh

Task: NLP

Format: TXT

Size: 1.13 MB

MirasAI

Associated Press Pakistan 74.4 Million Urdu Corpus

A 74.4M-word, 267,887-article Urdu news corpus from Associated Press Pakistan (2015-2026), released for non-commercial research with APP permission.

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: TXT

Size: 143.39 MB

RFE/RL

RFE/RL Afghan Pashto News Text Corpus

This dataset is a longitudinal news corpus for the Pashto language, sourced from Radio Azadi, from 2000 to 2026, it contains over 204,000 articles (16M tokens).

License: CC-BY-NC-SA-4.0

Locale: ps

Task: NLP

Format: TXT

Size: 117.68 MB