Datasets | Mozilla Data Collective

A collection of read speech recordings in Pashto.

Common Voice Scripted Speech 26.0 - Pashto

License: CC0-1.0

Locale: ps

Task: ASR

Format: MP3

Size: 101.84 GB

A collection of read speech recordings in Balti.

Common Voice Scripted Speech 26.0 - Balti

License: CC0-1.0

Locale: bft

Task: ASR

Format: MP3

Size: 347.02 MB

A collection of read speech recordings in Kateviri.

Common Voice Scripted Speech 26.0 - Kateviri

License: CC0-1.0

Locale: bsh

Task: ASR

Format: MP3

Size: 202.62 MB

Bismillah Graphics Publishers

Urdu Literature Corpus

This corpus contains 16,17,074 tokens of multiple Urdu literature books published by Bismillah Graphics Publishers.

License: CC-BY-NC-4.0

Locale: ur

Task: OTH

Format: TXT

Size: 2.86 MB

A Northern Pashto multimodal dataset with 10 hours of synchronized video, audio, transcriptions, speech segmentation, and ELAN annotations.

🚧 Northern Pashto Multimodal Dataset 🚧

License: MDC DLA-1.0

Locale: pbu

Task: NLP

Format: MP4, WAV, EAF

Size: 251.41 GB

MEDIAMEN

English–Punjabi (Shahmukhi) Parallel Sentences Corpus (Mediamen Archives)

This parallel sentences corpus containing 30,405 aligned sentence pairs with a total of approximately 0.62 million tokens, curated from the archival materials of Mediamen (Advertising Agency). The sentences were professionally translated from English into Punjabi (Shahmukhi) and are intended to support machine translation, linguistic research, and Punjabi language technology development, particularly for real-world and contemporary language use.

License: CC-BY-NC-4.0

Locale: en-PK, pnb

Task: MT

Format: CSV

Size: 1.08 MB

A Khowar-English speech translation dataset with approximately 9.5 hours of Khowar audio with English text translations.

🚧 Khowar Speech Translation Corpus 🚧

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: MP3, TSV

Size: 244.96 MB

A collection of read speech recordings in Punjabi.

Common Voice Scripted Speech 26.0 - Punjabi

License: CC0-1.0

Locale: pa-IN

Task: ASR

Format: MP3

Size: 104.82 MB

A collection of read speech recordings in Kohistani Shina.

Common Voice Scripted Speech 26.0 - Kohistani Shina

License: CC0-1.0

Locale: plk

Task: ASR

Format: MP3

Size: 330.88 MB

Open Home Foundation

Imre 1.0

Text to speech dataset for Hungarian, male speaker, approximately 1.5 hours of read speech.

License: CC0-1.0

Locale: hu-HU

Task: TTS

Format: WEBM

Size: 99.60 MB

A collection of read speech recordings in Saraiki.

Common Voice Scripted Speech 26.0 - Saraiki

License: CC0-1.0

Locale: skr

Task: ASR

Format: MP3

Size: 133.49 MB

A collection of 40 hours of high-quality, audio recordings and verified transcriptions for Singaporean Tamil

Singaporean Tamil Speech Collection

License: MDC-DLA 1.0

Locale: ta-SG

Task: TTS

Format: WAV, TSV

Size: 8.47 GB

Safety aligned Urdu medical question answer dataset of 3,072 records for supervised fine-tuning of medical-domain LLMs.

Urdu Medical SFT

License: CC-BY-SA-4.0

Locale: urd

Task: NLG

Format: PARQUET

Size: 357.97 KB

MirasAI

Associated Press Pakistan 21.4 Million Pashto Corpus

Pashto news corpus from the Associated Press of Pakistan, containing 99,495 articles and 21.4 million words from 2015–2026.

License: CC-BY-NC-SA-4.0

Locale: pus

Task: NLP

Format: TXT

Size: 38.81 MB

A parallel corpus of over 10,000 sentences of Khowar and English. The sentences are derived from a multimodal corpus consisting of 152 transcribed and translated Khowar language videos.

🚧 Khowar-English Parallel Corpus 🚧

License: MDC DLA-1.0

Locale: khw, en

Task: MT

Format: TSV

Size: 407.57 KB

A collection of read speech recordings in Gawarbaiti.

Common Voice Scripted Speech 26.0 - Gawarbaiti

License: CC0-1.0

Locale: gwt

Task: ASR

Format: MP3

Size: 249.85 MB

A collection of read speech recordings in Persian.

Common Voice Scripted Speech 26.0 - Persian

License: CC0-1.0

Locale: fa

Task: ASR

Format: MP3

Size: 10.45 GB

A bilingual Urdu and Sindhi grapheme-to-phoneme dataset for G2P, TTS, ASR, and speech technology research.

Urdu-Sindhi Grapheme-to-Phoneme Dataset

License: CC-BY-NC-SA-4.0

Locale: ur, sd

Task: TTS

Format: PARQUET

Size: 1.92 MB

A collection of 3,317 AI-generated Urdu quotes and aphorisms for text-generation and language modeling research.

Urdu AI Generated Quotes & Aphorisms

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLG

Format: JSON

Size: 174.90 KB

Curated Urdu dataset of 100,000 records with fabricated PII spans, for training and evaluating privacy span detection across 12 domains.

PII Redact Urdu UOPF

License: CC-BY-NC-SA-4.0

Locale: urd

Task: NLP

Format: JSONL

Size: 5.77 MB

A collection of read speech recordings in Eastern Balochi.

Common Voice Scripted Speech 26.0 - Eastern Balochi

License: CC0-1.0

Locale: bgp

Task: ASR

Format: MP3

Size: 259.69 MB

Open Home Foundation

Tugão 1.0

Text to speech dataset for Portuguese, male speaker, approximately 1.5 hours of read speech.

License: CC0-1.0

Locale: pt-PT

Task: TTS

Format: WEBM

Size: 61.84 MB

MDC Curators

CoVoST 2 Persian - English

The dataset includes audio files in Persian and their translations in English.

License: CC-BY-NC-4.0

Locale: fa, en

Task: MT

Format: MP3, TSV

Size: 1.52 GB