Loading datasets...
Release Date: 9/2/2026
Format: TXT
Size: 23.23 MB
Share
The Associated Press Pakistan 16.4 Million Sindhi Corpus is a Sindhi-language news dataset comprising 58,815 articles (approximately 16.4 million words) published by the Associated Press of Pakistan on its Sindhi-language section at app.com.pk, covering the period 2015–2026. The corpus was assembled by MirasAI LLC using an automated web crawler that parsed each article's HTML to extract the headline, body text, publication date, and source URL, followed by deduplication, boilerplate removal, and normalization to plain text with Sindhi script preserved in UTF-8. Crawling was rate-limited and conducted with the knowledge and permission of APP. APP retains full and exclusive ownership of the data, with MirasAI serving solely as documentation and hosting facilitator; access is restricted and approval-based via the Mozilla Data Collective, for non-commercial research use only, with no sale, sublicensing, or commercial redistribution permitted, and APP may request takedown within a 48-hour compliance window.
Licensing
Creative Commons Attribution Non Commercial Share Alike 4.0 International (CC-BY-NC-SA-4.0)
https://spdx.org/licenses/CC-BY-NC-SA-4.0.htmlRestrictions/Special Constraints
Access is restricted and approval-based through the Mozilla Data Collective for non-commercial Sindhi NLP research only. The Associated Press of Pakistan retains full ownership; MirasAI LLC acts as documentation and hosting facilitator. Sale, sublicensing, and redistribution are prohibited, and users must credit the Associated Press of Pakistan as the primary source.
Forbidden Usage
Commercial use, sale, sublicensing, redistribution, and commercial derivative works are prohibited. Use is limited to approved non-commercial Sindhi NLP research through the Mozilla Data Collective. Users must credit the Associated Press of Pakistan as the primary source and must not misrepresent MirasAI LLC as the data owner.
Ethical Review
Hosted with the permission of the Associated Press of Pakistan, which retains full ownership. MirasAI acts solely as a documentation and hosting facilitator. Access is restricted to approved, non-commercial research; sale, sublicensing, and redistribution are prohibited.
Intended Use
Intended for non-commercial NLP research in Sindhi, including language modeling, machine translation, and information retrieval. All uses must credit the Associated Press of Pakistan as the sole and primary source.
The Associated Press Pakistan (APP) 16.4 Million Sindhi Corpus is a large-scale collection of Sindhi-language news articles published by the Associated Press of Pakistan, Pakistan’s national news agency. Established in 1947, the Associated Press of Pakistan is the country’s premier news service and publishes news across multiple languages, including English, Urdu, Chinese, Arabic, Sindhi, Saraiki, Pashto, Balochi, and Brahvi.
This dataset specifically contains Sindhi-language text and comprises approximately 16.4 million words from the published Sindhi-language archive of the Associated Press of Pakistan. It provides a substantial collection of contemporary written Sindhi news content and serves as a valuable resource for research on Sindhi, an under-resourced language in natural language processing (NLP).
Sindhi is an Indo-Aryan language and one of the major regional languages of Pakistan, primarily spoken in the province of Sindh, with additional speaker communities in India and the diaspora worldwide. It is widely used in education, media, literature, and everyday communication among Sindhi-speaking communities. Sindhi has a rich linguistic and literary heritage and plays an important role in the development of speech and language technologies for low-resource languages.
| Field | Value |
|---|---|
| Articles | 58,815 |
| Word count | ~16.4 million |
| Coverage | 2015–2026 |
| Language | Sindhi (snd) |
| Source | app.com.pk (Sindhi section) |
Sindhi.tar
└── sindhi/
├── 2015.txt
├── 2016.txt
├── 2017.txt
├── 2018.txt
├── 2019.txt
├── 2020.txt
├── 2021.txt
├── 2022.txt
├── 2023.txt
├── 2024.txt
├── 2025.txt
└── 2026.txt
سمندر پار پا کستانیوں نے رواں سال ساڑھے اٹھارہ ارب ڈالر پاکستان بھجوائے، حافظ احسان احمد کھوکھر
اسلام آباد ۔ 21 دسمبر (اے پی پی) وزارت سمندر پار پاکستانیز کے گریونس کمشنر حافظ احسان احمد کھوکھر نے کہا ہے کہ سمندر پار پاکستانیز معیشت کو سنبھالا دینے میں کلیدی کردار ادا کر رہے ہیں، 124 ممالک میں 75 لاکھ سے زائد پاکستانی اپنی خدمات سرانجام دے رہے ہیں جس سے پاکستانی زرمبادلہ کے ذخائر بھی مستحکم ہو رہے ہیں۔ حافظ احسان احمد کھوکھر نے" اے پی پی" کو بتایا کہ سمندر پار پا کستانیوں کی خدمات سے رواں سال تقریباً ساڑھے 18 ارب ڈالر پاکستان بھجوائے گئے۔ انہوں نے کہا کہ سمندر پار پاکستانیوں کے مسائل میں کمی لانے کی ضرورت ہے۔
Articles were collected from the Associated Press of Pakistan's publicly published Sindhi-language section on app.com.pk using an automated web crawler developed by MirasAI. Each article's HTML was parsed to extract the headline, body text, publication date, and source URL articles were deduplicated, cleaned of boilerplate, and normalized to plain text with Sindhi script preserved in UTF-8. Crawling was rate-limited and conducted with the knowledge and permission of the Associated Press of Pakistan.
This corpus is uploaded and hosted with the express permission of the Associated Press of Pakistan. The Associated Press of Pakistan retains full and exclusive ownership of the data. MirasAI acts solely as documentation and hosting facilitator. Access on the Mozilla Data Collective is restricted and approval-based, for non-commercial research use only. No sale, sublicensing, or commercial redistribution is permitted.
Intended for non-commercial NLP research in Sindhi, including language modeling, machine translation, and information retrieval. All uses must credit the Associated Press of Pakistan as the sole and primary source.