Loading datasets...
Release Date: 9/2/2026
Format: TXT
Size: 38.81 MB
Share
The Pashto News Corpus is a large-scale collection of Pashto-language news articles published by the Associated Press of Pakistan, covering the period from 2015 to 2026. The corpus contains 99,495 articles and approximately 21.4 million words, making it a valuable resource for research and development in Pashto natural language processing. The articles were collected from APP’s Pashto-language section and processed to extract headlines, article text, publication dates, and source URLs while preserving the original Pashto script in UTF-8.
Licensing
Creative Commons Attribution Non Commercial Share Alike 4.0 International (CC-BY-NC-SA-4.0)
https://spdx.org/licenses/CC-BY-NC-SA-4.0.htmlRestrictions/Special Constraints
Access is restricted to approved users for non-commercial research only. The Associated Press of Pakistan retains full ownership of the underlying content. Sale, sublicensing, commercial redistribution, and republication are prohibited. Users must provide proper attribution, and redistribution requires prior authorization.
Forbidden Usage
Commercial use, resale, sublicensing, and redistribution are prohibited. Users must not republish Associated Press of Pakistan content as an independent or competing archive, claim ownership, or remove attribution. Unauthorized distribution or use violating applicable permissions, intellectual property rights, laws, or Mozilla Data Collective terms is forbidden.
Ethical Review
Hosted with the permission of the Associated Press of Pakistan, which retains full ownership. MirasAI acts solely as a documentation and hosting facilitator. Access is restricted to approved, non-commercial research; sale, sublicensing, and commercial redistribution are prohibited.
Intended Use
Designed for non-commercial Pashto NLP research, supporting applications such as language modeling, machine translation, and lexicon development. All use must acknowledge the Associated Press of Pakistan as the primary source.
The Pashto News Corpus is a large-scale collection of Pashto-language news articles published by the Associated Press of Pakistan, Pakistan’s national news agency. Established in 1947, the Associated Press of Pakistan is the country’s premier news service and publishes news across multiple languages, including English, Urdu, Chinese, Arabic, Sindhi, Saraiki, Pashto, Balochi, and Brahvi.
This dataset specifically contains Pashto-language text and comprises 99,495 articles with approximately 21.4 million words, covering news publications from 2015 to 2026. The corpus provides a substantial collection of contemporary written Pashto news content and represents a valuable resource for research on Pashto, a severely under-resourced language in natural language processing (NLP).
Pashto is an Eastern Iranian language spoken primarily in Afghanistan and the Khyber Pakhtunkhwa and northern Balochistan regions of Pakistan, with a large diaspora of speakers worldwide. It is one of Pakistan's major regional languages and holds official status in Afghanistan. Pashto is widely used in education, media, literature, and everyday communication among Pashtun communities, and it plays an important role in the development of speech and language technologies for low-resource languages.
We acknowledge the Associated Press of Pakistan for granting permission to collect and host this Pashto-language news corpus for approved non-commercial research purposes.
| Attribute | Details |
|---|---|
| Articles | 99,495 |
| Word Count | 21.4 million |
| Coverage | 2015–2026 |
| Language | Pashto |
| Language Code | pus |
| Script | Pashto Arabic-based script |
| Source | Associated Press of Pakistan (APP) |
| Data Format | TXT |
The corpus is organized as follows:
Pashto.tar/
└── Pashto/
├── 2015
├── 2016
├── 2017
├── 2018
├── 2019
├── 2020
├── 2021
├── 2022
├── 2023
├── 2024
├── 2025
└── 2026
اسلام آباد 23 دسمبر (اے پي پي) د سېنېټ چیئرمېن ميا رضا رباني د كرسمس په موقع عيسايانو ته د ايوان د غړو لكوا مباركي وركړي۔د شورو په ورځ د سېنېټ په غونډه كښې ده ووئيل چې د كرسمس په موقع عيسايانو له تر ټولو لويه ډالۍ به دا وي چې د سي ډي اے لخوا چې كوم ناسم راپور اړوند قائمه كمېټۍ ته وړاندې كړې شوې د سېنېټ قواعدو ٬ ضوابطو او استحقاقاتو لپاره قائمه كمېټي جاج واخلي دغسې چې عيسايانو ته دا پېغام وركړې شي چې سېنېټ د بشپړ هېواد نمائندګي لري او د هېواد د ټولو ټولنو د حقونو د تحفظ ذمه وار دې۔
The Associated Press of Pakistan (APP) retains full and exclusive ownership and rights over the underlying news content contained in this corpus.
MirasAI LLC acts solely as a documentation, dataset preparation, and hosting facilitator and does not claim ownership of APP's original news content.
The corpus was compiled from the Pashto-language news section of the Associated Press of Pakistan.
Source: Associated Press of Pakistan (APP) Coverage: 2015–2026 Language: Pashto Domain: News
Articles were collected from the Associated Press of Pakistan's publicly published Pashto-language section on app.com.pk using an automated web crawler developed by MirasAI. Each article's HTML was parsed to extract the headline, body text, publication date, and source URL; articles were deduplicated, cleaned of boilerplate, and normalized to plain text with Pashto script preserved in UTF-8. Crawling was rate-limited and conducted with the knowledge and permission of the Associated Press of Pakistan.
This corpus is uploaded and hosted with the express permission of the Associated Press of Pakistan. The Associated Press of Pakistan retains full and exclusive ownership of the data; MirasAI acts solely as documentation and hosting facilitator. Access on the Mozilla Data Collective is restricted and approval-based, for non-commercial research use only. No sale, sublicensing, or commercial redistribution is permitted.
Intended for non-commercial NLP research in Pashto, including language modeling, machine translation, and lexicon development. All uses must credit the Associated Press of Pakistan as the sole and primary source.