Pashto language stemming algorithm
This paper presents a stemming algorithm for morphological analysis for less popular or minor language like Pashto language. There is lack of resources and tools that can be applied in different applications such as in document indexing, clustering, language processing, text analysis, database sea...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Penerbit Universiti Kebangsaan Malaysia
2015
|
| Online Access: | http://journalarticle.ukm.my/8852/1/7048-23719-1-PB.pdf |
| _version_ | 1796930853447663616 |
|---|---|
| author | Aslamzai, Sebghatullah Saidah Saad, |
| author_facet | Aslamzai, Sebghatullah Saidah Saad, |
| author_sort | Aslamzai, Sebghatullah |
| collection | UKM |
| description | This paper presents a stemming algorithm for morphological analysis for less popular or minor language like
Pashto language. There is lack of resources and tools that can be applied in different applications such as in
document indexing, clustering, language processing, text analysis, database search systems, information retrieval,
and linguistic applications. The review of literature shows that only a few morphological studies have been
conducted in the Pashto language, and research which focused on automatic stemming has not yet been fully
analysed. In addition, no stemming algorithm has been proposed for extracting Pashto root words from the Pashto
corpus, which is applicable for the above mentioned functions. Therefore, the objective of the current thesis is to
develop a rule-based stemming algorithm for the Pashto language. The Pashto corpus is directly used as the input
and the stemming algorithm uses both inflectional and derivational morphemes. The output is in the form of
meaningful root word without affixes. Furthermore, the accuracy and strength of the proposed algorithm is
evaluated using word count method. To validate the function of the developed algorithm, two native speakers of
Pashto were recruited to evaluate the algorithm in terms of its accuracy and strength. The result of the study shows
that the proposed algorithm has the accuracy of 87%. This study can have a great contribution to Pashto language
in terms of extracting the root words useful for different purposes including data indexing, information retrieval,
linguistic application, etc. This research also lays the ground for further studies on Pashto language analysis. |
| first_indexed | 2024-03-06T04:09:21Z |
| format | Article |
| id | ukm.eprints-8852 |
| institution | Universiti Kebangsaan Malaysia |
| language | English |
| last_indexed | 2024-03-06T04:09:21Z |
| publishDate | 2015 |
| publisher | Penerbit Universiti Kebangsaan Malaysia |
| record_format | dspace |
| spelling | ukm.eprints-88522016-12-14T06:48:14Z http://journalarticle.ukm.my/8852/ Pashto language stemming algorithm Aslamzai, Sebghatullah Saidah Saad, This paper presents a stemming algorithm for morphological analysis for less popular or minor language like Pashto language. There is lack of resources and tools that can be applied in different applications such as in document indexing, clustering, language processing, text analysis, database search systems, information retrieval, and linguistic applications. The review of literature shows that only a few morphological studies have been conducted in the Pashto language, and research which focused on automatic stemming has not yet been fully analysed. In addition, no stemming algorithm has been proposed for extracting Pashto root words from the Pashto corpus, which is applicable for the above mentioned functions. Therefore, the objective of the current thesis is to develop a rule-based stemming algorithm for the Pashto language. The Pashto corpus is directly used as the input and the stemming algorithm uses both inflectional and derivational morphemes. The output is in the form of meaningful root word without affixes. Furthermore, the accuracy and strength of the proposed algorithm is evaluated using word count method. To validate the function of the developed algorithm, two native speakers of Pashto were recruited to evaluate the algorithm in terms of its accuracy and strength. The result of the study shows that the proposed algorithm has the accuracy of 87%. This study can have a great contribution to Pashto language in terms of extracting the root words useful for different purposes including data indexing, information retrieval, linguistic application, etc. This research also lays the ground for further studies on Pashto language analysis. Penerbit Universiti Kebangsaan Malaysia 2015-06 Article PeerReviewed application/pdf en http://journalarticle.ukm.my/8852/1/7048-23719-1-PB.pdf Aslamzai, Sebghatullah and Saidah Saad, (2015) Pashto language stemming algorithm. Asia-Pacific Journal of Information Technology and Multimedia, 4 (1). pp. 25-37. ISSN 2289-2192 http://ejournal.ukm.my/apjitm/issue/view/609 |
| spellingShingle | Aslamzai, Sebghatullah Saidah Saad, Pashto language stemming algorithm |
| title | Pashto language stemming algorithm |
| title_full | Pashto language stemming algorithm |
| title_fullStr | Pashto language stemming algorithm |
| title_full_unstemmed | Pashto language stemming algorithm |
| title_short | Pashto language stemming algorithm |
| title_sort | pashto language stemming algorithm |
| url | http://journalarticle.ukm.my/8852/1/7048-23719-1-PB.pdf |
| work_keys_str_mv | AT aslamzaisebghatullah pashtolanguagestemmingalgorithm AT saidahsaad pashtolanguagestemmingalgorithm |