Malay word stemmer to stem standard and slang word patterns on social media
Word stemmer is a text preprocessing tool used in many artificial intelligence applications such as text mining, text categorization and information retrieval. It is used to stem derived words into their respective root words. Many researchers have proposed word stemmers for Malay language using var...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Published: |
Springer Verlag
2016
|
| Subjects: |
| _version_ | 1796862176243220480 |
|---|---|
| author | Kassim, Mohamad Nizam Maarof, Mohd. Aizaini Zainal, Anazida Abdul Wahab, Amirudin |
| author_facet | Kassim, Mohamad Nizam Maarof, Mohd. Aizaini Zainal, Anazida Abdul Wahab, Amirudin |
| author_sort | Kassim, Mohamad Nizam |
| collection | ePrints |
| description | Word stemmer is a text preprocessing tool used in many artificial intelligence applications such as text mining, text categorization and information retrieval. It is used to stem derived words into their respective root words. Many researchers have proposed word stemmers for Malay language using various stemming approaches. Since the proliferation of social media, there are various word patterns have been used by social media users in which the existing word stemmers do not support in their stemming rules. These word patterns are slang words or informal conversation words which are used in daily conversation. Therefore, this paper proposes the new word stemmer for Malay language that able to stem standard and slang words. This paper also examines the differences between standard words and slang words. The experimental results show that the proposed word stemmer able to stem standard affixation and reduplication words and also stem slang affixation and reduplication words with better stemming accuracy. |
| first_indexed | 2024-03-05T20:07:36Z |
| format | Article |
| id | utm.eprints-74130 |
| institution | Universiti Teknologi Malaysia - ePrints |
| last_indexed | 2024-03-05T20:07:36Z |
| publishDate | 2016 |
| publisher | Springer Verlag |
| record_format | dspace |
| spelling | utm.eprints-741302017-11-28T05:01:13Z http://eprints.utm.my/74130/ Malay word stemmer to stem standard and slang word patterns on social media Kassim, Mohamad Nizam Maarof, Mohd. Aizaini Zainal, Anazida Abdul Wahab, Amirudin QA75 Electronic computers. Computer science Word stemmer is a text preprocessing tool used in many artificial intelligence applications such as text mining, text categorization and information retrieval. It is used to stem derived words into their respective root words. Many researchers have proposed word stemmers for Malay language using various stemming approaches. Since the proliferation of social media, there are various word patterns have been used by social media users in which the existing word stemmers do not support in their stemming rules. These word patterns are slang words or informal conversation words which are used in daily conversation. Therefore, this paper proposes the new word stemmer for Malay language that able to stem standard and slang words. This paper also examines the differences between standard words and slang words. The experimental results show that the proposed word stemmer able to stem standard affixation and reduplication words and also stem slang affixation and reduplication words with better stemming accuracy. Springer Verlag 2016 Article PeerReviewed Kassim, Mohamad Nizam and Maarof, Mohd. Aizaini and Zainal, Anazida and Abdul Wahab, Amirudin (2016) Malay word stemmer to stem standard and slang word patterns on social media. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9714 L . pp. 391-400. ISSN 0302-9743 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85007572977&doi=10.1007%2f978-3-319-40973-3_39&partnerID=40&md5=b6341e6c4c50a55dd4af8f8f3a2a2b66 |
| spellingShingle | QA75 Electronic computers. Computer science Kassim, Mohamad Nizam Maarof, Mohd. Aizaini Zainal, Anazida Abdul Wahab, Amirudin Malay word stemmer to stem standard and slang word patterns on social media |
| title | Malay word stemmer to stem standard and slang word patterns on social media |
| title_full | Malay word stemmer to stem standard and slang word patterns on social media |
| title_fullStr | Malay word stemmer to stem standard and slang word patterns on social media |
| title_full_unstemmed | Malay word stemmer to stem standard and slang word patterns on social media |
| title_short | Malay word stemmer to stem standard and slang word patterns on social media |
| title_sort | malay word stemmer to stem standard and slang word patterns on social media |
| topic | QA75 Electronic computers. Computer science |
| work_keys_str_mv | AT kassimmohamadnizam malaywordstemmertostemstandardandslangwordpatternsonsocialmedia AT maarofmohdaizaini malaywordstemmertostemstandardandslangwordpatternsonsocialmedia AT zainalanazida malaywordstemmertostemstandardandslangwordpatternsonsocialmedia AT abdulwahabamirudin malaywordstemmertostemstandardandslangwordpatternsonsocialmedia |