Building a French Stemmer Using a Dictionary of French Root Words
In this thesis, a strong French stemming algorithm based on a dictionary of French root words is developed. Four modules are observed for this purpose. The first module deals with the development of a list of French root words, and a list of affixes, that is, prefixes, suffixes, and prefix-suffix...
| المؤلف الرئيسي: | |
|---|---|
| التنسيق: | أطروحة |
| اللغة: | English English |
| منشور في: |
1999
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | http://psasir.upm.edu.my/id/eprint/9628/1/FSKTM_1999_2_IR.pdf |
| _version_ | 1825944622649573376 |
|---|---|
| author | Idi, Fulayi |
| author_facet | Idi, Fulayi |
| author_sort | Idi, Fulayi |
| collection | UPM |
| description | In this thesis, a strong French stemming algorithm based on a dictionary of
French root words is developed. Four modules are observed for this purpose.
The first module deals with the development of a list of French root words,
and a list of affixes, that is, prefixes, suffixes, and prefix-suffix pairs.
The second module removes the punctuation from words to be stemmed. It
also removes stop words from the corpus to be stemmed. After this second module,
words are noise-free, and this leads to the third module, that is, the stemming proper.
The stemming order adopted is prefix, then suffix, and finally prefix-suffix
pairs. Any word to be stemmed is first compared to a dictionary of French root words
to check if it is a root word. Then, the actual stemming process is performed. The stemming algorithm constructed is tested using selected criteria, among
which are inflection removal, prefix stripping and suffix stripping. For all these tests,
the new French stemming algorithm performs better than the existing French
stemmer, Savoy's stemmer.
Tests are also carried out to check the performance of the new French
stemmer in terms of understemming, overstemming, ambiguous stemming and
dictionary error. The new French stemmer has fewer understemming, overstemming,
and ambiguous stemming than Savoy's stemmer. However, the new stemmer has
more dictionary born errors than Savoy's stemmer. |
| first_indexed | 2024-03-06T07:18:48Z |
| format | Thesis |
| id | upm.eprints-9628 |
| institution | Universiti Putra Malaysia |
| language | English English |
| last_indexed | 2024-03-06T07:18:48Z |
| publishDate | 1999 |
| record_format | dspace |
| spelling | upm.eprints-96282023-11-28T03:12:36Z http://psasir.upm.edu.my/id/eprint/9628/ Building a French Stemmer Using a Dictionary of French Root Words Idi, Fulayi In this thesis, a strong French stemming algorithm based on a dictionary of French root words is developed. Four modules are observed for this purpose. The first module deals with the development of a list of French root words, and a list of affixes, that is, prefixes, suffixes, and prefix-suffix pairs. The second module removes the punctuation from words to be stemmed. It also removes stop words from the corpus to be stemmed. After this second module, words are noise-free, and this leads to the third module, that is, the stemming proper. The stemming order adopted is prefix, then suffix, and finally prefix-suffix pairs. Any word to be stemmed is first compared to a dictionary of French root words to check if it is a root word. Then, the actual stemming process is performed. The stemming algorithm constructed is tested using selected criteria, among which are inflection removal, prefix stripping and suffix stripping. For all these tests, the new French stemming algorithm performs better than the existing French stemmer, Savoy's stemmer. Tests are also carried out to check the performance of the new French stemmer in terms of understemming, overstemming, ambiguous stemming and dictionary error. The new French stemmer has fewer understemming, overstemming, and ambiguous stemming than Savoy's stemmer. However, the new stemmer has more dictionary born errors than Savoy's stemmer. 1999-07 Thesis NonPeerReviewed text en http://psasir.upm.edu.my/id/eprint/9628/1/FSKTM_1999_2_IR.pdf Idi, Fulayi (1999) Building a French Stemmer Using a Dictionary of French Root Words. Masters thesis, Universiti Putra Malaysia. French language English |
| spellingShingle | French language Idi, Fulayi Building a French Stemmer Using a Dictionary of French Root Words |
| title | Building a French Stemmer Using a Dictionary of French Root Words |
| title_full | Building a French Stemmer Using a Dictionary of French Root Words |
| title_fullStr | Building a French Stemmer Using a Dictionary of French Root Words |
| title_full_unstemmed | Building a French Stemmer Using a Dictionary of French Root Words |
| title_short | Building a French Stemmer Using a Dictionary of French Root Words |
| title_sort | building a french stemmer using a dictionary of french root words |
| topic | French language |
| url | http://psasir.upm.edu.my/id/eprint/9628/1/FSKTM_1999_2_IR.pdf |
| work_keys_str_mv | AT idifulayi buildingafrenchstemmerusingadictionaryoffrenchrootwords |