Development of a genetic-based hierarchical agglomerative clustering technique for parallel clustering of bilingual corpora based on reduced terms

In this project, we report on our work on applying Hierarchical Agglomerative Clustering (HAC) to a large corpus of documents where each appears both in Malay and English. We cluster these documents for each language and compare the results both with respect to the content of clusters produced. On t...

Full description

Bibliographic Details
Main Authors: Rayner Alfred, Jason Teo, Chung, Seng Kheau
Format: Research Report
Language:English
Published: Universiti Malaysia Sabah 2010
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/24737/1/Development%20of%20genetic-based%20hierarchical.pdf
Description
Summary:In this project, we report on our work on applying Hierarchical Agglomerative Clustering (HAC) to a large corpus of documents where each appears both in Malay and English. We cluster these documents for each language and compare the results both with respect to the content of clusters produced. On the data available, the results of clustering one language resemble the other, provided the number of clusters required is relatively small. Further? we study the effects of changing the method used to compute the inter-clusters distance that includes single link, complete link and average link distance between clusters. Finally, we describe an experiment employing a genetic algorithm to fine-tune the individual term weights in order to reproduce more closely a predefined set of clusters.