TextCSN: A semi-supervised approach for text clustering using pairwise constraints and convolutional siamese network

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Clustering is a key problem in several applications. Although this task is originally unsupervised, there are many proposals leveraging different supervision signals in order to improve clustering performance. Some semi-supervised clustering methods employ pairwise constraints to inform the learning algorithm about pairs of instances that should be in the same cluster (must-link constraints or similar instances) and pairs that should be in different clusters (cannot-link constraints or dissimilar instances). In many applications, to provide pairwise constraints is cheaper than asking users for explicit labels on the data. More recently, deep clustering methods have been proposed in the literature. Such methods consists in learning a deep neural representation of the input data in order to improve clustering. In this paper, we present TextCSN, a deep clustering approach that combines (i) a Convolutional Siamese Network (CSN) based on pairwise constraints to perform representation learning and (ii) the traditional K-Means algorithm for unsupervised clustering using the learned representation. As far as we know, this is the first semi-supervised deep learning method based on pairwise constraints applied on text clustering. By means of eight text clustering tasks, we assess our approach comparing it with two baselines: MPC-KMeans, a semi-supervised clustering algorithm; and ordinary K-Means algorithm. Results indicate that the proposed approach outperforms the baselines in six of these datasets, and its performance increases with the number of constraints provided.

Original languageEnglish
Title of host publicationThe 35th Annual ACM Symposium on Applied Computing : Brno, Czech Republic, March 30 - April 3, 2020
Number of pages8
Place of PublicationNew York
PublisherAssociation for Computing Machinery, Inc
Publication date30.03.2020
Pages1135-1142
ISBN (Electronic)978-1-4503-6866-7
DOIs
Publication statusPublished - 30.03.2020
Externally publishedYes
EventAnnual ACM Symposium on Applied Computing - SAC 2020 - Brno, Czech Republic
Duration: 30.03.202003.04.2020
Conference number: 35
https://www.sigapp.org/sac/sac2020/

DOI