Deep embedded clustering generalisability and adaptation for integrating mixed datatypes: two critical care cohorts

Abstract We validated a Deep Embedded Clustering (DEC) model and its adaptation for integrating mixed datatypes (in this study, numerical and categorical variables). Deep Embedded Clustering (DEC) is a promising technique capable of managing extensive sets of variables and non-linear relationships....

Full description

Bibliographic Details
Main Authors: Jip W. T. M. de Kok, Frank van Rosmalen, Jacqueline Koeze, Frederik Keus, Sander M. J. van Kuijk, José Castela Forte, Ronny M. Schnabel, Rob G. H. Driessen, Thijs T. W. van Herpt, Jan-Willem E. M. Sels, Dennis C. J. J. Bergmans, Chris P. H. Lexis, William P. T. M. van Doorn, Steven J. R. Meex, Minnan Xu, Xavier Borrat, Rachel Cavill, Iwan C. C. van der Horst, Bas C. T. van Bussel
Format: Article
Language:English
Published: Nature Portfolio 2024-01-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-024-51699-z
Description
Summary:Abstract We validated a Deep Embedded Clustering (DEC) model and its adaptation for integrating mixed datatypes (in this study, numerical and categorical variables). Deep Embedded Clustering (DEC) is a promising technique capable of managing extensive sets of variables and non-linear relationships. Nevertheless, DEC cannot adequately handle mixed datatypes. Therefore, we adapted DEC by replacing the autoencoder with an X-shaped variational autoencoder (XVAE) and optimising hyperparameters for cluster stability. We call this model “X-DEC”. We compared DEC and X-DEC by reproducing a previous study that used DEC to identify clusters in a population of intensive care patients. We assessed internal validity based on cluster stability on the development dataset. Since generalisability of clustering models has insufficiently been validated on external populations, we assessed external validity by investigating cluster generalisability onto an external validation dataset. We concluded that both DEC and X-DEC resulted in clinically recognisable and generalisable clusters, but X-DEC produced much more stable clusters.
ISSN:2045-2322