Post-clustering Inference under Dependency - LAAS - Laboratoire d'Analyse et d'Architecture des Systèmes
Pré-Publication, Document De Travail Année : 2023

Post-clustering Inference under Dependency

Résumé

Recent work by Gao et al. has laid the foundations for post-clustering inference. For the first time, the authors established a theoretical framework allowing to test for differences between means of estimated clusters. Additionally, they studied the estimation of unknown parameters while controlling the selective type I error. However, their theory was developed for independent observations identically distributed as $p$-dimensional Gaussian variables with a spherical covariance matrix. Here, we aim at extending this framework to a more convenient scenario for practical applications, where arbitrary dependence structures between observations and features are allowed. We show that a $p$-value for post-clustering inference under general dependency can be defined, and we assess the theoretical conditions allowing the compatible estimation of a covariance matrix. The theory is developed for hierarchical agglomerative clustering algorithms with several types of linkages, and for the $k$-means algorithm. We illustrate our method with synthetic data and real data of protein structures.
Fichier principal
Vignette du fichier
PCIdep.pdf (1.94 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04250364 , version 1 (19-10-2023)

Licence

Identifiants

Citer

Javier González-Delgado, Juan Cortés, Pierre Neuvial. Post-clustering Inference under Dependency. 2023. ⟨hal-04250364⟩
136 Consultations
26 Téléchargements

Altmetric

Partager

More