o:2376 Measure of Similarity between GMMs Based on Autoencoder-Generated Gaussian Component Representations en ABSTRACT A novel similarity measure between Gaussian mixture models (GMMs), based on similar- ities between the low-dimensional representations of individual GMM components and obtained using deep autoencoder architectures, is proposed in this paper. Two different approaches built upon these architectures are explored and utilized to obtain low-dimensional representations of Gaussian components in GMMs. The first approach relies on a classical autoencoder, utilizing the Euclidean norm cost function. Vectorized upper-diagonal symmetric positive definite (SPD) matrices corresponding to Gaussian components in particular GMMs are used as inputs to the autoencoder. Low-dimensional Euclidean vectors obtained from the autoencoder’s middle layer are then used to calculate distances among the original GMMs. The second approach relies on a deep convolutional neural network (CNN) autoencoder, using SPD representatives to generate embeddings correspond- ing to multivariate GMM components given as inputs. As the autoencoder training cost function, the Frobenious norm between the input and output layers of such network is used and combined with regularizer terms in the form of various pieces of information, as well as the Riemannian manifold-based distances between SPD representatives corresponding to the computed autoencoder feature maps. This is performed assuming that the underlying probability density functions (PDFs) of feature-map observations are multivariate Gaussians. By employing the proposed method, a significantly better trade-off between the recognition accuracy and the computational complexity is achieved when compared with other measures calculating distances among the SPD representatives of the original Gaussian components. The proposed method is much more efficient in machine learning tasks employing GMMs and operating on large datasets that require a large overall number of Gaussian components. Gaussian mixture models; autoencoders; KL divergence; classification; machine learning 1552099 10.3390/axioms12060535 2023-06-20T12:47:34.344Z 44 no 46 Vladimir Kalušev The Institute for Artificial Intelligence Research and Development of Serbia, Novi Sad, Serbia 0009-0005-8851-5790 46 Branislav Popović Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia 0000-0002-5413-1028 46 Marko Janev Institute of Mathematics, Serbian Academy of Sciences and Arts, Belgrade, Serbia 46 Branko Brkljač Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia 0000-0001-7932-6676 46 Nebojša Ralević Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia application/pdf 627040 https://unilib.phaidrabg.rs/o:2376 no yes 1 70 92000001 71A08 Axioms 2023