Quantum-probabilistic SVD: complex-valued factorization of matrix data

The paper reports a method for compressed representation of matrix data on the principles of quantum theory. The method is formalized as complex-valued matrix factorization based on standard singular value decomposition. The developed approach establishes a bridge between standard methods of semanti...

Full description

Bibliographic Details
Main Authors: Shyju Kozhisseri, Ilya A. Surov
Format: Article
Language:English
Published: Saint Petersburg National Research University of Information Technologies, Mechanics and Optics (ITMO University) 2022-06-01
Series:Naučno-tehničeskij Vestnik Informacionnyh Tehnologij, Mehaniki i Optiki
Subjects:
Online Access:https://ntv.ifmo.ru/file/article/21273.pdf
_version_ 1811240580107206656
author Shyju Kozhisseri
Ilya A. Surov
author_facet Shyju Kozhisseri
Ilya A. Surov
author_sort Shyju Kozhisseri
collection DOAJ
description The paper reports a method for compressed representation of matrix data on the principles of quantum theory. The method is formalized as complex-valued matrix factorization based on standard singular value decomposition. The developed approach establishes a bridge between standard methods of semantic data analysis and quantum models of cognition and decision. According to the quantum theory, real-valued observable quantities are generated by wavefunctions being complex-valued vectors in multidimensional Hilbert-space. Wavefunctions are defined as superpositions of basis vectors encoding composition of semantic factors. Basis vectors are found by singular value decomposition of the initial data matrix transformed to a real-valued amplitude form. Phase-dependent superposition amplitudes are found to optimize approximation of the source data. The resulting model represents the observed real-valued data as generated from a small number of basis wavefunctions superposed with complex-valued coefficients. The method is tested for random matrices of sizes from 3 × 3 to 12 × 12 and dimensionality of latent Hilbert-space from 2 to 4. The best approximation is achieved by encoding latent factors in normalized complex-valued amplitude vectors interpreted as wavefunctions generating the data. In terms of approximation fitness, the developed method surpasses standard truncated SVD of the same dimensionality. The mean advantage over the considered range of parameters is 22 %. The method permits cognitive interpretation in accord with the existing quantum models of cognition and decision. The method can be integrated in the algorithms of semantic data analysis including natural language processing. In these tasks, the obtained improvement of approximation translates to the increased precision of similarity measures, principal component analysis, advantage in classification, and document ranking methods. Integration with quantum models of cognition and decision is expected to boost methods of artificial intelligence and machine learning improving imitation of natural thinking.
first_indexed 2024-04-12T13:22:44Z
format Article
id doaj.art-35c47064119d4ed190e2d71e218ceb9c
institution Directory Open Access Journal
issn 2226-1494
2500-0373
language English
last_indexed 2024-04-12T13:22:44Z
publishDate 2022-06-01
publisher Saint Petersburg National Research University of Information Technologies, Mechanics and Optics (ITMO University)
record_format Article
series Naučno-tehničeskij Vestnik Informacionnyh Tehnologij, Mehaniki i Optiki
spelling doaj.art-35c47064119d4ed190e2d71e218ceb9c2022-12-22T03:31:25ZengSaint Petersburg National Research University of Information Technologies, Mechanics and Optics (ITMO University)Naučno-tehničeskij Vestnik Informacionnyh Tehnologij, Mehaniki i Optiki2226-14942500-03732022-06-0122356757310.17586/2226-1494-2022-22-3-567-573Quantum-probabilistic SVD: complex-valued factorization of matrix dataShyju Kozhisseri0https://orcid.org/0000-0002-0212-6833Ilya A. Surov1https://orcid.org/0000-0001-5690-7507Student, ITMO University, Saint Petersburg, 197101, Russian FederationPhD (Physics & Mathematics), Senior Researcher, ITMO University, Saint Petersburg, 197101, Russian Federation, sc 57219761715The paper reports a method for compressed representation of matrix data on the principles of quantum theory. The method is formalized as complex-valued matrix factorization based on standard singular value decomposition. The developed approach establishes a bridge between standard methods of semantic data analysis and quantum models of cognition and decision. According to the quantum theory, real-valued observable quantities are generated by wavefunctions being complex-valued vectors in multidimensional Hilbert-space. Wavefunctions are defined as superpositions of basis vectors encoding composition of semantic factors. Basis vectors are found by singular value decomposition of the initial data matrix transformed to a real-valued amplitude form. Phase-dependent superposition amplitudes are found to optimize approximation of the source data. The resulting model represents the observed real-valued data as generated from a small number of basis wavefunctions superposed with complex-valued coefficients. The method is tested for random matrices of sizes from 3 × 3 to 12 × 12 and dimensionality of latent Hilbert-space from 2 to 4. The best approximation is achieved by encoding latent factors in normalized complex-valued amplitude vectors interpreted as wavefunctions generating the data. In terms of approximation fitness, the developed method surpasses standard truncated SVD of the same dimensionality. The mean advantage over the considered range of parameters is 22 %. The method permits cognitive interpretation in accord with the existing quantum models of cognition and decision. The method can be integrated in the algorithms of semantic data analysis including natural language processing. In these tasks, the obtained improvement of approximation translates to the increased precision of similarity measures, principal component analysis, advantage in classification, and document ranking methods. Integration with quantum models of cognition and decision is expected to boost methods of artificial intelligence and machine learning improving imitation of natural thinking.https://ntv.ifmo.ru/file/article/21273.pdfquantum probabilitycognitive modelingsemantic analysiswavefunctionmatrix decomposition
spellingShingle Shyju Kozhisseri
Ilya A. Surov
Quantum-probabilistic SVD: complex-valued factorization of matrix data
Naučno-tehničeskij Vestnik Informacionnyh Tehnologij, Mehaniki i Optiki
quantum probability
cognitive modeling
semantic analysis
wavefunction
matrix decomposition
title Quantum-probabilistic SVD: complex-valued factorization of matrix data
title_full Quantum-probabilistic SVD: complex-valued factorization of matrix data
title_fullStr Quantum-probabilistic SVD: complex-valued factorization of matrix data
title_full_unstemmed Quantum-probabilistic SVD: complex-valued factorization of matrix data
title_short Quantum-probabilistic SVD: complex-valued factorization of matrix data
title_sort quantum probabilistic svd complex valued factorization of matrix data
topic quantum probability
cognitive modeling
semantic analysis
wavefunction
matrix decomposition
url https://ntv.ifmo.ru/file/article/21273.pdf
work_keys_str_mv AT shyjukozhisseri quantumprobabilisticsvdcomplexvaluedfactorizationofmatrixdata
AT ilyaasurov quantumprobabilisticsvdcomplexvaluedfactorizationofmatrixdata