Online clustered codebook
Vector Quantisation (VQ) is experiencing a comeback in machine learning, where it is increasingly used in representation learning. However, optimizing the codevectors in existing VQ-VAE is not entirely trivial. A problem is codebook collapse, where only a small subset of codevectors receive gradient...
| Main Authors: | , |
|---|---|
| Format: | Internet publication |
| Language: | English |
| Published: |
2023
|