AI Ekphrasis: Multi-Modal Learning with Foundation Models for Fine-Grained Poetry Retrieval

AI Ekphrasis: Multi-Modal Learning with Foundation Models for Fine-Grained Poetry Retrieval

Artificial intelligence research in natural language processing in the context of poetry struggles with the recognition of holistic content such as poetic symbolism, metaphor, and other fine-grained attributes. Given these challenges, multi-modal image–poetry reasoning and retrieval remain largely u...

Full description

Bibliographic Details
Main Authors:	Muhammad Shahid Jabbar, Jitae Shin, Jun-Dong Cho
Format:	Article
Language:	English
Published:	MDPI AG 2022-04-01
Series:	Electronics
Subjects:	image-based poetry retrieval fine-grained attribute recognition accessibility multi-modal attention cross-encoder
Online Access:	https://www.mdpi.com/2079-9292/11/8/1275

Similar Items

Deep Self-Supervised Hashing With Fine-Grained Similarity Mining for Cross-Modal Retrieval
by: Lijun Han, et al.
Published: (2024-01-01)

A Fine-Grained Semantic Alignment Method Specific to Aggregate Multi-Scale Information for Cross-Modal Remote Sensing Image Retrieval
by: Fuzhong Zheng, et al.
Published: (2023-10-01)

Fine-Grained Retrieval Method of Textile Image
by: Shutao Tan, et al.
Published: (2023-01-01)

A review of fine-grained sketch image retrieval based on deep learning
by: Qing Luo, et al.
Published: (2023-12-01)

Attribute-Guided Multi-Level Attention Network for Fine-Grained Fashion Retrieval
by: Ling Xiao, et al.
Published: (2024-01-01)

A Fusion Encoder with Multi-Task Guidance for Cross-Modal Text–Image Retrieval in Remote Sensing
by: Xiong Zhang, et al.
Published: (2023-09-01)

High‐level feature aggregation for fine‐grained architectural floor plan retrieval
by: Divya Sharma, et al.
Published: (2018-08-01)

A Novel Semantics-Preserving Hashing for Fine-Grained Image Retrieval
by: Han Sun, et al.
Published: (2020-01-01)

The poetry generator
by: Shafran, Joan K.
Published: (2013)

The State of the Art for Cross-Modal Retrieval: A Survey
by: Kun Zhou, et al.
Published: (2023-01-01)

Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval
by: Guoyou Li, et al.
Published: (2023-04-01)

A Framework for Enabling Unpaired Multi-Modal Learning for Deep Cross-Modal Hashing Retrieval
by: Mikel Williams-Lekuona, et al.
Published: (2022-12-01)

An Efficient Retrieval System Framework for Fabrics Based on Fine-Grained Similarity
by: Jun Xiang, et al.
Published: (2022-09-01)

Deep Multi-Modal Metric Learning with Multi-Scale Correlation for Image-Text Retrieval
by: Yan Hua, et al.
Published: (2020-03-01)

Exploring latent weight factors and global information for food-oriented cross-modal retrieval
by: Wenyu Zhao, et al.
Published: (2023-12-01)

Deep Hashing Similarity Learning for Cross-Modal Retrieval
by: Ying Ma, et al.
Published: (2024-01-01)

A Cross-Modal Hash Retrieval Method with Fused Triples
by: Wenxiao Li, et al.
Published: (2023-09-01)

Enhancing Cross-Modal Retrieval Based on Modality-Specific and Embedding Spaces
by: Rintaro Yanagi, et al.
Published: (2020-01-01)

Human Brain Dynamics Reflect the Correctness and Presentation Modality of Physics Concept Memory Retrieval
by: Chih-Ping Liang, et al.
Published: (2020-08-01)

Literature Review of Cross-Modal Retrieval Research
by: CHEN Ning, DUAN Youxiang, SUN Qifeng
Published: (2021-08-01)

Survey of Research Progress on Cross-modal Retrieval
by: FENG Xia, HU Zhi-yi, LIU Cai-hua
Published: (2021-08-01)

Cross-Modal Retrieval via Similarity-Preserving Learning and Semantic Average Embedding
by: Tao Zhi, et al.
Published: (2020-01-01)

Recallable Question Answering-Based Re-Ranking Considering Semantic Region for Cross-Modal Retrieval
by: Rintaro Yanagi, et al.
Published: (2023-01-01)

Pilgrimage ekphrasis: “The Annunciation” by Lydia Alexeeva
by: Markov Alexander Viktorovich
Published: (2022-10-01)

Learning Adequate Alignment and Interaction for Cross-Modal Retrieval
by: MingKang Wang, et al.
Published: (2023-12-01)

Discrete Robust Supervised Hashing for Cross-Modal Retrieval
by: Tao Yao, et al.
Published: (2019-01-01)

Intuitively Searching for the Rare Colors from Digital Artwork Collections by Text Description: A Case Demonstration of Japanese Ukiyo-e Print Retrieval
by: Kangying Li, et al.
Published: (2022-07-01)

Supervised Intra- and Inter-Modality Similarity Preserving Hashing for Cross-Modal Retrieval
by: Zhikui Chen, et al.
Published: (2018-01-01)

Paired cross-modal data augmentation for fine-grained image-to-text retrieval
by: Wang, Hao, et al.
Published: (2023)

Image–Text Cross-Modal Retrieval with Instance Contrastive Embedding
by: Ruigeng Zeng, et al.
Published: (2024-01-01)

Deep Label Feature Fusion Hashing for Cross-Modal Retrieval
by: Dongxiao Ren, et al.
Published: (2022-01-01)

Multi-Granularity Semantic Information Integration Graph for Cross-Modal Hash Retrieval
by: Zhichao Han, et al.
Published: (2024-01-01)

Cross-Modal Image Retrieval Considering Semantic Relationships With Many-to-Many Correspondence Loss
by: Huaying Zhang, et al.
Published: (2023-01-01)

Revisiting Local Descriptors via Frequent Pattern Mining for Fine-Grained Image Retrieval
by: Min Zheng, et al.
Published: (2022-01-01)

Deep Semantic Cross Modal Hashing Based on Graph Similarity of Modal-Specific
by: Junzheng Li
Published: (2021-01-01)

Object-Level Visual-Text Correlation Graph Hashing for Unsupervised Cross-Modal Retrieval
by: Ge Shi, et al.
Published: (2022-04-01)

Semantic Consistency Cross-Modal Retrieval With Semi-Supervised Graph Regularization
by: Gongwen Xu, et al.
Published: (2020-01-01)

Fine-Grained Encrypted Image Retrieval in Cloud Environment
by: Yi-Hui Chen, et al.
Published: (2023-12-01)

EFCMF: A Multimodal Robustness Enhancement Framework for Fine-Grained Recognition
by: Rongping Zou, et al.
Published: (2023-01-01)

Learning a cross-modal hashing network for multimedia search
by: Tan, Yap Peng, et al.
Published: (2018)