Visual Description Augmented Integration Network for Multimodal Entity and Relation Extraction

Visual Description Augmented Integration Network for Multimodal Entity and Relation Extraction

Multimodal Named Entity Recognition (MNER) and multimodal Relationship Extraction (MRE) play an important role in processing multimodal data and understanding entity relationships across textual and visual domains. However, irrelevant image information may introduce noise that misleads the recogniti...

Full description

Bibliographic Details
Main Authors:	Min Zuo, Yingjun Wang, Wei Dong, Qingchuan Zhang, Yuanyuan Cai, Jianlei Kong
Format:	Article
Language:	English
Published:	MDPI AG 2023-05-01
Series:	Applied Sciences
Subjects:	multimodal named entity recognition multimodal relation extraction image description generation visual description augmented integration
Online Access:	https://www.mdpi.com/2076-3417/13/10/6178

Similar Items

Visual Clue Guidance and Consistency Matching Framework for Multimodal Named Entity Recognition
by: Li He, et al.
Published: (2024-03-01)

Named Entity Recognition Datasets: A Classification Framework
by: Ying Zhang, et al.
Published: (2024-03-01)

Probing the Impacts of Visual Context in Multimodal Entity Alignment
by: Meng Wang, et al.
Published: (2023-04-01)

MLNet: a multi-level multimodal named entity recognition architecture
by: Hanming Zhai, et al.
Published: (2023-06-01)

Improving Named Entity Recognition for Social Media with Data Augmentation
by: Wenzhong Liu, et al.
Published: (2023-04-01)

Impact of Video Compression and Multimodal Embedding on Scene Description
by: Jin Young Lee
Published: (2019-08-01)

An Approach for Audio-Visual Content Understanding of Video using Multimodal Deep Learning Methodology
by: İsmet Ünlü, et al.
Published: (2022-08-01)

Pre-Training and Fine-Tuning with Next Sentence Prediction for Multimodal Entity Linking
by: Lu Li, et al.
Published: (2022-07-01)

Named Entity Extraction for Knowledge Graphs: A Literature Overview
by: Tareq Al-Moslmi, et al.
Published: (2020-01-01)

Using Augmented Small Multimodal Models to Guide Large Language Models for Multimodal Relation Extraction
by: Wentao He, et al.
Published: (2023-11-01)

Knowledge Graph Embedding With Interactive Guidance From Entity Descriptions
by: Wen'an Zhou, et al.
Published: (2019-01-01)

Study on Chinese Named Entity Extraction Rules Based on Boundary Location and Correction
by: LIU Pan, GUO Yanming, LEI Jun, LAO Mingrui, LI Guohui
Published: (2023-03-01)

Object Description Using Visual and Tactile Data
by: Peng Zhang, et al.
Published: (2022-01-01)

The use of metaphorical musical terminology for verbal description of music
by: Milena Petrović, et al.
Published: (2018-01-01)

MALAY NAMED ENTITY RECOGNITION USING RULE BASED APPROACH
by: Ulfa Nadia, et al.
Published: (2019-06-01)

ANALYSIS OF MULTIMODAL FUSION TECHNIQUES FOR AUDIO-VISUAL SPEECH RECOGNITION
by: D.V. Ivanko, et al.
Published: (2016-05-01)

Multimodal interaction design and application in augmented reality for chemical experiment
by: Mengting Xiao, et al.
Published: (2020-08-01)

A System for Interviewing and Collecting Statements Based on Intent Classification and Named Entity Recognition Using Augmentation
by: Junho Shin, et al.
Published: (2023-10-01)

Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
by: Hung-Kai Kung, et al.
Published: (2020-06-01)

Multimodal Emotion Recognition and Sentiment Analysis Using Masked Attention and Multimodal Interaction
by: Tatiana Voloshina, et al.
Published: (2023-05-01)

Data Augmentation for Audio-Visual Emotion Recognition with an Efficient Multimodal Conditional GAN
by: Fei Ma, et al.
Published: (2022-01-01)

A Named Entity-Annotated Corpus of 19th Century Classical Commentaries
by: Matteo Romanello, et al.
Published: (2024-01-01)

Simple and Effective Way to Disambiguate and Standardize Patent Applicants Using an Attention Mechanism With Data Augmentation
by: Juhyun Lee, et al.
Published: (2023-01-01)

ChineseCTRE: A Model for Geographical Named Entity Recognition and Correction Based on Deep Neural Networks and the BERT Model
by: Wei Zhang, et al.
Published: (2023-09-01)

Targeted Aspect-Based Multimodal Sentiment Analysis: An Attention Capsule Extraction and Multi-Head Fusion Network
by: Donghong Gu, et al.
Published: (2021-01-01)

Filtered BERT: Similarity Filter-Based Augmentation with Bidirectional Transfer Learning for Protected Health Information Prediction in Clinical Documents
by: Min Kang, et al.
Published: (2021-04-01)

Judicial nested named entity recognition method with MRC framework
by: Hu Zhang, et al.
Published: (2023-06-01)

Evaluation of Named Entity Recognition Algorithms in Short Texts
by: Edgar Casasola Murillo, et al.
Published: (2017-04-01)

Multimodal Art Pose Recognition and Interaction With Human Intelligence Enhancement
by: Chengming Ma, et al.
Published: (2021-11-01)

Incorporating Entity Type-Aware and Word–Word Relation-Aware Attention in Generative Named Entity Recognition
by: Ying Mo, et al.
Published: (2024-04-01)

Chinese Named Entity Recognition Method for Domain-Specific Text
by: He Liu, et al.
Published: (2023-01-01)

A Bidirectional Iterative Algorithm for Nested Named Entity Recognition
by: Slawomir Dadas, et al.
Published: (2020-01-01)

Systematic Literature Review of Information Extraction From Textual Data: Recent Methods, Applications, Trends, and Challenges
by: Mohd Hafizul Afifi Abdullah, et al.
Published: (2023-01-01)

Knowledge Graph Completion Based on Entity Descriptions in Hyperbolic Space
by: Xiaoming Zhang, et al.
Published: (2022-12-01)

Multimodal Sensor-Input Architecture with Deep Learning for Audio-Visual Speech Recognition in Wild
by: Yibo He, et al.
Published: (2023-02-01)

A Survey of Named-Entity Recognition Methods for Food Information Extraction
by: Gorjan Popovski, et al.
Published: (2020-01-01)

A Boundary Assembling Method for Nested Biomedical Named Entity Recognition
by: Yanping Chen, et al.
Published: (2020-01-01)

Entity Linking Method for Chinese Short Text Based on Siamese-Like Network
by: Yang Zhang, et al.
Published: (2022-08-01)

Kaplan and Marti on definite descriptions
by: E. V. Borisov
Published: (2023-12-01)

Descriptive Names, Rigidity, and Direct Reference
by: Filip Kawczyński
Published: (2022-11-01)