Concentration or distraction? A synergetic-based attention weights optimization method

Concentration or distraction? A synergetic-based attention weights optimization method

Abstract The attention mechanism empowers deep learning to a broader range of applications, but the contribution of the attention module is highly controversial. Research on modern Hopfield networks indicates that the attention mechanism can also be used in shallow networks. Its automatic sample fil...

Full description

Bibliographic Details
Main Authors:	Zihao Wang, Haifeng Li, Lin Ma, Feng Jiang
Format:	Article
Language:	English
Published:	Springer 2023-06-01
Series:	Complex & Intelligent Systems
Subjects:	Attention Synergetic neural network Recurrent neural network Multiple instance learning Shallow network
Online Access:	https://doi.org/10.1007/s40747-023-01133-0

Similar Items

Attention-Based SeriesNet: An Attention-Based Hybrid Neural Network Model for Conditional Time Series Forecasting
by: Yepeng Cheng, et al.
Published: (2020-06-01)

Modern Synergetic Neural Network for Synthetic Aperture Radar Target Recognition
by: Zihao Wang, et al.
Published: (2023-03-01)

Collaborative Co-Attention Network for Session-Based Recommendation
by: Wanyu Chen, et al.
Published: (2021-06-01)

ATTENTION AND LONG SHORT-TERM MEMORY NETWORK FOR REMAINING USEFUL LIFETIME PREDICTIONS OF TURBOFAN ENGINE DEGRADATION
by: Paulo Roberto de Oliveira da Costa, et al.
Published: (2019-12-01)

CARF-net : CNN attention and RNN fusion network for video-based person reidentification
by: Prasad, Dilip Kumar, et al.
Published: (2019)

Relation Classification via Recurrent Neural Network with Attention and Tensor Layers
by: Runyan Zhang, et al.
Published: (2018-09-01)

Leveraging Attention-Based Convolutional Neural Networks for Meningioma Classification in Computational Histopathology
by: Jannik Sehring, et al.
Published: (2023-10-01)

A Lightweight Attention-Based Network towards Distracted Driving Behavior Recognition
by: Yingcheng Lin, et al.
Published: (2022-04-01)

An attention-based hybrid deep learning approach for bengali video captioning
by: Md. Shahir Zaoad, et al.
Published: (2023-01-01)

A Remote-Sensing Scene-Image Classification Method Based on Deep Multiple-Instance Learning with a Residual Dense Attention ConvNet
by: Xinyu Wang, et al.
Published: (2022-10-01)

Attentional Extractive Summarization
by: José Ángel González, et al.
Published: (2023-01-01)

Photovoltaic Energy Forecast Using Weather Data through a Hybrid Model of Recurrent and Shallow Neural Networks
by: Wilson Castillo-Rojas, et al.
Published: (2023-07-01)

Multiple Instance Learning with Trainable Soft Decision Tree Ensembles
by: Andrei Konstantinov, et al.
Published: (2023-07-01)

A Job Recommendation Model Based on a Two-Layer Attention Mechanism
by: Yu Mao, et al.
Published: (2024-01-01)

A Model Architecture for Public Transport Networks Using a Combination of a Recurrent Neural Network Encoder Library and a Attention Mechanism
by: Thilo Reich, et al.
Published: (2022-09-01)

Wave Loss: A Topographic Metric for Image Segmentation
by: Ákos Kovács, et al.
Published: (2022-06-01)

Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response
by: Zheyu He, et al.
Published: (2023-04-01)

Synergetic basis of marketing innovations
by: I.B. Degtyaryova, et al.
Published: (2010-06-01)

Attention Guided Feature Encoding for Scene Text Recognition
by: Ehtesham Hassan, et al.
Published: (2022-10-01)

A Bidirectional Deep-Learning-Based Spectral Attention Mechanism for Hyperspectral Data Classification
by: Bishwas Praveen, et al.
Published: (2022-01-01)

Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition
by: Zhengyao Wen, et al.
Published: (2023-05-01)

A Deep Ensemble Neural Network with Attention Mechanisms for Lung Abnormality Classification Using Audio Inputs
by: Conor Wall, et al.
Published: (2022-07-01)

A systematic comparison of deep learning methods for EEG time series analysis
by: Dominik Walther, et al.
Published: (2023-02-01)

Unsupervised Image Enhancement Method Based on Attention Map Network Guidance and Attention Mechanism
by: Mengfei Wu, et al.
Published: (2023-04-01)

Remote Sensing Image Scene Classification Based on Head-Tail Global Joint Dual Attention Discrimination Network
by: Lin Wei, et al.
Published: (2023-01-01)

Synergetic and innovative approaches to education
by: Sarkhan Jafarov
Published: (2023-07-01)

ANOMALY DETECTION ON TIME SERIES WITH WASSERSTEIN GAN APPLIED TO PHM
by: Mélanie Ducoffe, et al.
Published: (2019-12-01)

Interactive Attention-Based Convolutional GRU for Aspect Level Sentiment Analysis
by: Lisha Chen, et al.
Published: (2021-07-01)

Graph Neural Network for representation learning of lung cancer
by: Rukhma Aftab, et al.
Published: (2023-10-01)

Cyberbullying Detection in Social Networks Using Bi-GRU with Self-Attention Mechanism
by: Yong Fang, et al.
Published: (2021-04-01)

Improvement of PMSM Sensorless Control Based on Synergetic and Sliding Mode Controllers Using a Reinforcement Learning Deep Deterministic Policy Gradient Agent
by: Marcel Nicola, et al.
Published: (2022-03-01)

Short-Term Load Forecasting Using an Attended Sequential Encoder-Stacked Decoder Model with Online Training
by: Sylwia Henselmeyer, et al.
Published: (2021-05-01)

Long- and Short-Term Preference Modeling Based on Multi-Level Attention for Next POI Recommendation
by: Xueying Wang, et al.
Published: (2022-05-01)

Real-Time Hardware Identification of Complex Dynamical Plant by Artificial Neural Network Based on Experimentally Processed Data by Smart Technologies
by: Valerii I. Kruzhkov, et al.
Published: (2023-06-01)

Personalized Movie Recommendations Based on a Multi-Feature Attention Mechanism with Neural Networks
by: Saisai Yu, et al.
Published: (2023-03-01)

A Robot Pose Estimation Optimized Visual SLAM Algorithm Based on CO-HDC Instance Segmentation Network for Dynamic Scenes
by: Jinjie Chen, et al.
Published: (2022-04-01)

Restoring Raindrops Using Attentive Generative Adversarial Networks
by: Hee-Deok Yang
Published: (2021-07-01)

Recognition Method of Massage Techniques Based on Attention Mechanism and Convolutional Long Short-Term Memory Neural Network
by: Shengding Zhu, et al.
Published: (2022-07-01)

Synergetic effects of network interconnections in the conditions of virtual reality
by: Kraus Kateryna, et al.
Published: (2021-01-01)

A Multi-Purpose Shallow Convolutional Neural Network for Chart Images
by: Filip Bajić, et al.
Published: (2022-10-01)