Inducing high energy-latency of large vision-language models with verbose images

Inducing high energy-latency of large vision-language models with verbose images

Large vision-language models (VLMs) such as GPT-4 have achieved exceptional performance across various multi-modal tasks. However, the deployment of VLMs necessitates substantial energy consumption and computational resources. Once attackers maliciously induce high energy consumption and latency tim...

Descrizione completa

Dettagli Bibliografici
Autori principali:	Gao, K, Bai, Y, Gu, J, Xia, ST, Torr, P, Li, Z, Liu, W
Natura:	Conference item
Lingua:	English
Pubblicazione:	OpenReview 2024

Documenti analoghi

Energy-latency manipulation of multi-modal large language models via verbose samples
di: Gao, K, et al.
Pubblicazione: (2024)

The verbosity epidemic.
di: Grais, R, et al.
Pubblicazione: (2008)

Evaluation of Rust code verbosity, understandability and complexity
di: Luca Ardito, et al.
Pubblicazione: (2021-02-01)

Head Concepts Selection for Verbose Medical Queries Expansion
di: Mohammed Maree, et al.
Pubblicazione: (2020-01-01)

The Role of Inhibition in Age-Related Off-Topic Verbosity: Not Access but Deletion and Restraint Functions
di: Shufei eYin, et al.
Pubblicazione: (2016-04-01)

Let the Customers Speak Their Hearts Out: The Role of Verbosity and Emotions in Online Viewer-to-Viewer Engagement
di: Fahad Mansoor Pasha, et al.
Pubblicazione: (2025-01-01)

Review of Verbosity and Description in the Sahifeh Sajjadieh Translation according to Antoine Berman Theory (Case Study: Ansaryan’s Translation)
di: mohamad farhadei, et al.
Pubblicazione: (2017-09-01)

LAVT: Language-Aware Vision Transformer for referring image segmentation
di: Yang, Z, et al.
Pubblicazione: (2022)

An image is worth 1000 lies: adversarial transferability across prompts on vision-language models
di: Luo, H, et al.
Pubblicazione: (2024)

Benchmarking robustness of adaptation methods on pre-trained vision-language models
di: Chen, S, et al.
Pubblicazione: (2024)

Language matters: a weakly SupervisedVision-Language pre-training approach for scene text detection and spotting
di: Xue, C, et al.
Pubblicazione: (2022)

Language-aware vision transformer for referring segmentation
di: Yang, Z, et al.
Pubblicazione: (2024)

Reducing Compilation Latency in the Julia Programming Language
di: Chintalapudi, Prem
Pubblicazione: (2023)

Latency-aware blockage prediction in vision-aided federated wireless networks
di: Ahsan Raza Khan, et al.
Pubblicazione: (2023-02-01)

Energy-Optimal Latency-Constrained Application Offloading in Mobile-Edge Computing
di: Xiaohui Gu, et al.
Pubblicazione: (2020-05-01)

Assessing the Utility of Multimodal Large Language Models (GPT-4 Vision and Large Language and Vision Assistant) in Identifying Melanoma Across Different Skin Tones
di: Katrina Cirone, et al.
Pubblicazione: (2024-03-01)

A Highly Parallel DRAM Architecture to Mitigate Large Access Latency and Improve Energy Efficiency of Modern DRAM Systems
di: Tareq A. Alawneh, et al.
Pubblicazione: (2024-01-01)

Person re-identification based on large vision-language model
di: Ding, Songyu
Pubblicazione: (2024)

Latency hiding in consistent, large scale, distributed virtual environments
di: Du, Jiang.
Pubblicazione: (2008)

Combining Unity with machine vision to create low latency, flexible and simple virtual realities
di: Yuri Ogawa, et al.
Pubblicazione: (2025-01-01)

uCAP: an unsupervised prompting method for vision-language models
di: Nguyen, AT, et al.
Pubblicazione: (2024)

Energy- and Latency-Aware Hybrid Offloading Algorithm for UAVs
di: Abdelhamied A. Ashraf Ateya, et al.
Pubblicazione: (2019-01-01)

Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
di: Anjus George, et al.
Pubblicazione: (2021-01-01)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
di: Wang, Da, et al.
Pubblicazione: (2021)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
di: Wang, Da, et al.
Pubblicazione: (2021)

A Low Latency Clustering Method for Large-Scale Drone Swarms
di: Xiaopan Zhu, et al.
Pubblicazione: (2019-01-01)

An empirical study on adaptation methods for large-scale vision-language models
di: Wang, Annan
Pubblicazione: (2023)

Insightful visions – Artificial intelligence large language models in scientific writing
di: John D Akkara
Pubblicazione: (2024-01-01)

MRONoC: A Low Latency and Energy Efficient on Chip Optical Interconnect Architecture
di: Huaxi Gu, et al.
Pubblicazione: (2017-01-01)

Rethinking visual prompting for multimodal large language models with external knowledge
di: Lin, Y, et al.
Pubblicazione: (2024)

A Low-Latency and Energy-Efficient Neighbor Discovery Algorithm for Wireless Sensor Networks
di: Zhaoquan Gu, et al.
Pubblicazione: (2020-01-01)

New Concepts in Therapeutic Manipulation of HIV-1 Transcription and Latency: Latency Reversal versus Latency Prevention
di: Catherine A. Lewis, et al.
Pubblicazione: (2023-07-01)

ROBUST VISION
di: Torr, P, et al.
Pubblicazione: (1994)

Towards interpretable sequence continuation: analyzing shared circuits in large language models
di: Lan, M, et al.
Pubblicazione: (2024)

Developmental context determines latency of MYC-induced tumorigenesis.
di: Shelly Beer, et al.
Pubblicazione: (2004-11-01)

Language of vision /
di: 434196 Kepes, Gyorgy
Pubblicazione: (1959)

Low-Latency Networking: Where Latency Lurks and How to Tame It
di: Modiano, Eytan H
Pubblicazione: (2020)

Terminal latency index, residual latency, and median-ulnar F-wave latency difference in carpal tunnel syndrome
di: Aslihan Uzunkulaoglu, et al.
Pubblicazione: (2019-01-01)

Energy-latency tradeoff for in-network function computation in random networks
di: Balister, Paul, et al.
Pubblicazione: (2012)

Analysis of Latency Performance of Bluetooth Low Energy (BLE) Networks
di: Keuchul Cho, et al.
Pubblicazione: (2014-12-01)