Inducing high energy-latency of large vision-language models with verbose images

Inducing high energy-latency of large vision-language models with verbose images

Large vision-language models (VLMs) such as GPT-4 have achieved exceptional performance across various multi-modal tasks. However, the deployment of VLMs necessitates substantial energy consumption and computational resources. Once attackers maliciously induce high energy consumption and latency tim...

Fuld beskrivelse

Bibliografiske detaljer
Main Authors:	Gao, K, Bai, Y, Gu, J, Xia, ST, Torr, P, Li, Z, Liu, W
Format:	Conference item
Sprog:	English
Udgivet:	OpenReview 2024

Lignende værker

Energy-latency manipulation of multi-modal large language models via verbose samples
af: Gao, K, et al.
Udgivet: (2024)

The verbosity epidemic.
af: Grais, R, et al.
Udgivet: (2008)

Evaluation of Rust code verbosity, understandability and complexity
af: Luca Ardito, et al.
Udgivet: (2021-02-01)

Head Concepts Selection for Verbose Medical Queries Expansion
af: Mohammed Maree, et al.
Udgivet: (2020-01-01)

The Role of Inhibition in Age-Related Off-Topic Verbosity: Not Access but Deletion and Restraint Functions
af: Shufei eYin, et al.
Udgivet: (2016-04-01)

Let the Customers Speak Their Hearts Out: The Role of Verbosity and Emotions in Online Viewer-to-Viewer Engagement
af: Fahad Mansoor Pasha, et al.
Udgivet: (2025-01-01)

Review of Verbosity and Description in the Sahifeh Sajjadieh Translation according to Antoine Berman Theory (Case Study: Ansaryan’s Translation)
af: mohamad farhadei, et al.
Udgivet: (2017-09-01)

LAVT: Language-Aware Vision Transformer for referring image segmentation
af: Yang, Z, et al.
Udgivet: (2022)

An image is worth 1000 lies: adversarial transferability across prompts on vision-language models
af: Luo, H, et al.
Udgivet: (2024)

Benchmarking robustness of adaptation methods on pre-trained vision-language models
af: Chen, S, et al.
Udgivet: (2024)

Language matters: a weakly SupervisedVision-Language pre-training approach for scene text detection and spotting
af: Xue, C, et al.
Udgivet: (2022)

Language-aware vision transformer for referring segmentation
af: Yang, Z, et al.
Udgivet: (2024)

Reducing Compilation Latency in the Julia Programming Language
af: Chintalapudi, Prem
Udgivet: (2023)

Latency-aware blockage prediction in vision-aided federated wireless networks
af: Ahsan Raza Khan, et al.
Udgivet: (2023-02-01)

Energy-Optimal Latency-Constrained Application Offloading in Mobile-Edge Computing
af: Xiaohui Gu, et al.
Udgivet: (2020-05-01)

Assessing the Utility of Multimodal Large Language Models (GPT-4 Vision and Large Language and Vision Assistant) in Identifying Melanoma Across Different Skin Tones
af: Katrina Cirone, et al.
Udgivet: (2024-03-01)

A Highly Parallel DRAM Architecture to Mitigate Large Access Latency and Improve Energy Efficiency of Modern DRAM Systems
af: Tareq A. Alawneh, et al.
Udgivet: (2024-01-01)

Person re-identification based on large vision-language model
af: Ding, Songyu
Udgivet: (2024)

uCAP: an unsupervised prompting method for vision-language models
af: Nguyen, AT, et al.
Udgivet: (2024)

Latency hiding in consistent, large scale, distributed virtual environments
af: Du, Jiang.
Udgivet: (2008)

Combining Unity with machine vision to create low latency, flexible and simple virtual realities
af: Yuri Ogawa, et al.
Udgivet: (2025-01-01)

Energy- and Latency-Aware Hybrid Offloading Algorithm for UAVs
af: Abdelhamied A. Ashraf Ateya, et al.
Udgivet: (2019-01-01)

An empirical study on adaptation methods for large-scale vision-language models
af: Wang, Annan
Udgivet: (2023)

Insightful visions – Artificial intelligence large language models in scientific writing
af: John D Akkara
Udgivet: (2024-01-01)

Rethinking visual prompting for multimodal large language models with external knowledge
af: Lin, Y, et al.
Udgivet: (2024)

Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
af: Anjus George, et al.
Udgivet: (2021-01-01)

MRONoC: A Low Latency and Energy Efficient on Chip Optical Interconnect Architecture
af: Huaxi Gu, et al.
Udgivet: (2017-01-01)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
af: Wang, Da, et al.
Udgivet: (2021)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
af: Wang, Da, et al.
Udgivet: (2021)

A Low Latency Clustering Method for Large-Scale Drone Swarms
af: Xiaopan Zhu, et al.
Udgivet: (2019-01-01)

Towards interpretable sequence continuation: analyzing shared circuits in large language models
af: Lan, M, et al.
Udgivet: (2024)

ROBUST VISION
af: Torr, P, et al.
Udgivet: (1994)

A Low-Latency and Energy-Efficient Neighbor Discovery Algorithm for Wireless Sensor Networks
af: Zhaoquan Gu, et al.
Udgivet: (2020-01-01)

New Concepts in Therapeutic Manipulation of HIV-1 Transcription and Latency: Latency Reversal versus Latency Prevention
af: Catherine A. Lewis, et al.
Udgivet: (2023-07-01)

Language of vision /
af: 434196 Kepes, Gyorgy
Udgivet: (1959)

Developmental context determines latency of MYC-induced tumorigenesis.
af: Shelly Beer, et al.
Udgivet: (2004-11-01)

Without Latency
af: Hulbert, Adam
Udgivet: (2015-09-01)

Energy-latency tradeoff for in-network function computation in random networks
af: Balister, Paul, et al.
Udgivet: (2012)

Analysis of Latency Performance of Bluetooth Low Energy (BLE) Networks
af: Keuchul Cho, et al.
Udgivet: (2014-12-01)

Enabling intelligence in fog computing to achieve energy and latency reduction
af: Quang Duy La, et al.
Udgivet: (2019-02-01)