Inducing high energy-latency of large vision-language models with verbose images

Inducing high energy-latency of large vision-language models with verbose images

Large vision-language models (VLMs) such as GPT-4 have achieved exceptional performance across various multi-modal tasks. However, the deployment of VLMs necessitates substantial energy consumption and computational resources. Once attackers maliciously induce high energy consumption and latency tim...

Bibliografske podrobnosti
Main Authors:	Gao, K, Bai, Y, Gu, J, Xia, ST, Torr, P, Li, Z, Liu, W
Format:	Conference item
Jezik:	English
Izdano:	OpenReview 2024

Podobne knjige/članki

Energy-latency manipulation of multi-modal large language models via verbose samples
od: Gao, K, et al.
Izdano: (2024)

The verbosity epidemic.
od: Grais, R, et al.
Izdano: (2008)

Evaluation of Rust code verbosity, understandability and complexity
od: Luca Ardito, et al.
Izdano: (2021-02-01)

Head Concepts Selection for Verbose Medical Queries Expansion
od: Mohammed Maree, et al.
Izdano: (2020-01-01)

The Role of Inhibition in Age-Related Off-Topic Verbosity: Not Access but Deletion and Restraint Functions
od: Shufei eYin, et al.
Izdano: (2016-04-01)

Let the Customers Speak Their Hearts Out: The Role of Verbosity and Emotions in Online Viewer-to-Viewer Engagement
od: Fahad Mansoor Pasha, et al.
Izdano: (2025-01-01)

Review of Verbosity and Description in the Sahifeh Sajjadieh Translation according to Antoine Berman Theory (Case Study: Ansaryan’s Translation)
od: mohamad farhadei, et al.
Izdano: (2017-09-01)

LAVT: Language-Aware Vision Transformer for referring image segmentation
od: Yang, Z, et al.
Izdano: (2022)

An image is worth 1000 lies: adversarial transferability across prompts on vision-language models
od: Luo, H, et al.
Izdano: (2024)

Benchmarking robustness of adaptation methods on pre-trained vision-language models
od: Chen, S, et al.
Izdano: (2024)

Language matters: a weakly SupervisedVision-Language pre-training approach for scene text detection and spotting
od: Xue, C, et al.
Izdano: (2022)

Language-aware vision transformer for referring segmentation
od: Yang, Z, et al.
Izdano: (2024)

Reducing Compilation Latency in the Julia Programming Language
od: Chintalapudi, Prem
Izdano: (2023)

Latency-aware blockage prediction in vision-aided federated wireless networks
od: Ahsan Raza Khan, et al.
Izdano: (2023-02-01)

Energy-Optimal Latency-Constrained Application Offloading in Mobile-Edge Computing
od: Xiaohui Gu, et al.
Izdano: (2020-05-01)

Assessing the Utility of Multimodal Large Language Models (GPT-4 Vision and Large Language and Vision Assistant) in Identifying Melanoma Across Different Skin Tones
od: Katrina Cirone, et al.
Izdano: (2024-03-01)

A Highly Parallel DRAM Architecture to Mitigate Large Access Latency and Improve Energy Efficiency of Modern DRAM Systems
od: Tareq A. Alawneh, et al.
Izdano: (2024-01-01)

Person re-identification based on large vision-language model
od: Ding, Songyu
Izdano: (2024)

uCAP: an unsupervised prompting method for vision-language models
od: Nguyen, AT, et al.
Izdano: (2024)

Latency hiding in consistent, large scale, distributed virtual environments
od: Du, Jiang.
Izdano: (2008)

Combining Unity with machine vision to create low latency, flexible and simple virtual realities
od: Yuri Ogawa, et al.
Izdano: (2025-01-01)

Energy- and Latency-Aware Hybrid Offloading Algorithm for UAVs
od: Abdelhamied A. Ashraf Ateya, et al.
Izdano: (2019-01-01)

An empirical study on adaptation methods for large-scale vision-language models
od: Wang, Annan
Izdano: (2023)

Insightful visions – Artificial intelligence large language models in scientific writing
od: John D Akkara
Izdano: (2024-01-01)

Rethinking visual prompting for multimodal large language models with external knowledge
od: Lin, Y, et al.
Izdano: (2024)

Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
od: Anjus George, et al.
Izdano: (2021-01-01)

MRONoC: A Low Latency and Energy Efficient on Chip Optical Interconnect Architecture
od: Huaxi Gu, et al.
Izdano: (2017-01-01)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
od: Wang, Da, et al.
Izdano: (2021)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
od: Wang, Da, et al.
Izdano: (2021)

A Low Latency Clustering Method for Large-Scale Drone Swarms
od: Xiaopan Zhu, et al.
Izdano: (2019-01-01)

Towards interpretable sequence continuation: analyzing shared circuits in large language models
od: Lan, M, et al.
Izdano: (2024)

ROBUST VISION
od: Torr, P, et al.
Izdano: (1994)

A Low-Latency and Energy-Efficient Neighbor Discovery Algorithm for Wireless Sensor Networks
od: Zhaoquan Gu, et al.
Izdano: (2020-01-01)

New Concepts in Therapeutic Manipulation of HIV-1 Transcription and Latency: Latency Reversal versus Latency Prevention
od: Catherine A. Lewis, et al.
Izdano: (2023-07-01)

Language of vision /
od: 434196 Kepes, Gyorgy
Izdano: (1959)

Developmental context determines latency of MYC-induced tumorigenesis.
od: Shelly Beer, et al.
Izdano: (2004-11-01)

Without Latency
od: Hulbert, Adam
Izdano: (2015-09-01)

Energy-latency tradeoff for in-network function computation in random networks
od: Balister, Paul, et al.
Izdano: (2012)

Analysis of Latency Performance of Bluetooth Low Energy (BLE) Networks
od: Keuchul Cho, et al.
Izdano: (2014-12-01)

Enabling intelligence in fog computing to achieve energy and latency reduction
od: Quang Duy La, et al.
Izdano: (2019-02-01)