Inducing high energy-latency of large vision-language models with verbose images

Inducing high energy-latency of large vision-language models with verbose images

Large vision-language models (VLMs) such as GPT-4 have achieved exceptional performance across various multi-modal tasks. However, the deployment of VLMs necessitates substantial energy consumption and computational resources. Once attackers maliciously induce high energy consumption and latency tim...

Полное описание

Библиографические подробности
Главные авторы:	Gao, K, Bai, Y, Gu, J, Xia, ST, Torr, P, Li, Z, Liu, W
Формат:	Conference item
Язык:	English
Опубликовано:	OpenReview 2024

Схожие документы

Energy-latency manipulation of multi-modal large language models via verbose samples
по: Gao, K, и др.
Опубликовано: (2024)

The verbosity epidemic.
по: Grais, R, и др.
Опубликовано: (2008)

Evaluation of Rust code verbosity, understandability and complexity
по: Luca Ardito, и др.
Опубликовано: (2021-02-01)

Head Concepts Selection for Verbose Medical Queries Expansion
по: Mohammed Maree, и др.
Опубликовано: (2020-01-01)

The Role of Inhibition in Age-Related Off-Topic Verbosity: Not Access but Deletion and Restraint Functions
по: Shufei eYin, и др.
Опубликовано: (2016-04-01)

Let the Customers Speak Their Hearts Out: The Role of Verbosity and Emotions in Online Viewer-to-Viewer Engagement
по: Fahad Mansoor Pasha, и др.
Опубликовано: (2025-01-01)

Review of Verbosity and Description in the Sahifeh Sajjadieh Translation according to Antoine Berman Theory (Case Study: Ansaryan’s Translation)
по: mohamad farhadei, и др.
Опубликовано: (2017-09-01)

LAVT: Language-Aware Vision Transformer for referring image segmentation
по: Yang, Z, и др.
Опубликовано: (2022)

An image is worth 1000 lies: adversarial transferability across prompts on vision-language models
по: Luo, H, и др.
Опубликовано: (2024)

Benchmarking robustness of adaptation methods on pre-trained vision-language models
по: Chen, S, и др.
Опубликовано: (2024)

Language matters: a weakly SupervisedVision-Language pre-training approach for scene text detection and spotting
по: Xue, C, и др.
Опубликовано: (2022)

Language-aware vision transformer for referring segmentation
по: Yang, Z, и др.
Опубликовано: (2024)

Reducing Compilation Latency in the Julia Programming Language
по: Chintalapudi, Prem
Опубликовано: (2023)

Latency-aware blockage prediction in vision-aided federated wireless networks
по: Ahsan Raza Khan, и др.
Опубликовано: (2023-02-01)

Energy-Optimal Latency-Constrained Application Offloading in Mobile-Edge Computing
по: Xiaohui Gu, и др.
Опубликовано: (2020-05-01)

Assessing the Utility of Multimodal Large Language Models (GPT-4 Vision and Large Language and Vision Assistant) in Identifying Melanoma Across Different Skin Tones
по: Katrina Cirone, и др.
Опубликовано: (2024-03-01)

A Highly Parallel DRAM Architecture to Mitigate Large Access Latency and Improve Energy Efficiency of Modern DRAM Systems
по: Tareq A. Alawneh, и др.
Опубликовано: (2024-01-01)

Person re-identification based on large vision-language model
по: Ding, Songyu
Опубликовано: (2024)

Latency hiding in consistent, large scale, distributed virtual environments
по: Du, Jiang.
Опубликовано: (2008)

Combining Unity with machine vision to create low latency, flexible and simple virtual realities
по: Yuri Ogawa, и др.
Опубликовано: (2025-01-01)

uCAP: an unsupervised prompting method for vision-language models
по: Nguyen, AT, и др.
Опубликовано: (2024)

Energy- and Latency-Aware Hybrid Offloading Algorithm for UAVs
по: Abdelhamied A. Ashraf Ateya, и др.
Опубликовано: (2019-01-01)

Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
по: Anjus George, и др.
Опубликовано: (2021-01-01)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
по: Wang, Da, и др.
Опубликовано: (2021)

Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
по: Wang, Da, и др.
Опубликовано: (2021)

A Low Latency Clustering Method for Large-Scale Drone Swarms
по: Xiaopan Zhu, и др.
Опубликовано: (2019-01-01)

An empirical study on adaptation methods for large-scale vision-language models
по: Wang, Annan
Опубликовано: (2023)

Insightful visions – Artificial intelligence large language models in scientific writing
по: John D Akkara
Опубликовано: (2024-01-01)

MRONoC: A Low Latency and Energy Efficient on Chip Optical Interconnect Architecture
по: Huaxi Gu, и др.
Опубликовано: (2017-01-01)

Rethinking visual prompting for multimodal large language models with external knowledge
по: Lin, Y, и др.
Опубликовано: (2024)

A Low-Latency and Energy-Efficient Neighbor Discovery Algorithm for Wireless Sensor Networks
по: Zhaoquan Gu, и др.
Опубликовано: (2020-01-01)

New Concepts in Therapeutic Manipulation of HIV-1 Transcription and Latency: Latency Reversal versus Latency Prevention
по: Catherine A. Lewis, и др.
Опубликовано: (2023-07-01)

ROBUST VISION
по: Torr, P, и др.
Опубликовано: (1994)

Towards interpretable sequence continuation: analyzing shared circuits in large language models
по: Lan, M, и др.
Опубликовано: (2024)

Developmental context determines latency of MYC-induced tumorigenesis.
по: Shelly Beer, и др.
Опубликовано: (2004-11-01)

Language of vision /
по: 434196 Kepes, Gyorgy
Опубликовано: (1959)

Low-Latency Networking: Where Latency Lurks and How to Tame It
по: Modiano, Eytan H
Опубликовано: (2020)

Terminal latency index, residual latency, and median-ulnar F-wave latency difference in carpal tunnel syndrome
по: Aslihan Uzunkulaoglu, и др.
Опубликовано: (2019-01-01)

Energy-latency tradeoff for in-network function computation in random networks
по: Balister, Paul, и др.
Опубликовано: (2012)

Analysis of Latency Performance of Bluetooth Low Energy (BLE) Networks
по: Keuchul Cho, и др.
Опубликовано: (2014-12-01)