Efficient inference offloading for mixture-of-experts large language models in internet of medical things

Efficient inference offloading for mixture-of-experts large language models in internet of medical things

Despite recent significant advancements in large language models (LLMs) for medical services, the deployment difficulties of LLMs in e-healthcare hinder complex medical applications in the Internet of Medical Things (IoMT). People are increasingly concerned about e-healthcare risks and privacy prote...

Full description

Bibliographic Details
Main Authors: Yuan, Xiaoming, Kong, Weixuan, Luo, Zhenyu, Xu, Minrui
Other Authors: School of Computer Science and Engineering
Format: Journal Article
Language:English
Published: 2024
Subjects:
Computer and Information Science
Large language models
Efficient inference offloading
Online Access:https://hdl.handle.net/10356/179743

Internet

https://hdl.handle.net/10356/179743

Similar Items