Linkun
hugg1ngfac3
AI & ML interests
None yet
Recent Activity
updated a model 1 day ago
hugg1ngfac3/gemma-4-31B-it-FP8 published a model 1 day ago
hugg1ngfac3/gemma-4-31B-it-FP8 updated a model 1 day ago
hugg1ngfac3/gemma-4-26B-A4B-it-FP8Organizations
-
Speculative Streaming: Fast LLM Inference without Auxiliary Models
Paper • 2402.11131 • Published • 42 -
Ouroboros: Speculative Decoding with Large Model Enhanced Drafting
Paper • 2402.13720 • Published • 7 -
Recurrent Drafter for Fast Speculative Decoding in Large Language Models
Paper • 2403.09919 • Published • 22 -
On Speculative Decoding for Multimodal Large Language Models
Paper • 2404.08856 • Published • 13
-
Speculative Streaming: Fast LLM Inference without Auxiliary Models
Paper • 2402.11131 • Published • 42 -
Ouroboros: Speculative Decoding with Large Model Enhanced Drafting
Paper • 2402.13720 • Published • 7 -
Recurrent Drafter for Fast Speculative Decoding in Large Language Models
Paper • 2403.09919 • Published • 22 -
On Speculative Decoding for Multimodal Large Language Models
Paper • 2404.08856 • Published • 13
datasets 0
None public yet