{"id":120229,"date":"2026-09-26T02:21:26","date_gmt":"2026-09-26T02:21:26","guid":{"rendered":"https:\/\/youzum.net\/liquid-ai-releases-lfm2-5-vl-3b-dspark-speculative-decoding-for-vision-language-models-with-up-to-3-13x-faster-decoding\/"},"modified":"2026-09-26T02:21:26","modified_gmt":"2026-09-26T02:21:26","slug":"liquid-ai-releases-lfm2-5-vl-3b-dspark-speculative-decoding-for-vision-language-models-with-up-to-3-13x-faster-decoding","status":"publish","type":"post","link":"https:\/\/youzum.net\/zh\/liquid-ai-releases-lfm2-5-vl-3b-dspark-speculative-decoding-for-vision-language-models-with-up-to-3-13x-faster-decoding\/","title":{"rendered":"Liquid AI Releases LFM2.5-VL-3B-DSpark: Speculative Decoding for Vision-Language Models With Up to 3.13x Faster Decoding"},"content":{"rendered":"

Liquid AI has announced<\/a> LFM2.5-VL-3B-DSpark<\/a>, an experimental speculative-decoding draft model for its LFM2.5-VL-3B<\/a> vision-language model. The drafter adds about 280M parameters and speeds up decoding without changing the model\u2019s output. Liquid AI team reports<\/a> up to 3.13x faster decoding on Apple silicon and up to 2.66x on an NVIDIA H100.<\/p>\n

Is it deployable?<\/strong> Yes, Weights are live on Hugging Face in Safetensors and GGUF<\/a>, with day-one support in SGLang, MLX-VLM, and llama.cpp. Liquid AI team labels the release experimental, and it ships under the LFM Open License v1.0<\/a>, which allows free commercial use only for companies under $10M in annual revenue.<\/p>\n

What Speculative Decoding Changes for a VLM<\/strong><\/h2>\n

A standard model generates one token per forward pass. Speculative decoding adds a small drafter that proposes several tokens ahead. The large target model then checks the whole block in one pass and keeps the tokens it agrees with.<\/p>\n

DSpark follows the recipe from Liquid AI\u2019s text-model DSpark drafters<\/a>, described in the DSpark paper<\/a>. The drafter reads the target model\u2019s hidden states from several layers and predicts the next k<\/em> tokens.<\/p>\n

The key design point:<\/strong> modality does not matter to the drafter. By the time tokens reach the hidden layers, text and image patches are both just tensors. So Liquid AI team reuses the exact same inference algorithm for its vision-language model.<\/p>\n

\n

Drafter Architecture and Training<\/strong><\/h2>\n<\/p>

The drafter is a simplified attention-only model. Ablations picked 4 layers and a block size of 9. Liquid AI recommends a block size of 8 or 9 at inference, depending on hardware. Apple silicon runs use 8.<\/p>\n

\n\n\n\n\n\n\n\n\n\n
Component<\/th>\nParameters<\/th>\n<\/tr>\n<\/thead>\n
Decoder stack (4 layers)<\/td>\n193.0M<\/td>\n<\/tr>\n
Hidden-state projection<\/td>\n21.0M<\/td>\n<\/tr>\n
Markov head<\/td>\n65.5M<\/td>\n<\/tr>\n
Norms + confidence head<\/td>\n6.4k<\/td>\n<\/tr>\n
Total<\/strong><\/td>\n279.5M<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n

The embedding and LM head are tied to the target, so the drafter does not carry them. Liquid AI says this raises the deployed parameter count by 8.9%. Training used supervised fine-tuning data covering common vision-language tasks for 10 epochs. All ablations and training ran exclusively on AMD hardware.<\/p>\n

Benchmark Results<\/strong><\/h2>\n

Evaluation follows the MMSpec benchmark<\/a> across 6 task types: General VQA, Text VQA, Image Captioning, Chart VQA, Complex Reasoning, and Multi-turn Conversation. All runs used batch size 1, temperature 0, and 16-bit weights for the vision encoder and backbone. Data was collected on Pipette<\/a>, Liquid AI\u2019s public device-benchmarking infrastructure.<\/p>\n

\n\n\n\n\n\n\n\n
Stack<\/th>\nDecode speedup<\/th>\nEnd-to-end speedup<\/th>\nAccepted tokens per pass<\/th>\n<\/tr>\n<\/thead>\n
MLX-VLM, M5 Max MacBook Pro (block 8)<\/td>\n2.30x to 3.13x<\/td>\n1.56x to 2.62x<\/td>\n3.24 to 4.34<\/td>\n<\/tr>\n
llama.cpp, M3 Ultra (block 8)<\/td>\n1.57x to 2.14x<\/td>\n1.30x to 1.77x<\/td>\n3.31 to 4.50<\/td>\n<\/tr>\n
SGLang, 1x H100 80GB (block 9)<\/td>\n2.04x to 2.66x<\/td>\n1.64x to 2.27x<\/td>\n3.46 to 4.57<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n

The \u2018up to\u2019 decode and end-to-end figures often come from different tasks. On the M5 Max, 3.13x decode is from COCO captioning, while 2.62x end-to-end is from MMMU-Pro.<\/p>\n

Acceptance landed in a similar range on both Apple stacks. Liquid AI reads this as acceptance depending on the drafter and workload, not the runtime.<\/p>\n

At higher concurrency, DSpark kept a throughput advantage at every measured level on a single H100 in SGLang. The gap narrows as concurrency rises.<\/p>\n

Output Quality and Temperature<\/strong><\/h2>\n

Under greedy decoding, the target verifies every proposed token, so output is identical to the base model. At non-zero temperatures with matched sampling, speculative decoding preserves the target\u2019s output distribution, as proven by Leviathan et al.<\/a><\/p>\n

Temperature does affect speed. Higher temperatures spread probability across more candidate tokens, so drafter and target disagree more often. In Liquid AI\u2019s tests, this lowered acceptance and throughput.<\/p>\n

Why End-to-End Gains Are Smaller on Edge<\/strong><\/h2>\n

Speculative decoding only accelerates decoding. Image encoding and prefill run at the same speed. A VLM must encode the image, then process hundreds of visual tokens alongside the prompt.<\/p>\n

On edge devices with less compute than data center GPUs, prefill takes a larger share of latency. Liquid AI frames this as Amdahl\u2019s law: total speedup is bounded by the part left unaccelerated. This explains cases like TextVQA on the M5 Max, where 2.69x faster decoding yields 1.56x end to end.<\/p>\n

How to Run It<\/strong><\/h2>\n

SGLang requires v0.5.19 or newer<\/a>. Launch LiquidAI\/LFM2.5-VL-3B<\/code> with --speculative-algorithm DSPARK<\/code> and point --speculative-draft-model-path<\/code> at the drafter. On Apple silicon, MLX-VLM<\/a> v0.7.2 or newer accepts the drafter through --draft-model<\/code>. DSpark in MLX-VLM currently supports greedy sampling only, so set temperature to 0. For llama.cpp, pair the GGUF drafter with the LFM2.5-VL-3B-GGUF<\/a> target.<\/p>\n

Integration work is public in the llama.cpp<\/a>, SGLang<\/a>, and MLX-VLM<\/a> pull requests. Acceleration of quantized models is outside the scope of this release.<\/p>\n

Key Takeaways<\/strong><\/h2>\n