• Joined on 2026-02-16
hugo opened issue hugo/RuDS#139 2026-09-05 21:32:02 +00:00
check rustpython to see if we can go back to python as scripting language
hugo closed issue hugo/DS4Server#71 2026-09-05 21:29:29 +00:00
add support for a separate vision model (small) to add eyes
hugo commented on issue hugo/DS4Server#71 2026-09-05 21:29:29 +00:00
add support for a separate vision model (small) to add eyes

not needed anymore due to fast vision capable models and ds4 flash exp

hugo closed issue hugo/DS4Server#36 2026-09-05 21:29:00 +00:00
ssd streaming seems to not show enough in the graph
hugo opened issue hugo/DS4Server#100 2026-09-05 21:28:43 +00:00
support deepseek v4 flash vision experimental
hugo pushed to main at hugo/DS4Server 2026-09-05 06:17:10 +00:00
b99ce2aa10 fix for stats and model selection
hugo closed issue hugo/DS4Server#99 2026-09-04 21:28:16 +00:00
Optimize and benchmark Qwen3.8 Flash Next on Apple silicon
hugo commented on issue hugo/DS4Server#99 2026-09-04 21:28:11 +00:00
Optimize and benchmark Qwen3.8 Flash Next on Apple silicon

Implemented and delivered in commit bd63538 (pushed to origin/main).

The Qwen3.8 Flash Next path now follows the pinned MTPLX/MLX execution contract end to end: exact affine QMV/QMM and BF16…

hugo pushed to main at hugo/DS4Server 2026-09-04 21:27:23 +00:00
bd6353804b Optimize Qwen3.8 inference on Apple silicon
hugo closed issue hugo/DS4Server#98 2026-09-03 20:39:48 +00:00
Add Qwen3.8 Flash Next native MTP speculation
hugo commented on issue hugo/DS4Server#98 2026-09-03 20:39:44 +00:00
Add Qwen3.8 Flash Next native MTP speculation

Implemented in commit bf82df7 (Add native Qwen MTP speculation).

Implementation:

  • Added the complete Rust Qwen3.8 one-layer MTP graph: four-stream hidden and token projections, full QSA…
hugo pushed to main at hugo/DS4Server 2026-09-03 20:39:02 +00:00
bf82df77cb Add native Qwen MTP speculation
hugo closed issue hugo/DS4Server#97 2026-09-03 19:46:53 +00:00
Implement exact Qwen Sparse Attention and long-context state
hugo pushed to main at hugo/DS4Server 2026-09-03 19:45:50 +00:00
714b39f7f3 Implement exact Qwen sparse attention
hugo reopened issue hugo/DS4Server#97 2026-09-03 19:38:07 +00:00
Implement exact Qwen Sparse Attention and long-context state
hugo closed issue hugo/DS4Server#97 2026-09-03 19:37:53 +00:00
Implement exact Qwen Sparse Attention and long-context state
hugo commented on issue hugo/DS4Server#97 2026-09-03 19:37:49 +00:00
Implement exact Qwen Sparse Attention and long-context state

Implemented and verified in dda70c3 (Implement exact Qwen sparse attention).

Implementation:

  • Added the official Qwen indexer graph in Rust: one affine 640-wide projection split into four…
hugo pushed to main at hugo/DS4Server 2026-09-03 19:36:41 +00:00
dda70c3793 Implement exact Qwen sparse attention
hugo closed issue hugo/DS4Server#96 2026-09-03 19:13:16 +00:00
Stream Qwen3.8 Flash Next PLE from mapped storage
hugo commented on issue hugo/DS4Server#96 2026-09-03 19:13:12 +00:00
Stream Qwen3.8 Flash Next PLE from mapped storage

Implemented fully in commit 87ccf67 (pushed to origin/main).

Implementation:

  • Added the official Qwen3.8 Flash Next 2/3-gram PLE hash contract in Rust, including the exact splitmix multipliers,…