hugo - Hugo's house of code horror

hugo pushed to main at hugo/DS4Server

2026-09-04 21:27:23 +00:00

bd6353804b Optimize Qwen3.8 inference on Apple silicon

hugo closed issue hugo/DS4Server#98

2026-09-03 20:39:48 +00:00

Add Qwen3.8 Flash Next native MTP speculation

hugo commented on issue hugo/DS4Server#98

2026-09-03 20:39:44 +00:00

Add Qwen3.8 Flash Next native MTP speculation

Implemented in commit bf82df7 (Add native Qwen MTP speculation).

Implementation:

Added the complete Rust Qwen3.8 one-layer MTP graph: four-stream hidden and token projections, full QSA…

hugo pushed to main at hugo/DS4Server

2026-09-03 20:39:02 +00:00

bf82df77cb Add native Qwen MTP speculation

hugo closed issue hugo/DS4Server#97

2026-09-03 19:46:53 +00:00

Implement exact Qwen Sparse Attention and long-context state

hugo pushed to main at hugo/DS4Server

2026-09-03 19:45:50 +00:00

714b39f7f3 Implement exact Qwen sparse attention

hugo reopened issue hugo/DS4Server#97

2026-09-03 19:38:07 +00:00

Implement exact Qwen Sparse Attention and long-context state

hugo closed issue hugo/DS4Server#97

2026-09-03 19:37:53 +00:00

Implement exact Qwen Sparse Attention and long-context state

hugo commented on issue hugo/DS4Server#97

2026-09-03 19:37:49 +00:00

Implement exact Qwen Sparse Attention and long-context state

Implemented and verified in dda70c3 (Implement exact Qwen sparse attention).

Implementation:

Added the official Qwen indexer graph in Rust: one affine 640-wide projection split into four…

hugo pushed to main at hugo/DS4Server

2026-09-03 19:36:41 +00:00

dda70c3793 Implement exact Qwen sparse attention

hugo closed issue hugo/DS4Server#96

2026-09-03 19:13:16 +00:00

Stream Qwen3.8 Flash Next PLE from mapped storage

hugo commented on issue hugo/DS4Server#96

2026-09-03 19:13:12 +00:00

Stream Qwen3.8 Flash Next PLE from mapped storage

Implemented fully in commit 87ccf67 (pushed to origin/main).

Implementation:

Added the official Qwen3.8 Flash Next 2/3-gram PLE hash contract in Rust, including the exact splitmix multipliers,…

hugo pushed to main at hugo/DS4Server

2026-09-03 19:12:31 +00:00

87ccf67d0c Stream Qwen PLE embeddings

hugo closed issue hugo/DS4Server#95

2026-09-03 18:33:05 +00:00

Implement the Qwen3.8 Flash Next Rust and Metal text core

hugo commented on issue hugo/DS4Server#95

2026-09-03 18:32:28 +00:00

Implement the Qwen3.8 Flash Next Rust and Metal text core

Implemented in c414640 (Implement Qwen text core).\n\nThe server now opens the frozen Qwen safetensors set through a dedicated Rust model/executor path and runs the 48-layer 3:1 hybrid text graph…

hugo pushed to main at hugo/DS4Server

2026-09-03 18:32:01 +00:00

c414640050 Implement Qwen text core

hugo closed issue hugo/DS4Server#94

2026-09-03 17:58:16 +00:00

Integrate Qwen3.8 Flash Next loading and tokenizer behavior

hugo commented on issue hugo/DS4Server#94

2026-09-03 17:57:00 +00:00

Integrate Qwen3.8 Flash Next loading and tokenizer behavior

Implemented and verified in commit 3773cfd (Integrate Qwen3.8 model intake).\n\nThe native model catalog and Model Manager now treat the pinned 29-file, 105,438,842,430-byte Bare Speed set as one…

hugo pushed to main at hugo/DS4Server

2026-09-03 17:56:33 +00:00

3773cfda2e Integrate Qwen3.8 model intake

hugo closed issue hugo/DS4Server#93

2026-09-03 17:16:28 +00:00

Prepare exact Qwen3.8 Flash Next Bare Speed artifacts