Compare commits

...
15 Commits
378 changed files with 70890 additions and 1846 deletions

No files matched your search

Generated
+10
View File
@@ -834,6 +834,7 @@ dependencies = [
"shlex",
"time",
"turbovault-parser",
"unicode-normalization-alignments",
"ureq",
"url",
"usvg",
@@ -3948,6 +3949,15 @@ version = "0.1.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3b09c83c3c29d37506a3e260c08c03743a6bb66a9cd432c6934ab501a190571f"
[[package]]
name = "unicode-normalization-alignments"
version = "0.1.12"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "43f613e4fa046e69818dd287fdc4bc78175ff20331479dab6e1b0f98d57062de"
dependencies = [
"smallvec",
]
[[package]]
name = "unicode-properties"
version = "0.1.4"
+1
View File
@@ -35,6 +35,7 @@ sha2 = "0.11.0"
shlex = "2.0.1"
time = { version = "0.3.54", features = ["formatting", "parsing"] }
turbovault-parser = "1.6.0"
unicode-normalization-alignments = "0.1.12"
ureq = { version = "3.3.0", default-features = false, features = ["rustls"] }
url = "2.5.8"
usvg = "0.45.1"
+4
View File
@@ -40,6 +40,10 @@ the Metal kernels and small native integration layers are adapted from
sampling, cancellation, idle unload, and a bounded resident session pool.
Supported acceleration includes SSD expert streaming, DeepSeek legacy MTP,
DSpark, GLM MTP, directional steering, and model-specific memory admission.
- **DeepSeek V4 Flash Vision Experimental.** Model Manager offers the
Vision Experimental main model, required image encoder, and matching DSpark
drafter. Image input works in chat, tool results, and the HTTP APIs, with
image-aware KV reuse. The 0731 drafter is not interchangeable with this model.
- **Local HTTP APIs.** A configurable listener on `127.0.0.1:4000` exposes
Models, Chat Completions, Completions, Anthropic Messages, and Responses APIs
with streaming, tool calls, usage accounting, cancellation, and prefix-aware
+129
View File
@@ -0,0 +1,129 @@
# Issue #100: DeepSeek V4 Flash Vision Experimental
The catalog ID is `deepseek-v4-flash-vision-exp`. The main model and image
encoder are required together, including for text-only use; DSpark uses the
separate Vision-Exp support file. Model Manager verifies both hashes and GGUF
metadata before making the model available. Existing 0731 files remain separate.
The session database migration accepts the new model without changing existing
session IDs or content.
## Reference and architecture
The behavioral oracle is DS4 commit
`0aaea5a238fb41a35106a551e73c8409dfb751ac`. This is existing DS4 functionality;
MTPLX is the Qwen oracle and has no corresponding DeepSeek implementation.
The three GGUF artifacts are pinned by size and SHA256 in `src/model.rs`, from
`antirez/deepseek-v4-gguf` revision
`f71f23d552d664e523b422157b2befbf74040380`. Their required source checkpoint is
`deepseek-ai/DeepSeek-V4-Flash-Vision-Exp` revision
`e46e16bf6035c6f317eb2ac7458eb0362926d402`.
All image decoding, resizing, patch construction, encoder graph execution,
prompt layout, attention-mask construction, model loading, and cache ownership
are Rust. Objective-C only binds Metal buffers and dispatches GPU primitives.
No DS4 C application or Python model implementation is linked, compiled into,
or invoked by the product. The independent Python comparison in
`tools/issue100-vision-reference.py` is test-only.
| Requirement / DS4 behavior | Implementation |
| --- | --- |
| Distinct checkpoint and drafter | Three catalog artifacts; strict revision, variant, tensor inventory, and RMS epsilon checks; wrong drafter/encoder rejection |
| Image preprocessing | EXIF orientation; decoded RGB identity; DS4 bicubic resize, centered padding, 14-pixel channel-major patches, minimum pixels and 381-token pre-alignment budget |
| Vision tower | 32 Rust-dispatched ViT blocks, 2-D RoPE, DS4 BF16 rounding points, 3x3 aligner reorder, GELU projection to 4096 dimensions |
| Image prompt | Position-dependent leading pads, paired-row permutation, newline/pad/end sentinel vectors, synthetic token kinds, whole-image prefill chunks |
| Visual language-model execution | Image embeddings broadcast to all hyperconnection streams, bidirectional image-window attention, causal compressed keys with indexer masks, visual MoE routing biases and ordinary text hash routing |
| Continued conversations | Historical image identity and positions retained with the exact generated token frontier; new images laid out at their actual appended positions |
| Cache safety | Decoded-pixel fingerprints, position/count checks, changed/reordered-image invalidation, resident-session ownership, checkpoint serialization and validation |
| App / API use | Shared model selector, model manager, image/tool-result input, API model ID, reasoning modes, statistics, configuration, and evaluator support |
DeepSeek image identity in DS4Server's disk checkpoints is a DS4Server storage
extension. It validates every serialized image span against the synthetic token
stream before installing the restored state. Other model checkpoint formats
and payloads are unchanged.
## Numerical and regression evidence
The Rust encoder was reviewed operation by operation against
`ds4_gpu_deepseek4_vision_encode`. The reused BF16 matrix bridge is byte-identical
at the function level (SHA256
`621818731c2d43989a8fd08f186d1054ecdb49a91cb1453591f07bc2613d3fef`).
`metal/glm53_bf16.metal` is byte-identical to that DS4 revision (SHA256
`27d93dcfe81b09f93ed65cd986aaa0b9c1ca1df7fc43e58c15da533284d50db5`).
The shared vision kernels used here also match; the reference's unrelated GLM
merger-layernorm barrier change is outside the DeepSeek graph.
The independent published DeepSeek PyTorch encoder comparison on the fixed red
square produces 100x4096 aligned values, cosine similarity 0.99500793, RMSE
0.00568503, and maximum absolute difference 0.10229492. This is not a bitwise
DS4 oracle comparison: the published Python graph uses BF16 module operations,
while DS4 accepts FP32 patches and specifies its own BF16 rounding boundaries.
DS4's operation order and rounding are retained in the Rust graph.
Focused checks include DS4's published image-layout and attention-bound vectors,
image-size limits, real sidecar tensor validation, wrong-checkpoint rejection,
all DeepSeek reasoning modes in image continuations, mixed text/image routing
with exact selected experts and analytical normalized weights, and raw/mixed
attention over a wrapped KV ring with independently computed visible-key means.
The existing real-model 0731 resident-session and GLM 5.3 verifier tests pass.
## Reproducing the checks
Download the three catalog files at the artifact revision above into
`local-eval-results/issue100-artifacts/`. The ignored `issue100_managed_intake`
test hard-links these into `local-eval-results/issue100-managed/`, runs the real
SHA256/intake pipeline, and writes normal verification markers only after success.
```sh
cargo test --all-features issue100
cargo test --all-features issue100_checkpoint_metadata -- --ignored --nocapture
cargo test --all-features issue100_visual_text -- --ignored --nocapture
cargo test --all-features issue100_managed_intake -- --ignored --nocapture
```
Run Metal tests serially in separate processes under `test-supervisor`, with the
child output redirected to a separate log. Copy the compiled test binary outside
`target/` before starting a longer test. The encoder accepts
`DS4_ISSUE100_IMAGE` and `DS4_ISSUE100_ENCODER_OUTPUT` (dump prefix); its filter is
`issue100_encoder_real_weights`. The small primitive filter is
`issue100_visual_routing_and_attention`. The production generation/cache test
filter is `issue100_full_model_images_cache_and_dspark` and uses the committed
PNG fixtures here. `DS4_ISSUE100_KEEP_VISION=1` selects persistent encoder
residency; `DS4_ISSUE100_SSD=1` selects a 4096-expert SSD cache.
The full-model test requires the intake test first and checks real image answers,
target-only/DSpark agreement with actual drafting, warm/disk continuation,
same-token-layout image replacement, multiple images, tool images, and text-only
use after image requests. All three isolated runs passed on the M5 Max, using
the real managed artifacts after successful SHA256 and metadata intake.
## Final isolated validation
| Runtime mode | Result | Duration | DSpark drafted / accepted |
| --- | --- | --- | --- |
| Resident, transient encoder | Pass | 15.10 s | 15 / 10 |
| Resident, persistent encoder | Pass | 15.94 s | 15 / 10 |
| SSD, 4096-expert cache and preload | Pass | 31.46 s | 30 / 0 |
Each fresh process checked red-square and blue-circle recognition, image order,
new user and tool images, changed images with identical synthetic prompt tokens,
warm and disk-restored continuation, exact checkpoint logits, and text-only use
after images. DSpark output matched target-only output within each runtime mode;
the resident and SSD answers use different wording, so these receipts do not
claim token equivalence between storage modes. Zero accepted drafts in the SSD
fixture is a measured result, not a disabled drafter.
The SSD log retains 129 existing mapped-range diagnostics (three per layer) from
the GPU-copy hotlist preload attempt. The existing Rust loader then successfully
seeds through the host-loading primitive after finishing GPU commands. Both
preload primitives exist in the DS4 reference; this change retains the existing
DS4Server fallback. These are not image-encoder failures. Resource logs are
process accounting and do not measure total file-backed GPU residency.
All commit gates passed: rustfmt, Clippy with warnings denied, signed app bundle,
and all-feature tests (323 application tests plus eight tool/supervisor tests;
247 hardware/artifact-dependent tests are ignored by that generic suite).
The relevant ignored tests were run explicitly as documented above. The bundle
contains the new Metal kernel and its DS4 license. Logs alongside this document
record intake, encoder/primitive checks, family regression controls, the three
full-model runs, and the commit gates.
+8
View File
@@ -0,0 +1,8 @@
cargo build --release --all-targets --all-features
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `release` profile [optimized] target(s) in 43.29s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
cargo packager --release --formats app
codesign --force --deep --sign - --timestamp=none target/release/DS4Server.app
target/release/DS4Server.app: replacing existing signature
+4
View File
@@ -0,0 +1,4 @@
Checking ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `dev` profile [unoptimized + debuginfo] target(s) in 4.60s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
+10
View File
@@ -0,0 +1,10 @@
running 1 test
test engine::metal::tests::resident_multi_session_switching_preserves_each_kv_frontier ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 1.615 ms, residency requested in 9081.153 ms, warmup 3.442 ms (mapped 82697.67 MiB from offset 5.09 MiB)
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 568 filtered out; finished in 11.19s
@@ -0,0 +1,5 @@
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 0.14s
@@ -0,0 +1,45 @@
{"event":"test_supervisor_started","pid":13017,"limit_bytes":17179869184,"start_seconds":60.0,"idle_seconds":120.0,"sample_ms":100}
{"event":"test_resource_sample","elapsed_ms":0,"usage":{"cpu_time_ns":163666,"resident_bytes":688128,"physical_bytes":213064,"peak_physical_bytes":213064,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":101,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":205,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":306,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":407,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":518,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":626,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":733,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":835,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":943,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1052,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1163,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1273,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1374,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1482,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1592,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1697,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1802,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1908,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2018,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2119,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2224,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2334,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2441,"usage":{"cpu_time_ns":2659875,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1593344,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2542,"usage":{"cpu_time_ns":31532500,"resident_bytes":30605312,"physical_bytes":11207424,"peak_physical_bytes":11207424,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2648,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2751,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2855,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2958,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3068,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3178,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3288,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3393,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3500,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3607,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3717,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3818,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3924,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4029,"usage":{"cpu_time_ns":31631291,"resident_bytes":30621696,"physical_bytes":11223808,"peak_physical_bytes":12288768,"disk_read_bytes":2285568,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4134,"usage":{"cpu_time_ns":79446208,"resident_bytes":61718528,"physical_bytes":145966496,"peak_physical_bytes":145966496,"disk_read_bytes":2285568,"disk_write_bytes":4620288}}
{"event":"test_resource_sample","elapsed_ms":4244,"usage":{"cpu_time_ns":189471500,"resident_bytes":62750720,"physical_bytes":146769312,"peak_physical_bytes":146769312,"disk_read_bytes":2285568,"disk_write_bytes":4620288}}
{"event":"test_resource_sample","elapsed_ms":4349,"usage":{"cpu_time_ns":265315666,"resident_bytes":67895296,"physical_bytes":213583264,"peak_physical_bytes":213583264,"disk_read_bytes":2613248,"disk_write_bytes":4833280}}
{"event":"test_resource_sample","elapsed_ms":4451,"usage":{"cpu_time_ns":265315666,"resident_bytes":67895296,"physical_bytes":213583264,"peak_physical_bytes":213583264,"disk_read_bytes":2613248,"disk_write_bytes":4833280}}
{"event":"test_resource_summary","elapsed_ms":4560,"peak":{"cpu_time_ns":265315666,"resident_bytes":67895296,"physical_bytes":213583264,"peak_physical_bytes":213583264,"disk_read_bytes":2613248,"disk_write_bytes":4833280},"error":null}
+11
View File
@@ -0,0 +1,11 @@
running 1 test
test engine::metal::deepseek_vision::tests::issue100_encoder_real_weights ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 0.039 ms, residency requested in 6.538 ms, warmup 3.368 ms (mapped 889.64 MiB from offset 0.02 MiB)
ds4: Metal mapped mmaped model as 1 overlapping shared buffers
{"grid":[28,28],"aligned_grid":[10,10],"tokens":100,"width":224,"height":224,"values":409600}
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 563 filtered out; finished in 2.01s
@@ -0,0 +1,149 @@
{"event":"test_supervisor_started","pid":37642,"limit_bytes":120259084288,"start_seconds":60.0,"idle_seconds":120.0,"sample_ms":100}
{"event":"test_resource_sample","elapsed_ms":0,"usage":{"cpu_time_ns":158791,"resident_bytes":655360,"physical_bytes":180296,"peak_physical_bytes":213064,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":110,"usage":{"cpu_time_ns":86772708,"resident_bytes":61030400,"physical_bytes":39846512,"peak_physical_bytes":39846512,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":220,"usage":{"cpu_time_ns":174636750,"resident_bytes":108462080,"physical_bytes":68764608,"peak_physical_bytes":68764608,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":325,"usage":{"cpu_time_ns":281313375,"resident_bytes":108462080,"physical_bytes":68764608,"peak_physical_bytes":68764608,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":428,"usage":{"cpu_time_ns":383873000,"resident_bytes":108462080,"physical_bytes":68764608,"peak_physical_bytes":68764608,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":537,"usage":{"cpu_time_ns":492457791,"resident_bytes":108462080,"physical_bytes":68764608,"peak_physical_bytes":68764608,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":647,"usage":{"cpu_time_ns":602852916,"resident_bytes":109133824,"physical_bytes":187646912,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":757,"usage":{"cpu_time_ns":712857208,"resident_bytes":109133824,"physical_bytes":187646912,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":859,"usage":{"cpu_time_ns":812860541,"resident_bytes":109133824,"physical_bytes":187548608,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":969,"usage":{"cpu_time_ns":922864833,"resident_bytes":109133824,"physical_bytes":187548608,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1075,"usage":{"cpu_time_ns":1022868333,"resident_bytes":109133824,"physical_bytes":187548608,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1185,"usage":{"cpu_time_ns":1059079041,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1292,"usage":{"cpu_time_ns":1059079041,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1402,"usage":{"cpu_time_ns":1068676208,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1511,"usage":{"cpu_time_ns":1138948708,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1621,"usage":{"cpu_time_ns":1248951791,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1724,"usage":{"cpu_time_ns":1348956625,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1834,"usage":{"cpu_time_ns":1458987666,"resident_bytes":109166592,"physical_bytes":187564992,"peak_physical_bytes":187646912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1944,"usage":{"cpu_time_ns":1576030458,"resident_bytes":128204800,"physical_bytes":202311240,"peak_physical_bytes":202311240,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2054,"usage":{"cpu_time_ns":1678444500,"resident_bytes":132841472,"physical_bytes":268912248,"peak_physical_bytes":268912248,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2162,"usage":{"cpu_time_ns":1683235708,"resident_bytes":135757824,"physical_bytes":268977784,"peak_physical_bytes":268977784,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2270,"usage":{"cpu_time_ns":1787228333,"resident_bytes":136052736,"physical_bytes":270878328,"peak_physical_bytes":270878328,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2380,"usage":{"cpu_time_ns":1792551041,"resident_bytes":137576448,"physical_bytes":351028904,"peak_physical_bytes":351028904,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2490,"usage":{"cpu_time_ns":1798559166,"resident_bytes":138182656,"physical_bytes":371295912,"peak_physical_bytes":371295912,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2601,"usage":{"cpu_time_ns":1804472791,"resident_bytes":138674176,"physical_bytes":384419496,"peak_physical_bytes":384419496,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2711,"usage":{"cpu_time_ns":1809852125,"resident_bytes":139116544,"physical_bytes":396428968,"peak_physical_bytes":396428968,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2821,"usage":{"cpu_time_ns":1816155541,"resident_bytes":139624448,"physical_bytes":409552552,"peak_physical_bytes":409552552,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2931,"usage":{"cpu_time_ns":1873384375,"resident_bytes":140836864,"physical_bytes":434636456,"peak_physical_bytes":434636456,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3041,"usage":{"cpu_time_ns":1981844875,"resident_bytes":154206208,"physical_bytes":434914984,"peak_physical_bytes":434914984,"disk_read_bytes":16384,"disk_write_bytes":25169920}}
{"event":"test_resource_sample","elapsed_ms":3152,"usage":{"cpu_time_ns":2037590041,"resident_bytes":160645120,"physical_bytes":306103976,"peak_physical_bytes":447579864,"disk_read_bytes":16384,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":3259,"usage":{"cpu_time_ns":2126845083,"resident_bytes":161169408,"physical_bytes":318293672,"peak_physical_bytes":447579864,"disk_read_bytes":16384,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":3369,"usage":{"cpu_time_ns":2231828375,"resident_bytes":147636224,"physical_bytes":260523712,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3475,"usage":{"cpu_time_ns":2338136333,"resident_bytes":162742272,"physical_bytes":255903400,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3585,"usage":{"cpu_time_ns":2409057041,"resident_bytes":164610048,"physical_bytes":320128680,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3696,"usage":{"cpu_time_ns":2417197916,"resident_bytes":150568960,"physical_bytes":375146200,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3806,"usage":{"cpu_time_ns":2422607208,"resident_bytes":151011328,"physical_bytes":387172056,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3916,"usage":{"cpu_time_ns":2428629583,"resident_bytes":151502848,"physical_bytes":400279256,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4022,"usage":{"cpu_time_ns":2433951458,"resident_bytes":151945216,"physical_bytes":411862744,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4125,"usage":{"cpu_time_ns":2439699666,"resident_bytes":152387584,"physical_bytes":442828504,"peak_physical_bytes":447579864,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4235,"usage":{"cpu_time_ns":2876701875,"resident_bytes":195395584,"physical_bytes":360859448,"peak_physical_bytes":484361992,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4342,"usage":{"cpu_time_ns":3007532875,"resident_bytes":205291520,"physical_bytes":482150200,"peak_physical_bytes":484361992,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4449,"usage":{"cpu_time_ns":3332647875,"resident_bytes":208683008,"physical_bytes":484591416,"peak_physical_bytes":484591416,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4559,"usage":{"cpu_time_ns":3765325791,"resident_bytes":208961536,"physical_bytes":484869944,"peak_physical_bytes":484869944,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4669,"usage":{"cpu_time_ns":3864230375,"resident_bytes":209551360,"physical_bytes":484738872,"peak_physical_bytes":484886328,"disk_read_bytes":24576,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4779,"usage":{"cpu_time_ns":3967922875,"resident_bytes":205324288,"physical_bytes":375228192,"peak_physical_bytes":497403752,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4881,"usage":{"cpu_time_ns":4068514458,"resident_bytes":221200384,"physical_bytes":391120696,"peak_physical_bytes":497403752,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4991,"usage":{"cpu_time_ns":4091918750,"resident_bytes":221921280,"physical_bytes":447317816,"peak_physical_bytes":497403752,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5099,"usage":{"cpu_time_ns":4102419666,"resident_bytes":206536704,"physical_bytes":506021688,"peak_physical_bytes":506021688,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5209,"usage":{"cpu_time_ns":4107575708,"resident_bytes":206979072,"physical_bytes":518031160,"peak_physical_bytes":518031160,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5319,"usage":{"cpu_time_ns":4113264541,"resident_bytes":207470592,"physical_bytes":531171128,"peak_physical_bytes":531171128,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5429,"usage":{"cpu_time_ns":4118395625,"resident_bytes":207912960,"physical_bytes":542754616,"peak_physical_bytes":542754616,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5539,"usage":{"cpu_time_ns":4127693000,"resident_bytes":208846848,"physical_bytes":572409656,"peak_physical_bytes":572409656,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5649,"usage":{"cpu_time_ns":4559910291,"resident_bytes":211697664,"physical_bytes":488245096,"peak_physical_bytes":599164728,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5759,"usage":{"cpu_time_ns":4996436541,"resident_bytes":212369408,"physical_bytes":488359808,"peak_physical_bytes":599164728,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5870,"usage":{"cpu_time_ns":5435416416,"resident_bytes":212992000,"physical_bytes":488458112,"peak_physical_bytes":599164728,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5980,"usage":{"cpu_time_ns":5499016208,"resident_bytes":213499904,"physical_bytes":488458112,"peak_physical_bytes":599164728,"disk_read_bytes":32768,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":6090,"usage":{"cpu_time_ns":5606456291,"resident_bytes":227901440,"physical_bytes":488458112,"peak_physical_bytes":599164728,"disk_read_bytes":40960,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":6202,"usage":{"cpu_time_ns":5715925250,"resident_bytes":227901440,"physical_bytes":488458112,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6309,"usage":{"cpu_time_ns":5720009125,"resident_bytes":228179968,"physical_bytes":502368128,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6419,"usage":{"cpu_time_ns":5724536500,"resident_bytes":228179968,"physical_bytes":503039872,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6529,"usage":{"cpu_time_ns":5732569833,"resident_bytes":228196352,"physical_bytes":503039872,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6639,"usage":{"cpu_time_ns":6201525250,"resident_bytes":228835328,"physical_bytes":491308928,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6749,"usage":{"cpu_time_ns":6311372583,"resident_bytes":228835328,"physical_bytes":491308928,"peak_physical_bytes":599164728,"disk_read_bytes":45056,"disk_write_bytes":130789376}}
{"event":"test_resource_sample","elapsed_ms":6859,"usage":{"cpu_time_ns":6415947833,"resident_bytes":222134272,"physical_bytes":385697592,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":6961,"usage":{"cpu_time_ns":6494033333,"resident_bytes":223510528,"physical_bytes":448546592,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7063,"usage":{"cpu_time_ns":6496621833,"resident_bytes":223526912,"physical_bytes":405948216,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7173,"usage":{"cpu_time_ns":6501995166,"resident_bytes":223526912,"physical_bytes":429262648,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7275,"usage":{"cpu_time_ns":6593164875,"resident_bytes":224968704,"physical_bytes":476743504,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7381,"usage":{"cpu_time_ns":6986154666,"resident_bytes":227557376,"physical_bytes":479479632,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7491,"usage":{"cpu_time_ns":7096023166,"resident_bytes":227688448,"physical_bytes":479479632,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":158916608}}
{"event":"test_resource_sample","elapsed_ms":7601,"usage":{"cpu_time_ns":7201462833,"resident_bytes":228966400,"physical_bytes":479479632,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":7711,"usage":{"cpu_time_ns":7219993875,"resident_bytes":230834176,"physical_bytes":543704912,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":7821,"usage":{"cpu_time_ns":7321288833,"resident_bytes":228982784,"physical_bytes":450332496,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":7931,"usage":{"cpu_time_ns":7330549833,"resident_bytes":236273664,"physical_bytes":518342480,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8042,"usage":{"cpu_time_ns":7342040750,"resident_bytes":233537536,"physical_bytes":577849168,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8152,"usage":{"cpu_time_ns":7350480041,"resident_bytes":234192896,"physical_bytes":578504528,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8262,"usage":{"cpu_time_ns":7360057041,"resident_bytes":234913792,"physical_bytes":579225424,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8372,"usage":{"cpu_time_ns":7369511708,"resident_bytes":235667456,"physical_bytes":579979088,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8482,"usage":{"cpu_time_ns":7377769000,"resident_bytes":236339200,"physical_bytes":580634448,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8592,"usage":{"cpu_time_ns":7819415708,"resident_bytes":236404736,"physical_bytes":457819984,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8702,"usage":{"cpu_time_ns":7929061291,"resident_bytes":236421120,"physical_bytes":457836368,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":187043840}}
{"event":"test_resource_sample","elapsed_ms":8812,"usage":{"cpu_time_ns":8034578750,"resident_bytes":248725504,"physical_bytes":457836368,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":8922,"usage":{"cpu_time_ns":8101839000,"resident_bytes":250855424,"physical_bytes":522291024,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9033,"usage":{"cpu_time_ns":8153384833,"resident_bytes":249004032,"physical_bytes":458082128,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9143,"usage":{"cpu_time_ns":8210025625,"resident_bytes":250888192,"physical_bytes":522323792,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9253,"usage":{"cpu_time_ns":8270070583,"resident_bytes":249036800,"physical_bytes":458114896,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9359,"usage":{"cpu_time_ns":8317796000,"resident_bytes":250920960,"physical_bytes":522356560,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9469,"usage":{"cpu_time_ns":8322483791,"resident_bytes":254771200,"physical_bytes":480429880,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9579,"usage":{"cpu_time_ns":8326288208,"resident_bytes":254771200,"physical_bytes":480429880,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9689,"usage":{"cpu_time_ns":8336750625,"resident_bytes":255180800,"physical_bytes":582321976,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9799,"usage":{"cpu_time_ns":8346214125,"resident_bytes":255901696,"physical_bytes":571262800,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":9909,"usage":{"cpu_time_ns":8355466000,"resident_bytes":256655360,"physical_bytes":572016464,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":10019,"usage":{"cpu_time_ns":8364417875,"resident_bytes":257376256,"physical_bytes":572737360,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":10125,"usage":{"cpu_time_ns":8373669666,"resident_bytes":258129920,"physical_bytes":573572944,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":10235,"usage":{"cpu_time_ns":8823157958,"resident_bytes":258326528,"physical_bytes":460605264,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":10342,"usage":{"cpu_time_ns":8929590083,"resident_bytes":258326528,"physical_bytes":460605264,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":227495936}}
{"event":"test_resource_sample","elapsed_ms":10452,"usage":{"cpu_time_ns":9035189583,"resident_bytes":223461376,"physical_bytes":358303568,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":10559,"usage":{"cpu_time_ns":9140813375,"resident_bytes":235307008,"physical_bytes":361875280,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":10660,"usage":{"cpu_time_ns":9189294625,"resident_bytes":237404160,"physical_bytes":426297168,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":10770,"usage":{"cpu_time_ns":9198647541,"resident_bytes":223264768,"physical_bytes":482707280,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":10880,"usage":{"cpu_time_ns":9203889041,"resident_bytes":223707136,"physical_bytes":494290768,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":10990,"usage":{"cpu_time_ns":9209785166,"resident_bytes":224215040,"physical_bytes":507414352,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11101,"usage":{"cpu_time_ns":9215004875,"resident_bytes":224657408,"physical_bytes":519423824,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11211,"usage":{"cpu_time_ns":9220738000,"resident_bytes":225099776,"physical_bytes":549930832,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11321,"usage":{"cpu_time_ns":9674345333,"resident_bytes":228573184,"physical_bytes":500369280,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11425,"usage":{"cpu_time_ns":9943252875,"resident_bytes":229130240,"physical_bytes":504547200,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11532,"usage":{"cpu_time_ns":10150432208,"resident_bytes":229703680,"physical_bytes":504596352,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11642,"usage":{"cpu_time_ns":10260039750,"resident_bytes":229703680,"physical_bytes":504596352,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":281427968}}
{"event":"test_resource_sample","elapsed_ms":11753,"usage":{"cpu_time_ns":10365728416,"resident_bytes":250511360,"physical_bytes":421431120,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":11863,"usage":{"cpu_time_ns":10468843916,"resident_bytes":251428864,"physical_bytes":476284752,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":11973,"usage":{"cpu_time_ns":10485306541,"resident_bytes":253067264,"physical_bytes":476284752,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12083,"usage":{"cpu_time_ns":10580108791,"resident_bytes":251445248,"physical_bytes":476301136,"peak_physical_bytes":599164728,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12193,"usage":{"cpu_time_ns":10590163125,"resident_bytes":227557376,"physical_bytes":625657704,"peak_physical_bytes":625657704,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12303,"usage":{"cpu_time_ns":10600883083,"resident_bytes":228573184,"physical_bytes":647989096,"peak_physical_bytes":647989096,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12413,"usage":{"cpu_time_ns":10611199541,"resident_bytes":229621760,"physical_bytes":658081640,"peak_physical_bytes":658081640,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12524,"usage":{"cpu_time_ns":10621232500,"resident_bytes":230637568,"physical_bytes":667715432,"peak_physical_bytes":667715432,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12634,"usage":{"cpu_time_ns":10631547416,"resident_bytes":231686144,"physical_bytes":677807976,"peak_physical_bytes":677807976,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12744,"usage":{"cpu_time_ns":10643259916,"resident_bytes":232718336,"physical_bytes":649594728,"peak_physical_bytes":686278504,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12854,"usage":{"cpu_time_ns":10652608916,"resident_bytes":233603072,"physical_bytes":673482600,"peak_physical_bytes":686278504,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":12963,"usage":{"cpu_time_ns":11113440875,"resident_bytes":237142016,"physical_bytes":508725096,"peak_physical_bytes":709068648,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":13073,"usage":{"cpu_time_ns":11310966750,"resident_bytes":237928448,"physical_bytes":517588840,"peak_physical_bytes":709068648,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":13182,"usage":{"cpu_time_ns":11583143708,"resident_bytes":238125056,"physical_bytes":517785448,"peak_physical_bytes":709068648,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":13292,"usage":{"cpu_time_ns":12074052916,"resident_bytes":238698496,"physical_bytes":520570728,"peak_physical_bytes":709068648,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":13402,"usage":{"cpu_time_ns":12183887500,"resident_bytes":238698496,"physical_bytes":520570728,"peak_physical_bytes":709068648,"disk_read_bytes":49152,"disk_write_bytes":307720192}}
{"event":"test_resource_sample","elapsed_ms":13512,"usage":{"cpu_time_ns":12287995458,"resident_bytes":264699904,"physical_bytes":520570728,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":13623,"usage":{"cpu_time_ns":12365533041,"resident_bytes":266616832,"physical_bytes":584812392,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":13730,"usage":{"cpu_time_ns":12406870416,"resident_bytes":268255232,"physical_bytes":584812392,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":13841,"usage":{"cpu_time_ns":12476579583,"resident_bytes":266633216,"physical_bytes":584828776,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":13951,"usage":{"cpu_time_ns":12525649333,"resident_bytes":231768064,"physical_bytes":404277072,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14061,"usage":{"cpu_time_ns":12634644083,"resident_bytes":230735872,"physical_bytes":397395792,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14171,"usage":{"cpu_time_ns":12645684541,"resident_bytes":232620032,"physical_bytes":461637456,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14281,"usage":{"cpu_time_ns":12654951833,"resident_bytes":233095168,"physical_bytes":545392464,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14391,"usage":{"cpu_time_ns":12660581375,"resident_bytes":233537536,"physical_bytes":556975952,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14501,"usage":{"cpu_time_ns":12666264500,"resident_bytes":233979904,"physical_bytes":568985424,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14609,"usage":{"cpu_time_ns":12671240625,"resident_bytes":234373120,"physical_bytes":579471184,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14719,"usage":{"cpu_time_ns":12676731250,"resident_bytes":234766336,"physical_bytes":608880464,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14829,"usage":{"cpu_time_ns":13145764291,"resident_bytes":238206976,"physical_bytes":514164584,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":14939,"usage":{"cpu_time_ns":13600598416,"resident_bytes":238780416,"physical_bytes":518326120,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":15049,"usage":{"cpu_time_ns":13675123958,"resident_bytes":239763456,"physical_bytes":518358888,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":345866240}}
{"event":"test_resource_sample","elapsed_ms":15159,"usage":{"cpu_time_ns":13781108666,"resident_bytes":262504448,"physical_bytes":523552616,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15270,"usage":{"cpu_time_ns":13834173625,"resident_bytes":233472000,"physical_bytes":502433616,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15375,"usage":{"cpu_time_ns":13837911416,"resident_bytes":233472000,"physical_bytes":526190416,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15485,"usage":{"cpu_time_ns":13847026875,"resident_bytes":234209280,"physical_bytes":576014160,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15596,"usage":{"cpu_time_ns":14333755000,"resident_bytes":237600768,"physical_bytes":578946896,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15706,"usage":{"cpu_time_ns":14443734750,"resident_bytes":237600768,"physical_bytes":578946896,"peak_physical_bytes":709068648,"disk_read_bytes":53248,"disk_write_bytes":372752384}}
{"event":"test_resource_sample","elapsed_ms":15816,"usage":{"cpu_time_ns":14541420333,"resident_bytes":219529216,"physical_bytes":299026184,"peak_physical_bytes":709068648,"disk_read_bytes":61440,"disk_write_bytes":387313664}}
{"event":"test_resource_sample","elapsed_ms":15926,"usage":{"cpu_time_ns":14651424000,"resident_bytes":219529216,"physical_bytes":299026184,"peak_physical_bytes":709068648,"disk_read_bytes":61440,"disk_write_bytes":387313664}}
{"event":"test_resource_summary","elapsed_ms":16036,"peak":{"cpu_time_ns":14651424000,"resident_bytes":268255232,"physical_bytes":677807976,"peak_physical_bytes":709068648,"disk_read_bytes":61440,"disk_write_bytes":387313664},"error":null}
+20
View File
@@ -0,0 +1,20 @@
running 1 test
test engine::metal::deepseek_vision::tests::issue100_full_model_images_cache_and_dspark ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 1.695 ms, residency requested in 461.052 ms, warmup 3.497 ms (mapped 82697.67 MiB from offset 5.09 MiB)
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
ds4: Metal model views created in 0.143 ms, residency requested in 461.793 ms, warmup 0.639 ms (mapped 5711.67 MiB from offset 0.01 MiB)
ds4: Metal mapped mmaped model as 3 overlapping shared buffers
ds4: Metal model views created in 0.047 ms, residency requested in 833.434 ms, warmup 0.581 ms (mapped 889.64 MiB from offset 0.02 MiB)
ds4: Metal mapped mmaped model as 4 overlapping shared buffers
red: The image features a solid red square centered on a white background.
DSpark drafted=15 accepted=10
blue: A solid blue circle centered on a white background.
pair: The first shape is red, and the second shape is blue.
tool image: The color in the image is blue.
issue100: production rendering, image recognition, multi-image/tool input, same-layout image invalidation, disk/warm KV and DSpark target equivalence passed
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 15.94s
@@ -0,0 +1,142 @@
{"event":"test_supervisor_started","pid":37604,"limit_bytes":120259084288,"start_seconds":60.0,"idle_seconds":120.0,"sample_ms":100}
{"event":"test_resource_sample","elapsed_ms":0,"usage":{"cpu_time_ns":415125,"resident_bytes":180224,"physical_bytes":245952,"peak_physical_bytes":295032,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":101,"usage":{"cpu_time_ns":97345208,"resident_bytes":63045632,"physical_bytes":41222744,"peak_physical_bytes":41222744,"disk_read_bytes":126976,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":212,"usage":{"cpu_time_ns":161737875,"resident_bytes":108445696,"physical_bytes":68830144,"peak_physical_bytes":68830144,"disk_read_bytes":9883648,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":322,"usage":{"cpu_time_ns":271741791,"resident_bytes":108445696,"physical_bytes":68830144,"peak_physical_bytes":68830144,"disk_read_bytes":9883648,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":432,"usage":{"cpu_time_ns":391744500,"resident_bytes":108445696,"physical_bytes":68830144,"peak_physical_bytes":68830144,"disk_read_bytes":9883648,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":542,"usage":{"cpu_time_ns":501772208,"resident_bytes":108445696,"physical_bytes":68830144,"peak_physical_bytes":68830144,"disk_read_bytes":9883648,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":648,"usage":{"cpu_time_ns":599084208,"resident_bytes":109133824,"physical_bytes":187728832,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":758,"usage":{"cpu_time_ns":709088500,"resident_bytes":109133824,"physical_bytes":187728832,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":868,"usage":{"cpu_time_ns":793179208,"resident_bytes":109133824,"physical_bytes":187728832,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":978,"usage":{"cpu_time_ns":803179541,"resident_bytes":109133824,"physical_bytes":187630528,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1081,"usage":{"cpu_time_ns":913183000,"resident_bytes":109133824,"physical_bytes":187630528,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1191,"usage":{"cpu_time_ns":1024193041,"resident_bytes":109133824,"physical_bytes":187630528,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1298,"usage":{"cpu_time_ns":1124198625,"resident_bytes":109133824,"physical_bytes":187630528,"peak_physical_bytes":187728832,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1408,"usage":{"cpu_time_ns":1240872791,"resident_bytes":126746624,"physical_bytes":201606752,"peak_physical_bytes":201606752,"disk_read_bytes":10391552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1518,"usage":{"cpu_time_ns":1347208333,"resident_bytes":132022272,"physical_bytes":206161528,"peak_physical_bytes":206161528,"disk_read_bytes":10461184,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1628,"usage":{"cpu_time_ns":1364817916,"resident_bytes":132825088,"physical_bytes":268961424,"peak_physical_bytes":268961424,"disk_read_bytes":11153408,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1738,"usage":{"cpu_time_ns":1455558833,"resident_bytes":135774208,"physical_bytes":269043344,"peak_physical_bytes":269043344,"disk_read_bytes":11153408,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1848,"usage":{"cpu_time_ns":1480383583,"resident_bytes":136052736,"physical_bytes":270927504,"peak_physical_bytes":270927504,"disk_read_bytes":11153408,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1959,"usage":{"cpu_time_ns":1493076208,"resident_bytes":138084352,"physical_bytes":367691480,"peak_physical_bytes":367691480,"disk_read_bytes":11755520,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2069,"usage":{"cpu_time_ns":1499107416,"resident_bytes":138592256,"physical_bytes":380831448,"peak_physical_bytes":380831448,"disk_read_bytes":11755520,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2179,"usage":{"cpu_time_ns":1504363291,"resident_bytes":139034624,"physical_bytes":392414936,"peak_physical_bytes":392414936,"disk_read_bytes":11755520,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2289,"usage":{"cpu_time_ns":1510003500,"resident_bytes":139526144,"physical_bytes":405522136,"peak_physical_bytes":405522136,"disk_read_bytes":11755520,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2399,"usage":{"cpu_time_ns":1532340166,"resident_bytes":140886016,"physical_bytes":434751192,"peak_physical_bytes":434751192,"disk_read_bytes":11821056,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2510,"usage":{"cpu_time_ns":1641900958,"resident_bytes":140886016,"physical_bytes":434751192,"peak_physical_bytes":434751192,"disk_read_bytes":11821056,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2620,"usage":{"cpu_time_ns":1727359458,"resident_bytes":160661504,"physical_bytes":285099736,"peak_physical_bytes":447645424,"disk_read_bytes":12017664,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":2730,"usage":{"cpu_time_ns":1785970916,"resident_bytes":161185792,"physical_bytes":318375640,"peak_physical_bytes":447645424,"disk_read_bytes":12017664,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":2831,"usage":{"cpu_time_ns":1886208291,"resident_bytes":161382400,"physical_bytes":318375640,"peak_physical_bytes":447645424,"disk_read_bytes":12021760,"disk_write_bytes":33705984}}
{"event":"test_resource_sample","elapsed_ms":2941,"usage":{"cpu_time_ns":1991190375,"resident_bytes":148144128,"physical_bytes":260867848,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3051,"usage":{"cpu_time_ns":2066984541,"resident_bytes":150044672,"physical_bytes":305776392,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3161,"usage":{"cpu_time_ns":2074594333,"resident_bytes":150274048,"physical_bytes":373950216,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3272,"usage":{"cpu_time_ns":2080296208,"resident_bytes":150765568,"physical_bytes":387057416,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3382,"usage":{"cpu_time_ns":2085985041,"resident_bytes":151257088,"physical_bytes":400164616,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3492,"usage":{"cpu_time_ns":2091268916,"resident_bytes":151699456,"physical_bytes":411748104,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3602,"usage":{"cpu_time_ns":2097277666,"resident_bytes":152190976,"physical_bytes":443942664,"peak_physical_bytes":447645424,"disk_read_bytes":12034048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3708,"usage":{"cpu_time_ns":2535618166,"resident_bytes":195903488,"physical_bytes":388417360,"peak_physical_bytes":484345632,"disk_read_bytes":12247040,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3814,"usage":{"cpu_time_ns":2681934000,"resident_bytes":205062144,"physical_bytes":482248552,"peak_physical_bytes":484345632,"disk_read_bytes":12247040,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":3925,"usage":{"cpu_time_ns":2984151416,"resident_bytes":208437248,"physical_bytes":484689768,"peak_physical_bytes":484689768,"disk_read_bytes":12247040,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4035,"usage":{"cpu_time_ns":3411319916,"resident_bytes":209207296,"physical_bytes":484788072,"peak_physical_bytes":484951912,"disk_read_bytes":12247040,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4145,"usage":{"cpu_time_ns":3521395875,"resident_bytes":209272832,"physical_bytes":484804456,"peak_physical_bytes":484951912,"disk_read_bytes":12247040,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":4248,"usage":{"cpu_time_ns":3615762833,"resident_bytes":203587584,"physical_bytes":366987112,"peak_physical_bytes":497485696,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4358,"usage":{"cpu_time_ns":3701139166,"resident_bytes":205537280,"physical_bytes":431228776,"peak_physical_bytes":497485696,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4464,"usage":{"cpu_time_ns":3708145125,"resident_bytes":207290368,"physical_bytes":493815656,"peak_physical_bytes":497485696,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4574,"usage":{"cpu_time_ns":3714040458,"resident_bytes":207781888,"physical_bytes":512624488,"peak_physical_bytes":512624488,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4685,"usage":{"cpu_time_ns":3719232750,"resident_bytes":208224256,"physical_bytes":524683112,"peak_physical_bytes":524683112,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4787,"usage":{"cpu_time_ns":3724906291,"resident_bytes":208666624,"physical_bytes":536266600,"peak_physical_bytes":536266600,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4896,"usage":{"cpu_time_ns":3731142000,"resident_bytes":209158144,"physical_bytes":549373800,"peak_physical_bytes":549373800,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":4999,"usage":{"cpu_time_ns":3942764875,"resident_bytes":211648512,"physical_bytes":477726616,"peak_physical_bytes":601360232,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5110,"usage":{"cpu_time_ns":4171788250,"resident_bytes":213417984,"physical_bytes":489736088,"peak_physical_bytes":601360232,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5221,"usage":{"cpu_time_ns":4603727416,"resident_bytes":214007808,"physical_bytes":489785240,"peak_physical_bytes":601360232,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5331,"usage":{"cpu_time_ns":5030277958,"resident_bytes":214073344,"physical_bytes":489834392,"peak_physical_bytes":601360232,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5441,"usage":{"cpu_time_ns":5125664208,"resident_bytes":214597632,"physical_bytes":489850776,"peak_physical_bytes":601360232,"disk_read_bytes":12259328,"disk_write_bytes":77606912}}
{"event":"test_resource_sample","elapsed_ms":5551,"usage":{"cpu_time_ns":5227421291,"resident_bytes":229031936,"physical_bytes":489850776,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":5661,"usage":{"cpu_time_ns":5311782708,"resident_bytes":230948864,"physical_bytes":554092440,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":5764,"usage":{"cpu_time_ns":5317321833,"resident_bytes":229294080,"physical_bytes":504416152,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":5874,"usage":{"cpu_time_ns":5322005333,"resident_bytes":229294080,"physical_bytes":504416152,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":5975,"usage":{"cpu_time_ns":5410758875,"resident_bytes":229343232,"physical_bytes":504448920,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":6085,"usage":{"cpu_time_ns":5802163208,"resident_bytes":229965824,"physical_bytes":492701592,"peak_physical_bytes":601360232,"disk_read_bytes":12279808,"disk_write_bytes":104198144}}
{"event":"test_resource_sample","elapsed_ms":6195,"usage":{"cpu_time_ns":5911762250,"resident_bytes":230850560,"physical_bytes":492701592,"peak_physical_bytes":601360232,"disk_read_bytes":12288000,"disk_write_bytes":120975360}}
{"event":"test_resource_sample","elapsed_ms":6305,"usage":{"cpu_time_ns":6013668791,"resident_bytes":222904320,"physical_bytes":385861480,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6415,"usage":{"cpu_time_ns":6090444875,"resident_bytes":224690176,"physical_bytes":449972072,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6525,"usage":{"cpu_time_ns":6096262625,"resident_bytes":224706560,"physical_bytes":410306408,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6636,"usage":{"cpu_time_ns":6101809250,"resident_bytes":224706560,"physical_bytes":433276776,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6746,"usage":{"cpu_time_ns":6446828208,"resident_bytes":228212736,"physical_bytes":448989056,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6856,"usage":{"cpu_time_ns":6607495666,"resident_bytes":228737024,"physical_bytes":451725184,"peak_physical_bytes":601360232,"disk_read_bytes":38891520,"disk_write_bytes":132325376}}
{"event":"test_resource_sample","elapsed_ms":6966,"usage":{"cpu_time_ns":6707505833,"resident_bytes":230162432,"physical_bytes":451741568,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7077,"usage":{"cpu_time_ns":6812796416,"resident_bytes":232030208,"physical_bytes":515966848,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7187,"usage":{"cpu_time_ns":6828540666,"resident_bytes":233668608,"physical_bytes":515966848,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7297,"usage":{"cpu_time_ns":6920792875,"resident_bytes":232062976,"physical_bytes":515999616,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7400,"usage":{"cpu_time_ns":6927874916,"resident_bytes":236322816,"physical_bytes":575309696,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7510,"usage":{"cpu_time_ns":6936864125,"resident_bytes":237092864,"physical_bytes":581633920,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7620,"usage":{"cpu_time_ns":6946076750,"resident_bytes":237846528,"physical_bytes":582387584,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7729,"usage":{"cpu_time_ns":6954095666,"resident_bytes":238501888,"physical_bytes":583042944,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7839,"usage":{"cpu_time_ns":6962969291,"resident_bytes":239222784,"physical_bytes":583370624,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":7942,"usage":{"cpu_time_ns":6974284583,"resident_bytes":239845376,"physical_bytes":584304512,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":8052,"usage":{"cpu_time_ns":7409587958,"resident_bytes":239894528,"physical_bytes":461539200,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":8162,"usage":{"cpu_time_ns":7519416625,"resident_bytes":239894528,"physical_bytes":461539200,"peak_physical_bytes":601360232,"disk_read_bytes":38912000,"disk_write_bytes":160452608}}
{"event":"test_resource_sample","elapsed_ms":8264,"usage":{"cpu_time_ns":7616060750,"resident_bytes":252198912,"physical_bytes":461539200,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8374,"usage":{"cpu_time_ns":7691425791,"resident_bytes":254099456,"physical_bytes":525764480,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8481,"usage":{"cpu_time_ns":7731651416,"resident_bytes":255737856,"physical_bytes":525764480,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8591,"usage":{"cpu_time_ns":7799902208,"resident_bytes":254115840,"physical_bytes":525780864,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8699,"usage":{"cpu_time_ns":7848593166,"resident_bytes":255754240,"physical_bytes":525780864,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8809,"usage":{"cpu_time_ns":7908017625,"resident_bytes":254099456,"physical_bytes":525764480,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":8919,"usage":{"cpu_time_ns":7914622000,"resident_bytes":254410752,"physical_bytes":480331648,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9024,"usage":{"cpu_time_ns":7918761250,"resident_bytes":254410752,"physical_bytes":480331648,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9131,"usage":{"cpu_time_ns":7928645208,"resident_bytes":254722048,"physical_bytes":582125440,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9241,"usage":{"cpu_time_ns":7937778500,"resident_bytes":255492096,"physical_bytes":582879104,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9351,"usage":{"cpu_time_ns":7945633041,"resident_bytes":256147456,"physical_bytes":583534464,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9461,"usage":{"cpu_time_ns":7955466125,"resident_bytes":256966656,"physical_bytes":584353664,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9564,"usage":{"cpu_time_ns":7963225708,"resident_bytes":257622016,"physical_bytes":585009024,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9665,"usage":{"cpu_time_ns":8066724208,"resident_bytes":257966080,"physical_bytes":467289984,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9775,"usage":{"cpu_time_ns":8474248208,"resident_bytes":257966080,"physical_bytes":460474240,"peak_physical_bytes":601360232,"disk_read_bytes":38928384,"disk_write_bytes":200904704}}
{"event":"test_resource_sample","elapsed_ms":9885,"usage":{"cpu_time_ns":8583266833,"resident_bytes":270729216,"physical_bytes":460474240,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":251236352}}
{"event":"test_resource_sample","elapsed_ms":9995,"usage":{"cpu_time_ns":8688466750,"resident_bytes":223100928,"physical_bytes":358156136,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10098,"usage":{"cpu_time_ns":8711523041,"resident_bytes":222429184,"physical_bytes":411535208,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10201,"usage":{"cpu_time_ns":8721726416,"resident_bytes":222806016,"physical_bytes":485017448,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10311,"usage":{"cpu_time_ns":8727381958,"resident_bytes":223248384,"physical_bytes":496600936,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10414,"usage":{"cpu_time_ns":8732902750,"resident_bytes":223690752,"physical_bytes":508610408,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10515,"usage":{"cpu_time_ns":8737633791,"resident_bytes":224083968,"physical_bytes":519096168,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10626,"usage":{"cpu_time_ns":8743981500,"resident_bytes":224575488,"physical_bytes":551126888,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10736,"usage":{"cpu_time_ns":9179050708,"resident_bytes":228032512,"physical_bytes":500074392,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10846,"usage":{"cpu_time_ns":9607171375,"resident_bytes":228589568,"physical_bytes":504252312,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":10948,"usage":{"cpu_time_ns":9654308083,"resident_bytes":229146624,"physical_bytes":504285080,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":11058,"usage":{"cpu_time_ns":9764272291,"resident_bytes":232669184,"physical_bytes":504285080,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":254836736}}
{"event":"test_resource_sample","elapsed_ms":11164,"usage":{"cpu_time_ns":9865513916,"resident_bytes":223969280,"physical_bytes":395118440,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11274,"usage":{"cpu_time_ns":9900431958,"resident_bytes":224722944,"physical_bytes":449759080,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11381,"usage":{"cpu_time_ns":9980970333,"resident_bytes":226361344,"physical_bytes":449759080,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11491,"usage":{"cpu_time_ns":10008942166,"resident_bytes":224755712,"physical_bytes":449791848,"peak_physical_bytes":601360232,"disk_read_bytes":38948864,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11598,"usage":{"cpu_time_ns":10025156833,"resident_bytes":227459072,"physical_bytes":643467112,"peak_physical_bytes":643467112,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11708,"usage":{"cpu_time_ns":10035450875,"resident_bytes":228474880,"physical_bytes":653100904,"peak_physical_bytes":653100904,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11818,"usage":{"cpu_time_ns":10046117208,"resident_bytes":229523456,"physical_bytes":663193448,"peak_physical_bytes":663193448,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":11928,"usage":{"cpu_time_ns":10056543416,"resident_bytes":230539264,"physical_bytes":672827240,"peak_physical_bytes":672827240,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12034,"usage":{"cpu_time_ns":10067115291,"resident_bytes":231587840,"physical_bytes":682919784,"peak_physical_bytes":682919784,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12144,"usage":{"cpu_time_ns":10077606875,"resident_bytes":232603648,"physical_bytes":692553576,"peak_physical_bytes":692553576,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12254,"usage":{"cpu_time_ns":10201624083,"resident_bytes":234848256,"physical_bytes":505087896,"peak_physical_bytes":747063144,"disk_read_bytes":39014400,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12364,"usage":{"cpu_time_ns":10523251625,"resident_bytes":237207552,"physical_bytes":517080984,"peak_physical_bytes":747063144,"disk_read_bytes":39047168,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12475,"usage":{"cpu_time_ns":10950040875,"resident_bytes":237273088,"physical_bytes":517130136,"peak_physical_bytes":747063144,"disk_read_bytes":39047168,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12581,"usage":{"cpu_time_ns":11380337916,"resident_bytes":237813760,"physical_bytes":519882648,"peak_physical_bytes":747063144,"disk_read_bytes":39047168,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12691,"usage":{"cpu_time_ns":11490253666,"resident_bytes":237813760,"physical_bytes":519882648,"peak_physical_bytes":747063144,"disk_read_bytes":39047168,"disk_write_bytes":281128960}}
{"event":"test_resource_sample","elapsed_ms":12798,"usage":{"cpu_time_ns":11591107666,"resident_bytes":263815168,"physical_bytes":519882648,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":12908,"usage":{"cpu_time_ns":11666141750,"resident_bytes":265715712,"physical_bytes":584107928,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13018,"usage":{"cpu_time_ns":11710186333,"resident_bytes":267354112,"physical_bytes":584107928,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13120,"usage":{"cpu_time_ns":11774231000,"resident_bytes":265748480,"physical_bytes":584140696,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13230,"usage":{"cpu_time_ns":11819233625,"resident_bytes":230899712,"physical_bytes":403802032,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13340,"usage":{"cpu_time_ns":11902769000,"resident_bytes":231768064,"physical_bytes":461064112,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13450,"usage":{"cpu_time_ns":11911332291,"resident_bytes":231948288,"physical_bytes":537020336,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13560,"usage":{"cpu_time_ns":11917327625,"resident_bytes":232390656,"physical_bytes":548603824,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13671,"usage":{"cpu_time_ns":11923259083,"resident_bytes":232833024,"physical_bytes":560613296,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13781,"usage":{"cpu_time_ns":11929796458,"resident_bytes":233226240,"physical_bytes":541575088,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":13891,"usage":{"cpu_time_ns":11935700958,"resident_bytes":233668608,"physical_bytes":541149104,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":14001,"usage":{"cpu_time_ns":11945452541,"resident_bytes":234438656,"physical_bytes":595691440,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":14111,"usage":{"cpu_time_ns":12379474208,"resident_bytes":237355008,"physical_bytes":517818336,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":14221,"usage":{"cpu_time_ns":12807909208,"resident_bytes":238354432,"physical_bytes":517834720,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":14331,"usage":{"cpu_time_ns":12912712875,"resident_bytes":238895104,"physical_bytes":517834720,"peak_physical_bytes":747063144,"disk_read_bytes":39051264,"disk_write_bytes":319275008}}
{"event":"test_resource_sample","elapsed_ms":14441,"usage":{"cpu_time_ns":12979513958,"resident_bytes":232620032,"physical_bytes":496813952,"peak_physical_bytes":747063144,"disk_read_bytes":39075840,"disk_write_bytes":346161152}}
{"event":"test_resource_sample","elapsed_ms":14548,"usage":{"cpu_time_ns":12983783458,"resident_bytes":232620032,"physical_bytes":520570752,"peak_physical_bytes":747063144,"disk_read_bytes":39075840,"disk_write_bytes":346161152}}
{"event":"test_resource_sample","elapsed_ms":14658,"usage":{"cpu_time_ns":12992564791,"resident_bytes":233357312,"physical_bytes":562431872,"peak_physical_bytes":747063144,"disk_read_bytes":39075840,"disk_write_bytes":346161152}}
{"event":"test_resource_sample","elapsed_ms":14768,"usage":{"cpu_time_ns":13433878916,"resident_bytes":236748800,"physical_bytes":578373528,"peak_physical_bytes":747063144,"disk_read_bytes":39075840,"disk_write_bytes":346161152}}
{"event":"test_resource_sample","elapsed_ms":14878,"usage":{"cpu_time_ns":13543829166,"resident_bytes":236748800,"physical_bytes":578373528,"peak_physical_bytes":747063144,"disk_read_bytes":39075840,"disk_write_bytes":346161152}}
{"event":"test_resource_sample","elapsed_ms":14981,"usage":{"cpu_time_ns":13631951291,"resident_bytes":218923008,"physical_bytes":298518352,"peak_physical_bytes":747063144,"disk_read_bytes":39084032,"disk_write_bytes":360722432}}
{"event":"test_resource_sample","elapsed_ms":15091,"usage":{"cpu_time_ns":13750884625,"resident_bytes":217546752,"physical_bytes":295946064,"peak_physical_bytes":747063144,"disk_read_bytes":39084032,"disk_write_bytes":360722432}}
{"event":"test_resource_summary","elapsed_ms":15199,"peak":{"cpu_time_ns":13750884625,"resident_bytes":270729216,"physical_bytes":692553576,"peak_physical_bytes":747063144,"disk_read_bytes":39084032,"disk_write_bytes":360722432},"error":null}
+18
View File
@@ -0,0 +1,18 @@
running 1 test
test engine::metal::deepseek_vision::tests::issue100_full_model_images_cache_and_dspark ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 1.707 ms, residency requested in 460.920 ms, warmup 3.718 ms (mapped 82697.67 MiB from offset 5.09 MiB)
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
ds4: Metal model views created in 0.118 ms, residency requested in 771.569 ms, warmup 0.756 ms (mapped 5711.67 MiB from offset 0.01 MiB)
ds4: Metal mapped mmaped model as 3 overlapping shared buffers
red: The image features a solid red square centered on a white background.
DSpark drafted=15 accepted=10
blue: A solid blue circle centered on a white background.
pair: The first shape is red, and the second shape is blue.
tool image: The color in the image is blue.
issue100: production rendering, image recognition, multi-image/tool input, same-layout image invalidation, disk/warm KV and DSpark target equivalence passed
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 15.10s
@@ -0,0 +1,293 @@
{"event":"test_supervisor_started","pid":37684,"limit_bytes":120259084288,"start_seconds":60.0,"idle_seconds":120.0,"sample_ms":100}
{"event":"test_resource_sample","elapsed_ms":0,"usage":{"cpu_time_ns":172458,"resident_bytes":671744,"physical_bytes":196680,"peak_physical_bytes":213064,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":110,"usage":{"cpu_time_ns":79014291,"resident_bytes":60178432,"physical_bytes":38978136,"peak_physical_bytes":38978136,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":215,"usage":{"cpu_time_ns":165433500,"resident_bytes":129089536,"physical_bytes":83756592,"peak_physical_bytes":83756592,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":325,"usage":{"cpu_time_ns":261924375,"resident_bytes":134348800,"physical_bytes":269092472,"peak_physical_bytes":269092472,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":436,"usage":{"cpu_time_ns":275562625,"resident_bytes":137035776,"physical_bytes":269158008,"peak_physical_bytes":269158008,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":546,"usage":{"cpu_time_ns":381450875,"resident_bytes":137330688,"physical_bytes":271042144,"peak_physical_bytes":335267448,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":656,"usage":{"cpu_time_ns":392603041,"resident_bytes":146014208,"physical_bytes":286328488,"peak_physical_bytes":335267448,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":756,"usage":{"cpu_time_ns":626728583,"resident_bytes":1249771520,"physical_bytes":3413428696,"peak_physical_bytes":3413281240,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":865,"usage":{"cpu_time_ns":847348666,"resident_bytes":2936602624,"physical_bytes":4638740080,"peak_physical_bytes":4638740080,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":976,"usage":{"cpu_time_ns":1178879833,"resident_bytes":4585914368,"physical_bytes":6545969976,"peak_physical_bytes":6545658680,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1083,"usage":{"cpu_time_ns":1349362625,"resident_bytes":5337268224,"physical_bytes":8941491528,"peak_physical_bytes":8941491528,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1193,"usage":{"cpu_time_ns":1641163083,"resident_bytes":7489110016,"physical_bytes":8944147272,"peak_physical_bytes":8944147272,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1304,"usage":{"cpu_time_ns":1884554166,"resident_bytes":9855336448,"physical_bytes":10076299784,"peak_physical_bytes":10076021256,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1414,"usage":{"cpu_time_ns":2087453458,"resident_bytes":10206986240,"physical_bytes":13239427856,"peak_physical_bytes":13239427856,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1524,"usage":{"cpu_time_ns":2372938375,"resident_bytes":12270059520,"physical_bytes":13244098760,"peak_physical_bytes":13244098760,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1632,"usage":{"cpu_time_ns":2593712208,"resident_bytes":13402570752,"physical_bytes":17385925648,"peak_physical_bytes":17385581584,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1742,"usage":{"cpu_time_ns":2827094500,"resident_bytes":15023489024,"physical_bytes":17537298576,"peak_physical_bytes":17537298576,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1849,"usage":{"cpu_time_ns":3100383125,"resident_bytes":17033723904,"physical_bytes":17541035568,"peak_physical_bytes":17541035568,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1959,"usage":{"cpu_time_ns":3267652333,"resident_bytes":17762811904,"physical_bytes":21469231192,"peak_physical_bytes":21469231192,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2066,"usage":{"cpu_time_ns":3300018583,"resident_bytes":17762811904,"physical_bytes":21831710808,"peak_physical_bytes":21831710808,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2166,"usage":{"cpu_time_ns":3379156041,"resident_bytes":18569756672,"physical_bytes":21833661080,"peak_physical_bytes":21833661080,"disk_read_bytes":151552,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2272,"usage":{"cpu_time_ns":3662131166,"resident_bytes":20141162496,"physical_bytes":21837053696,"peak_physical_bytes":21837086464,"disk_read_bytes":495616,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2382,"usage":{"cpu_time_ns":3852920083,"resident_bytes":21920727040,"physical_bytes":22236775488,"peak_physical_bytes":22236775488,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2484,"usage":{"cpu_time_ns":3967280583,"resident_bytes":22012739584,"physical_bytes":23021487216,"peak_physical_bytes":23021323376,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2584,"usage":{"cpu_time_ns":3983733041,"resident_bytes":22012788736,"physical_bytes":23523312752,"peak_physical_bytes":23523312752,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2694,"usage":{"cpu_time_ns":4016687291,"resident_bytes":22011412480,"physical_bytes":24661623920,"peak_physical_bytes":24661443696,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2800,"usage":{"cpu_time_ns":4041146625,"resident_bytes":22011412480,"physical_bytes":25399985264,"peak_physical_bytes":25399985264,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2901,"usage":{"cpu_time_ns":4055634333,"resident_bytes":22010118144,"physical_bytes":25707185264,"peak_physical_bytes":25707185264,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3011,"usage":{"cpu_time_ns":4107557750,"resident_bytes":22010118144,"physical_bytes":26129106032,"peak_physical_bytes":26129106032,"disk_read_bytes":675840,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3115,"usage":{"cpu_time_ns":4365355458,"resident_bytes":24474632192,"physical_bytes":26132974432,"peak_physical_bytes":26132974432,"disk_read_bytes":1003520,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3225,"usage":{"cpu_time_ns":4619785166,"resident_bytes":25976422400,"physical_bytes":26304810952,"peak_physical_bytes":26304810952,"disk_read_bytes":1167360,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3331,"usage":{"cpu_time_ns":4690986541,"resident_bytes":26662043648,"physical_bytes":26988106176,"peak_physical_bytes":26988106176,"disk_read_bytes":1531904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3432,"usage":{"cpu_time_ns":4811608291,"resident_bytes":26904952832,"physical_bytes":27541475944,"peak_physical_bytes":27541475944,"disk_read_bytes":1613824,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3533,"usage":{"cpu_time_ns":4841416375,"resident_bytes":26904035328,"physical_bytes":28270252648,"peak_physical_bytes":28270252648,"disk_read_bytes":1613824,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3633,"usage":{"cpu_time_ns":4863742666,"resident_bytes":26901102592,"physical_bytes":29019198056,"peak_physical_bytes":29019198056,"disk_read_bytes":1613824,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3736,"usage":{"cpu_time_ns":4903229916,"resident_bytes":26901037056,"physical_bytes":29393785448,"peak_physical_bytes":29393785448,"disk_read_bytes":1613824,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3841,"usage":{"cpu_time_ns":5122084916,"resident_bytes":29138714624,"physical_bytes":29483505864,"peak_physical_bytes":29483194568,"disk_read_bytes":2662400,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3951,"usage":{"cpu_time_ns":5374999500,"resident_bytes":29573578752,"physical_bytes":29910047256,"peak_physical_bytes":29910047256,"disk_read_bytes":3551232,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4061,"usage":{"cpu_time_ns":5577649916,"resident_bytes":29601906688,"physical_bytes":29939472944,"peak_physical_bytes":29939505712,"disk_read_bytes":4763648,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4166,"usage":{"cpu_time_ns":5777629208,"resident_bytes":29649616896,"physical_bytes":29991836256,"peak_physical_bytes":29991869024,"disk_read_bytes":26390528,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4277,"usage":{"cpu_time_ns":6085482000,"resident_bytes":29727326208,"physical_bytes":30072363664,"peak_physical_bytes":30072363664,"disk_read_bytes":65073152,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4382,"usage":{"cpu_time_ns":6389288875,"resident_bytes":29802315776,"physical_bytes":30147336896,"peak_physical_bytes":30147353280,"disk_read_bytes":154578944,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4492,"usage":{"cpu_time_ns":6722753375,"resident_bytes":29852008448,"physical_bytes":30199536344,"peak_physical_bytes":30199536344,"disk_read_bytes":184774656,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4599,"usage":{"cpu_time_ns":7061638375,"resident_bytes":29880516608,"physical_bytes":30231599856,"peak_physical_bytes":30231616240,"disk_read_bytes":230371328,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4702,"usage":{"cpu_time_ns":7353204083,"resident_bytes":29944348672,"physical_bytes":30305032992,"peak_physical_bytes":30305032992,"disk_read_bytes":279506944,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4807,"usage":{"cpu_time_ns":7656767625,"resident_bytes":30010556416,"physical_bytes":30384970576,"peak_physical_bytes":30384970576,"disk_read_bytes":332034048,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":4918,"usage":{"cpu_time_ns":7841943791,"resident_bytes":30041243648,"physical_bytes":30414019432,"peak_physical_bytes":30414019432,"disk_read_bytes":333590528,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":5028,"usage":{"cpu_time_ns":7945233875,"resident_bytes":30048305152,"physical_bytes":30414297960,"peak_physical_bytes":30414297960,"disk_read_bytes":333590528,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":5138,"usage":{"cpu_time_ns":8037639833,"resident_bytes":30076436480,"physical_bytes":30277819264,"peak_physical_bytes":30426897280,"disk_read_bytes":345223168,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":5248,"usage":{"cpu_time_ns":8166172708,"resident_bytes":30076485632,"physical_bytes":30311603072,"peak_physical_bytes":30426897280,"disk_read_bytes":362643456,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":5358,"usage":{"cpu_time_ns":8326059375,"resident_bytes":30077042688,"physical_bytes":30312242048,"peak_physical_bytes":30426897280,"disk_read_bytes":365887488,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":5465,"usage":{"cpu_time_ns":8452181750,"resident_bytes":30077091840,"physical_bytes":30312258432,"peak_physical_bytes":30426897280,"disk_read_bytes":366034944,"disk_write_bytes":25317376}}
{"event":"test_resource_sample","elapsed_ms":5575,"usage":{"cpu_time_ns":8561194500,"resident_bytes":30077419520,"physical_bytes":30312258432,"peak_physical_bytes":30426897280,"disk_read_bytes":366034944,"disk_write_bytes":33705984}}
{"event":"test_resource_sample","elapsed_ms":5686,"usage":{"cpu_time_ns":8666788041,"resident_bytes":30070013952,"physical_bytes":30267005848,"peak_physical_bytes":30426897280,"disk_read_bytes":367099904,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":5796,"usage":{"cpu_time_ns":8775923125,"resident_bytes":30085627904,"physical_bytes":30281505688,"peak_physical_bytes":30426897280,"disk_read_bytes":392626176,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":5906,"usage":{"cpu_time_ns":8814061958,"resident_bytes":30083891200,"physical_bytes":30317370288,"peak_physical_bytes":30426897280,"disk_read_bytes":1296498688,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6016,"usage":{"cpu_time_ns":8819137750,"resident_bytes":30083891200,"physical_bytes":30317370288,"peak_physical_bytes":30426897280,"disk_read_bytes":1325469696,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6126,"usage":{"cpu_time_ns":8991600500,"resident_bytes":30074470400,"physical_bytes":30360017840,"peak_physical_bytes":30426897280,"disk_read_bytes":1337217024,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6237,"usage":{"cpu_time_ns":9259636125,"resident_bytes":30074667008,"physical_bytes":30365260720,"peak_physical_bytes":30426897280,"disk_read_bytes":1339346944,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6347,"usage":{"cpu_time_ns":9522133791,"resident_bytes":30074863616,"physical_bytes":30370503600,"peak_physical_bytes":30426897280,"disk_read_bytes":1393807360,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6455,"usage":{"cpu_time_ns":9758080750,"resident_bytes":30075076608,"physical_bytes":30375746480,"peak_physical_bytes":30426897280,"disk_read_bytes":1394642944,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6565,"usage":{"cpu_time_ns":10011188666,"resident_bytes":30075273216,"physical_bytes":30380858288,"peak_physical_bytes":30426897280,"disk_read_bytes":1394642944,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6675,"usage":{"cpu_time_ns":10307665458,"resident_bytes":30075420672,"physical_bytes":30384954288,"peak_physical_bytes":30426897280,"disk_read_bytes":1394642944,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6782,"usage":{"cpu_time_ns":10580451791,"resident_bytes":30075568128,"physical_bytes":30388673456,"peak_physical_bytes":30426897280,"disk_read_bytes":1394823168,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":6892,"usage":{"cpu_time_ns":10896423833,"resident_bytes":30075715584,"physical_bytes":30392818608,"peak_physical_bytes":30426897280,"disk_read_bytes":1395314688,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7001,"usage":{"cpu_time_ns":11164930083,"resident_bytes":30075912192,"physical_bytes":30398061488,"peak_physical_bytes":30426897280,"disk_read_bytes":1395970048,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7111,"usage":{"cpu_time_ns":11499992666,"resident_bytes":30076059648,"physical_bytes":30401797040,"peak_physical_bytes":30426897280,"disk_read_bytes":1396494336,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7221,"usage":{"cpu_time_ns":11790385083,"resident_bytes":30076207104,"physical_bytes":30405942192,"peak_physical_bytes":30426897280,"disk_read_bytes":1396969472,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7331,"usage":{"cpu_time_ns":12101886958,"resident_bytes":30076354560,"physical_bytes":30428781488,"peak_physical_bytes":30428814256,"disk_read_bytes":1397493760,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7442,"usage":{"cpu_time_ns":12238553375,"resident_bytes":30076911616,"physical_bytes":30433549208,"peak_physical_bytes":30433549208,"disk_read_bytes":1405079552,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7543,"usage":{"cpu_time_ns":12275020583,"resident_bytes":30076878848,"physical_bytes":30434401176,"peak_physical_bytes":30434597784,"disk_read_bytes":2168623104,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7649,"usage":{"cpu_time_ns":12303557666,"resident_bytes":30070734848,"physical_bytes":30434401176,"peak_physical_bytes":30434597784,"disk_read_bytes":2840956928,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7759,"usage":{"cpu_time_ns":12377144416,"resident_bytes":30063755264,"physical_bytes":30344436632,"peak_physical_bytes":30456912792,"disk_read_bytes":3501359104,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7869,"usage":{"cpu_time_ns":12895256958,"resident_bytes":30102257664,"physical_bytes":30347598792,"peak_physical_bytes":30456912792,"disk_read_bytes":3513008128,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":7979,"usage":{"cpu_time_ns":13404548375,"resident_bytes":30109450240,"physical_bytes":30354725832,"peak_physical_bytes":30456912792,"disk_read_bytes":3524509696,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8089,"usage":{"cpu_time_ns":13917976666,"resident_bytes":30109499392,"physical_bytes":30354742216,"peak_physical_bytes":30456912792,"disk_read_bytes":3531341824,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8200,"usage":{"cpu_time_ns":14435387125,"resident_bytes":30109532160,"physical_bytes":30354742216,"peak_physical_bytes":30456912792,"disk_read_bytes":3542417408,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8310,"usage":{"cpu_time_ns":14681285291,"resident_bytes":30109548544,"physical_bytes":30354742216,"peak_physical_bytes":30456912792,"disk_read_bytes":3549560832,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8420,"usage":{"cpu_time_ns":15303234375,"resident_bytes":30109564928,"physical_bytes":30354742216,"peak_physical_bytes":30456912792,"disk_read_bytes":3557015552,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8531,"usage":{"cpu_time_ns":15556167666,"resident_bytes":30109614080,"physical_bytes":30354709448,"peak_physical_bytes":30456912792,"disk_read_bytes":3557015552,"disk_write_bytes":51015680}}
{"event":"test_resource_sample","elapsed_ms":8634,"usage":{"cpu_time_ns":15651460416,"resident_bytes":30107254784,"physical_bytes":30257798112,"peak_physical_bytes":30456912792,"disk_read_bytes":3557072896,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":8744,"usage":{"cpu_time_ns":15760740875,"resident_bytes":30123098112,"physical_bytes":30273625032,"peak_physical_bytes":30456912792,"disk_read_bytes":3585167360,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":8849,"usage":{"cpu_time_ns":15826246500,"resident_bytes":30122262528,"physical_bytes":30328757216,"peak_physical_bytes":30456912792,"disk_read_bytes":3585167360,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":8959,"usage":{"cpu_time_ns":15924891833,"resident_bytes":30106697728,"physical_bytes":30346124280,"peak_physical_bytes":30456912792,"disk_read_bytes":3587559424,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9061,"usage":{"cpu_time_ns":16231248291,"resident_bytes":30106845184,"physical_bytes":30369520632,"peak_physical_bytes":30456912792,"disk_read_bytes":3642888192,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9163,"usage":{"cpu_time_ns":16508232875,"resident_bytes":30107090944,"physical_bytes":30374812664,"peak_physical_bytes":30456912792,"disk_read_bytes":3643904000,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9274,"usage":{"cpu_time_ns":16835094875,"resident_bytes":30107238400,"physical_bytes":30379006968,"peak_physical_bytes":30456912792,"disk_read_bytes":3644755968,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9384,"usage":{"cpu_time_ns":17064060750,"resident_bytes":30107435008,"physical_bytes":30384249848,"peak_physical_bytes":30456912792,"disk_read_bytes":3672969216,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9494,"usage":{"cpu_time_ns":17367804333,"resident_bytes":30107582464,"physical_bytes":30387969016,"peak_physical_bytes":30456912792,"disk_read_bytes":3673378816,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9599,"usage":{"cpu_time_ns":17635300833,"resident_bytes":30107779072,"physical_bytes":30393211896,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9701,"usage":{"cpu_time_ns":17876276583,"resident_bytes":30107877376,"physical_bytes":30395603960,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9804,"usage":{"cpu_time_ns":18099795833,"resident_bytes":30108073984,"physical_bytes":30400846840,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":9915,"usage":{"cpu_time_ns":18370225458,"resident_bytes":30108221440,"physical_bytes":30404991992,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10025,"usage":{"cpu_time_ns":18649135000,"resident_bytes":30108418048,"physical_bytes":30410234872,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10135,"usage":{"cpu_time_ns":18950571583,"resident_bytes":30108565504,"physical_bytes":30413954040,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10238,"usage":{"cpu_time_ns":19243127416,"resident_bytes":30108712960,"physical_bytes":30418099192,"peak_physical_bytes":30456912792,"disk_read_bytes":3673493504,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10348,"usage":{"cpu_time_ns":19468346291,"resident_bytes":30109204480,"physical_bytes":30440954848,"peak_physical_bytes":30456912792,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10458,"usage":{"cpu_time_ns":19655778208,"resident_bytes":30110433280,"physical_bytes":30357183456,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10568,"usage":{"cpu_time_ns":20202366125,"resident_bytes":30111973376,"physical_bytes":30356986848,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10673,"usage":{"cpu_time_ns":20799819541,"resident_bytes":30111973376,"physical_bytes":30356986848,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10783,"usage":{"cpu_time_ns":21514310958,"resident_bytes":30111973376,"physical_bytes":30356986848,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10884,"usage":{"cpu_time_ns":21680742833,"resident_bytes":30111989760,"physical_bytes":30357150688,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":10994,"usage":{"cpu_time_ns":22207464041,"resident_bytes":30112006144,"physical_bytes":30357167072,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":11104,"usage":{"cpu_time_ns":22741278583,"resident_bytes":30112006144,"physical_bytes":30357167072,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":11215,"usage":{"cpu_time_ns":22851533541,"resident_bytes":30112006144,"physical_bytes":30357167072,"peak_physical_bytes":30465694688,"disk_read_bytes":3674755072,"disk_write_bytes":77099008}}
{"event":"test_resource_sample","elapsed_ms":11325,"usage":{"cpu_time_ns":22954984250,"resident_bytes":30126407680,"physical_bytes":30357167072,"peak_physical_bytes":30465694688,"disk_read_bytes":3674759168,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11432,"usage":{"cpu_time_ns":23052234291,"resident_bytes":30128291840,"physical_bytes":30421556192,"peak_physical_bytes":30465694688,"disk_read_bytes":3674759168,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11542,"usage":{"cpu_time_ns":23071331375,"resident_bytes":30130733056,"physical_bytes":30421556192,"peak_physical_bytes":30465694688,"disk_read_bytes":3693780992,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11646,"usage":{"cpu_time_ns":23209985166,"resident_bytes":30127259648,"physical_bytes":30357363680,"peak_physical_bytes":30465694688,"disk_read_bytes":3727990784,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11748,"usage":{"cpu_time_ns":23297664208,"resident_bytes":30127259648,"physical_bytes":30357363680,"peak_physical_bytes":30465694688,"disk_read_bytes":3753467904,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11859,"usage":{"cpu_time_ns":23372176750,"resident_bytes":30134337536,"physical_bytes":30364441568,"peak_physical_bytes":30465694688,"disk_read_bytes":3755483136,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":11965,"usage":{"cpu_time_ns":23459469083,"resident_bytes":30134337536,"physical_bytes":30364441568,"peak_physical_bytes":30465694688,"disk_read_bytes":3766525952,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12075,"usage":{"cpu_time_ns":23546605333,"resident_bytes":30134337536,"physical_bytes":30364441568,"peak_physical_bytes":30465694688,"disk_read_bytes":3793051648,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12182,"usage":{"cpu_time_ns":23583082666,"resident_bytes":30141415424,"physical_bytes":30371519456,"peak_physical_bytes":30465694688,"disk_read_bytes":3798605824,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12289,"usage":{"cpu_time_ns":23633072125,"resident_bytes":30141415424,"physical_bytes":30371519456,"peak_physical_bytes":30465694688,"disk_read_bytes":3836813312,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12396,"usage":{"cpu_time_ns":24173243166,"resident_bytes":30141480960,"physical_bytes":30371519456,"peak_physical_bytes":30465694688,"disk_read_bytes":3836862464,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12507,"usage":{"cpu_time_ns":24283430333,"resident_bytes":30141480960,"physical_bytes":30371519456,"peak_physical_bytes":30465694688,"disk_read_bytes":3836862464,"disk_write_bytes":129265664}}
{"event":"test_resource_sample","elapsed_ms":12615,"usage":{"cpu_time_ns":24386579583,"resident_bytes":30124589056,"physical_bytes":30272494560,"peak_physical_bytes":30465694688,"disk_read_bytes":3836866560,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":12716,"usage":{"cpu_time_ns":24487581875,"resident_bytes":30136434688,"physical_bytes":30279801824,"peak_physical_bytes":30465694688,"disk_read_bytes":3836866560,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":12827,"usage":{"cpu_time_ns":24542420333,"resident_bytes":30138351616,"physical_bytes":30343994336,"peak_physical_bytes":30465694688,"disk_read_bytes":3836866560,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":12937,"usage":{"cpu_time_ns":24609636250,"resident_bytes":30138368000,"physical_bytes":30316485600,"peak_physical_bytes":30465694688,"disk_read_bytes":3836866560,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13047,"usage":{"cpu_time_ns":24660025500,"resident_bytes":30138892288,"physical_bytes":30322711520,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13157,"usage":{"cpu_time_ns":24704671666,"resident_bytes":30138892288,"physical_bytes":30322711520,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13267,"usage":{"cpu_time_ns":24729231875,"resident_bytes":30138892288,"physical_bytes":30322711520,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13377,"usage":{"cpu_time_ns":24752070791,"resident_bytes":30138892288,"physical_bytes":30322711520,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13488,"usage":{"cpu_time_ns":24765555666,"resident_bytes":30138892288,"physical_bytes":30322711520,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13598,"usage":{"cpu_time_ns":25018497416,"resident_bytes":30140628992,"physical_bytes":30333918176,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13699,"usage":{"cpu_time_ns":25368037541,"resident_bytes":30141661184,"physical_bytes":30333918176,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":156889088}}
{"event":"test_resource_sample","elapsed_ms":13809,"usage":{"cpu_time_ns":25477831208,"resident_bytes":30142873600,"physical_bytes":30333918176,"peak_physical_bytes":30465694688,"disk_read_bytes":3836882944,"disk_write_bytes":173666304}}
{"event":"test_resource_sample","elapsed_ms":13920,"usage":{"cpu_time_ns":25581216666,"resident_bytes":30143119360,"physical_bytes":30333918176,"peak_physical_bytes":30465694688,"disk_read_bytes":3836956672,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14030,"usage":{"cpu_time_ns":25614751625,"resident_bytes":30145019904,"physical_bytes":30398143456,"peak_physical_bytes":30465694688,"disk_read_bytes":3836956672,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14140,"usage":{"cpu_time_ns":25695362083,"resident_bytes":30146658304,"physical_bytes":30398143456,"peak_physical_bytes":30465694688,"disk_read_bytes":3836956672,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14249,"usage":{"cpu_time_ns":25732065166,"resident_bytes":30145069056,"physical_bytes":30398192608,"peak_physical_bytes":30465694688,"disk_read_bytes":3836956672,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14359,"usage":{"cpu_time_ns":25959792416,"resident_bytes":30146412544,"physical_bytes":30448032736,"peak_physical_bytes":30465694688,"disk_read_bytes":3913797632,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14465,"usage":{"cpu_time_ns":26150650916,"resident_bytes":30146838528,"physical_bytes":30448409568,"peak_physical_bytes":30465694688,"disk_read_bytes":4004794368,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14572,"usage":{"cpu_time_ns":26389519916,"resident_bytes":30147198976,"physical_bytes":30448770016,"peak_physical_bytes":30465694688,"disk_read_bytes":4051668992,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14682,"usage":{"cpu_time_ns":26595790083,"resident_bytes":30148558848,"physical_bytes":30450113504,"peak_physical_bytes":30465694688,"disk_read_bytes":4068954112,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14792,"usage":{"cpu_time_ns":26764758875,"resident_bytes":30148935680,"physical_bytes":30450392032,"peak_physical_bytes":30465694688,"disk_read_bytes":4070150144,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":14902,"usage":{"cpu_time_ns":27008912125,"resident_bytes":30149296128,"physical_bytes":30450752480,"peak_physical_bytes":30465694688,"disk_read_bytes":4071575552,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15013,"usage":{"cpu_time_ns":27269163333,"resident_bytes":30149591040,"physical_bytes":30451047392,"peak_physical_bytes":30465694688,"disk_read_bytes":4072296448,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15123,"usage":{"cpu_time_ns":27524712833,"resident_bytes":30149951488,"physical_bytes":30451407840,"peak_physical_bytes":30465694688,"disk_read_bytes":4083585024,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15233,"usage":{"cpu_time_ns":27783522833,"resident_bytes":30150311936,"physical_bytes":30451768288,"peak_physical_bytes":30465694688,"disk_read_bytes":4092989440,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15343,"usage":{"cpu_time_ns":28006672083,"resident_bytes":30150672384,"physical_bytes":30452128736,"peak_physical_bytes":30465694688,"disk_read_bytes":4104966144,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15453,"usage":{"cpu_time_ns":28262583291,"resident_bytes":30150934528,"physical_bytes":30452390880,"peak_physical_bytes":30465694688,"disk_read_bytes":4110848000,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15563,"usage":{"cpu_time_ns":28436411791,"resident_bytes":30151081984,"physical_bytes":30471363552,"peak_physical_bytes":30471478240,"disk_read_bytes":4230991872,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15673,"usage":{"cpu_time_ns":28522152083,"resident_bytes":30151081984,"physical_bytes":30490237920,"peak_physical_bytes":30490237920,"disk_read_bytes":4239347712,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15782,"usage":{"cpu_time_ns":29074400041,"resident_bytes":30151131136,"physical_bytes":30379105248,"peak_physical_bytes":30490237920,"disk_read_bytes":4239364096,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15885,"usage":{"cpu_time_ns":29177243833,"resident_bytes":30151131136,"physical_bytes":30379105248,"peak_physical_bytes":30490237920,"disk_read_bytes":4239364096,"disk_write_bytes":184512512}}
{"event":"test_resource_sample","elapsed_ms":15996,"usage":{"cpu_time_ns":29282412833,"resident_bytes":30163435520,"physical_bytes":30379105248,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16106,"usage":{"cpu_time_ns":29379956166,"resident_bytes":30165303296,"physical_bytes":30443330528,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16216,"usage":{"cpu_time_ns":29401162041,"resident_bytes":30166941696,"physical_bytes":30443330528,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16326,"usage":{"cpu_time_ns":29502622625,"resident_bytes":30165336064,"physical_bytes":30443363296,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16436,"usage":{"cpu_time_ns":29519998500,"resident_bytes":30163484672,"physical_bytes":30379154400,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16547,"usage":{"cpu_time_ns":29620050500,"resident_bytes":30165368832,"physical_bytes":30443396064,"peak_physical_bytes":30490237920,"disk_read_bytes":4239372288,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16657,"usage":{"cpu_time_ns":29683406750,"resident_bytes":30166482944,"physical_bytes":30395390944,"peak_physical_bytes":30490237920,"disk_read_bytes":4250497024,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16765,"usage":{"cpu_time_ns":29947350000,"resident_bytes":30166548480,"physical_bytes":30396210144,"peak_physical_bytes":30490237920,"disk_read_bytes":4309020672,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16875,"usage":{"cpu_time_ns":30196229333,"resident_bytes":30166581248,"physical_bytes":30396210144,"peak_physical_bytes":30490237920,"disk_read_bytes":4312068096,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":16982,"usage":{"cpu_time_ns":30371828625,"resident_bytes":30166581248,"physical_bytes":30396210144,"peak_physical_bytes":30490237920,"disk_read_bytes":4314918912,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17092,"usage":{"cpu_time_ns":30628974000,"resident_bytes":30166482944,"physical_bytes":30396095456,"peak_physical_bytes":30490237920,"disk_read_bytes":4372295680,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17197,"usage":{"cpu_time_ns":30840286958,"resident_bytes":30166908928,"physical_bytes":30487714808,"peak_physical_bytes":30490237920,"disk_read_bytes":4445351936,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17307,"usage":{"cpu_time_ns":31024411875,"resident_bytes":30167236608,"physical_bytes":30488042488,"peak_physical_bytes":30490237920,"disk_read_bytes":4465127424,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17418,"usage":{"cpu_time_ns":31204110208,"resident_bytes":30167662592,"physical_bytes":30488468472,"peak_physical_bytes":30490237920,"disk_read_bytes":4465307648,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17528,"usage":{"cpu_time_ns":31387529458,"resident_bytes":30167990272,"physical_bytes":30488714232,"peak_physical_bytes":30490237920,"disk_read_bytes":4471746560,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17638,"usage":{"cpu_time_ns":31573751916,"resident_bytes":30168317952,"physical_bytes":30489041912,"peak_physical_bytes":30490237920,"disk_read_bytes":4472057856,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17748,"usage":{"cpu_time_ns":31762003708,"resident_bytes":30168727552,"physical_bytes":30489451512,"peak_physical_bytes":30490237920,"disk_read_bytes":4472123392,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17858,"usage":{"cpu_time_ns":31929757500,"resident_bytes":30169055232,"physical_bytes":30489779192,"peak_physical_bytes":30490237920,"disk_read_bytes":4475121664,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":17969,"usage":{"cpu_time_ns":32113021125,"resident_bytes":30169481216,"physical_bytes":30490205176,"peak_physical_bytes":30490237920,"disk_read_bytes":4480774144,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18079,"usage":{"cpu_time_ns":32287936958,"resident_bytes":30169808896,"physical_bytes":30490532856,"peak_physical_bytes":30490532856,"disk_read_bytes":4483657728,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18189,"usage":{"cpu_time_ns":32439398458,"resident_bytes":30170005504,"physical_bytes":30490713056,"peak_physical_bytes":30490827768,"disk_read_bytes":4530761728,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18299,"usage":{"cpu_time_ns":32522143625,"resident_bytes":30170005504,"physical_bytes":30490860512,"peak_physical_bytes":30490860512,"disk_read_bytes":4533006336,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18409,"usage":{"cpu_time_ns":33100925041,"resident_bytes":30170103808,"physical_bytes":30384823264,"peak_physical_bytes":30490860512,"disk_read_bytes":4533596160,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18519,"usage":{"cpu_time_ns":33210887083,"resident_bytes":30170103808,"physical_bytes":30384823264,"peak_physical_bytes":30490860512,"disk_read_bytes":4533596160,"disk_write_bytes":224579584}}
{"event":"test_resource_sample","elapsed_ms":18620,"usage":{"cpu_time_ns":33306021083,"resident_bytes":30135828480,"physical_bytes":30284192736,"peak_physical_bytes":30490860512,"disk_read_bytes":4533669888,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":18730,"usage":{"cpu_time_ns":33414152833,"resident_bytes":30147657728,"physical_bytes":30289370080,"peak_physical_bytes":30490860512,"disk_read_bytes":4559912960,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":18832,"usage":{"cpu_time_ns":33488920500,"resident_bytes":30149541888,"physical_bytes":30353611744,"peak_physical_bytes":30490860512,"disk_read_bytes":4559912960,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":18942,"usage":{"cpu_time_ns":33569982125,"resident_bytes":30135369728,"physical_bytes":30372338680,"peak_physical_bytes":30490860512,"disk_read_bytes":4570775552,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19049,"usage":{"cpu_time_ns":33810365125,"resident_bytes":30135566336,"physical_bytes":30397242336,"peak_physical_bytes":30490860512,"disk_read_bytes":4573577216,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19159,"usage":{"cpu_time_ns":33994178166,"resident_bytes":30135762944,"physical_bytes":30402485216,"peak_physical_bytes":30490860512,"disk_read_bytes":4578951168,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19263,"usage":{"cpu_time_ns":34182716625,"resident_bytes":30135959552,"physical_bytes":30407728096,"peak_physical_bytes":30490860512,"disk_read_bytes":4579131392,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19365,"usage":{"cpu_time_ns":34420288500,"resident_bytes":30138220544,"physical_bytes":30415035360,"peak_physical_bytes":30490860512,"disk_read_bytes":4582146048,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19467,"usage":{"cpu_time_ns":34705557958,"resident_bytes":30138368000,"physical_bytes":30417705952,"peak_physical_bytes":30490860512,"disk_read_bytes":4582342656,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19577,"usage":{"cpu_time_ns":34939255625,"resident_bytes":30138466304,"physical_bytes":30420720608,"peak_physical_bytes":30490860512,"disk_read_bytes":4582375424,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19688,"usage":{"cpu_time_ns":35300182250,"resident_bytes":30138613760,"physical_bytes":30424865760,"peak_physical_bytes":30490860512,"disk_read_bytes":4582424576,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19798,"usage":{"cpu_time_ns":35573245375,"resident_bytes":30138761216,"physical_bytes":30428584928,"peak_physical_bytes":30490860512,"disk_read_bytes":4582490112,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":19908,"usage":{"cpu_time_ns":35878756583,"resident_bytes":30138957824,"physical_bytes":30433827808,"peak_physical_bytes":30490860512,"disk_read_bytes":4585406464,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20018,"usage":{"cpu_time_ns":36185725041,"resident_bytes":30138646528,"physical_bytes":30437972960,"peak_physical_bytes":30490860512,"disk_read_bytes":4585996288,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20128,"usage":{"cpu_time_ns":36479011166,"resident_bytes":30138793984,"physical_bytes":30441692128,"peak_physical_bytes":30490860512,"disk_read_bytes":4586143744,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20237,"usage":{"cpu_time_ns":36787288625,"resident_bytes":30138957824,"physical_bytes":30464941024,"peak_physical_bytes":30490860512,"disk_read_bytes":4588519424,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20347,"usage":{"cpu_time_ns":37007103291,"resident_bytes":30139449344,"physical_bytes":30468709344,"peak_physical_bytes":30490860512,"disk_read_bytes":4621811712,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20457,"usage":{"cpu_time_ns":37104526250,"resident_bytes":30139465728,"physical_bytes":30381841376,"peak_physical_bytes":30492826592,"disk_read_bytes":4622778368,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20567,"usage":{"cpu_time_ns":37688377958,"resident_bytes":30149312512,"physical_bytes":30391819232,"peak_physical_bytes":30492826592,"disk_read_bytes":4622778368,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20677,"usage":{"cpu_time_ns":38275103833,"resident_bytes":30149312512,"physical_bytes":30391819232,"peak_physical_bytes":30492826592,"disk_read_bytes":4629872640,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20787,"usage":{"cpu_time_ns":38856834416,"resident_bytes":30156406784,"physical_bytes":30399060960,"peak_physical_bytes":30492826592,"disk_read_bytes":4634345472,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":20898,"usage":{"cpu_time_ns":39451263125,"resident_bytes":30156406784,"physical_bytes":30399060960,"peak_physical_bytes":30492826592,"disk_read_bytes":4634345472,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":21003,"usage":{"cpu_time_ns":39596631333,"resident_bytes":30156455936,"physical_bytes":30399060960,"peak_physical_bytes":30492826592,"disk_read_bytes":4641406976,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":21113,"usage":{"cpu_time_ns":40182793708,"resident_bytes":30156488704,"physical_bytes":30399060960,"peak_physical_bytes":30492826592,"disk_read_bytes":4641456128,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":21223,"usage":{"cpu_time_ns":40695415708,"resident_bytes":30156505088,"physical_bytes":30399077344,"peak_physical_bytes":30492826592,"disk_read_bytes":4641456128,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":21332,"usage":{"cpu_time_ns":40803346916,"resident_bytes":30156505088,"physical_bytes":30399077344,"peak_physical_bytes":30492826592,"disk_read_bytes":4641456128,"disk_write_bytes":278126592}}
{"event":"test_resource_sample","elapsed_ms":21442,"usage":{"cpu_time_ns":40907531041,"resident_bytes":30179966976,"physical_bytes":30328151008,"peak_physical_bytes":30492826592,"disk_read_bytes":4679618560,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":21548,"usage":{"cpu_time_ns":41013934541,"resident_bytes":30177378304,"physical_bytes":30318926816,"peak_physical_bytes":30492826592,"disk_read_bytes":4679618560,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":21659,"usage":{"cpu_time_ns":41027781583,"resident_bytes":30179311616,"physical_bytes":30383332320,"peak_physical_bytes":30492826592,"disk_read_bytes":4679618560,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":21765,"usage":{"cpu_time_ns":41119768458,"resident_bytes":30177460224,"physical_bytes":30319123424,"peak_physical_bytes":30492826592,"disk_read_bytes":4679618560,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":21875,"usage":{"cpu_time_ns":41156868000,"resident_bytes":30179328000,"physical_bytes":30383348704,"peak_physical_bytes":30492826592,"disk_read_bytes":4679618560,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":21985,"usage":{"cpu_time_ns":41342061583,"resident_bytes":30156095488,"physical_bytes":30509161464,"peak_physical_bytes":30509161464,"disk_read_bytes":4723347456,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22096,"usage":{"cpu_time_ns":41616151666,"resident_bytes":30156390400,"physical_bytes":30524824568,"peak_physical_bytes":30524824568,"disk_read_bytes":4769927168,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22206,"usage":{"cpu_time_ns":41852867791,"resident_bytes":30156685312,"physical_bytes":30527642616,"peak_physical_bytes":30527642616,"disk_read_bytes":4770009088,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22316,"usage":{"cpu_time_ns":42065418000,"resident_bytes":30156980224,"physical_bytes":30530460664,"peak_physical_bytes":30530460664,"disk_read_bytes":4777152512,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22416,"usage":{"cpu_time_ns":42257686500,"resident_bytes":30157275136,"physical_bytes":30533278712,"peak_physical_bytes":30533278712,"disk_read_bytes":4777234432,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22527,"usage":{"cpu_time_ns":42481148333,"resident_bytes":30157570048,"physical_bytes":30535736312,"peak_physical_bytes":30536113144,"disk_read_bytes":4777742336,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22632,"usage":{"cpu_time_ns":42659996041,"resident_bytes":30157864960,"physical_bytes":30538554360,"peak_physical_bytes":30538570744,"disk_read_bytes":4783755264,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22739,"usage":{"cpu_time_ns":42862177166,"resident_bytes":30158159872,"physical_bytes":30541372408,"peak_physical_bytes":30541372408,"disk_read_bytes":4784214016,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22849,"usage":{"cpu_time_ns":43088445208,"resident_bytes":30158618624,"physical_bytes":30545828856,"peak_physical_bytes":30545828856,"disk_read_bytes":4784836608,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":22959,"usage":{"cpu_time_ns":43349610208,"resident_bytes":30158913536,"physical_bytes":30548646904,"peak_physical_bytes":30548646904,"disk_read_bytes":4785442816,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23067,"usage":{"cpu_time_ns":43608854250,"resident_bytes":30159208448,"physical_bytes":30551464952,"peak_physical_bytes":30551464952,"disk_read_bytes":4785786880,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23177,"usage":{"cpu_time_ns":43805280375,"resident_bytes":30159503360,"physical_bytes":30554283000,"peak_physical_bytes":30554283000,"disk_read_bytes":4786147328,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23287,"usage":{"cpu_time_ns":44005966125,"resident_bytes":30159929344,"physical_bytes":30558280696,"peak_physical_bytes":30558280696,"disk_read_bytes":4786786304,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23397,"usage":{"cpu_time_ns":44262162083,"resident_bytes":30160224256,"physical_bytes":30561098744,"peak_physical_bytes":30561098744,"disk_read_bytes":4787277824,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23508,"usage":{"cpu_time_ns":44530889250,"resident_bytes":30160519168,"physical_bytes":30563916792,"peak_physical_bytes":30563933176,"disk_read_bytes":4787834880,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23618,"usage":{"cpu_time_ns":44753365875,"resident_bytes":30160814080,"physical_bytes":30566571000,"peak_physical_bytes":30566587384,"disk_read_bytes":4788342784,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23728,"usage":{"cpu_time_ns":44987289625,"resident_bytes":30161108992,"physical_bytes":30569389048,"peak_physical_bytes":30569405432,"disk_read_bytes":4788736000,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23838,"usage":{"cpu_time_ns":45216566166,"resident_bytes":30161403904,"physical_bytes":30572207096,"peak_physical_bytes":30572223480,"disk_read_bytes":4789194752,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":23948,"usage":{"cpu_time_ns":45458169458,"resident_bytes":30161862656,"physical_bytes":30576663544,"peak_physical_bytes":30576663544,"disk_read_bytes":4795437056,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24059,"usage":{"cpu_time_ns":45684483458,"resident_bytes":30162010112,"physical_bytes":30596963320,"peak_physical_bytes":30596979704,"disk_read_bytes":4887220224,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24169,"usage":{"cpu_time_ns":45826783208,"resident_bytes":30162567168,"physical_bytes":30599748600,"peak_physical_bytes":30599748600,"disk_read_bytes":4964274176,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24279,"usage":{"cpu_time_ns":45925905458,"resident_bytes":30162583552,"physical_bytes":30408629240,"peak_physical_bytes":30624177144,"disk_read_bytes":4965617664,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24382,"usage":{"cpu_time_ns":46507525833,"resident_bytes":30165368832,"physical_bytes":30411758584,"peak_physical_bytes":30624177144,"disk_read_bytes":4965617664,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24488,"usage":{"cpu_time_ns":47114579208,"resident_bytes":30165417984,"physical_bytes":30411889656,"peak_physical_bytes":30624177144,"disk_read_bytes":4972318720,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24599,"usage":{"cpu_time_ns":47722864833,"resident_bytes":30165434368,"physical_bytes":30411889656,"peak_physical_bytes":30624177144,"disk_read_bytes":4975120384,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24709,"usage":{"cpu_time_ns":48327934916,"resident_bytes":30165549056,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4977561600,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24815,"usage":{"cpu_time_ns":48436081625,"resident_bytes":30165549056,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4986753024,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":24925,"usage":{"cpu_time_ns":49015098916,"resident_bytes":30165565440,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4993798144,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25036,"usage":{"cpu_time_ns":49613245416,"resident_bytes":30165565440,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4993814528,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25146,"usage":{"cpu_time_ns":50201444791,"resident_bytes":30165614592,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4993814528,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25248,"usage":{"cpu_time_ns":50782855791,"resident_bytes":30165614592,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4994600960,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25359,"usage":{"cpu_time_ns":50855208875,"resident_bytes":30165614592,"physical_bytes":30411922424,"peak_physical_bytes":30624177144,"disk_read_bytes":4996796416,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25465,"usage":{"cpu_time_ns":51429409333,"resident_bytes":30165630976,"physical_bytes":30411938808,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25575,"usage":{"cpu_time_ns":51539702083,"resident_bytes":30165630976,"physical_bytes":30411709432,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":304209920}}
{"event":"test_resource_sample","elapsed_ms":25686,"usage":{"cpu_time_ns":51647167208,"resident_bytes":30191632384,"physical_bytes":30411709432,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":25800,"usage":{"cpu_time_ns":51757197416,"resident_bytes":30191632384,"physical_bytes":30411709432,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":25910,"usage":{"cpu_time_ns":51790196791,"resident_bytes":30193500160,"physical_bytes":30476164088,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26015,"usage":{"cpu_time_ns":51860793958,"resident_bytes":30191648768,"physical_bytes":30411955192,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26125,"usage":{"cpu_time_ns":51925178791,"resident_bytes":30193532928,"physical_bytes":30476196856,"peak_physical_bytes":30624177144,"disk_read_bytes":4996812800,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26235,"usage":{"cpu_time_ns":51976582666,"resident_bytes":30161207296,"physical_bytes":30306589688,"peak_physical_bytes":30624177144,"disk_read_bytes":4997353472,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26346,"usage":{"cpu_time_ns":52086761666,"resident_bytes":30158635008,"physical_bytes":30303902712,"peak_physical_bytes":30624177144,"disk_read_bytes":4997877760,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26456,"usage":{"cpu_time_ns":52140797166,"resident_bytes":30160535552,"physical_bytes":30368177168,"peak_physical_bytes":30624177144,"disk_read_bytes":4997877760,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26566,"usage":{"cpu_time_ns":52166837416,"resident_bytes":30161747968,"physical_bytes":30325447696,"peak_physical_bytes":30624177144,"disk_read_bytes":4997877760,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26676,"usage":{"cpu_time_ns":52270796375,"resident_bytes":30161747968,"physical_bytes":30384987152,"peak_physical_bytes":30624177144,"disk_read_bytes":5015490560,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26786,"usage":{"cpu_time_ns":52371656958,"resident_bytes":30161747968,"physical_bytes":30384987152,"peak_physical_bytes":30624177144,"disk_read_bytes":5015490560,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":26897,"usage":{"cpu_time_ns":52488050708,"resident_bytes":30161747968,"physical_bytes":30384987152,"peak_physical_bytes":30624177144,"disk_read_bytes":5015490560,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27007,"usage":{"cpu_time_ns":52742979291,"resident_bytes":30161846272,"physical_bytes":30431255568,"peak_physical_bytes":30624177144,"disk_read_bytes":5033021440,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27117,"usage":{"cpu_time_ns":53054210000,"resident_bytes":30161993728,"physical_bytes":30434974736,"peak_physical_bytes":30624177144,"disk_read_bytes":5038051328,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27227,"usage":{"cpu_time_ns":53321723708,"resident_bytes":30162141184,"physical_bytes":30439119888,"peak_physical_bytes":30624177144,"disk_read_bytes":5040885760,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27335,"usage":{"cpu_time_ns":53600033875,"resident_bytes":30162337792,"physical_bytes":30444362768,"peak_physical_bytes":30624177144,"disk_read_bytes":5040984064,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27445,"usage":{"cpu_time_ns":53854126750,"resident_bytes":30162485248,"physical_bytes":30448081936,"peak_physical_bytes":30624177144,"disk_read_bytes":5041082368,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27556,"usage":{"cpu_time_ns":54171421458,"resident_bytes":30162632704,"physical_bytes":30452030480,"peak_physical_bytes":30624177144,"disk_read_bytes":5041213440,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27666,"usage":{"cpu_time_ns":54459903458,"resident_bytes":30162780160,"physical_bytes":30455749648,"peak_physical_bytes":30624177144,"disk_read_bytes":5041311744,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27776,"usage":{"cpu_time_ns":54741755500,"resident_bytes":30162976768,"physical_bytes":30460992528,"peak_physical_bytes":30624177144,"disk_read_bytes":5041328128,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27886,"usage":{"cpu_time_ns":55008021375,"resident_bytes":30163124224,"physical_bytes":30465137680,"peak_physical_bytes":30624177144,"disk_read_bytes":5041737728,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":27996,"usage":{"cpu_time_ns":55327138000,"resident_bytes":30163288064,"physical_bytes":30468873232,"peak_physical_bytes":30624177144,"disk_read_bytes":5045161984,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28107,"usage":{"cpu_time_ns":55571821666,"resident_bytes":30163435520,"physical_bytes":30473018384,"peak_physical_bytes":30624177144,"disk_read_bytes":5048455168,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28217,"usage":{"cpu_time_ns":55881069708,"resident_bytes":30163582976,"physical_bytes":30476737552,"peak_physical_bytes":30624177144,"disk_read_bytes":5049126912,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28327,"usage":{"cpu_time_ns":56205873666,"resident_bytes":30163681280,"physical_bytes":30479358992,"peak_physical_bytes":30624177144,"disk_read_bytes":5078896640,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28437,"usage":{"cpu_time_ns":56506929625,"resident_bytes":30163697664,"physical_bytes":30502476816,"peak_physical_bytes":30624177144,"disk_read_bytes":5156802560,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28547,"usage":{"cpu_time_ns":56577683625,"resident_bytes":30164221952,"physical_bytes":30506900496,"peak_physical_bytes":30624177144,"disk_read_bytes":5159899136,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28657,"usage":{"cpu_time_ns":57208882291,"resident_bytes":30166990848,"physical_bytes":30413052944,"peak_physical_bytes":30624177144,"disk_read_bytes":5168140288,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28768,"usage":{"cpu_time_ns":57817709875,"resident_bytes":30167040000,"physical_bytes":30413052944,"peak_physical_bytes":30624177144,"disk_read_bytes":5169434624,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28877,"usage":{"cpu_time_ns":58415020625,"resident_bytes":30167040000,"physical_bytes":30413052944,"peak_physical_bytes":30624177144,"disk_read_bytes":5172547584,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":28988,"usage":{"cpu_time_ns":59005264291,"resident_bytes":30167040000,"physical_bytes":30413052944,"peak_physical_bytes":30624177144,"disk_read_bytes":5172547584,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":29098,"usage":{"cpu_time_ns":59093337875,"resident_bytes":30167040000,"physical_bytes":30413216784,"peak_physical_bytes":30624177144,"disk_read_bytes":5175087104,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":29198,"usage":{"cpu_time_ns":59665016416,"resident_bytes":30167056384,"physical_bytes":30413216784,"peak_physical_bytes":30624177144,"disk_read_bytes":5179658240,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":29309,"usage":{"cpu_time_ns":60259292458,"resident_bytes":30167072768,"physical_bytes":30413233168,"peak_physical_bytes":30624177144,"disk_read_bytes":5179707392,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":29416,"usage":{"cpu_time_ns":60366687875,"resident_bytes":30167072768,"physical_bytes":30413233168,"peak_physical_bytes":30624177144,"disk_read_bytes":5179707392,"disk_write_bytes":342355968}}
{"event":"test_resource_sample","elapsed_ms":29526,"usage":{"cpu_time_ns":60476678000,"resident_bytes":30176428032,"physical_bytes":30413233168,"peak_physical_bytes":30624177144,"disk_read_bytes":5179707392,"disk_write_bytes":350744576}}
{"event":"test_resource_sample","elapsed_ms":29630,"usage":{"cpu_time_ns":60584143166,"resident_bytes":30162436096,"physical_bytes":30322416656,"peak_physical_bytes":30624177144,"disk_read_bytes":5180850176,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":29740,"usage":{"cpu_time_ns":60708120333,"resident_bytes":30162960384,"physical_bytes":30353497104,"peak_physical_bytes":30624177144,"disk_read_bytes":5181718528,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":29848,"usage":{"cpu_time_ns":60799686958,"resident_bytes":30162976768,"physical_bytes":30362442768,"peak_physical_bytes":30624177144,"disk_read_bytes":5190975488,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":29959,"usage":{"cpu_time_ns":60934210333,"resident_bytes":30162976768,"physical_bytes":30362442768,"peak_physical_bytes":30624177144,"disk_read_bytes":5220745216,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30069,"usage":{"cpu_time_ns":61006942583,"resident_bytes":30170054656,"physical_bytes":30369520656,"peak_physical_bytes":30624177144,"disk_read_bytes":5227823104,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30179,"usage":{"cpu_time_ns":61092643750,"resident_bytes":30170071040,"physical_bytes":30369537040,"peak_physical_bytes":30624177144,"disk_read_bytes":5251203072,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30289,"usage":{"cpu_time_ns":61174474250,"resident_bytes":30170071040,"physical_bytes":30369537040,"peak_physical_bytes":30624177144,"disk_read_bytes":5265276928,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30399,"usage":{"cpu_time_ns":61227649875,"resident_bytes":30170071040,"physical_bytes":30369537040,"peak_physical_bytes":30624177144,"disk_read_bytes":5286395904,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30510,"usage":{"cpu_time_ns":61296737041,"resident_bytes":30170071040,"physical_bytes":30369537040,"peak_physical_bytes":30624177144,"disk_read_bytes":5296275456,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30615,"usage":{"cpu_time_ns":61672150000,"resident_bytes":30172348416,"physical_bytes":30380760080,"peak_physical_bytes":30624177144,"disk_read_bytes":5296275456,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30722,"usage":{"cpu_time_ns":61967489916,"resident_bytes":30172856320,"physical_bytes":30380760080,"peak_physical_bytes":30624177144,"disk_read_bytes":5296275456,"disk_write_bytes":369209344}}
{"event":"test_resource_sample","elapsed_ms":30833,"usage":{"cpu_time_ns":62077499208,"resident_bytes":30174543872,"physical_bytes":30380760080,"peak_physical_bytes":30624177144,"disk_read_bytes":5296275456,"disk_write_bytes":377597952}}
{"event":"test_resource_sample","elapsed_ms":30943,"usage":{"cpu_time_ns":62166982708,"resident_bytes":29337665536,"physical_bytes":29333772152,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_sample","elapsed_ms":31048,"usage":{"cpu_time_ns":62264277083,"resident_bytes":26074611712,"physical_bytes":29324938824,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_sample","elapsed_ms":31159,"usage":{"cpu_time_ns":62378628833,"resident_bytes":17460772864,"physical_bytes":29284873680,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_sample","elapsed_ms":31265,"usage":{"cpu_time_ns":62482826916,"resident_bytes":10172383232,"physical_bytes":29252755760,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_sample","elapsed_ms":31371,"usage":{"cpu_time_ns":62534506250,"resident_bytes":8705425408,"physical_bytes":25881910376,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_sample","elapsed_ms":31482,"usage":{"cpu_time_ns":62631362208,"resident_bytes":127090688,"physical_bytes":0,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856}}
{"event":"test_resource_summary","elapsed_ms":31586,"peak":{"cpu_time_ns":62631362208,"resident_bytes":30193532928,"physical_bytes":30599748600,"peak_physical_bytes":30624177144,"disk_read_bytes":5296357376,"disk_write_bytes":383737856},"error":null}
+144
View File
@@ -0,0 +1,144 @@
running 1 test
test engine::metal::deepseek_vision::tests::issue100_full_model_images_cache_and_dspark ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal SSD streaming mode enabled; full model residency and warmup are skipped
ds4: Metal model range 0.47..0.47 GiB is not covered by mapped model views
ds4: Metal model range 1.64..1.64 GiB is not covered by mapped model views
ds4: Metal model range 1.11..1.11 GiB is not covered by mapped model views
ds4: Metal model range 2.19..2.19 GiB is not covered by mapped model views
ds4: Metal model range 3.36..3.36 GiB is not covered by mapped model views
ds4: Metal model range 2.83..2.84 GiB is not covered by mapped model views
ds4: Metal model range 3.85..3.85 GiB is not covered by mapped model views
ds4: Metal model range 5.02..5.02 GiB is not covered by mapped model views
ds4: Metal model range 4.49..4.49 GiB is not covered by mapped model views
ds4: Metal model range 5.44..5.44 GiB is not covered by mapped model views
ds4: Metal model range 6.61..6.61 GiB is not covered by mapped model views
ds4: Metal model range 6.05..6.06 GiB is not covered by mapped model views
ds4: Metal model range 7.13..7.14 GiB is not covered by mapped model views
ds4: Metal model range 8.31..8.31 GiB is not covered by mapped model views
ds4: Metal model range 7.75..7.75 GiB is not covered by mapped model views
ds4: Metal model range 8.81..8.81 GiB is not covered by mapped model views
ds4: Metal model range 9.98..9.99 GiB is not covered by mapped model views
ds4: Metal model range 9.43..9.43 GiB is not covered by mapped model views
ds4: Metal model range 10.42..10.43 GiB is not covered by mapped model views
ds4: Metal model range 11.60..11.60 GiB is not covered by mapped model views
ds4: Metal model range 11.02..11.02 GiB is not covered by mapped model views
ds4: Metal model range 12.18..12.18 GiB is not covered by mapped model views
ds4: Metal model range 13.35..13.35 GiB is not covered by mapped model views
ds4: Metal model range 12.79..12.79 GiB is not covered by mapped model views
ds4: Metal model range 13.85..13.85 GiB is not covered by mapped model views
ds4: Metal model range 15.02..15.02 GiB is not covered by mapped model views
ds4: Metal model range 14.45..14.46 GiB is not covered by mapped model views
ds4: Metal model range 15.58..15.58 GiB is not covered by mapped model views
ds4: Metal model range 16.75..16.75 GiB is not covered by mapped model views
ds4: Metal model range 16.20..16.20 GiB is not covered by mapped model views
ds4: Metal model range 17.23..17.23 GiB is not covered by mapped model views
ds4: Metal model range 18.40..18.40 GiB is not covered by mapped model views
ds4: Metal model range 17.84..17.84 GiB is not covered by mapped model views
ds4: Metal model range 18.68..18.68 GiB is not covered by mapped model views
ds4: Metal model range 19.85..19.85 GiB is not covered by mapped model views
ds4: Metal model range 19.23..19.23 GiB is not covered by mapped model views
ds4: Metal model range 20.54..20.54 GiB is not covered by mapped model views
ds4: Metal model range 21.71..21.72 GiB is not covered by mapped model views
ds4: Metal model range 21.13..21.14 GiB is not covered by mapped model views
ds4: Metal model range 22.19..22.19 GiB is not covered by mapped model views
ds4: Metal model range 23.36..23.36 GiB is not covered by mapped model views
ds4: Metal model range 22.77..22.77 GiB is not covered by mapped model views
ds4: Metal model range 23.95..23.95 GiB is not covered by mapped model views
ds4: Metal model range 25.12..25.13 GiB is not covered by mapped model views
ds4: Metal model range 24.55..24.56 GiB is not covered by mapped model views
ds4: Metal model range 25.53..25.54 GiB is not covered by mapped model views
ds4: Metal model range 26.71..26.71 GiB is not covered by mapped model views
ds4: Metal model range 26.11..26.11 GiB is not covered by mapped model views
ds4: Metal model range 27.39..27.39 GiB is not covered by mapped model views
ds4: Metal model range 28.56..28.56 GiB is not covered by mapped model views
ds4: Metal model range 28.00..28.01 GiB is not covered by mapped model views
ds4: Metal model range 29.06..29.06 GiB is not covered by mapped model views
ds4: Metal model range 30.23..30.23 GiB is not covered by mapped model views
ds4: Metal model range 29.67..29.68 GiB is not covered by mapped model views
ds4: Metal model range 30.43..30.43 GiB is not covered by mapped model views
ds4: Metal model range 31.60..31.60 GiB is not covered by mapped model views
ds4: Metal model range 30.95..30.96 GiB is not covered by mapped model views
ds4: Metal model range 32.47..32.47 GiB is not covered by mapped model views
ds4: Metal model range 33.64..33.64 GiB is not covered by mapped model views
ds4: Metal model range 33.09..33.10 GiB is not covered by mapped model views
ds4: Metal model range 34.15..34.16 GiB is not covered by mapped model views
ds4: Metal model range 35.33..35.33 GiB is not covered by mapped model views
ds4: Metal model range 34.78..34.78 GiB is not covered by mapped model views
ds4: Metal model range 35.77..35.77 GiB is not covered by mapped model views
ds4: Metal model range 36.94..36.94 GiB is not covered by mapped model views
ds4: Metal model range 36.37..36.37 GiB is not covered by mapped model views
ds4: Metal model range 37.39..37.39 GiB is not covered by mapped model views
ds4: Metal model range 38.56..38.56 GiB is not covered by mapped model views
ds4: Metal model range 37.97..37.98 GiB is not covered by mapped model views
ds4: Metal model range 39.26..39.26 GiB is not covered by mapped model views
ds4: Metal model range 40.43..40.43 GiB is not covered by mapped model views
ds4: Metal model range 39.89..39.90 GiB is not covered by mapped model views
ds4: Metal model range 40.70..40.70 GiB is not covered by mapped model views
ds4: Metal model range 41.87..41.87 GiB is not covered by mapped model views
ds4: Metal model range 41.26..41.27 GiB is not covered by mapped model views
ds4: Metal model range 42.53..42.53 GiB is not covered by mapped model views
ds4: Metal model range 43.70..43.70 GiB is not covered by mapped model views
ds4: Metal model range 43.13..43.13 GiB is not covered by mapped model views
ds4: Metal model range 44.05..44.05 GiB is not covered by mapped model views
ds4: Metal model range 45.22..45.22 GiB is not covered by mapped model views
ds4: Metal model range 44.61..44.61 GiB is not covered by mapped model views
ds4: Metal model range 46.04..46.04 GiB is not covered by mapped model views
ds4: Metal model range 47.21..47.21 GiB is not covered by mapped model views
ds4: Metal model range 46.68..46.68 GiB is not covered by mapped model views
ds4: Metal model range 47.54..47.55 GiB is not covered by mapped model views
ds4: Metal model range 48.72..48.72 GiB is not covered by mapped model views
ds4: Metal model range 48.14..48.14 GiB is not covered by mapped model views
ds4: Metal model range 49.01..49.01 GiB is not covered by mapped model views
ds4: Metal model range 50.18..50.19 GiB is not covered by mapped model views
ds4: Metal model range 49.54..49.55 GiB is not covered by mapped model views
ds4: Metal model range 50.94..50.94 GiB is not covered by mapped model views
ds4: Metal model range 52.11..52.12 GiB is not covered by mapped model views
ds4: Metal model range 51.54..51.54 GiB is not covered by mapped model views
ds4: Metal model range 52.39..52.39 GiB is not covered by mapped model views
ds4: Metal model range 53.56..53.56 GiB is not covered by mapped model views
ds4: Metal model range 52.92..52.92 GiB is not covered by mapped model views
ds4: Metal model range 54.16..54.16 GiB is not covered by mapped model views
ds4: Metal model range 55.33..55.34 GiB is not covered by mapped model views
ds4: Metal model range 54.72..54.72 GiB is not covered by mapped model views
ds4: Metal model range 56.08..56.08 GiB is not covered by mapped model views
ds4: Metal model range 57.25..57.26 GiB is not covered by mapped model views
ds4: Metal model range 56.70..56.70 GiB is not covered by mapped model views
ds4: Metal model range 57.64..57.64 GiB is not covered by mapped model views
ds4: Metal model range 58.81..58.81 GiB is not covered by mapped model views
ds4: Metal model range 58.22..58.22 GiB is not covered by mapped model views
ds4: Metal model range 59.45..59.45 GiB is not covered by mapped model views
ds4: Metal model range 60.62..60.63 GiB is not covered by mapped model views
ds4: Metal model range 60.07..60.07 GiB is not covered by mapped model views
ds4: Metal model range 61.01..61.01 GiB is not covered by mapped model views
ds4: Metal model range 62.18..62.19 GiB is not covered by mapped model views
ds4: Metal model range 61.59..61.60 GiB is not covered by mapped model views
ds4: Metal model range 62.77..62.77 GiB is not covered by mapped model views
ds4: Metal model range 63.94..63.94 GiB is not covered by mapped model views
ds4: Metal model range 63.37..63.37 GiB is not covered by mapped model views
ds4: Metal model range 64.15..64.16 GiB is not covered by mapped model views
ds4: Metal model range 65.33..65.33 GiB is not covered by mapped model views
ds4: Metal model range 64.67..64.68 GiB is not covered by mapped model views
ds4: Metal model range 66.07..66.07 GiB is not covered by mapped model views
ds4: Metal model range 67.24..67.24 GiB is not covered by mapped model views
ds4: Metal model range 66.65..66.65 GiB is not covered by mapped model views
ds4: Metal model range 67.62..67.62 GiB is not covered by mapped model views
ds4: Metal model range 68.79..68.79 GiB is not covered by mapped model views
ds4: Metal model range 68.16..68.17 GiB is not covered by mapped model views
ds4: Metal model range 69.51..69.52 GiB is not covered by mapped model views
ds4: Metal model range 70.69..70.69 GiB is not covered by mapped model views
ds4: Metal model range 70.11..70.12 GiB is not covered by mapped model views
ds4: Metal model range 71.09..71.09 GiB is not covered by mapped model views
ds4: Metal model range 72.26..72.26 GiB is not covered by mapped model views
ds4: Metal model range 71.66..71.66 GiB is not covered by mapped model views
red: The image shows a solid red square.
DSpark drafted=30 accepted=0
blue: The image shows a solid blue circle.
pair: The first shape is red, and the second shape is blue.
tool image: The color in the image is blue.
issue100: production rendering, image recognition, multi-image/tool input, same-layout image invalidation, disk/warm KV and DSpark target equivalence passed
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 31.46s
+58
View File
@@ -0,0 +1,58 @@
running 1 test
test engine::metal::glm::tests::glm53_two_row_verifier_restores_recurrent_state ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 2.025 ms, residency requested in 9751.845 ms, warmup 4.026 ms (mapped 92026.06 MiB from offset 9.07 MiB)
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
partial prefill HC workspace guards passed
partial prefill HC workspace guards passed
partial prefill HC workspace guards passed
partial prefill HC workspace guards passed
partial prefill HC workspace guards passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP verify2 at 12: 44.202 ms, draft 729, target 729
ds4: GLM MTP draft 387 at position 13 in 3.1 ms
verify2 accepted and rewind keep=0 passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP verify2 at 12: 36.927 ms, draft 729, target 729
ds4: GLM MTP draft 387 at position 13 in 2.8 ms
verify2 accepted and rewind keep=1 passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP verify2 at 12: 36.681 ms, draft 730, target 729
ds4: GLM MTP draft 5733 at position 12 in 2.1 ms
verify2 rejected and scalar replay state passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP draft 5733 at position 12 in 3.1 ms
verify2 scalar boundary cap=1 cancelled=false passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP draft 5733 at position 12 in 3.0 ms
verify2 scalar boundary cap=2 cancelled=true passed
verify2 prefill 0
verify2 prefill 4
verify2 prefill 8
verify2 prefill 12
ds4: GLM MTP draft 5733 at position 12 in 3.0 ms
engine-lifetime counters across new and restored chats passed
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 568 filtered out; finished in 14.15s
@@ -0,0 +1,5 @@
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 0.22s
Binary file not shown.

After

Width:  |  Height:  |  Size: 1.2 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 697 B

+8
View File
@@ -0,0 +1,8 @@
running 1 test
test model::transfer::tests::issue100_managed_intake ... verified DeepSeek-V4-Flash-Vision-Encoder.gguf 932857760 bytes
verified DeepSeek-V4-Flash-Vision-Exp-DSpark-support.gguf 5989114528 bytes
verified DeepSeek-V4-Flash-Vision-Exp-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8.gguf 86720111776 bytes
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 622.11s
+22
View File
@@ -0,0 +1,22 @@
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `test` profile [unoptimized + debuginfo] target(s) in 4.00s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
Running unittests src/main.rs (target/debug/deps/ds4_server-d15236c42a8179f4)
running 1 test
test engine::validation::tests::issue100_checkpoint_metadata_is_strict ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 568 filtered out; finished in 0.01s
Running unittests tools/qwen38-artifacts.rs (target/debug/deps/qwen38_artifacts-3a34dfcd9c4f3de8)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 4 filtered out; finished in 0.00s
Running unittests tools/test-supervisor.rs (target/debug/deps/test_supervisor-978addc9e5e8dbda)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 4 filtered out; finished in 0.00s
@@ -0,0 +1,40 @@
{"event":"test_supervisor_started","pid":19964,"limit_bytes":4294967296,"start_seconds":60.0,"idle_seconds":120.0,"sample_ms":100}
{"event":"test_resource_sample","elapsed_ms":0,"usage":{"cpu_time_ns":155791,"resident_bytes":671744,"physical_bytes":196680,"peak_physical_bytes":213064,"disk_read_bytes":0,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":107,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":217,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":319,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":427,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":537,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":647,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":757,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":866,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":976,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1083,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1187,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1298,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1400,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1501,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1610,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1712,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1816,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":1918,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2025,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2132,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2243,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2344,"usage":{"cpu_time_ns":2620666,"resident_bytes":32768,"physical_bytes":81992,"peak_physical_bytes":98376,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2447,"usage":{"cpu_time_ns":2858791,"resident_bytes":376832,"physical_bytes":163912,"peak_physical_bytes":163912,"disk_read_bytes":1597440,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2558,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2666,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2770,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2877,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":2987,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3097,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3207,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3316,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3426,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3536,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3644,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3746,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3856,"usage":{"cpu_time_ns":32403000,"resident_bytes":27983872,"physical_bytes":11141864,"peak_physical_bytes":12206824,"disk_read_bytes":3067904,"disk_write_bytes":0}}
{"event":"test_resource_sample","elapsed_ms":3960,"usage":{"cpu_time_ns":38735291,"resident_bytes":46923776,"physical_bytes":21824280,"peak_physical_bytes":24675072,"disk_read_bytes":3256320,"disk_write_bytes":4456448}}
{"event":"test_resource_summary","elapsed_ms":4067,"peak":{"cpu_time_ns":38735291,"resident_bytes":46923776,"physical_bytes":21824280,"peak_physical_bytes":24675072,"disk_read_bytes":3256320,"disk_write_bytes":4456448},"error":null}
+11
View File
@@ -0,0 +1,11 @@
running 1 test
test engine::metal::deepseek_vision::tests::issue100_visual_routing_and_attention ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
ds4: Metal 4 tensor API enabled for Tensor kernels
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
ds4: Metal model views created in 0.022 ms, residency requested in 0.060 ms, warmup 4.036 ms (mapped 0.02 MiB from offset 0.00 MiB)
ds4: Metal mapped mmaped model as 1 overlapping shared buffers
issue100 visual routing: hash/text/image rows and weights pass; raw/mixed/index-masked visual attention with wrapped KV passes
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 1.52s
@@ -0,0 +1 @@
{"source_revision": "e46e16bf6035c6f317eb2ac7458eb0362926d402", "ds4_revision": "0aaea5a238fb41a35106a551e73c8409dfb751ac", "torch": "2.14.1", "device": "mps", "shape": [100, 4096], "max_abs": 0.102294921875, "rmse": 0.005685029085725546, "reference_rms": 0.05688675865530968, "cosine": 0.9950079321861267}
+613
View File
@@ -0,0 +1,613 @@
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `test` profile [unoptimized + debuginfo] target(s) in 5.00s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
Running unittests src/main.rs (target/debug/deps/ds4_server-d15236c42a8179f4)
running 570 tests
test agent::tests::ai_risk_response_requires_structured_risk_and_reason ... ok
test agent::tests::anchored_edits_require_unique_head_and_tail ... ok
test a2ui::tests::streaming_parser_only_accepts_complete_a2ui_jsonl_lines ... ok
test agent::tests::ai_shell_risk_assessment_receives_the_dev_brain_root ... ok
test a2ui::tests::embedded_catalog_and_validator_cover_the_same_components ... ok
test agent::tests::dev_brain_paths_are_trusted_by_shell_risk_assessment ... ok
test a2ui::tests::basic_formatters_follow_catalog_examples ... ok
test a2ui::tests::catalog_validation_rejects_invalid_variants_and_function_arguments ... ok
test a2ui::tests::catalog_accepts_pie_donut_and_heatmap_charts ... ok
test a2ui::tests::dismissal_boundaries_replay_history_and_a_fresh_active_epoch ... ok
test a2ui::tests::lifecycle_updates_incrementally_and_json_pointer_upserts ... ok
test a2ui::tests::latest_created_surface_is_the_active_surface ... ok
test agent::tests::present_svg_parsers_recover_exact_source_for_both_model_transports ... ok
test agent::tests::ralph_loop_stops_on_cap_blocker_failure_and_cancellation ... ok
test a2ui::tests::catalog_validation_and_actions_use_current_local_data ... ok
test a2ui::tests::all_basics_compose_into_one_surface ... ok
test agent::tests::model_adapters_preserve_primitives_and_report_recoverable_syntax_errors ... ok
test agent::tests::ralph_report_semantics_and_handoff_bound_are_enforced ... ok
test agent::tests::risky_shell_commands_require_one_time_approval ... ok
test a2ui::tests::v1_action_and_function_round_trips_follow_current_schema ... ok
test agent::tests::scripted_ralph_backend_gets_fresh_prompts_and_only_validated_handoffs ... ok
test agent::tests::project_boundary_rejects_parent_paths ... ok
test agent::tests::generated_schemas_match_the_executable_tool_contracts ... ok
test agent::tests::ralph_report_schemas_are_child_only_and_parse_for_both_models ... ok
test agent::tests::repeated_call_advisories_use_canonical_arguments_and_reset_per_user_turn ... ok
test a2ui::export::tests::static_svg_renderer_covers_the_complete_catalog ... ok
test agent::tests::stored_tool_cards_restore_ai_approval_reasons_by_call ... ok
test agent::tests::tool_output_keeps_terminal_lines_but_parameter_summaries_do_not ... ok
test agent::tests::present_svg_executes_without_side_effects_and_maps_only_completed_cards ... ok
test agent::web::tests::browser_helpers_preserve_ds4_wire_values ... ok
test agent::web::tests::headless_browser_extracts_a_local_page ... ignored, requires an installed Chrome browser
test agent::tests::prompts_and_parsers_expose_the_reference_tool_set ... ok
test agent::tests::validation_is_precise_and_prevents_side_effects_until_corrected ... ok
test app::generation::tests::attached_image_marker_is_model_only ... ok
test agent::tests::glob_confinement_skips_symlinks_and_honors_cancellation ... ok
test agent::tests::present_svg_validation_enforces_the_static_vector_boundary ... ok
test agent::tests::successful_structured_file_tools_report_project_paths ... ok
test agent::tests::glob_finds_all_regular_file_names_deterministically_without_reading_them ... ok
test agent::tests::standard_agent_skills_are_discovered_prompted_and_read_only ... ok
test agent::tests::shell_commands_skip_user_startup_files ... ok
test app::generation::tests::plain_chat_uses_the_same_unmodified_prompt_in_ui_and_headless ... ok
test app::generation::tests::queued_guidance_is_one_reference_style_user_turn ... ok
test app::generation::tests::title_context_starts_at_the_first_user_and_ignores_system_rows ... ok
test app::generation::tests::turn_summary_accumulates_model_continuations ... ok
test agent::tests::standard_file_tools_can_maintain_only_managed_dev_brain_pages ... ok
test agent::tests::shell_environment_is_loaded_once_from_login_and_interactive_startup_files ... ok
test app::git::tests::configured_git_diff_options_change_the_rendered_patch ... ok
test app::git::tests::unified_diff_parser_aligns_replacements_for_split_view ... ok
test agent::tests::ralph_round_contexts_are_unique_and_child_jobs_are_cleaned_up ... ok
test app::git::tests::unstage_works_before_the_first_commit ... ok
test app::preferences::tests::runtime_config_updates_after_lock_poisoning ... ok
test app::git::tests::libgit2_status_merges_staged_and_worktree_changes ... ok
test app::projects::tests::discarding_a_session_removes_every_checkpoint_stage ... ok
test app::projects::tests::draft_titles_follow_the_stored_session_count ... ok
test agent::tests::denial_and_stop_cancel_commands_awaiting_approval ... ok
test app::projects::tests::session_states_are_exclusive_and_ordered ... ok
test app::projects::tests::sweeping_removes_checkpoints_of_sessions_that_no_longer_exist ... ok
test app::projects::tests::git_state_lists_and_switches_local_branches ... ok
test app::tests::background_activity_drives_polling_indicators_and_quit_confirmation ... ok
test agent::tests::shell_environment_probe_stops_blocked_startup_files ... ok
test app::git::tests::origin_fetch_pull_and_push_use_the_current_branch ... ok
test app::tests::chat_html_export_embeds_loaded_a2ui_images_as_data_urls ... ok
test agent::tests::oversized_shell_output_is_bounded_and_retained_until_cleanup ... ok
test app::tests::chat_only_follows_updates_while_near_the_tail ... ok
test app::tests::ds4_gib_and_streaming_cache_inputs_are_typed ... ok
test app::tests::one_shot_titles_are_reduced_to_a_single_sidebar_line ... ok
test app::tests::owned_runtime_paths_stay_in_application_support ... ok
test app::tests::preferences_shortcut_and_dspark_support_are_explicit ... ok
test app::tests::source_does_not_depend_on_a_sibling_ds4_checkout ... ok
test app::tests::stored_session_always_selects_its_model ... ok
test app::tests::tab_scrolls_a_field_back_into_the_preferences_viewport ... ok
test app::view::a2ui::tests::renderer_input_helpers_cover_dates_numbers_choices_and_weights ... ok
test app::view::chat::tests::chat_divider_groups_token_counts_by_thousands ... ok
test app::view::chat::tests::composer_uses_shift_enter_for_line_breaks ... ok
test app::view::git::tests::split_diff_width_covers_the_longest_side_and_tabs ... ok
test app::preferences::tests::multiline_system_prompt_round_trips_through_the_editor ... ok
test app::view::tests::action_buttons_share_geometry ... ok
test app::view::tests::context_pie_wedge_follows_the_fill_grade ... ok
test app::view::tests::download_measurements_are_readable ... ok
test app::view::tests::raised_surfaces_stay_dark ... ok
test compaction::tests::a_new_summary_replaces_the_previous_rebuild_summary ... ok
test compaction::tests::hard_trigger_and_retry_reserve_match_the_reference ... ok
test compaction::tests::soft_trigger_matches_reference_thresholds ... ok
test compaction::tests::summary_budget_keeps_answer_room_and_rejects_exhausted_contexts ... ok
test compaction::tests::summary_control_markup_is_private ... ok
test compaction::tests::tail_prefers_the_first_user_boundary_after_target ... ok
test config::tests::defaults_write_an_empty_file_and_reload_unchanged ... ok
test app::generation::tests::legacy_generation_rows_collapse_into_their_user_turn ... ok
test app::preferences::tests::selectors_rehydrate_their_generation_and_model_profiles ... ok
test app::tests::chat_export_preserves_completed_svg_and_keeps_failures_generic ... ok
test app::generation::tests::forced_compaction_requires_new_visible_chat ... ok
test config::tests::deprecated_flash_config_migrates_and_persists_only_0731 ... ok
test app::generation::tests::model_history_uses_persisted_content_without_changing_the_transcript ... ok
test config::tests::model_profiles_expose_only_their_upstream_thinking_modes ... ok
test app::tests::chat_export_formats_visible_turns_reasoning_and_bash_tools ... ok
test app::tests::assistant_stream_keeps_reasoning_separate_from_the_answer ... ok
test config::tests::legacy_flat_model_settings_are_dropped_but_the_prompt_is_kept ... ok
test config::tests::invalid_files_are_reported_instead_of_reset ... ok
test app::tests::chat_html_export_is_safe_standalone_and_renders_embedded_surfaces ... ok
test config::tests::explicit_0731_dspark_opt_out_survives_the_default ... ok
test config::tests::only_changed_values_are_written_and_read_back ... ok
test app::view::stats::tests::current_session_summary_uses_persisted_chat_facts ... ok
test app::generation::tests::assistant_markdown_keeps_llm_tables ... ok
test app::generation::tests::last_compaction_selects_its_tail_without_hiding_history ... ok
test app::generation::tests::complete_tool_call_in_reasoning_gets_one_correction ... ok
test app::generation::tests::extension_context_deduplicates_session_start_and_rearms_after_compaction ... ok
test config::tests::qwen_selection_and_native_defaults_survive_restart ... ok
test app::generation::tests::a2ui_auto_switch_waits_for_a_renderable_surface ... ok
test dev_brain::tests::revision_fixture_preserves_numeric_looking_strings ... ok
test dev_brain::tests::path_confinement_and_unrelated_notes_are_preserved ... ok
test dev_brain::tests::skill_index_migration_does_not_overwrite_an_unrelated_root_note ... ok
test dsml::tests::parses_reference_and_legacy_dsml_syntaxes ... ok
test dsml::tests::recovers_complete_invokes_before_an_incomplete_one ... ok
test dsml::tests::recovers_complete_invokes_without_the_outer_closing_tag ... ok
test engine::deepseek_vision::tests::issue100_ds4_image_layout_and_attention_vectors ... ok
test database::tests::context_work_reactivates_an_archived_session ... ok
test database::tests::sessions_are_ordered_by_recent_use_within_sidebar_groups ... ok
test engine::ds4_sampling::tests::heap_fallback_preserves_rng_and_signed_zero_ties ... ok
test engine::gguf::tests::accepts_exact_mxfp4_block_layout ... ok
test engine::gguf::tests::keeps_unknown_tensor_kinds_rejected ... ok
test engine::gguf::tests::mxfp4_scalar_dot_matches_independent_values ... ok
test engine::gguf::tests::maps_metadata_and_tensor_payload_without_copying_weights ... ok
test engine::gguf::tests::rejects_mxfp4_dimension_overflow ... ok
test engine::gguf::tests::rejects_mxfp4_rows_that_are_not_block_aligned ... ok
test database::tests::inline_svg_tool_call_survives_session_switch_compaction_and_reopen ... ok
test engine::gguf::tests::rejects_truncated_mxfp4_payload ... ok
test database::tests::a2ui_dismissal_persists_a_fresh_surface_boundary ... ok
test engine::metal::deepseek_vision::tests::issue100_encoder_real_weights ... ignored, requires the pinned Vision-Exp sidecar and Apple Metal
test engine::metal::deepseek_vision::tests::issue100_full_model_images_cache_and_dspark ... ignored, requires the verified Vision-Exp managed artifacts and 110 GiB of Apple unified memory
test engine::metal::deepseek_vision::tests::issue100_visual_routing_and_attention ... ignored, requires Apple Metal; isolated visual routing and attention primitives
test engine::metal::glm::tests::dsa_indexer_schedule_matches_the_reference ... ok
test engine::metal::glm::tests::glm53_m5_text_performance_gate ... ignored, requires the installed GLM 5.3 Flash Q2 checkpoint and Apple Metal
test engine::metal::glm::tests::glm53_m5_vision_performance_and_oracle_gate ... ignored, requires GLM 5.3 Q2, its vision sidecar, a fixed image, and Apple Metal
test engine::metal::glm::tests::glm53_reference_logits_replay_separates_sampling_from_execution ... ignored, requires the installed GLM 5.3 Flash Q2 checkpoint and Apple Metal
test engine::metal::glm::tests::glm53_reference_prompt_tokens_match_shared_runtime ... ignored, installed GLM and DS4SERVER_GLM_REFERENCE_LOG from the standalone reference
test engine::metal::glm::tests::glm53_two_row_verifier_restores_recurrent_state ... ignored, installed GLM 5.3 and Metal; run under test-supervisor
test engine::metal::glm::tests::glm_byte_budget_reserves_prefill_before_dynamic_experts ... ok
test engine::metal::glm::tests::glm_mtp_preserves_target_tokens_and_drafts ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
test engine::metal::glm::tests::glm_prefill_schedule_matches_ds4_boundaries ... ok
test engine::metal::glm::tests::glm_resident_decode_flushes_periodically_without_a_final_or_ssd_flush ... ok
test engine::metal::glm::tests::repeated_glm_prompt_rewinds_one_token_for_logits ... ok
test engine::metal::glm::tests::resident_and_streamed_glm_match_ds4_decode_oracles ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
test engine::metal::glm::tests::streamed_glm_uses_ds4_indexed_prefill_for_long_prompts ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
test engine::metal::gpu::qwen_mtplx_allocation_tests::backend_allocation_policy_is_explicit_inside_and_outside_qwen_scope ... ignored, requires Apple Metal; allocation only, no GPU dispatch or model
test engine::metal::gpu::qwen_mtplx_allocation_tests::dispatch_retains_allocation_without_changing_data_donation ... ignored, requires Apple Metal, no model weights
test engine::metal::gpu::qwen_mtplx_allocation_tests::empty_storage_preserves_data_identity_views_and_zero_allocator_usage ... ignored, requires Apple Metal context; empty descriptors, no GPU allocation
test engine::metal::gpu::qwen_mtplx_allocation_tests::mtplx_tensor_cpu_access_releases_native_storage ... ignored, requires Apple Metal; CPU buffer access only, no GPU dispatch or model
test engine::metal::markov::tests::installed_markov_worker_dispatch ... ignored, requires installed 0731 DSpark support; CPU dispatch diagnostic, not parity acceptance
test database::tests::migrations_and_crud_work ... ok
test engine::kvstore::tests::opening_reclaims_checkpoints_the_index_cannot_reach ... ok
test engine::metal::markov::tests::markov_workers_reuse_threads_and_buffers_with_ordered_ties ... ok
test engine::metal::power_throttle_keeps_ds4_ewma_and_full_power_bypass ... ok
test engine::metal::qwen::tests::affine_split_k_matches_reference_shapes_and_scratch_bound ... ok
test engine::metal::qwen::tests::dense_attention_crossover_is_phase_specific ... ok
test engine::metal::qwen::tests::qwen_affine_qmv_and_qmm_match_mlx_reference ... ignored, requires the pinned Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_affine_qmv_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_core_boundary_and_checkpoint_are_stable ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_fused_gdn_input_rows_match_separate_projections ... ignored, requires the pinned Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_gdn_conv_norm_rows_matches_mtplx ... ignored, requires Apple Metal
test engine::metal::qwen::tests::qwen_gdn_delta_rows_matches_mtplx ... ignored, requires Apple Metal
test engine::metal::qwen::tests::qwen_layer_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qsa_selection_and_capacity_cover_the_full_native_window ... ok
test engine::metal::qwen::tests::qwen_lazy_target_probabilities_match_batched_sampling ... ignored, requires the pinned Qwen metadata and Apple Metal; no model inference
test engine::metal::qwen::tests::qwen_m5_performance_gate ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_metal_primitives_match_reference_vectors ... ignored, requires Apple Metal
test engine::metal::qwen::tests::qwen_mtp_matches_target_and_restores_its_cache ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_ple_gather_copies_only_the_requested_row ... ok
test engine::metal::qwen::tests::qwen_qsa_dense_mask_accepts_unsorted_blocks ... ignored, requires Apple Metal
test engine::metal::qwen::tests::qwen_qsa_full_context_preallocation_succeeds ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_qsa_logical_depth_oracles_cover_prefill_decode_and_state ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_qsa_real_layer_executes_the_first_sparse_token ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_qsa_selection_and_attention_remain_bounded_at_native_depths ... ignored, requires Apple Metal and allocates the full QSA score window
test engine::metal::qwen::tests::qwen_reference_layer_trace ... ignored, diagnostic trace against the pinned MLX-LM reference
test engine::metal::qwen::tests::qwen_reference_sdpa_trace ... ignored, diagnostic comparison with captured MTPLX SDPA inputs
test engine::metal::qwen::tests::qwen_reference_stateful_trace ... ignored, diagnostic trace against the pinned MLX-LM reference
test engine::metal::qwen::tests::qwen_reference_verify_trace ... ignored, diagnostic trace against the pinned MTPLX verifier
test engine::metal::qwen::tests::qwen_sorted_routed_prefill_matches_grouped_output ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_stage_counters_preserve_async_batches ... ignored, requires pinned Qwen embeddings and Apple Metal; stage profiler opt-in
test engine::metal::qwen::tests::qwen_target_submission_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen::tests::qwen_verify_layer_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
test engine::metal::qwen_mtplx::allocator::mtplx_allocations_preserve_logical_bounds_with_reference_rounding ... ignored, requires Apple Metal, no model weights
test engine::kvstore::tests::budget_evicts_the_least_valuable_unprotected_entry ... ok
test engine::metal::qwen::tests::qwen_ple_hash_contract_matches_golden_boundaries ... ok
test engine::metal::qwen_mtplx::allocator::mtplx_native_allocator_heap_limits_and_gpu_lifetime ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx::allocator::mtplx_native_allocator_replays_reference_allocations ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::ar::mtplx_ar_driver_matches_reference ... ignored, requires Apple Metal; unchanged MTPLX generate_ar orchestration oracle
test engine::metal::qwen_mtplx::array::mtplx_array_detach_clears_every_siblings_inputs_and_primitive ... ok
test engine::metal::qwen_mtplx::array::mtplx_array_materialization_keeps_geometry_and_rejects_short_storage ... ignored, requires Apple Metal; typed materialized descriptors without model weights
test engine::metal::qwen_mtplx::array::mtplx_array_layout_preserves_dtype_shape_stride_and_materialization_flags ... ok
test engine::metal::qwen_mtplx::array::mtplx_dtype_promotion_matches_all_reference_pairs ... ok
test engine::metal::qwen_mtplx::attention::mtplx_qsa_dense_mask_graph_matches_reference ... ignored, requires Apple Metal; original MTPLX block mask including sentinel and tails
test engine::metal::qwen_mtplx::attention::mtplx_qsa_eager_array_graph_matches_reference ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::attention::mtplx_qsa_prefill_gather_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX tiled prefill gather
test engine::metal::qwen_mtplx::attention::mtplx_qsa_rows_gather_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX QSA rows-gather attention
test engine::metal::qwen_mtplx::attention::mtplx_sdpa_fallback_graph_matches_reference ... ignored, requires Apple M5 Max; actual Qwen SDPA fallback reference
test engine::metal::qwen_mtplx::binary::mtplx_graph_binary_preserves_reference_branches ... ignored, requires Apple Metal; binary graph broadcast/layout and donation branches
test engine::metal::qwen_mtplx::binding::mtplx_installed_module_binding_matches_reference ... ignored, requires installed DS4_QWEN38_ARTIFACTS and SSD policy; only small norms and four table rows evaluated
test engine::metal::qwen_mtplx::cache::mtplx_kv_cache_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX KVCache growth, trim and state receipts
test database::tests::session_model_migration_preserves_data_and_accepts_catalog ... ok
test engine::metal::qwen_mtplx::allocator::mtplx_allocator_cache_matches_live_reference_trace ... ok
test engine::metal::qwen_mtplx::cache::mtplx_qsa_cache_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX positional cache, mirror and held state aliases
test engine::metal::qwen_mtplx::compile_graph::mtplx_compile_scalar_bits_and_custom_kernel_identity ... ignored, requires Metal buffers and external supervisor; scalar ownership only, no GPU dispatch
test engine::kvstore::tests::longest_compatible_prefix_wins_and_hits_survive_reopen ... ok
test engine::metal::qwen_mtplx::decoder::mtplx_decoder_connected_attention_and_moe_advance_caches ... ignored, requires Apple Metal and external test-supervisor; complete decoder/cache smoke
test engine::metal::qwen_mtplx::context_copy::prompt_copy_match_and_backoff_preserve_reference_policy ... ok
test engine::metal::qwen_mtplx::dense::mtplx_dense_attention_batches_match_reference ... ignored, requires Apple M5 Max; actual BF16 batched matmul reference
test engine::metal::qwen_mtplx::dense::mtplx_dense_float_graph_matches_reference ... ignored, requires Apple M5 Max; floating Matmul factory and original dispatch
test engine::metal::qwen_mtplx::dense::mtplx_qsa_score_array_graph_matches_reference ... ignored, requires Apple M5 Max; canonical QSA F32 graph with the original TF32 setting
test engine::metal::qwen_mtplx::encoder::mtplx_empty_bindings_preserve_nil_dependencies_without_dummy_storage ... ignored, requires Apple Metal; empty original-kernel grids and nil bindings
test engine::metal::qwen_mtplx::decoder::mtplx_decoder_residual_preserves_graph_order ... ok
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_commits_after_primitives_and_balances_completion ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::compiled::mtplx_replay_replaces_descriptors_without_rebuilding_primitives ... ok
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_barrier_epochs_and_commit_thresholds ... ok
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_scope_routes_operators_and_allocator ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_shared_events_and_error_completion_order ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_untracked_dependencies_across_encoders_and_commands ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_drains_failure_preserves_cause_and_retries_only_failed_nodes ... ignored, requires Apple Metal; supervised evaluator failure and retry
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_releases_intermediates_and_preserves_descriptor_donation ... ignored, requires Apple Metal; graph ownership and last-consumer release
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_retains_tracer_topology_without_input_donation ... ignored, requires Apple Metal; evaluator tracer donation and retained topology
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_runs_cpu_gpu_siblings_and_async_continuations ... ignored, requires Apple Metal; tiny supervised CPU/GPU evaluator graph
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_tracks_stream_fences_per_leaf_and_cross_device_union ... ok
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_ar_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_AR_REFERENCE required
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_preserves_bfs_width_and_sibling_choice ... ok
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_mtp_prefill_matches_reference ... ignored, full installed MTP model; external guard and DS4_QWEN38_MTP_PREFILL_REFERENCE required
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_preserves_scheduled_detach_and_tracer_errors ... ok
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_ping_forward_matches_reference ... ignored, full installed model; requires external memory guard and DS4_QWEN38_FORWARD_REFERENCE
test engine::metal::qwen_mtplx::execution::qwen_power_throttle_drains_before_sleep_and_bypasses_at_full_power ... ignored, requires Apple Metal; run under test-supervisor
test engine::metal::qwen_mtplx::fused::mtplx_compiled_constant_spelling ... ok
test engine::metal::qwen_mtplx::fused::mtplx_compiled_fusion_gpu_matches_reference ... ignored, requires Metal and external supervisor; generated fusion vs pinned SiLU plus multi-output/scalar dispatch
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_forward_matches_model_reference ... ignored, requires Apple Metal; actual MTPLX GDN forward and cache receipts
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_prefill_and_verify_match_model_reference ... ignored, requires Apple Metal; complete GDN Conv1d prefill and fused verify graphs
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_staged_primitives_match_reference ... ignored, requires Apple Metal; 80 actual delta-update receipts and six conv-normalization kernels
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_step_preserves_views_and_siblings ... ignored, requires Apple Metal; GDN custom primitive strided copies and sibling roots
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_event_snapshots_preserve_values_streams_and_shared_errors ... ignored, requires Apple Metal events, no model weights
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_fence_coherence_preserves_empty_and_partial_word_spans ... ignored, requires Apple Metal3, model-free empty coherent dispatch
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_fences_transfer_cpu_gpu_gpu_cpu_in_both_modes ... ignored, requires Apple Metal3, tiny model-free coherent fence kernels
test engine::metal::qwen_mtplx::hyper::mtplx_graph_hyper_forward_matches_reference ... ignored, requires Apple M5 Max; actual MTPLX GatedResidual reference receipts
test engine::metal::qwen_mtplx::hyper::mtplx_graph_hyper_pack_and_reads_match_reference ... ignored, requires Apple Metal; original hyper primitives and runtime pack
test engine::metal::qwen_mtplx::indexing::mtplx_graph_indexing_preserves_layouts_and_offsets ... ignored, requires Apple Metal; Select layout branches, GatherAxis views and empty arguments
test engine::metal::qwen_mtplx::indexing::mtplx_scatter_axis_graph_matches_reference ... ignored, requires Apple Metal; pinned Bool ScatterAxis layout and broadcast paths
test engine::metal::qwen_mtplx::issue103_analysis::issue103_numeric_receipts ... ignored, #103 diagnostic; Metal required, eager versus compiled numeric operands
test engine::metal::qwen_mtplx::issue103_analysis::issue103_sampling_receipts ... ignored, #103 diagnostic; Metal required, pins currently broken sampling law and invalid rows
test engine::metal::qwen_mtplx::issue103_analysis::issue103_sorted_gather_receipts ... ignored, #103 diagnostic; M5 and pinned runtime shader required; initialized sentinels
test engine::metal::qwen_mtplx::issue103_analysis::issue103_tokenizer_receipts ... ignored, #103 diagnostic; installed tokenizer and latest oracle JSONL; no GPU
test engine::metal::qwen_mtplx::issue103_analysis::issue103_vision_position_receipts ... ignored, #103 diagnostic; small active attention module on Metal; mixed position boundary
test engine::metal::qwen_mtplx::issue104::issue104_installed_ar_stream_and_state ... ignored, full pinned Bare-Speed model; external memory guard required
test engine::metal::qwen_mtplx::issue105::issue105_batched_greedy_rejects_each_invalid_row ... ignored, Metal required; run serially under test-supervisor
test engine::metal::qwen_mtplx::issue106::issue106_complete_state_and_checkpoint_recovery ... ignored, installed model and actual pre-fix checkpoint; external memory guard required
test engine::metal::qwen_mtplx::issue106::issue106_upstream_exit_matrix ... ignored, installed model, scripted logits on real caches; external memory guard required
test engine::metal::qwen_mtplx::issue108::issue108_attention_chunk_positions ... ignored, Metal and pinned MTPLX chunk fixtures; external supervisor required
test engine::metal::qwen_mtplx::issue109::issue109_gate_phase_and_dtype_laws ... ignored, Metal and exhaustive pinned gate fixtures; external supervisor required
test engine::metal::qwen_mtplx::issue110::issue110_actual_projection_rows_match_oracle ... ignored, installed layer weights and pinned oracle receipts; external memory supervisor required
test engine::metal::qwen_mtplx::issue110::issue110_guard_allocation_refusal_releases_graph_and_retries ... ignored, Metal allocation refusal and retry; external supervisor required
test engine::metal::qwen_mtplx::issue110::issue110_large_cold_and_warm_prefill ... ignored, full installed model and large partial chunks; serial memory supervisor required
test engine::metal::qwen_mtplx::issue112_bench::issue112_hidden_prefill ... ignored, full installed model hidden-state prefill; serial supervisor required
test engine::metal::qwen_mtplx::issue112_bench::issue112_paired_prefill ... ignored, full installed model; serial memory supervisor and explicit output directory
test engine::metal::qwen_mtplx::linear::mtplx_graph_affine_dequantize_matches_reference ... ignored, requires Apple Metal; original table dequantize dtype/group/bit/layout receipts
test engine::metal::qwen_mtplx::linear::mtplx_graph_affine_quantize_matches_reference ... ignored, requires Apple Metal; original affine quantize dtype/group/bit/layout receipts
test engine::metal::qwen_mtplx::linear::mtplx_graph_gather_qmm_matches_reference ... ignored, requires Apple Metal; original GatherQMM array layouts and expert routing
test engine::metal::qwen_mtplx::linear::mtplx_graph_quantized_linear_batched_identity ... ignored, requires Apple Metal and external supervisor; strided/broadcast batched affine dispatch
test engine::metal::qwen_mtplx::linear::mtplx_graph_quantized_linear_matches_reference ... ignored, requires Apple M5 Max Metal; 78 pinned affine fixtures through lazy graph
test engine::metal::qwen_mtplx::linear::sorted_gather_guard_matches_pinned_call_predicates ... ok
test engine::metal::qwen_mtplx::load::mtplx_safetensors_load_laziness_boundaries_and_lifetime ... ignored, requires Apple Metal; bounded CPU Load and dependent GPU graph
test engine::metal::qwen_mtplx::mlp::mtplx_graph_shared_mlp_matches_reference ... ignored, requires Apple M5 Max; actual MTPLX shared MLP reference receipts
test engine::metal::qwen_mtplx::mlp::mtplx_graph_split_and_compiled_silu_layouts ... ignored, requires Apple Metal; Split sibling ownership and compiled SiLU layouts
test engine::metal::qwen_mtplx::model::mtplx_model_compile_policy_and_run_boundaries ... ok
test engine::metal::qwen_mtplx::moe::mtplx_graph_sparse_moe_matches_reference ... ignored, requires Apple M5 Max; full MoE Array graph, no model weights; use test-supervisor
test engine::metal::qwen_mtplx::moe_sorted::issue112_all_kernel_variants ... ignored, Metal synthetic all supported row-map variants; external supervisor
test engine::metal::qwen_mtplx::moe_sorted::issue112_canary_failures ... ignored, Metal canary rejection and sticky fallback; external supervisor
test engine::metal::qwen_mtplx::moe_sorted::issue112_full_model_state ... ignored, full installed model; validates all cold/warm state receipts against the pre-port oracle
test engine::metal::qwen_mtplx::moe_sorted::issue112_installed_gate_up ... ignored, installed projection weights; external supervisor required
test engine::metal::qwen_mtplx::moe_sorted::row_map_applicability ... ok
test engine::metal::qwen_mtplx::fused::mtplx_compile_fusion_preserves_parent_and_output_boundaries ... ok
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_embedding_matches_reference ... ignored, requires Apple Metal; full resident NGram graph and lazy decode history
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_gpu_rows_and_history_match_reference ... ignored, requires Apple Metal; original lazy NGram GPU row graph, no table
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_resident_matches_reference ... ignored, requires Apple Metal; original NGramTable resident gather/dequantize receipts
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_table_priority ... ignored, requires Apple Metal; NGram table routing and missing-sidecar behavior
test engine::metal::qwen_mtplx::ngram_sidecar::mtplx_ngram_sidecar_matches_reference ... ignored, requires Apple Metal; actual file-backed MTPLX sidecar/LRU/dequantization receipts
test engine::metal::qwen_mtplx::ngram_stage::mtplx_ngram_stage_allclose_branches ... ignored, requires Apple Metal; stage verification special values and original reduction branches
test engine::metal::qwen_mtplx::ngram_stage::mtplx_ngram_stage_matches_reference ... ignored, requires Apple Metal; original complete stage lifecycle and file-backed tables
test engine::metal::qwen_mtplx::normalization::mtplx_graph_norm_modules_match_reference ... ignored, requires Apple Metal; connected Qwen normalization graph golden fixtures
test engine::metal::qwen_mtplx::normalization::mtplx_graph_rms_norm_preserves_reference_layout_and_values ... ignored, requires Apple Metal; graph RMSNorm donation, copy, broadcast and looped kernels
test engine::metal::qwen_mtplx::normalization::mtplx_logsumexp_graph_matches_reference ... ignored, requires Apple Metal; original sampler LogSumExp branches
test engine::metal::qwen_mtplx::normalization::mtplx_softmax_graph_storage_matches_reference ... ignored, requires Apple Metal; original Softmax type and storage branches
test engine::metal::qwen_mtplx::ops::mtplx_concatenate_preserves_general_general_copy_semantics ... ignored, requires Apple Metal; Concatenate promotion, offsets, strided writers and validation
test engine::metal::qwen_mtplx::ops::mtplx_owned_operations_build_and_execute_qsa_layout_graph ... ignored, requires Apple Metal; self-contained lazy QSA-layout recipe, no callback map
test engine::metal::qwen_mtplx::ops::mtplx_slice_and_contiguous_preserve_cache_window_semantics ... ignored, requires Apple Metal; normalized Slice and Contiguous cache-window graph
test engine::metal::qwen_mtplx::owner::issue105_product::issue105_product_ar_cleanup_and_http_retry ... ignored, installed Qwen model; serial test-supervisor with memory guard required
test engine::metal::qwen_mtplx::owner::issue105_product::issue105_product_mtp_cleanup_and_http_retry ... ignored, installed Qwen MTP model; serial test-supervisor with memory guard required
test engine::metal::qwen_mtplx::owner::issue106_product::issue106_product_discards_old_checkpoint_and_recovers_cold ... ignored, installed model and actual pre-fix checkpoint; external memory guard required
test engine::metal::qwen_mtplx::fused::mtplx_compiled_emitter_matches_all_pinned_silu_bodies ... ok
test engine::metal::qwen_mtplx::owner::issue107_product::issue107_vision_product ... ignored, installed model plus vision tower; serial external memory supervisor required
test engine::metal::qwen_mtplx::owner::issue109_product::issue109_verify_rows_and_warm_checkpoint ... ignored, installed model; serial external memory supervisor required
test engine::metal::qwen_mtplx::owner::issue109_product::issue113_default_verify_and_checkpoint ... ignored, installed model and actual pre-head-chunk checkpoint; serial external memory supervisor
test engine::metal::qwen_mtplx::owner::issue111_product::issue111_token_prefix_cache ... ignored, installed model; serial external memory supervisor required
test engine::metal::qwen_mtplx::owner::issue116_product::issue116_normalized_token_cache ... ignored, installed model; serial external memory supervisor required
test engine::metal::qwen_mtplx::owner::issue117_product::issue117_reasoning_history_cache ... ignored, installed model; serial external memory supervisor required
test engine::metal::qwen_mtplx::owner::qwen_product_generator_chat_matches_reference ... ignored, full installed model through product Generator; external supervisor and chat reference required
test engine::metal::qwen_mtplx::owner::qwen_vision_chat_checkpoint_preserves_image_identity ... ignored, requires installed Qwen, Metal, and DS4_QWEN_VISION_IMAGE; run under test-supervisor
test engine::metal::qwen_mtplx::owner::qwen_mtp_progress_publishes_without_turn_completion_or_double_counting ... ok
test engine::metal::qwen_mtplx::ple::mtplx_graph_ple_connected_matches_reference ... ignored, requires Apple M5 Max; complete original PLELayer with real lookup
test engine::metal::qwen_mtplx::ple::mtplx_graph_ple_projection_and_cache_match_reference ... ignored, requires Apple M5 Max; actual MTPLX PLELayer after embedding lookup
test engine::metal::qwen_mtplx::policy::qwen_server_policy_matches_original_functions ... ignored, requires DS4_QWEN38_POLICY_REFERENCE from pinned MTPLX; CPU-only
test engine::metal::qwen_mtplx::policy::sorted_moe_switch_and_family_rehearsal ... ok
test engine::metal::qwen_mtplx::prefill::mtplx_mtp_prefill_driver_matches_reference ... ignored, requires Apple Metal; original streaming MTP history prefill
test engine::metal::qwen_mtplx::prefill::mtplx_prefill_driver_matches_reference ... ignored, requires Apple Metal; original _prefill control flow and raw cache roots
test engine::metal::qwen_mtplx::qsa_attention::mtplx_qsa_attention_module_matches_reference ... ignored, requires Metal and unchanged whole-Attention receipts; no model download
test engine::metal::qwen_mtplx::qsa_compile::mtplx_compiled_indexer_array_replay_matches_reference ... ignored, requires Metal and original compiled indexer receipts; no model weights
test engine::metal::qwen_mtplx::qsa_core::mtplx_qsa_core_host_matches_reference ... ignored, requires Metal and original host-core receipts; no model weights
test engine::metal::qwen_mtplx::qsa_graph::qsa_cache_donation_requires_descriptor_data_and_allocation_contract ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::qsa_graph::qsa_completion_owns_buffers_until_gpu_finishes ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::qsa_graph::qsa_evaluator_retains_inputs_and_siblings_not_primary_data ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::policy::retired_ar_pipeline_flag_cannot_change_server_or_turn_policy ... ok
test engine::metal::qwen_mtplx::qsa_indexer::issue107::issue107_real_geometry_query_and_block_start_positions ... ignored, Metal and independently verified pinned indexer fixtures; external supervisor required
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_canonical_indexer_routes_match_reference ... ignored, requires Metal and original ongoing indexer routing receipts; no weights
test engine::metal::qwen_mtplx::qsa_graph::qsa_schedule_preserves_the_selected_sibling ... ok
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_indexer_compiled_commit_matches_reference ... ignored, requires Metal and original indexer lifecycle receipts; no model weights
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_indexer_prefix_matches_reference ... ignored, requires Apple Metal, original stateful QSAIndexer receipts, no model weights
test engine::metal::qwen_mtplx::qsa_prefill::mtplx_qsa_prefill_graph_matches_reference ... ignored, requires Metal and original two-stage prefill receipts, no weights
test engine::metal::qwen_mtplx::qsa_prepare::mtplx_qsa_prepare_graph_matches_reference ... ignored, requires Apple Metal; parameterized original QSA preparation and traced positions
test engine::metal::qwen_mtplx::qsa_select::mtplx_qsa_fused_graph_matches_reference ... ignored, requires Apple Metal and original QSA selector receipts; no model weights
test engine::metal::qwen_mtplx::random::mtplx_sampler_prefix_matches_reference ... ignored, requires Apple Metal; original target-prefix sampler and default RNG
test engine::metal::qwen_mtplx::random::mtplx_sampler_resident_matches_reference ... ignored, requires Apple Metal; original MTPLX resident sampling and keyed RNG
test engine::metal::qwen_mtplx::reduce::mtplx_sampler_argmax_matches_reference ... ignored, requires Apple Metal; original MTPLX greedy ArgReduce and storage
test engine::metal::qwen_mtplx::reduce::mtplx_sum_graph_matches_reference ... ignored, requires Apple Metal; original shared sum dispatch and QSA mean
test engine::metal::qwen_mtplx::request::qwen_request_settings_override_backend_policy ... ok
test engine::metal::qwen_mtplx::request::qwen_request_progress_uses_ui_frontiers_and_decode_timer ... ok
test engine::metal::qwen_mtplx::residency::mtplx_residency_matches_reference_lifecycle_cases ... ignored, requires Apple Metal 3 / macOS 15, no model weights
test engine::metal::qwen_mtplx::rope::mtplx_rope_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX RoPE, static YaRN and multi-axis receipts
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_batched_matches_reference ... ignored, requires Apple Metal; original MTPLX bound and serial batch distributions
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_entry_matches_reference ... ignored, requires Apple Metal; actual MTPLX generator sampling entry
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_fallback_matches_reference ... ignored, requires Apple Metal; original sparse fallback and host dense sampler
test database::tests::chat_and_compaction_history_survive_reopen_and_session_deletion ... ok
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_penalties_match_reference ... ignored, requires Apple Metal; original GPU and CPU raw-logit penalties
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_selection_matches_reference ... ignored, requires Apple Metal; original MTPLX sampler selection, no model weights
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_serial_support_matches_reference ... ignored, requires Apple Metal; actual MTPLX serial candidate route, no weights
test engine::metal::qwen_mtplx::scheduler::mtplx_cpu_dispatch_counts_tenth_and_completes_after_failed_work ... ok
test engine::metal::qwen_mtplx::scheduler::mtplx_cpu_primitive_holds_data_and_temporaries_in_fifo_order ... ignored, requires Apple Metal shared storage, no GPU dispatch or model weights
test engine::metal::qwen_mtplx::compile_graph::mtplx_compile_simplify_preserves_reference_parent_rules ... ok
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_cpu_events_propagate_errors_without_consuming_source ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_streams_preserve_fifo_errors_and_shutdown ... ok
test engine::metal::qwen_mtplx::sdpa::mtplx_sdpa_vector_matches_reference ... ignored, requires Apple M5 Max; actual pinned fused SDPA kernels
test engine::metal::qwen_mtplx::session_cache::issue114_snapshot_stage_preserves_zero_bits ... ignored, Metal; exact pinned lazy/deep snapshot zero-sign law
test engine::metal::qwen_mtplx::session_cache::mtplx_full_installed_chat_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_CHAT_REFERENCE required
test engine::metal::qwen_mtplx::session_cache::mtplx_session_boundary_policy ... ok
test engine::metal::qwen_mtplx::session_cache::mtplx_session_final_state_requires_capture_and_safe_cache ... ok
test engine::metal::qwen_mtplx::session_checkpoint::qwen_checkpoint_roundtrip_and_failed_restore_preserve_live_state ... ignored, model-free Metal checkpoint; external supervisor and DS4_QWEN38_CHECKPOINT_DIR required
test engine::metal::qwen_mtplx::session_codec::mtplx_session_codec_host_import_matches_reference ... ignored, model-free Metal imports; external supervisor and DS4_HOST_IMPORT_REFERENCE required
test engine::metal::qwen_mtplx::session_codec::mtplx_session_codec_matches_original_blobs_and_restore ... ignored, tiny GPU arrays; external supervisor and DS4_SESSION_CODEC_REFERENCE required
test engine::metal::qwen_mtplx::sort::mtplx_sort_graph_matches_reference ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::sparse_attention::mtplx_sparse_attention_graph_matches_reference ... ignored, requires Apple M5; actual MTPLX sparse Decode and TensorOps Prefill consumers
test engine::metal::qwen_mtplx::speculative::mtplx_full_installed_mtp_generation_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_MTP_GENERATION_REFERENCE required
test engine::metal::profile::tests::profile_reports_locality_and_lru_hits ... ok
test engine::metal::qwen_mtplx::stream::mtplx_stream_routes_queues_events_and_finalizes_all_under_pressure ... ignored, requires Apple Metal, tiny model-free two-queue copy
test engine::metal::qwen_mtplx::stream::mtplx_stream_registry_preserves_thread_defaults_templates_and_clear ... ok
test engine::metal::qwen_mtplx::submission::mtplx_submission_attaches_at_flush_eval_finish_and_drop ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx::unary::mtplx_graph_unary_preserves_reference_layout_and_values ... ignored, requires Apple Metal; graph unary layout, donation and kernel boundaries
test engine::metal::qwen_mtplx::verify_sdpa::issue113_head_chunk_outputs_and_dispatch ... ignored, Metal, pinned head-chunk numerical and dispatch fixtures; serial supervisor
test engine::metal::qwen_mtplx::verify_sdpa::issue113_plan_and_policy_match_pinned_oracle ... ok
test engine::metal::qwen_mtplx::views::mtplx_dtype_conversion_and_views_preserve_values_layout_and_donation ... ignored, requires Apple Metal; original conversion/view kernels and donation in lazy eval
test engine::metal::qwen_mtplx::views::mtplx_dynamic_slice_graph_matches_reference ... ignored, requires Metal and original dynamic slice receipts; no model weights
test engine::metal::qwen_mtplx::views::mtplx_reshape_shares_or_copies_in_the_connected_evaluator ... ignored, requires Apple Metal; original Reshape copy kernels and shared backing
test engine::metal::qwen_mtplx::views::mtplx_views_preserve_aliases_offsets_strides_and_gpu_output ... ignored, requires Apple Metal; connected zero-copy views and offset-aware original copy kernel
test engine::metal::qwen_mtplx::vision::qwen_vision_tower_matches_mtplx_image ... ignored, requires Metal and pinned Qwen vision artifacts/reference values
test engine::metal::qwen_mtplx::weights::mtplx_checkpoint_projection_fusions_match_reference ... ignored, requires Apple Metal; bounded lazy checkpoint Load and fusion
test engine::metal::qwen_mtplx::weights::mtplx_installed_checkpoint_fusion_metadata_matches_reference ... ignored, requires installed DS4_QWEN38_ARTIFACTS; headers only, never evaluate weights
test engine::metal::qwen_mtplx_tests::mtplx_affine_selection_preserves_reference_boundaries ... ok
test engine::metal::qwen_mtplx_tests::mtplx_canonical_hyper_and_gdn_kernels_match_reference ... ignored, requires Apple Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_canonical_source_bodies_preserve_pinned_hashes ... ok
test engine::metal::qwen_mtplx_tests::mtplx_connected_delta_update_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_gather_sort_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_decode_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_forward_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_staged_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_norm_modules_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_router_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_sparse_moe_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_connected_switch_glu_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_gate_up_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_cache_lifecycle_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_backings_and_dynamic_copies_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_cache_routing_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_cache_window_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_capacity_matches_reference ... ok
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_indexer_modes_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_scalar_sources_match_reference ... ok
test engine::metal::qwen_mtplx_tests::mtplx_qsa_connected_cache_selection_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_eager_topk_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_f32_scores_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_indexer_preparation_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_indexer_routes_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_producer_dispatch_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx::submission::mtplx_all_native_command_commits_pass_the_submission_hook ... ok
test engine::metal::qwen_mtplx_tests::mtplx_qsa_selector_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_runtime_affine_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_runtime_argsort_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::metal::qwen_mtplx_tests::mtplx_runtime_gather_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
test engine::deepseek_vision::tests::issue100_ds4_preprocess_dimensions_and_limits ... ok
test engine::metal::tests::batch_raw_span_includes_the_chunk_and_previous_window ... ok
test engine::metal::tests::compression_schedule_tracks_the_deepseek_model_shape ... ok
test engine::metal::tests::decode_feature_policy_keeps_device_generations_and_rollbacks_separate ... ok
test engine::metal::tests::decode_raw_span_tracks_the_logical_sliding_window ... ok
test engine::metal::tests::directional_steering_matches_the_ds4_token_oracle ... ignored, requires the installed Flash GGUF, DS4 steering fixture, and a Metal device
test dev_brain::tests::parser_and_index_rebuild_ignore_links_in_code ... ok
test engine::metal::tests::dspark_confidence_quantizes_q8_input_like_ds4 ... ok
test engine::metal::tests::dspark_matches_original_summary_cycles ... ignored, requires installed 0731/DSpark and DS4SERVER_DSPARK_REFERENCE cycle recording
test engine::metal::tests::dspark_markov_activation_matches_q8_rounding ... ok
test engine::metal::tests::dspark_runs_a_target_owned_greedy_cycle ... ignored, requires the installed 0731 Flash and checkpoint-specific DSpark GGUF fixtures
test engine::metal::tests::dspark_scheduler_matches_the_ds4_default_window ... ok
test engine::metal::tests::dspark_verifier_selects_only_the_committed_row ... ok
test engine::metal::tests::flash_0731_long_context_crosses_indexed_prefill_boundary ... ignored, requires a 0731 Flash GGUF and an Apple M5 device
test engine::metal::tests::flash_0731_m5_decode_performance_gate ... ignored, requires a 0731 Flash GGUF and an Apple M5 device
test engine::metal::tests::flash_0731_resident_and_ssd_streaming_choose_the_same_tokens ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
test engine::metal::tests::flash_0731_runs_exact_sampled_dspark ... ignored, requires the installed 0731 target and checkpoint-specific DSpark GGUF fixtures
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_activity_preserves_reference_pressure_and_wait_rules ... ok
test engine::metal::tests::flash_0731_ssd_streaming_maps_and_seeds_batched_prefill_layers ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
test engine::metal::tests::half_conversion_handles_normal_and_subnormal_values ... ok
test engine::metal::tests::pro_q4_model_spans_remain_isolated ... ok
test engine::metal::tests::pro_ssd_streaming_full_layer_and_selected_batch_agree ... ignored, requires the installed DeepSeek V4 Pro GGUF and Apple Metal
test engine::metal::tests::resident_multi_session_switching_preserves_each_kv_frontier ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
test engine::metal::tests::generated_hotlists_match_each_model_shape ... ok
test engine::metal::tests::ssd_streaming_supports_dspark ... ignored, requires the installed 0731 Flash and checkpoint-specific DSpark GGUF fixtures
test engine::metal::tests::pro_resident_admission_includes_weights_context_and_scratch ... ok
test engine::metal::tests::streaming_memory_plan_matches_ds4_graph_formulas ... ok
test engine::metal::vision::tests::glm53_resize_matches_reference_token_grids ... ok
test engine::qwen::tests::pinned_artifact_set_loads_and_renders_goldens ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
test engine::qwen::tests::pinned_qwen_metadata_matches_product_without_executor_state ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
test engine::qwen_vision::qwen_image_cache_keys_distinguish_pixels_and_preserve_prior_text ... ok
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_distribution_and_rng_match_reference ... ok
test engine::qwen_vision::qwen_vision_positions_and_resize_contract ... ok
test engine::qwen::tests::metadata_and_safetensors_boundaries_fail_closed ... ok
test engine::sampling_tests::checkpoint_rebuilds_explain_compatibility_and_history_misses ... ok
test engine::sampling_tests::checkpoint_tag_accepts_an_unchanged_prefix_before_reminders ... ok
test engine::sampling_tests::checkpoint_tag_covers_the_canonical_chat_state ... ok
test engine::sampling_tests::checkpoint_headers_identify_the_exact_model ... ok
test engine::sampling_tests::ds4_sampler_real_logits_cpu_benchmark ... ignored, CPU-only; requires DS4_SAMPLER_RECORDING with the recorded GLM logits
test engine::sampling_tests::exact_delta_sampling_accepts_or_corrects_the_draft ... ok
test engine::sampling_tests::generated_text_drains_incomplete_bytes_before_phase_changes_and_finish ... ok
test engine::sampling_tests::generated_text_preserves_thinking_utf8_and_split_stops ... ok
test engine::sampling_tests::metal_executes_real_flash_token ... ignored, requires the 80 GiB Flash checkpoint and Apple Metal
test engine::qwen::tests::frozen_inventory_and_memory_categories_are_exact ... ok
test engine::sampling_tests::qwen_rng_matches_numpy_pcg64 ... ok
test engine::sampling_tests::qwen_sampling_uses_mtplx_global_nucleus_mass_before_top_k ... ok
test engine::sampling_tests::resumed_prefill_crossover_matches_each_ds4_graph ... ok
test engine::sampling_tests::sampling_probabilities_match_ds4_filter_order ... ok
test engine::sampling_tests::split_utf8_token_bytes_are_joined_before_decoding ... ok
test engine::sampling_tests::top_k_and_stream_stops_are_applied_before_output ... ok
test engine::sampling_tests::workspace_instruction_identity_participates_in_append_only_kv_keys ... ok
test engine::sampling_tests::zero_temperature_is_greedy ... ok
test engine::tokenizer::issue111::issue111_ds4_families ... ignored, CPU-only; installed DS4 GGUFs and exact oracle IDs
test engine::tokenizer::issue111::issue111_every_unicode_scalar_split ... ignored, CPU-only; exhaustive pinned Qwen split receipt
test engine::tokenizer::issue111::issue111_qwen_tokens_and_requests ... ignored, CPU-only; installed Qwen tokenizer and pinned exact IDs
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_cpu_rows_and_raw_history_match_reference ... ok
test engine::tokenizer::issue116::issue116_nfc_tokens_and_requests ... ignored, CPU-only; pinned NFC receipts and installed Qwen tokenizer
test engine::tokenizer::issue116::nfc_contract_and_composition ... ok
test engine::tokenizer::issue116::only_affected_qwen_history_changes_checkpoint_tags ... ok
test engine::tokenizer::issue117::direct_history_omits_reasoning_but_retains_the_scaffold ... ok
test engine::tokenizer::issue117::issue117_history_renders_tokens_and_context ... ignored, CPU-only; installed Qwen tokenizer and pinned history receipts
test engine::tokenizer::issue117::only_affected_histories_change_keys ... ok
test engine::tokenizer::issue117::reasoning_only_direct_turn_merges_surrounding_users ... ok
test engine::tokenizer::tests::character_helpers_are_total_at_every_byte_offset ... ok
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ignored, CPU-only; requires DS4SERVER_CHAT_REFERENCE and its installed GGUF
test engine::tokenizer::tests::issue100_visual_text_preserves_image_boundaries ... ignored, CPU-only; requires the installed 0731 tokenizer shared with Vision-Exp
test engine::tokenizer::tests::qwen_checkpoint_continuation_matches_full_conversation ... ignored, requires the installed Qwen tokenizer, but no GPU or model weights
test engine::tokenizer::tests::qwen_plain_chat_matches_mtplx_server_tokens ... ignored, requires local tokenizer and tools/qwen-chat-reference.py output; no inference
test engine::tokenizer::tests::reasoning_prefixes_match_each_model_family_contract ... ok
test engine::validation::tests::configured_glm53_main_fixture_passes_the_exact_layout ... ok
test engine::validation::tests::configured_glm53_vision_fixture_passes_the_exact_layout ... ok
test engine::tokenizer::issue111::qwen_split_boundaries ... ok
test engine::validation::tests::installed_dspark_fixture_passes_the_target_layout ... ok
test engine::validation::tests::issue100_checkpoint_metadata_is_strict ... ignored, requires the pinned Vision-Exp encoder and DSpark support GGUFs
test engine::validation::tests::mxfp4_is_limited_to_routed_experts ... ok
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_workspace_matches_reference ... ok
test extensions::tests::duplicate_skill_names_and_update_rollback_are_deterministic ... ok
test engine::sampling_tests::probability_ratio_speculation_preserves_the_target_distribution ... ok
test extensions::tests::hook_output_is_bounded_typed_and_event_matched ... ok
test dev_brain::tests::skill_validation_and_default_guide_restore_are_strict ... ok
test extensions::tests::manifest_and_paths_are_validated_without_following_escapes ... ok
test extensions::tests::pinned_ponytail_runs_all_lifecycle_modes ... ignored, downloads the pinned Ponytail reference integration
test engine::metal::qwen_mtplx::array::mtplx_array_releases_sibling_cycles_and_deep_input_graphs ... ok
test extensions::tests::symlink_and_variable_escapes_are_rejected ... ok
test extensions::tests::registry_persists_enable_disable_errors_and_uninstall ... ok
test instructions::tests::changes_removals_resume_and_compaction_are_append_only ... ok
test instructions::tests::discovery_is_global_to_local_deduplicated_and_confined ... ok
test instructions::tests::empty_and_repaired_baselines_do_not_repeat_prompt_content ... ok
test instructions::tests::newly_crossed_scope_is_added_once_and_unavailable_content_is_retained ... ok
test metrics::tests::cache_report_splits_buckets_and_folds_index_files_into_their_checkpoint ... ok
test metrics::tests::decode_timer_excludes_later_work_and_resets_between_requests ... ok
test metrics::tests::prompt_timing_keeps_unmeasured_components_distinct_from_zero ... ok
test metrics::tests::removed_preview_metric_code_stays_decodable ... ok
test metrics::tests::snapshots_track_runtime_and_server_counters ... ok
test model::qwen::qwen_vision_is_an_independent_managed_artifact_set ... ok
test model::qwen::tests::embedded_manifest_is_the_frozen_complete_set ... ok
test model::qwen::tests::verification_rejects_hash_mismatch_and_honors_cancellation ... ok
test model::transfer::tests::cancellation_keeps_the_partial_file_for_the_next_run ... ok
test dev_brain::tests::validation_names_every_drifted_source_and_requires_semantic_refresh ... ok
test model::transfer::tests::catalog_and_checksum_verification_are_explicit ... ok
test model::transfer::tests::issue100_managed_intake ... ignored, requires all three pinned Vision-Exp GGUF artifacts; performs full SHA256 and intake validation
test instructions::tests::frames_escape_control_tags_and_enforce_utf8_byte_limits ... ok
test model::transfer::tests::qwen_set_verifies_reloads_and_removes_as_one_managed_artifact ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
test model::transfer::tests::issue100_catalog_keeps_vision_and_dspark_checkpoint_specific ... ok
test model::transfer::tests::managed_artifact_inventory_and_delete_include_partial_files ... ok
test model::transfer::tests::verification_reports_bytes_read ... ok
test model_eval::tests::acceleration_receipt_reports_effective_sampling_contract ... ok
test model_eval::tests::acceleration_switch_uses_each_models_native_path ... ok
test model_eval::tests::canary_cross_phase_samples_keep_their_start_phase ... ok
test model::transfer::tests::restart_resumes_at_the_existing_partial_byte ... ok
test model_eval::tests::evaluations_exclude_overlapping_workers_and_release_on_exit ... ok
test model_eval::tests::external_canary_observes_phases_and_finishes_on_eof ... ignored, Metal probe only; DS4SERVER_CANARY_BINARY must point to the current release binary
test model_eval::tests::external_canary_protocol_accepts_only_known_phases ... ok
test model_eval::tests::parses_safe_defaults_and_overrides ... ok
test model_eval::tests::rejects_unbounded_or_invalid_limits ... ok
test model_eval::tests::repeated_prompts_form_one_ordered_conversation ... ok
test model_eval::tests::warmup_timing_separates_loading_without_inventing_missing_durations ... ok
test model_eval::tests::worker_progress_events_advance_the_watchdog ... ok
test native_edit::tests::edit_history_supports_undo_and_redo ... ok
test native_edit::tests::paste_replays_a_complete_command_shortcut ... ok
test native_media::tests::media_player_only_accepts_remote_http_urls ... ok
test native_menu::tests::edit_items_are_custom_menu_events ... ok
test native_menu::tests::user_guide_uses_unmodified_f1 ... ok
test native_menu::tests::view_items_keep_the_selected_pane_checked ... ok
test runtime::tests::dropping_active_generation_cancels_it ... ok
test runtime::tests::operation_failures_use_the_matching_event ... ok
test runtime::tests::operation_tracking_is_consistent ... ok
test runtime::tests::runtime_panic_recovery_accepts_the_next_operation ... ok
test server::request::tests::reasoning_requests_preserve_each_models_exact_modes ... ok
test server::tests::canonical_tool_replay_preserves_argument_types ... ok
test server::tests::connection_slots_enforce_the_limit_and_release_on_drop ... ok
test server::tests::content_arrays_match_ds4_text_projection ... ok
test server::tests::context_limit_errors_use_protocol_standard_fields ... ok
test server::tests::cors_headers_are_opt_in_and_cover_preflight ... ok
test server::tests::dsml_tool_stream_projects_incremental_json_arguments ... ok
test server::tests::generated_dsml_becomes_openai_tool_calls ... ok
test server::tests::generated_tool_parser_accepts_ds4_recovery_syntaxes ... ok
test server::tests::model_metadata_uses_the_requested_alias_and_default_token_limit ... ok
test server::tests::protocol_tool_results_require_live_or_replayed_call_ids ... ok
test server::tests::qwen_http_requests_keep_echoed_reasoning_without_tools ... ok
test dev_brain::tests::source_hash_drift_excludes_page_from_authoritative_queries ... ok
test server::tests::responses_parser_rejects_dropped_state_and_preserves_hosted_calls ... ok
test server::tests::sampled_tool_replay_survives_server_restart ... ok
test server::tests::streaming_errors_match_ds4_server_framing ... ok
test dev_brain::tests::validation_keeps_broken_links_editable_and_reports_provenance_errors ... ok
test server::tests::tool_prompt_matches_ds4_server_text ... ok
test server::tests::tool_stream_projects_ds4_recovery_syntaxes ... ok
test settings::tests::captured_ds4_cli_options_are_uniquely_classified ... ok
test settings::tests::effective_settings_build_one_engine_and_turn_configuration ... ok
test settings::tests::effective_settings_preserve_unset_model_defaults ... ok
test settings::tests::execution_settings_keep_ds4_automatic_values_and_glm_rules ... ok
test settings::tests::kv_cache_gates_follow_the_ds4_store_rules ... ok
test settings::tests::reasoning_selection_is_exact_and_model_specific ... ok
test settings::tests::runtime_settings_preserve_automatic_values_and_cross_field_rules ... ok
test settings::tests::speculative_settings_match_acceleration_defaults_and_dependencies ... ok
test dev_brain::tests::verified_skills_are_indexed_and_injected_on_demand ... ok
test server::tests::streaming_prefill_keeps_the_client_connection_alive ... ok
test dev_brain::tests::source_versions_follow_that_file_instead_of_the_whole_worktree ... ok
test model_eval::tests::cpu_accounting_matches_getrusage_units ... ok
test engine::validation::tests::installed_ds4_fixture_opens_and_renders_a_prompt ... ok
test model::transfer::tests::stalled_download_times_out_and_keeps_the_partial_file ... ok
test server::tests::request_deadline_stops_slow_clients ... ok
test engine::sampling_tests::ds4_sampler_matches_original_reference_tokens_and_rng ... ok
test extensions::tests::direct_hook_runner_isolated_environment_and_handles_failures ... ok
test agent::tests::execution_failures_and_timeouts_have_distinct_codes ... ok
kill: 21799: No such process
test agent::tests::dropping_session_tools_stops_live_jobs_and_removes_output ... ok
test engine::qwen_vision::qwen_image_preprocessing_matches_pillow_mtplx ... ok
test agent::tests::local_file_and_bash_tools_execute_in_the_project ... ok
test extensions::tests::lifecycle_matchers_preserve_declared_event_order ... ok
test engine::metal::qwen_mtplx_tests::mtplx_runtime_shaders_are_pinned ... ok
test extensions::tests::hook_failures_are_bounded_actionable_and_non_shell ... ok
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_mixed_distributions_match_reference ... ok
test result: ok. 323 passed; 0 failed; 247 ignored; 0 measured; 0 filtered out; finished in 5.53s
Running unittests tools/qwen38-artifacts.rs (target/debug/deps/qwen38_artifacts-3a34dfcd9c4f3de8)
running 4 tests
test tests::artifact_names_cannot_escape_the_output_directory ... ok
test tests::affine_sample_digest_uses_packed_values_scales_and_biases ... ok
test tests::safetensors_validation_rejects_duplicate_names_and_invalid_ranges ... ok
test tests::artifact_download_resumes_an_authenticated_partial ... ok
test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests tools/test-supervisor.rs (target/debug/deps/test_supervisor-978addc9e5e8dbda)
running 4 tests
test supervisor::tests::direct_worker_arguments_are_not_rust_test_arguments ... ok
test supervisor::tests::split_records_cannot_be_interleaved_with_watchdog_samples ... ok
test supervisor::tests::split_probe_records_do_not_reset_progress ... ok
ready{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
ready
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
{"event":"gpu_canary_sample","ok":true}
progressprogressprogressprogressprogressprogressprogressprogresstest supervisor::tests::watchdog_stops_memory_and_silence_but_not_total_runtime ... ok
test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.33s
+5
View File
@@ -0,0 +1,5 @@
running 1 test
test engine::tokenizer::tests::issue100_visual_text_preserves_image_boundaries ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 569 filtered out; finished in 0.10s
+120
View File
@@ -0,0 +1,120 @@
# Issue 104: retire the Qwen AR pipeline
The Qwen AR driver now samples every token through `sample_from_logits` and
the request's PCG64 stream, following MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`.
The obsolete pipeline option, admission, keyed decode loop, cached speculative
tail, model mode and compile-policy lane are removed. Classic tail capture
forwards the final sampled token before banking its state.
The server no longer supplies or reads `MTPLX_AR_PIPELINE`. The installed-model
reference harness cannot enable it either. Generic PLE staging/resident-table
fields remain for their independently tested callers. Their classic defaults
are preserved. The historical lazy sampling primitive and its scalar keyed
categorical wrapper are test-only, retained to reproduce the original sampling
law receipt and exercise the existing RNG fixtures.
## Baseline and oracle
Pre-fix production revision: `5773942c8ffe41352104d673ff0eef949df10c71`, with only
the installed-model diagnostic added. Model: unchanged Bare-Speed revision
`74559cdf34fbfc0b593de72d17e93f37fd4f9ea7`; MLX 0.32.2; Apple M5 Max / 128 GiB.
Each model process ran serially under `test-supervisor 114688 60 120`.
| Configuration | Actual old lane | Temperature .6, p .95, k 20, seed 0, eight tokens |
| --- | --- | --- |
| SSD, pipeline disabled | Classic | 314, 279, 198, 2, 20732, 198, 2, 198 |
| SSD, pipeline enabled | Classic | Same tokens and every final-state hash |
| Full resident table, pipeline disabled | Classic | Same tokens and every final-state hash |
| Full resident table, pipeline enabled | Keyed pipeline | 314, 279, 35067, 82, 13, 220, 19, 15 |
The temperature-1 control also diverged at token 3 only with the resident
pipeline. Its classic tokens were `314,279,198,2,20732,20086,198,2053`; pipeline
tokens were `314,279,695,47,4920,82,5212,2502`. Full resident attachment was asserted,
and the old driver's actual `Decoded::pipeline` was recorded, rather than
inferring engagement from an environment flag.
`tools/issue104-reference.py` runs the pinned original `generate_ar` and
SessionBank against the installed artifacts. The checked-in
`tests/fixtures/issue104-ar-model.json` contains cold and warm token IDs, final
logits and every trunk-state array's shape/hash. Cold receipts equal both
pre-fix native classic baselines in full. The warm turn restores all 11 committed
tokens and adds suffix `[1075]` before decoding eight more tokens.
Native regression `issue104_installed_ar_stream_and_state` checks those complete
receipts with synchronous and asynchronous evaluation. It also cancels a warm
turn after three callbacks, checks that the saved state is intact, and retries
from that state. Every completed turn asserts that PLE staging remains enabled
and resident preference remains in classic mode. Run with `MTPLX_AR_PIPELINE=1`
to exercise an explicit obsolete flag without recreating the removed lane.
## Scope review
The checked route is request/session ownership → `Execution::decode_ar` →
`ar::decode` → classic sampling → final-token capture. No production AR caller
can reach the lazy primitive. Every former admission and mode call in policy,
model, decoder, binding and installed reference tests was removed. GDN compilation
still obeys its two existing environment gates, including explicit-off precedence.
Normal prefill and MTP retain their compilation/staging paths. DS4/GLM sampling,
RNG, inference and Metal kernels have no changes.
The 1,120 fresh MTPLX orchestration fixtures cover both obsolete flag values,
sync/async evaluation, official .6/.95/k20, 1/.95/k20, .5/k2, p=0/1, greedy,
presence penalty, zero/one/two/three/twelve-token limits, stops and final capture.
Existing sampler fixtures additionally exercise tied logits, frequency penalties
and exact PCG64 continuation. The historical primitive-law receipt remains in
`docs/issue103-analysis/native-sampling-final.log`.
The server-policy oracle's `--server-only` mode compares all existing native
defaults and verifies pipeline removal across 268 environment/MTP cases.
Current upstream additionally supplies defaults for other, unported features and
has replaced its old boundary-count diagnostic API; this scoped check does not
claim those unrelated policy extensions are implemented.
## Timing interpretation
`receipts.jsonl` records measured decode seconds separately from state equality
and process memory peaks. These are bounded eight-token correctness probes,
including first-use and memory-pressure effects, not steady-state throughput
claims. Old resident classic/pipeline times at .6 were 7.576/17.518 seconds;
at 1.0 they were 1.332/5.452 seconds. SSD classic repeated at .6 took
0.649/1.120 seconds and at 1.0 took 1.280/1.273 seconds. No overlap is retained
to preserve these old timings.
After removal, synchronous SSD decode took 0.642/1.309 seconds at temperatures
.6/1.0; synchronous resident decode took 0.813/1.427 seconds. Async controls took
1.182/1.298 seconds (SSD) and 1.435/1.426 seconds (resident). All produce the
classic stream and state. Peak process physical footprint was 72.5 GB for the
SSD regression and 104.5 GB for the resident regression.
## Completed validation
- Both installed-model regressions passed with the obsolete flag explicitly on,
including warm state, cancellation/retry, sync/async and pre-fix equality.
- All 1,120 AR orchestration fixtures, 1,080 sampler-entry fixtures, the penalty
and distribution/RNG fixtures, the original sampling-law diagnostic, and the
connected decoder/cache control passed under the supervisor.
- The scoped 268-case current server-default comparison passed. The ordinary
suite includes DS4's 64 exact token/RNG fixtures and compile-policy controls.
- `cargo fmt --all -- --check`, warnings-denied Clippy, `make bundle` including
signing, and `cargo test --all-features` passed (308 application tests plus
two tool suites of four tests each; 211 opt-in application tests ignored).
- Every artifact SHA256 was re-read and matched the unchanged revision;
see `environment.json`. Compact run results are in `checks.json` and
`receipts.jsonl`. Source review found no DS4/GLM changes and no remaining
production AR-pipeline admission or mode path.
## Reproduction
Build the test executable with `cargo test --all-features --bin ds4-server
--no-run`; pass that executable, not Cargo, to the supervisor. Set
`DS4_QWEN38_ARTIFACTS` to the installed artifact directory, and set
`MTPLX_COMPILED_GDN=1 MTPLX_QWEN4EXP_COMPILE=1`. Run
`issue104_installed_ar_stream_and_state --ignored --nocapture --test-threads=1`
once with default SSD policy and once with `MTPLX_NGRAM_RESIDENT=1` and adequate
RAM. Set `MTPLX_AR_PIPELINE=1` on both runs. Optional `DS4_ISSUE104_BASELINE`
compares the cold records to a separately saved pre-fix classic receipt.
For the isolated Python oracle, point `PYTHONPATH` at pinned MTPLX, use the
MLX-0.32.2 environment, the same compilation flags, and
`MTPLX_SUSTAINED_PREFILL=1 MTPLX_PREFILL_CHUNK_SIZE=2048`. Run
`tools/issue104-reference.py MODEL_DIRECTORY` under the same supervisor.
+36
View File
@@ -0,0 +1,36 @@
{
"clippy": [
" Finished `dev` profile [unoptimized + debuginfo] target(s) in 4.49s"
],
"bundle": [
" Finished `release` profile [optimized] target(s) in 49.59s",
"target/release/DS4Server.app: replacing existing signature"
],
"tests": [
" Finished `test` profile [unoptimized + debuginfo] target(s) in 0.25s",
"test result: ok. 308 passed; 0 failed; 211 ignored; 0 measured; 0 filtered out; finished in 6.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.30s"
],
"mtplx_ar_driver_matches_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 518 filtered out; finished in 2.10s"
],
"mtplx_sampler_entry_matches_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 518 filtered out; finished in 56.60s"
],
"mtplx_sampler_penalties_match_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 518 filtered out; finished in 7.94s"
],
"mtplx_sampler_distribution_and_rng_match_reference": [
"test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 519 filtered out; finished in 0.00s"
],
"issue103_sampling_receipts": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 518 filtered out; finished in 1.48s"
],
"mtplx_decoder_connected_attention_and_moe_advance_caches": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 518 filtered out; finished in 0.79s"
],
"fmt": "passed",
"diff_check": "passed",
"scoped_current_server_policy": "268 cases passed"
}
+45
View File
@@ -0,0 +1,45 @@
{
"base_revision": "5773942c8ffe41352104d673ff0eef949df10c71",
"oracle_revision": "9882703f3105363ddc37eca9f97aa09a1d387112",
"model_revision": "74559cdf34fbfc0b593de72d17e93f37fd4f9ea7",
"model_root": "/Users/gb/Library/Application Support/de.rfc1437.ds4server/models/qwen3.8-flash-next",
"artifact_verification": "Every SHA256 re-read and matched on 2026-10-04",
"artifact_sha256": {
"LICENSE": "a0dc422560841fd68e06d974907f8b4c709bca44a67daad2b528437bdf676c08",
"chat_template.jinja": "c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041",
"config.json": "826302af9ff3293cfc9975c9a5a96546fa0aa9f0808505adfc30a62fef806965",
"generation_config.json": "e70c136c1b78ddc1fb0905bac8e733a4dc448d4f852a5dd75143fffc70be550e",
"merges.txt": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d",
"model-00001-of-00017.safetensors": "a27232c9434b9d8961f198cf36f44e228b3f23a5f8d874ba4ca8af32a1b23ffc",
"model-00002-of-00017.safetensors": "6268ae80950f6b935fca672fae5aa455eb3ea4f139730e54e6e5f8581faa94dc",
"model-00003-of-00017.safetensors": "71a9abbd420dce567f2c06593bfee2d6cea681989d51eaef1b1c5dffd65a844b",
"model-00004-of-00017.safetensors": "c8112da735bb1c8dbc4757926ab8ec1eba7a707a8767c7e43c6150586cf63a4c",
"model-00005-of-00017.safetensors": "48258b931e7596c1b43c8b38c044060787ef6d85cca2c1935852bc962801f792",
"model-00006-of-00017.safetensors": "f357d2d66f7b768ebb19ba464556bbe46c572cf3cd1f8226faddf9216b150d0c",
"model-00007-of-00017.safetensors": "d3152e808d013e3afa4a9c391f6d8088e74a10303c89d45fb61dad7e457160f6",
"model-00008-of-00017.safetensors": "1d93bd4872f338fa19416bac64ebeb05aedf2721a07ac48e37c53921252c95c1",
"model-00009-of-00017.safetensors": "d22d4be580296e3d4fa5f4fe5902c8fc448d8204b6dcde4641f87b9c675930ca",
"model-00010-of-00017.safetensors": "111d0166c888cabb7d6fc19c4bb7eb42e2b51946f71b4983dd750b031755637e",
"model-00011-of-00017.safetensors": "73dad882cf94a5486cfe0dcda876b0f740556bc469608d2ced7a07540e699803",
"model-00012-of-00017.safetensors": "a6057d5a06276461760a4f4e88991550a43abdc5f8afacef06e860f5e7843393",
"model-00013-of-00017.safetensors": "ff25dc6e1c250c9b9ece83d59111a4c4055dad1b1f160546c614dcc17395b152",
"model-00014-of-00017.safetensors": "d8c9de3ae28abccc8e3da09dc92fbbed4039d6d65dabb2657edebc11b2b09652",
"model-00015-of-00017.safetensors": "a5438d468074c709febdeadb9f6a2db54fa9fb30a37c33de78584f28d6fa1191",
"model-00016-of-00017.safetensors": "4a07409bd568cd1435641495d90c805dcb0d0e5d8dc64409273d604a7d06b342",
"model-00017-of-00017.safetensors": "9c064e0b8dc0054e2b453fe2b8450c287e1ede6e74bb74ecf5aaed1ef9271913",
"model-vision.safetensors": "5aff6983f36f52acbecc1f61f703ae7b927e74525bf3b1133ba276bb7a5b52b1",
"model.safetensors.index.json": "81e77f5b25bb29e25e239ae2f9f324c9cada379ee600441d6c229f1d95a13443",
"mtp.safetensors": "1bd4b2fc20a93b53f22b4cab0b14d68bc0fe666bb64e4e2f898872c30d7d26ae",
"mtplx_runtime.json": "381c7666872f878542494a48a874bb0784c72a955d18cc077324d3c9e74b8cdb",
"ngram-table.safetensors": "af7f0880c1798e60353b07cc6b0faa0d41f78734818d858ff013ab7e3bce9de5",
"preprocessor_config.json": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516",
"processor_config.json": "dcc7ce0121d6d1c514804e68e5673e04c239ad2547339ea6330289d272a748f8",
"tokenizer.json": "0997f410c57a1f4e53b09e4be8f4a172d90edd9564368fb0847030937229b9f3",
"tokenizer_config.json": "b11349aafa7cdc6a320767cf7ceb29ed82f7eda5d65e8e0819e76f0ce947bf27",
"video_preprocessor_config.json": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13",
"vocab.json": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003"
},
"physical_memory_bytes": 137438953472,
"os": "macOS 26.6.2 (25G83)",
"hardware": "Apple M5 Max"
}
+37
View File
@@ -0,0 +1,37 @@
{"run":"before-ssd","event":"issue104_environment","resident_tables":[false],"mtp":false}
{"run":"before-ssd","event":"issue104_ar","temperature":0.6,"legacy":false,"pipeline":false,"tokens":[314,279,198,2,20732,198,2,198],"seconds":0.64901575,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"before-ssd","event":"issue104_ar","temperature":0.6,"legacy":true,"pipeline":false,"tokens":[314,279,198,2,20732,198,2,198],"seconds":1.119514625,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"before-ssd","event":"issue104_ar","temperature":1.0,"legacy":false,"pipeline":false,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.279887375,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"before-ssd","event":"issue104_ar","temperature":1.0,"legacy":true,"pipeline":false,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.273476917,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"before-ssd","event":"test_resource_summary","elapsed_ms":34988,"peak":{"cpu_time_ns":32497220166,"resident_bytes":59135393792,"physical_bytes":72378445512,"peak_physical_bytes":72378478280,"disk_read_bytes":71780679680,"disk_write_bytes":9781248},"error":null}
{"run":"before-resident","event":"issue104_environment","resident_tables":[true],"mtp":false}
{"run":"before-resident","event":"issue104_ar","temperature":0.6,"legacy":false,"pipeline":false,"tokens":[314,279,198,2,20732,198,2,198],"seconds":7.5761748749999995,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"before-resident","event":"issue104_ar","temperature":0.6,"legacy":true,"pipeline":true,"tokens":[314,279,35067,82,13,220,19,15],"seconds":17.51813525,"state_sha256":"780fc40e50d844db43f003860b865aa123e28d84be3ad7ac585c5197ac3e502f"}
{"run":"before-resident","event":"issue104_ar","temperature":1.0,"legacy":false,"pipeline":false,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.332490958,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"before-resident","event":"issue104_ar","temperature":1.0,"legacy":true,"pipeline":true,"tokens":[314,279,695,47,4920,82,5212,2502],"seconds":5.452344583,"state_sha256":"6d85808248625e1691696f38ebd1cccc4e46d5e96439d7e0fa156841014b33ff"}
{"run":"before-resident","event":"test_resource_summary","elapsed_ms":115309,"peak":{"cpu_time_ns":72117394541,"resident_bytes":55280517120,"physical_bytes":104389150752,"peak_physical_bytes":104440955808,"disk_read_bytes":119938990080,"disk_write_bytes":18446744073709518848},"error":null}
{"run":"after-ssd","event":"issue104_environment","resident_tables":[false],"mtp":false}
{"run":"after-ssd","event":"issue104_ar","temperature":0.6,"asynchronous":false,"tokens":[314,279,198,2,20732,198,2,198],"seconds":0.642156958,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"after-ssd","event":"issue104_warm","temperature":0.6,"asynchronous":false,"state_sha256":"cd0e50af7ec373da52da7e32d94d7a55ce11c9cb3fc68d7d1d2c0d4607a927bc"}
{"run":"after-ssd","event":"issue104_ar","temperature":0.6,"asynchronous":true,"tokens":[314,279,198,2,20732,198,2,198],"seconds":1.182015375,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"after-ssd","event":"issue104_warm","temperature":0.6,"asynchronous":true,"state_sha256":"cd0e50af7ec373da52da7e32d94d7a55ce11c9cb3fc68d7d1d2c0d4607a927bc"}
{"run":"after-ssd","event":"issue104_ar","temperature":1.0,"asynchronous":false,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.30897475,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"after-ssd","event":"issue104_warm","temperature":1.0,"asynchronous":false,"state_sha256":"9d5d1ac4b918ff915aa9bcd4fc81d8c561094fa0b8cb71a2d759c0924e2a9b54"}
{"run":"after-ssd","event":"issue104_ar","temperature":1.0,"asynchronous":true,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.298059,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"after-ssd","event":"issue104_warm","temperature":1.0,"asynchronous":true,"state_sha256":"9d5d1ac4b918ff915aa9bcd4fc81d8c561094fa0b8cb71a2d759c0924e2a9b54"}
{"run":"after-ssd","event":"test_resource_summary","elapsed_ms":62881,"peak":{"cpu_time_ns":65904669875,"resident_bytes":61079650304,"physical_bytes":72499870168,"peak_physical_bytes":72499870168,"disk_read_bytes":71786532864,"disk_write_bytes":344064},"error":null}
{"run":"after-resident","event":"issue104_environment","resident_tables":[true],"mtp":false}
{"run":"after-resident","event":"issue104_ar","temperature":0.6,"asynchronous":false,"tokens":[314,279,198,2,20732,198,2,198],"seconds":0.813106875,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"after-resident","event":"issue104_warm","temperature":0.6,"asynchronous":false,"state_sha256":"cd0e50af7ec373da52da7e32d94d7a55ce11c9cb3fc68d7d1d2c0d4607a927bc"}
{"run":"after-resident","event":"issue104_ar","temperature":0.6,"asynchronous":true,"tokens":[314,279,198,2,20732,198,2,198],"seconds":1.435416458,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"after-resident","event":"issue104_warm","temperature":0.6,"asynchronous":true,"state_sha256":"cd0e50af7ec373da52da7e32d94d7a55ce11c9cb3fc68d7d1d2c0d4607a927bc"}
{"run":"after-resident","event":"issue104_ar","temperature":1.0,"asynchronous":false,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.426774333,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"after-resident","event":"issue104_warm","temperature":1.0,"asynchronous":false,"state_sha256":"9d5d1ac4b918ff915aa9bcd4fc81d8c561094fa0b8cb71a2d759c0924e2a9b54"}
{"run":"after-resident","event":"issue104_ar","temperature":1.0,"asynchronous":true,"tokens":[314,279,198,2,20732,20086,198,2053],"seconds":1.4262525,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"after-resident","event":"issue104_warm","temperature":1.0,"asynchronous":true,"state_sha256":"9d5d1ac4b918ff915aa9bcd4fc81d8c561094fa0b8cb71a2d759c0924e2a9b54"}
{"run":"after-resident","event":"test_resource_summary","elapsed_ms":115119,"peak":{"cpu_time_ns":89721565333,"resident_bytes":62532075520,"physical_bytes":104507069232,"peak_physical_bytes":104507069232,"disk_read_bytes":104724783104,"disk_write_bytes":0},"error":null}
{"run":"oracle-warm","event":"issue104_oracle","temperature":0.6,"warm":false,"tokens":[314,279,198,2,20732,198,2,198],"cached_tokens":0,"seconds":4.613554999988992,"state_sha256":"62ab1517fbe639323f74633514726721d025b6d51635f4f81de73bb8851b94b0"}
{"run":"oracle-warm","event":"issue104_oracle","temperature":0.6,"warm":true,"tokens":[314,279,198,2,20732,198,2,198],"cached_tokens":11,"seconds":0.18006633399636485,"state_sha256":"cd0e50af7ec373da52da7e32d94d7a55ce11c9cb3fc68d7d1d2c0d4607a927bc"}
{"run":"oracle-warm","event":"issue104_oracle","temperature":1.0,"warm":false,"tokens":[314,279,198,2,20732,20086,198,2053],"cached_tokens":0,"seconds":0.20107879099668935,"state_sha256":"9e37724c8c634904d51e3fd982587549c7321e2d12aab1217df951189a730642"}
{"run":"oracle-warm","event":"issue104_oracle","temperature":1.0,"warm":true,"tokens":[25,198,2,198,15666,25835,1608,678],"cached_tokens":11,"seconds":0.17781587500940077,"state_sha256":"9d5d1ac4b918ff915aa9bcd4fc81d8c561094fa0b8cb71a2d759c0924e2a9b54"}
{"run":"oracle-warm","event":"test_resource_summary","elapsed_ms":15510,"peak":{"cpu_time_ns":18162759666,"resident_bytes":61776969728,"physical_bytes":72906603160,"peak_physical_bytes":72906619568,"disk_read_bytes":103772155904,"disk_write_bytes":0},"error":null}
+95
View File
@@ -0,0 +1,95 @@
# Issue 105: reject invalid Qwen logits and invalidate the failed session
Qwen now reports numerical failure instead of emitting fabricated IDs for NaN,
positive infinity or all-masked logits. Negative-infinity masks with a finite
winner remain legal. Failed sessions lose their live, resident and persisted
state, while unrelated healthy conversations remain reusable.
## Oracle and approved exception
The oracle is MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`, MLX 0.32.2.
The unchanged installed Bare-Speed model and environment were verified for
`../issue104-ar/environment.json` immediately before this issue.
Ordinary greedy uses the upstream `any(isnan(row)) | isinf(max(row))` graph,
evaluated with argmax. Only failures read the full row for the NaN/infinity
census. Sampled support retains its existing GPU route and host-softmax fallback;
invalid mass now raises the same numerical error instead of selecting token 0.
SparseDistribution no longer invents an ID when positive mass is absent.
The pinned oracle remains inconsistent in specialized greedy MTP paths:
`generation.py:7577,13295,15371` still use unchecked argmax. The user explicitly
approved extending rejection throughout MTP on 2026-10-04. This deliberate
invalid-row exception is not claimed as upstream parity. `oracle.jsonl` records
the ordinary error, lazy sentinel and specialized-MTP token 0 side by side.
Batched verification validates every row, so a healthy row cannot conceal an
all-masked neighbor. Valid choices and RNG draws are unchanged.
The old lazy sampler is only a historical #104/RNG test diagnostic. Its finite
law remains historical and its invalid result is now the checked -1 sentinel.
No product path calls it. The unrelated diagnostic prefix sampler retains its
upstream contract; it is not a production target/draft sampling route.
## Ownership and family boundary review
| Requirement | Implementation and evidence |
| --- | --- |
| Reject before consuming a fabricated ID | Ordinary AR, MTP primary/target/draft and context-copy target all reach checked sampling; invalid prefill emits no text. |
| Clear a prefix captured before failure | LiveSession discards current and prefix; QwenExecutor resets trunk/head/boundary caches. Installed faults occur after real prefill and prefix capture. |
| Clear selected, resident and disk state | Generator invalidates the failed conversation's checkpoints, resident aliases, indexes and staging files, and clears selection/store frontier. |
| No stale bootstrap or later persistence | First local fault creates then removes a real system bootstrap. A later explicit save fails without a committed snapshot. All failed requests retry cold. |
| Preserve other sessions | A real healthy checkpoint remains byte-identical and resident throughout both product matrices, then restores successfully. |
| Final capture ownership | A test-only fault consumes an invalid row through the real numerical guard during final capture; the resulting error crosses the actual snapshot/request/Generator owners and prevents persistence. Normal capture adds no sampling pass. |
| Streaming and non-streaming | Actual Generator events pass through the production HTTP response adapters; explicit SSE errors/HTTP 500 are checked, followed by valid requests using the same Generator. |
| DS4/GLM unchanged | Shared cleanup requires both QwenMtplx and the numerical-error discriminator. DS4 `ds4.c:39410-39460` retains its greedy/no-finite-mass fallback; shared RNG, samplers and checkpoint formats are untouched. Default tests include exact DS4 token/RNG controls. |
DS4Server uses content-addressed API conversations rather than MTPLX session IDs.
Its cleanup therefore invalidates every ancestor of the failed API request and
its selected source. Local chats invalidate their file and system bootstrap.
Shared bootstrap prefixes belonging to the failed ancestry are invalidated,
while other conversations' complete checkpoints remain intact. This is the
DS4Server-specific persistence integration of MTPLX's session-bank eviction.
Checkpoint writes are synchronous on the serialized model worker. Errors return
before final persistence; the cleared owner cannot later save or be banked by an
outgoing resident swap. Filesystem cleanup failures are reported explicitly.
Production remains Rust/Metal; Python is used solely for isolated oracle receipts.
## Validation
- Fresh ordinary-entry fixtures: 1,080 cases, three consecutive draws each,
including evaluation boundaries, valid tokens/probabilities and next RNG.
- Sparse fallback: 150 cases; batched fallback: 653; mixed distributions: 100;
historical keyed/lazy diagnostics: 387. Mixed and distribution/RNG tests run
in the ordinary cargo suite, not with `--ignored`.
- Four synthetic rows at temperatures 0/.6/1, with exact oracle error census,
legal tokens and invalid lazy sentinel: `native-invalid-rows.jsonl`.
- Batched greedy: both row orders, widths 64/4097, all four rows, including a
healthy neighbor beside an all-masked row.
- Installed AR: 24 cases (prefill, later forward, final capture; four rows;
both HTTP modes), 18 invalid/cold-retry cases and six legal-mask successes.
- Installed MTP: 32 cases, additionally exercising draft-head faults; 24
invalid/cold-retry cases and eight legal-mask successes. A real supported
penalty disables context-copy for draft tests and half the target tests,
ensuring both target routes and the actual draft head are exercised.
- All four commit gates: formatting, Clippy with warnings denied, signed app
bundle, and all-feature cargo tests. Exact outcomes are in `checks.json`.
These are correctness and cleanup tests, not throughput measurements. Test-only
injection fields, output substitution and HTTP harness are absent from release
code. The initial test runs deliberately failed if the requested fault boundary
was bypassed; the final matrices reach every specified boundary.
## Reproduction
Build with `cargo test --all-features --bin ds4-server --no-run` and
`cargo build --bin test-supervisor`. Resolve the executable printed by Cargo.
Run model-free ignored tests serially under `test-supervisor 4096 60 120
--command <test-executable> <test-name> --ignored --nocapture --test-threads=1`.
For `issue105_product_ar_cleanup_and_http_retry` and
`issue105_product_mtp_cleanup_and_http_retry`, use memory limit 114688 MiB,
`DS4_QWEN38_ARTIFACTS` pointing to the installed unchanged model, and a fresh
`DS4_ISSUE105_DIR` per run. Keep model processes serial. For the oracle, run
`tools/issue105-reference.py` in the isolated MLX 0.32.2 environment with
`PYTHONPATH` pointing at the pinned MTPLX checkout.
@@ -0,0 +1,25 @@
{"case":0,"mtp":false,"stage":"Prefill","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":1,"mtp":false,"stage":"Prefill","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":2,"mtp":false,"stage":"Prefill","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":3,"mtp":false,"stage":"Prefill","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":4,"mtp":false,"stage":"Prefill","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":5,"mtp":false,"stage":"Prefill","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":6,"mtp":false,"stage":"Prefill","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":7,"mtp":false,"stage":"Prefill","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":8,"mtp":false,"stage":"Target","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":9,"mtp":false,"stage":"Target","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":10,"mtp":false,"stage":"Target","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":11,"mtp":false,"stage":"Target","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":12,"mtp":false,"stage":"Target","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":13,"mtp":false,"stage":"Target","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":14,"mtp":false,"stage":"Target","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":15,"mtp":false,"stage":"Target","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":16,"mtp":false,"stage":"Capture","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":17,"mtp":false,"stage":"Capture","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":18,"mtp":false,"stage":"Capture","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":19,"mtp":false,"stage":"Capture","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":20,"mtp":false,"stage":"Capture","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":21,"mtp":false,"stage":"Capture","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":22,"mtp":false,"stage":"Capture","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":23,"mtp":false,"stage":"Capture","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"event":"test_resource_summary","elapsed_ms":58704,"peak":{"cpu_time_ns":62056161375,"resident_bytes":25310855168,"physical_bytes":77867608424,"peak_physical_bytes":77867624808,"disk_read_bytes":68731633664,"disk_write_bytes":9359335424},"error":null}
+37
View File
@@ -0,0 +1,37 @@
{
"mtplx_sampler_entry_matches_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 521 filtered out; finished in 59.33s"
],
"mtplx_sampler_fallback_matches_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 3.76s"
],
"mtplx_sampler_resident_matches_reference": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 11.51s"
],
"mtplx_sampler_batched": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 115.98s"
],
"product_ar": {
"cases": 24,
"invalid": 18,
"legal_mask": 6,
"status": "passed"
},
"product_mtp": {
"cases": 32,
"invalid": 24,
"legal_mask": 8,
"status": "passed"
},
"completion": "Acceptance, source review and all four commit gates passed.",
"commit_gates": {
"fmt": "passed",
"clippy_all_targets_all_features": "passed",
"make_bundle": "passed; ad-hoc codesigned",
"cargo_test_all_features": "308 application tests passed, 214 ignored; two tools each 4 passed"
},
"invalid_rows_vs_pinned_oracle": "passed; exact census/error text and valid tokens; invalid lazy sentinel -1",
"mtplx_sampler_mixed_distributions_match_reference": "100 cases passed in default cargo test",
"approved_exception": "User approved rejection throughout Qwen MTP on 2026-10-04, including specialized paths where the pinned oracle still fabricates token 0.",
"batched_greedy": "passed: each of 4 rows in both positions beside a healthy neighbor, widths 64 and 4097"
}
@@ -0,0 +1,33 @@
{"case":0,"mtp":true,"stage":"Prefill","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":1,"mtp":true,"stage":"Prefill","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":2,"mtp":true,"stage":"Prefill","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":3,"mtp":true,"stage":"Prefill","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":4,"mtp":true,"stage":"Prefill","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":5,"mtp":true,"stage":"Prefill","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":6,"mtp":true,"stage":"Prefill","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":7,"mtp":true,"stage":"Prefill","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":8,"mtp":true,"stage":"Target","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":9,"mtp":true,"stage":"Target","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":10,"mtp":true,"stage":"Target","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":11,"mtp":true,"stage":"Target","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":12,"mtp":true,"stage":"Target","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":13,"mtp":true,"stage":"Target","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":14,"mtp":true,"stage":"Target","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":15,"mtp":true,"stage":"Target","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":16,"mtp":true,"stage":"Capture","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":17,"mtp":true,"stage":"Capture","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":18,"mtp":true,"stage":"Capture","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":19,"mtp":true,"stage":"Capture","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":20,"mtp":true,"stage":"Capture","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":21,"mtp":true,"stage":"Capture","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":22,"mtp":true,"stage":"Capture","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":23,"mtp":true,"stage":"Capture","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":24,"mtp":true,"stage":"Draft","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":25,"mtp":true,"stage":"Draft","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":26,"mtp":true,"stage":"Draft","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":27,"mtp":true,"stage":"Draft","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":28,"mtp":true,"stage":"Draft","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":29,"mtp":true,"stage":"Draft","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true}
{"case":30,"mtp":true,"stage":"Draft","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"case":31,"mtp":true,"stage":"Draft","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false}
{"event":"test_resource_summary","elapsed_ms":81120,"peak":{"cpu_time_ns":83647679458,"resident_bytes":27535687680,"physical_bytes":78398221632,"peak_physical_bytes":78399221056,"disk_read_bytes":70370205696,"disk_write_bytes":12404834304},"error":null}
@@ -0,0 +1,16 @@
{"case":"invalid_logits","row":"nan","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=64, inf=0, vocab=64)"}}
{"case":"invalid_logits","row":"nan","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=64, inf=0, vocab=64)"}}
{"case":"invalid_logits","row":"nan","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=64, inf=0, vocab=64)"}}
{"case":"invalid_logits_lazy","row":"nan","result":{"Ok":[-1]}}
{"case":"invalid_logits","row":"positive_inf","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=0, inf=1, vocab=64)"}}
{"case":"invalid_logits","row":"positive_inf","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=1, vocab=64)"}}
{"case":"invalid_logits","row":"positive_inf","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=1, vocab=64)"}}
{"case":"invalid_logits_lazy","row":"positive_inf","result":{"Ok":[-1]}}
{"case":"invalid_logits","row":"all_negative_inf","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=0, inf=64, vocab=64)"}}
{"case":"invalid_logits","row":"all_negative_inf","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=64, vocab=64)"}}
{"case":"invalid_logits","row":"all_negative_inf","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=64, vocab=64)"}}
{"case":"invalid_logits_lazy","row":"all_negative_inf","result":{"Ok":[-1]}}
{"case":"invalid_logits","row":"valid_mask","temperature":0.0,"ordinary":{"Ok":1}}
{"case":"invalid_logits","row":"valid_mask","temperature":0.6,"ordinary":{"Ok":1}}
{"case":"invalid_logits","row":"valid_mask","temperature":1.0,"ordinary":{"Ok":1}}
{"case":"invalid_logits_lazy","row":"valid_mask","result":{"Ok":[3]}}
+20
View File
@@ -0,0 +1,20 @@
{"case": "ordinary", "row": "nan", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64}
{"case": "ordinary", "row": "nan", "temperature": 0.6, "error": "non-finite logits in softmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64}
{"case": "ordinary", "row": "nan", "temperature": 1.0, "error": "non-finite logits in softmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64}
{"case": "lazy", "row": "nan", "token": -1}
{"case": "mtp_greedy_specialized", "row": "nan", "token": 0}
{"case": "ordinary", "row": "positive_inf", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64}
{"case": "ordinary", "row": "positive_inf", "temperature": 0.6, "error": "non-finite logits in softmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64}
{"case": "ordinary", "row": "positive_inf", "temperature": 1.0, "error": "non-finite logits in softmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64}
{"case": "lazy", "row": "positive_inf", "token": -1}
{"case": "mtp_greedy_specialized", "row": "positive_inf", "token": 0}
{"case": "ordinary", "row": "all_negative_inf", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64}
{"case": "ordinary", "row": "all_negative_inf", "temperature": 0.6, "error": "non-finite logits in softmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64}
{"case": "ordinary", "row": "all_negative_inf", "temperature": 1.0, "error": "non-finite logits in softmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64}
{"case": "lazy", "row": "all_negative_inf", "token": -1}
{"case": "mtp_greedy_specialized", "row": "all_negative_inf", "token": 0}
{"case": "ordinary", "row": "valid_mask", "temperature": 0.0, "token": 1}
{"case": "ordinary", "row": "valid_mask", "temperature": 0.6, "token": 1}
{"case": "ordinary", "row": "valid_mask", "temperature": 1.0, "token": 1}
{"case": "lazy", "row": "valid_mask", "token": 3}
{"case": "mtp_greedy_specialized", "row": "valid_mask", "token": 1}
+73
View File
@@ -0,0 +1,73 @@
# Issue 106: complete MTP final-primary state
Qwen's round-head stop/token-limit exit now re-arms its emitted primary for the
existing final commit, exactly as pinned MTPLX 2.12.2
`9882703f3105363ddc37eca9f97aa09a1d387112`, `generation.py:13001-13019` does.
That commit updates committed MTP history and forwards the primary once. Sampling,
acceptance, RNG, snapshot ownership and other exit branches are unchanged.
Qwen checkpoint magic is now `QWMTKV02`. Old `QWMTKV01` files are rejected before
tensor allocation; Generator's existing incompatible-cache path removes the file,
resets the owner and rebuilds cold. This deliberately invalidates all old Qwen
checkpoints, including AR files, because V1 does not certify complete MTP state.
It does not alter the DS4/GLM format or their owners. This is a DS4Server persistence
version change around MTPLX's existing inference behavior.
There is no in-process executable hot-upgrade mechanism: resident sessions belong
to the process-local Generator. Installing a new executable takes effect on
restart, which drops all resident state. Runtime engine changes also drop the old
Generator (`runtime.rs`, `run_command`). New processes cannot import old resident
objects, and old processes' subsequently written V1 files are still rejected.
## Acceptance review
| Requirement | Evidence |
| --- | --- |
| Real pre-fix reproduction | Parent `5ecf8ab`, unchanged model, 12 first-primary cases: key 4, all 12 trunk offsets 3, MTP offset 2, pending absent and no error. `before.jsonl`. |
| Actually persisted bad state | A real `QWMTKV01` file was saved from the sampled depth-1 reproduction, with IDs `[9707,11,1075,314]`. File identity and hash in `checks.json`; the 116 MB cache is not checked into Git. |
| Full state, not offsets alone | All 12 cases now have trunk 4 and history 3. Every encoded tensor's raw bytes, dtype, shape and metadata, including GDN/conv, PLE, QSA/KV, MTP history, logits and hidden state, match independent teacher forcing. `native-state.jsonl`. |
| Exactly once and next turn | Teacher forcing restores the prompt, explicitly appends one MTP history row and forwards one primary. All corrected snapshots match it, persist/reopen exactly, restore four tokens, then match the full state after suffix `[1075]`. |
| All upstream exits | Eight cases compare token sequences, cache lengths and stop origin with the pinned upstream scripted-model test: bonus, deferred correction, accepted draft, sampled correction, first/fresh primary, and both max-token depths. Native tests script only logits; real model computation and caches still execute. Context copy is disabled in both oracle and native matrix so the intended draft/verify routes are reached. `oracle.jsonl`, `native-matrix.jsonl`. |
| No false final capture on failure | Cancellation at finalization returns an error; failed final forward leaves pending/error and no safe final arrays; disabling final capture leaves pending. `native-state.jsonl`. |
| Old cache recovery in product | The real old file is rejected and removed by Generator, and recovery reports zero reused tokens. Its entire newly persisted state and response equal an independent cold request. `native-product.jsonl`. |
| Existing persistence contracts | Model-free checkpoint roundtrip, corruption, failed restore, cancellation and atomic-write regression run under the Metal supervisor. |
| Other families | Production diff is confined to Qwen's MTP exit and checkpoint signature. DS4/GLM retain `DS4RKV01`/version 2 and their existing pending/state behavior; shared RNG and inference helpers are unchanged. Ordinary cargo tests retain DS4 token/RNG controls. |
The former bug-asserting `issue103_mtp_final_receipts` diagnostic is replaced by
these positive-contract regressions. The only new Execution hooks are `cfg(test)`
scripted logits/failure injection, absent from release builds. No Python is called
by the product. These receipts establish correctness, not speed.
## Reproduction
Use the unchanged Bare-Speed revision
`74559cdf34fbfc0b593de72d17e93f37fd4f9ea7`, M5 Max 128 GiB, SSD PLE,
MLX 0.32.2 for the isolated oracle. Artifact/environment hashes were refreshed in
`../issue104-ar/environment.json`. Native raw prompt is `[9707,11,1075]`,
chunk 2048, seed 0, depths 1/2/3, temperatures 0/.6.
To regenerate an actual old file, use an isolated checkout of `5ecf8ab`, apply
`baseline-save.patch`, build its tests and run `issue103_mtp_final_receipts` with
`DS4_ISSUE106_BAD_CHECKPOINT` pointing to the output file. The patch only adds
persistence to the old diagnostic; it does not manufacture a header or cache.
Build current tests with `cargo test --all-features --bin ds4-server --no-run`.
Set `DS4_QWEN38_ARTIFACTS` to the installed model, `DS4_ISSUE106_BAD_CHECKPOINT`
to that real old file, and `DS4_ISSUE106_DIR` to a temporary output directory.
Run each ignored test separately and serially through
`target/debug/test-supervisor 114688 60 120 --command <test-executable>
<test-name> --ignored --nocapture --test-threads=1`:
- `issue106_complete_state_and_checkpoint_recovery`
- `issue106_product_discards_old_checkpoint_and_recovers_cold`
- `issue106_upstream_exit_matrix` (also `MTPLX_CONTEXT_COPY=0`,
`DS4_ISSUE106_ORACLE` pointing to fresh oracle JSONL).
Generate the oracle with `MTPLX_CONTEXT_COPY=0 <isolated-python>
tools/issue106-reference.py <pinned-mtplx-checkout>`, with pytest and the pinned
reference dependencies installed in that isolated environment.
Run `qwen_checkpoint_roundtrip_and_failed_restore_preserve_live_state` separately
with a 4096 MiB supervisor cap and `DS4_QWEN38_CHECKPOINT_DIR` set.
All four mandatory commit gates and individual supervisor outcomes are recorded
in `checks.json`.
@@ -0,0 +1,22 @@
--- a/src/engine/metal/qwen_mtplx/issue103_analysis.rs
+++ b/src/engine/metal/qwen_mtplx/issue103_analysis.rs
@@ -407,6 +407,19 @@
"{}",
serde_json::json!({"case":"mtp_final","exit":if stop_exit {"first_primary_stop"} else {"max_tokens"},"depth":depth,"temperature":temperature,"prompt_ids":ids,"tokens":result.tokens,"key_length":key.len(),"restored_cached_tokens":reused,"trunk_offsets":offsets,"mtp_offset":execution.mtp_offset().unwrap(),"pending":result.pending,"final_state_error":result.final_state_error})
);
+ if depth == 1 && temperature == 0.6 && !stop_exit {
+ let path = std::env::var_os("DS4_ISSUE106_BAD_CHECKPOINT").unwrap();
+ let metadata = crate::engine::qwen::QwenMetadata::open(&root, true).unwrap();
+ let identity = super::session_checkpoint::Identity {
+ model: metadata.checkpoint_identity(), context: 4096,
+ vocabulary: metadata.tokenizer.vocab_size() as u32, mtp: true,
+ };
+ let mut live = super::request::LiveSession {
+ current: Some(snapshot), ..Default::default()
+ };
+ live.save_checkpoint(std::path::Path::new(&path), identity,
+ [106; 32], &execution.streams, execution.stream, |_| {}, || false).unwrap();
+ }
assert_eq!(offsets, vec![3; 12]);
assert_eq!(reused, 4);
assert!(result.pending.is_none() && result.final_state_error.is_none());
+13
View File
@@ -0,0 +1,13 @@
{"case":"mtp_final","exit":"max_tokens","depth":1,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":1,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"max_tokens","depth":1,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":1,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"max_tokens","depth":2,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":2,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"max_tokens","depth":2,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":2,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"max_tokens","depth":3,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":3,"temperature":0.0,"prompt_ids":[9707,11,1075],"tokens":[11],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"max_tokens","depth":3,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_final","exit":"first_primary_stop","depth":3,"temperature":0.6,"prompt_ids":[9707,11,1075],"tokens":[314],"key_length":4,"restored_cached_tokens":4,"trunk_offsets":[3,3,3,3,3,3,3,3,3,3,3,3],"mtp_offset":2,"pending":null,"final_state_error":null}
{"case":"mtp_next_turn","missing_token":314,"suffix_ids":[1075],"different_logits":247643,"bad_sha256":"9c22c019eeb07fead0760dc06ef796e4fbf3f5b4946b02ad808f430ecc6cee5c","good_sha256":"9a556dd9d3063864b70c3338cb0cdf76cc578a01de1c7771b1da0abf3e776feb"}
+108
View File
@@ -0,0 +1,108 @@
{
"before": {
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 521 filtered out; finished in 8.91s"
],
"cases": 13,
"elapsed_ms": 11509,
"peak_physical_bytes": 73985465832,
"supervisor_error": null,
"log_sha256": "fd1c975e413b08c58ba486c6372e6d9d7e68bba87b71ca07633bfd5bc3efe070"
},
"state": {
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 523 filtered out; finished in 101.17s"
],
"cases": 15,
"elapsed_ms": 102581,
"peak_physical_bytes": 74587317128,
"supervisor_error": null,
"log_sha256": "cfcc068258fab9a2ec08632738ee4dcb148f9ff7b2f0a0b282e1ef8b026b3968"
},
"matrix": {
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 523 filtered out; finished in 8.91s"
],
"cases": 8,
"elapsed_ms": 9126,
"peak_physical_bytes": 74049414840,
"supervisor_error": null,
"log_sha256": "2d03f4fcb937abda28cfb00082aa0cefe9234d95645645e31021ca80da36fe36"
},
"product": {
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 523 filtered out; finished in 12.86s"
],
"cases": 1,
"elapsed_ms": 12972,
"peak_physical_bytes": 76933755256,
"supervisor_error": null,
"log_sha256": "f320e66e0a3355a588d07c6510b3d3449b4a3b2d7266cc18b5b1c82b0f02dc77"
},
"codec": {
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 523 filtered out; finished in 0.09s"
],
"cases": 0,
"elapsed_ms": 105,
"peak_physical_bytes": 213088,
"supervisor_error": null,
"log_sha256": "dbddf0b37a9600bdf3eec6868e9cbf5434296bb9998d68ebe1e51ba414ee94b8"
},
"old_checkpoint": {
"base": "5ecf8ab4f31aeaef7a06b4f03fbb8d658f28c486",
"size": 116442383,
"sha256": "8cd38359515e9d30b191992cc477393ee59b5cac7b6d610aa5838e589ce02c64",
"magic": "QWMTKV01",
"tokens": [
9707,
11,
1075,
314
],
"trunk_offsets": [
3,
3,
3,
3,
3,
3,
3,
3,
3,
3,
3,
3
],
"mtp_offset": 2
},
"commit_gates": {
"fmt": {
"status": "passed",
"log_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
},
"clippy": {
"status": "passed",
"log_sha256": "d2d16d1a8d8e5adb2a590b9e1f424c52e7ed907a53b3ed35bbae82e7e858aa14"
},
"bundle": {
"status": "passed",
"log_sha256": "abab34fc4488a041b6cdd2dd276957888c9e1994cceb1a88f4949c06e274effc"
},
"tests": {
"status": "passed",
"log_sha256": "70e2bc94647ccdb67c1b3b6197590bed21f2bf90e7eaf2d4008a605a0ea74320",
"test_results": [
"test result: ok. 308 passed; 0 failed; 216 ignored; 0 measured; 0 filtered out; finished in 5.57s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.39s"
]
}
},
"oracle": {
"revision": "9882703f3105363ddc37eca9f97aa09a1d387112",
"mlx": "0.32.2",
"mtp_cases": 8,
"ar_control": "passed"
}
}
@@ -0,0 +1,8 @@
{"case":"mtp_exit","label":"bonus primary","tokens":[1,1,1,3],"key_length":9,"trunk_offsets":[9,9,9,9,9,9,9,9,9,9,9,9],"mtp_offset":8,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1],"accepted":2,"correction":null,"bonus":3,"capture_committed":false}]}
{"case":"mtp_exit","label":"deferred greedy correction","tokens":[1,1,1,3],"key_length":9,"trunk_offsets":[9,9,9,9,9,9,9,9,9,9,9,9],"mtp_offset":8,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1,1],"accepted":2,"correction":null,"bonus":null,"capture_committed":true},{"primary":3,"primary_already_emitted":false,"drafts":[],"accepted":0,"correction":null,"bonus":null,"capture_committed":false}]}
{"case":"mtp_exit","label":"accepted draft stop","tokens":[1,1,1,3],"key_length":9,"trunk_offsets":[9,9,9,9,9,9,9,9,9,9,9,9],"mtp_offset":8,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1,3],"accepted":3,"correction":null,"bonus":null,"capture_committed":false}]}
{"case":"mtp_exit","label":"sampled correction","tokens":[1,1,1,3],"key_length":9,"trunk_offsets":[9,9,9,9,9,9,9,9,9,9,9,9],"mtp_offset":8,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1,1],"accepted":2,"correction":3,"bonus":null,"capture_committed":true}]}
{"case":"mtp_exit","label":"first primary","tokens":[1,3],"key_length":7,"trunk_offsets":[7,7,7,7,7,7,7,7,7,7,7,7],"mtp_offset":6,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1,1],"accepted":0,"correction":null,"bonus":null,"capture_committed":true},{"primary":3,"primary_already_emitted":false,"drafts":[],"accepted":0,"correction":null,"bonus":null,"capture_committed":false}]}
{"case":"mtp_exit","label":"fresh primary depth 1","tokens":[1,1,3],"key_length":8,"trunk_offsets":[8,8,8,8,8,8,8,8,8,8,8,8],"mtp_offset":7,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1],"accepted":1,"correction":null,"bonus":3,"capture_committed":false}]}
{"case":"mtp_exit","label":"max tokens depth 3","tokens":[1,1,1,1,1,1,1],"key_length":12,"trunk_offsets":[12,12,12,12,12,12,12,12,12,12,12,12],"mtp_offset":11,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1,1],"accepted":3,"correction":null,"bonus":1,"capture_committed":false},{"primary":1,"primary_already_emitted":true,"drafts":[1,1],"accepted":2,"correction":null,"bonus":null,"capture_committed":false}]}
{"case":"mtp_exit","label":"max tokens depth 2","tokens":[1,1,1,1,1],"key_length":10,"trunk_offsets":[10,10,10,10,10,10,10,10,10,10,10,10],"mtp_offset":9,"oracle_matches":true,"cycles":[{"primary":1,"primary_already_emitted":false,"drafts":[1,1],"accepted":2,"correction":null,"bonus":1,"capture_committed":false},{"primary":1,"primary_already_emitted":true,"drafts":[1],"accepted":1,"correction":null,"bonus":null,"capture_committed":false}]}
@@ -0,0 +1 @@
{"case":"product_checkpoint_recovery","old_removed":true,"cold_tokens":0,"new_magic":"QWMTKV02","fresh_state_equal":true}
@@ -0,0 +1,15 @@
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"41fe15b0c3043a6ad54b55784288e2b2e51ff52106f2f80973be206319dd34db","next_sha256":"6232c8c27ec724f5b0bd585a1dcc8dc840f1f7f58e2a7cbf8050849dc4a002cd","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"cancel","safe_final_state":false}
{"case":"forward","safe_final_state":false}
{"case":"capture_disabled","safe_final_state":false}
+9
View File
@@ -0,0 +1,9 @@
{"case": "mtp_exit", "label": "bonus primary", "stop_index": 8, "depth": 2, "omniscient": false, "temperature": 0.0, "max_tokens": 16, "tokens": [1, 1, 1, 3], "gap": 0, "origin": "bonus", "safe": true}
{"case": "mtp_exit", "label": "deferred greedy correction", "stop_index": 8, "depth": 3, "omniscient": false, "temperature": 0.0, "max_tokens": 16, "tokens": [1, 1, 1, 3], "gap": 0, "origin": "primary", "safe": true}
{"case": "mtp_exit", "label": "accepted draft stop", "stop_index": 8, "depth": 3, "omniscient": true, "temperature": 0.0, "max_tokens": 16, "tokens": [1, 1, 1, 3], "gap": 0, "origin": "accepted_draft", "safe": true}
{"case": "mtp_exit", "label": "sampled correction", "stop_index": 8, "depth": 3, "omniscient": false, "temperature": 0.7, "max_tokens": 16, "tokens": [1, 1, 1, 3], "gap": 0, "origin": "residual_correction", "safe": true}
{"case": "mtp_exit", "label": "first primary", "stop_index": 6, "depth": 3, "omniscient": false, "temperature": 0.0, "max_tokens": 16, "tokens": [1, 3], "gap": 0, "origin": "primary", "safe": true}
{"case": "mtp_exit", "label": "fresh primary depth 1", "stop_index": 7, "depth": 1, "omniscient": false, "temperature": 0.0, "max_tokens": 16, "tokens": [1, 1, 3], "gap": 0, "origin": "bonus", "safe": true}
{"case": "mtp_exit", "label": "max tokens depth 3", "stop_index": 10000, "depth": 3, "omniscient": false, "temperature": 0.0, "max_tokens": 7, "tokens": [1, 1, 1, 1, 1, 1, 1], "gap": 0, "origin": null, "safe": true}
{"case": "mtp_exit", "label": "max tokens depth 2", "stop_index": 10000, "depth": 2, "omniscient": false, "temperature": 0.0, "max_tokens": 5, "tokens": [1, 1, 1, 1, 1], "gap": 0, "origin": null, "safe": true}
{"case": "ar_control", "passed": true}
+104
View File
@@ -0,0 +1,104 @@
# Issue 107: image-aware sparse QSA
Qwen vision now retains the indexer's sparse selection. The indexer receives the
request's position table and delta, rotates queries row by row and pooled keys at
each block's first token, and uses the eager preparation route selected by pinned
MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`. Its compiled/fused preparation
is ineligible with image positions; the existing sparse selectors/consumers remain
eligible. Budgets, thresholds, text preparation and attention projection RoPE are
unchanged. Issue 108 still owns the attention projection's table-straddling case.
The indexer's new helper implements `_vision_position_cos_sin` using the native
array operations, including I32 positions, clipped table gather, per-row selection,
axis gather, trigonometry and YaRN amplitude. Signed I32 Gather reuses the existing
U32 payload-copy kernel: it performs no value arithmetic or float conversion.
Tests include signed extrema on both front-axis and general gather routes.
Image identities now include a numerical policy: 1 for image-aware sparse QSA,
0 for the old dense policy (also MTPLX's explicit diagnostic rollback flag).
Missing fields deserialize as 0. Old vision checkpoints are rejected before
tensor materialization, obsolete live/resident owners are discarded, and stale
owners cannot save a checkpoint. Identical image bytes and token spans do not
bypass this policy. Text-only identities remain empty and compatible. The V1
signature rejection delivered in issue 106 remains in force; this issue also
rejects affected V2 vision files without invalidating unaffected V2 text files.
Request prefix matching additionally rejects a restore ending strictly inside an
image span, matching MTPLX's image-safe restore boundary. Complete image spans and
preceding text prefixes remain eligible. Existing image digests continue to
distinguish different pixels with identical image-pad token IDs.
## Acceptance and review
- The owned `vision_sparse_qsa` regression now requires equal sparse output for
text and a vision context with equal text positions. Separate issue 108/109
diagnostic assertions remain unchanged.
- Real indexer geometry: four heads, dim128, ratio4, top-k512, 2,072 raw key rows,
518 pooled blocks. Query rows and block starts cross a 2,060-row position table.
Table, equal-axis, delta-only and empty-table cases match pinned MTPLX exactly
in F32 and BF16; independent NumPy math verifies the F32 values. Normal fused
selectors remain active while compiled preparation is correctly bypassed.
- A real 2,095-token, two-image request exceeds the sparse budget. Corrected final
model logits match MTPLX byte-for-byte: SHA256
`8b97664316bec6113c85b7dfca9b09967391f019ea1064b83d81a3d9d5191354`.
Pre-fix logits differ (`a79aa02a98542adeea636f22c85fc5f929308dc5dc75658d4072e6f275d22abe`).
- The actual pre-fix dense-vision checkpoint is 412,628,836 bytes, SHA256
`7ddc663d4f337ff272000a7237dac05a224262bf25bc88257e784547b2056326`.
Tests reject its normal disk load and import its original tensor payload only
through a test helper to verify stale live/resident rejection and save refusal.
- Product tests cover unchanged images, identical complete-state restore/reopen
and follow-up, text edits before/between/after two images, different pixels with
identical pad IDs, cancellation/resend, a prefix ending inside an image, and
unaffected text checkpoints. Comparisons cover all serialized tensors and state
metadata, not only response text.
- DS4/GLM do not call the modified Qwen modules. Their sampling, RNG, vision and
checkpoint formats are unchanged. This is MTPLX behavior plus DS4Server's
application-specific checkpoint policy integration.
- The 12 affected whole-attention fixture rows were regenerated from the pinned
oracle (profiles 7 and 9, TF32 on/off). All 56 fixture rows pass with both lazy
and prepared inputs, including output/state hashes, consumer routes, compiled
core lifecycle and counters. Existing text-only indexer route fixtures pass.
All four commit gates passed. The initial general test run hit an unrelated
`dev_brain` fixture whose temporary short Git hash was all digits and therefore
parsed as a YAML integer. Its focused retry and the subsequent full suite passed;
no unrelated source change was included. `checks.json` records both outcomes.
The tests and receipts are correctness evidence, not performance measurements.
See `checks.json` and the accompanying JSONL files for actual run outcomes.
## Reproduction
Use the same unchanged Bare-Speed artifact and environment documented in
`../issue104-ar/environment.json`, including the pinned vision tower. The input
image is `local-eval-results/qwen-vision-input/image.png` (1024 square pixels),
repeated twice; tests generate an independent 1024-square blue control.
An isolated checkout of parent `a8cad88` plus `baseline-capture.patch` regenerates
the actual old snapshot with `issue107_vision_product`. Set `DS4_ISSUE107_DIR` to
its output directory. Do not replace a new file's header to fake old state.
Generate fresh reference results in the isolated MLX 0.32.2 environment:
```sh
python tools/issue107-model-reference.py PINNED_MTPLX MODEL IMAGE ORACLE_DIR
python tools/issue107-indexer-reference.py PINNED_MTPLX INDEXER_DIR
```
Build native tests with `cargo test --all-features --bin ds4-server --no-run`.
Run ignored tests one at a time via `test-supervisor MEMORY_MIB 60 120 --command
TEST_EXECUTABLE TEST_NAME --ignored --nocapture --test-threads=1`. Use 114688 MiB
for the product test and 4096 MiB for model-free tests. Set
`DS4_QWEN38_ARTIFACTS`, `DS4_QWEN_VISION_IMAGE`, `DS4_ISSUE107_DIR`,
`DS4_ISSUE107_BAD_CHECKPOINT`, `DS4_ISSUE107_ORACLE_DIR`, and
`DS4_ISSUE107_INDEXER` to the corresponding files/directories.
Owned tests: `issue107_vision_product`,
`issue107_real_geometry_query_and_block_start_positions`, and the
`vision_sparse_qsa` case in `issue103_vision_position_receipts`.
To refresh just the affected whole-attention receipts, set `PYTHONPATH` to the
pinned checkout and run `qsa_attention_module_fixtures(profile_filter=7)` and
`qsa_attention_module_fixtures(profile_filter=9)` from
`runpy.run_path("tools/mtplx-kernel-fixtures.py")` in separate processes with
`MLX_ENABLE_TF32=1` and `0`. Replace only those profile/TF32 rows in the fixture.
@@ -0,0 +1,102 @@
--- a/src/engine/metal/qwen_mtplx/owner.rs
+++ b/src/engine/metal/qwen_mtplx/owner.rs
@@ -1068,3 +1068,7 @@
#[cfg(test)]
#[path = "issue106_product.rs"]
mod issue106_product;
+
+#[cfg(test)]
+#[path = "issue107_product.rs"]
+mod issue107_product;
--- /dev/null
+++ b/src/engine/metal/qwen_mtplx/issue107_product.rs
@@ -0,0 +1,89 @@
+//! Long multi-image request and cache compatibility through the product owner.
+use super::*;
+use crate::settings::{
+ GenerationPreferences, ReasoningMode, RuntimePreferences, SpeculativePreferences,
+ effective_settings,
+};
+use base64::Engine as _;
+
+#[test]
+#[ignore = "installed model plus vision tower; serial external memory supervisor required"]
+fn issue107_vision_product() {
+ let root = std::path::PathBuf::from(std::env::var_os("DS4_QWEN38_ARTIFACTS").unwrap());
+ let image = std::fs::read(std::env::var_os("DS4_QWEN_VISION_IMAGE").unwrap()).unwrap();
+ let directory = std::path::PathBuf::from(std::env::var_os("DS4_ISSUE107_DIR").unwrap());
+ std::fs::create_dir_all(&directory).unwrap();
+ let settings = effective_settings(
+ crate::model::ModelChoice::Qwen38FlashNext,
+ &GenerationPreferences {
+ context_tokens: 8192,
+ max_generated_tokens: 1,
+ system_prompt: String::new(),
+ temperature: Some(0.),
+ top_p: Some(0.95),
+ min_p: Some(0.),
+ seed: Some(1),
+ reasoning_mode: ReasoningMode::Low,
+ },
+ &RuntimePreferences {
+ speculative: SpeculativePreferences {
+ glm_mtp: true,
+ ..Default::default()
+ },
+ ..Default::default()
+ },
+ root.parent().unwrap(),
+ )
+ .unwrap();
+ let marker = crate::engine::vision_data_marker(&format!(
+ "data:image/png;base64,{}",
+ base64::engine::general_purpose::STANDARD.encode(&image)
+ ));
+ let messages = [ChatTurn {
+ user: true,
+ tool: false,
+ system: false,
+ skip_previous_eos: false,
+ reasoning: None,
+ reasoning_complete: true,
+ content: format!("Describe these images{marker}{marker}"),
+ }];
+ let mut owner = QwenExecutor::open(&settings.engine).unwrap();
+ owner.policy.store_min_suffix = Some(0);
+ let metrics = Metrics::new(&directory.join("metrics"));
+ let (out, complete) = owner
+ .generate(
+ &messages,
+ &settings.turn,
+ &AtomicBool::new(false),
+ &metrics,
+ |p, _, _| {
+ eprintln!("#107 prefill {p}");
+ },
+ |_, _| {},
+ )
+ .unwrap();
+ assert!(complete);
+ assert!(out.prompt_tokens > 2048);
+ assert_eq!(out.cached_tokens, 0);
+ let saved = owner.live.current.as_ref().unwrap();
+ let logits = owner.execution.values_f32(&saved.logits).unwrap();
+ std::fs::write(
+ directory.join("long-final.f32"),
+ logits
+ .iter()
+ .flat_map(|v| v.to_le_bytes())
+ .collect::<Vec<_>>(),
+ )
+ .unwrap();
+ std::fs::write(directory.join("long-input.json"),serde_json::to_vec(&serde_json::json!({"ids":saved.token_ids,"images":owner.live.current_images,"prompt_tokens":out.prompt_tokens})).unwrap()).unwrap();
+ owner
+ .save_checkpoint(&directory.join("long.bin"), [107; 32], &mut |_| {})
+ .unwrap();
+ println!(
+ "{}",
+ serde_json::json!({"case":"vision_long","prompt_tokens":out.prompt_tokens,"cached_tokens":out.cached_tokens,
+ "tokens":owner.live.current.as_ref().unwrap().token_ids,"text":out.message.content,"reasoning":out.message.reasoning,
+ "logits_sha256":crate::engine::metal::qwen_mtplx_tests::hex_digest(&logits.iter().flat_map(|v|v.to_le_bytes()).collect::<Vec<_>>())})
+ );
+}
+1
View File
@@ -0,0 +1 @@
{"case":"vision_long","prompt_tokens":2095,"cached_tokens":0,"text":"","reasoning":"The","logits_sha256":"a79aa02a98542adeea636f22c85fc5f929308dc5dc75658d4072e6f275d22abe","bank_token_count":2096,"bank_token_ids_sha256":"a757dd27268f65ff6926bc0b2d6d81faec709b89512673068d3c536056c5105b","last_token":760}
+132
View File
@@ -0,0 +1,132 @@
{
"before": {
"cases": 1,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 524 filtered out; finished in 11.84s"
],
"elapsed_ms": 12922,
"peak_physical_bytes": 81646134816,
"supervisor_error": null,
"log_sha256": "15b89366a4a1488df33e2ada91cc848b9ac6240bf7f8a44f3afe4ff2c2f0c757"
},
"model-oracle": {
"cases": 7,
"test_result": [],
"elapsed_ms": 15413,
"peak_physical_bytes": 80281215320,
"supervisor_error": null,
"log_sha256": "efe9ea90eaf1d6a3d9e95669cd07f9318fdce6a3ae48d7b8dbecc545622511f2"
},
"indexer-oracle": {
"cases": 17,
"test_result": [],
"elapsed_ms": 625,
"peak_physical_bytes": 215155408,
"supervisor_error": null,
"log_sha256": "aac8e9211ffc59569716960a5493420ddf9f235e0d54e38ae02a7d27de9cee84"
},
"indexer-native-final": {
"cases": 15,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 0.28s"
],
"elapsed_ms": 315,
"peak_physical_bytes": 181633888,
"supervisor_error": null,
"log_sha256": "1e634d173e8a5e4b6e50785ffcb31a70ac3438292293dddfa63316563d208b1e"
},
"small": {
"cases": 4,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 0.14s"
],
"elapsed_ms": 210,
"peak_physical_bytes": 37094192,
"supervisor_error": null,
"log_sha256": "afb6f32dc619c6e3ec70ca877e08aeae1fece96c64dc12019f0704354c0bfde6"
},
"product": {
"cases": 16,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 165.40s"
],
"elapsed_ms": 166771,
"peak_physical_bytes": 82617511280,
"supervisor_error": null,
"log_sha256": "844160c173fc4ba29b3475e871e940376b2ad553f0be75c17cf0fd049fe862de"
},
"text-indexer": {
"cases": 0,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 38.29s"
],
"elapsed_ms": 38368,
"peak_physical_bytes": 1108821168,
"supervisor_error": null,
"log_sha256": "0494120021c6accce4e4976465b6a7c6c2ddbe94af829bd0ca71dd1ef17f2809"
},
"attention-native-1": {
"cases": 0,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 14.09s"
],
"elapsed_ms": 14204,
"peak_physical_bytes": 1608435056,
"supervisor_error": null,
"log_sha256": "2ed6ca37f3700b0780cdf5c2262409ff16d2ed8c172ebd0206795c7a71fb4fea"
},
"attention-native-0": {
"cases": 0,
"test_result": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 525 filtered out; finished in 13.94s"
],
"elapsed_ms": 14007,
"peak_physical_bytes": 1607861592,
"supervisor_error": null,
"log_sha256": "a32c72594ee7ce00b04553e65bca9de5b6cb0125b1d23b3abc574208fddb6e08"
},
"pre_fix_checkpoint": {
"base": "a8cad8810060d22ee7ccac82c210ef40d4e08785",
"bytes": 412628836,
"sha256": "7ddc663d4f337ff272000a7237dac05a224262bf25bc88257e784547b2056326",
"magic": "QWMTKV02",
"vision_policy": "absent (legacy 0)",
"images": 2,
"prompt_tokens": 2095
},
"model_logits": {
"before": "a79aa02a98542adeea636f22c85fc5f929308dc5dc75658d4072e6f275d22abe",
"native": "8b97664316bec6113c85b7dfca9b09967391f019ea1064b83d81a3d9d5191354",
"oracle": "8b97664316bec6113c85b7dfca9b09967391f019ea1064b83d81a3d9d5191354"
},
"input_image_sha256": "b7568d90f4df6180d9af14a824dd553cd995457561d29167354c1ba66b728347",
"commit_gates": {
"fmt": {
"status": "passed",
"log_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
},
"clippy": {
"status": "passed",
"log_sha256": "c437a2464fc3d0eb441259bf1126ad32e23230ebfde7e51a6c3fd06259d1bfc9"
},
"bundle": {
"status": "passed",
"log_sha256": "0b9900a8392b683ce2804a420fbcbd9cac895658bbad67859d56a9b046110159"
},
"tests-final": {
"status": "passed",
"log_sha256": "649b53e5b60e39c4a22a8f76246128b2024f76e6d9c9a9ec65b93e1b638cf261",
"results": [
"test result: ok. 308 passed; 0 failed; 218 ignored; 0 measured; 0 filtered out; finished in 5.52s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.29s"
]
}
},
"unrelated_initial_test_failure": {
"test": "dev_brain::tests::source_versions_follow_that_file_instead_of_the_whole_worktree",
"cause": "Temporary commit short hash 6496041 was parsed as an integer in unquoted YAML; test uses git2::Signature::now, so hash changes with time.",
"resolution": "Focused retry passed, followed by full suite passing. No unrelated source change."
},
"review": "All issue 107 acceptance, oracle route/numerics, Qwen cache policy, and family boundaries reviewed; no remaining gap."
}
@@ -0,0 +1,15 @@
{"case":"indexer","dtype":"f32","mode":"table","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"equal","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"equal","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"delta","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"delta","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"empty","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"f32","mode":"empty","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"table","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"table","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"equal","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"equal","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"delta","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"delta","part":"pooled","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"empty","part":"query","exact_oracle_match":true}
{"case":"indexer","dtype":"bf16","mode":"empty","part":"pooled","exact_oracle_match":true}
@@ -0,0 +1,17 @@
{"case":"indexer","dtype":"f32","mode":"table","part":"query","shape":[1,16,4,128],"sha256":"00cf519652dde6ac163822403e7bd26c6f131fde0673633d71f9cd6523ebb730"}
{"case":"indexer","dtype":"f32","mode":"table","part":"pooled","shape":[1,518,128],"sha256":"d4c1f51750ebba1e83c2b5bed38a1962682630f39c0f3beae8455144444d8114"}
{"case":"indexer","dtype":"f32","mode":"equal","part":"query","shape":[1,16,4,128],"sha256":"6ed0da7d959383ae23041ff321283fd7fa99d4e4539c8a4bd0f22bafd8dd457a"}
{"case":"indexer","dtype":"f32","mode":"equal","part":"pooled","shape":[1,518,128],"sha256":"a6117d1182ed7abf52af125c9cfccba6bd1e416f3aa54d47b58d261c1b0f498d"}
{"case":"indexer","dtype":"f32","mode":"delta","part":"query","shape":[1,16,4,128],"sha256":"b7efbed01f410398d6bd2393f45c52071c1f1da109b244f5e9b851814ec7cebc"}
{"case":"indexer","dtype":"f32","mode":"delta","part":"pooled","shape":[1,518,128],"sha256":"f6533b66111c3230d4a6d1c0d32fbaccb97e9a25a42b5b0498671d83ffaa9bcf"}
{"case":"indexer","dtype":"f32","mode":"empty","part":"query","shape":[1,16,4,128],"sha256":"b7efbed01f410398d6bd2393f45c52071c1f1da109b244f5e9b851814ec7cebc"}
{"case":"indexer","dtype":"f32","mode":"empty","part":"pooled","shape":[1,518,128],"sha256":"f6533b66111c3230d4a6d1c0d32fbaccb97e9a25a42b5b0498671d83ffaa9bcf"}
{"case":"indexer","dtype":"bf16","mode":"table","part":"query","shape":[1,16,4,128],"sha256":"0e32ce79b902a3c1974a682486432f7e719dfe6c560490279948c629d7680a20"}
{"case":"indexer","dtype":"bf16","mode":"table","part":"pooled","shape":[1,518,128],"sha256":"a71f98ac2d9db6ad26a83daf9d8736c6a3a0ba0e4e03517a464718b4f72c1cad"}
{"case":"indexer","dtype":"bf16","mode":"equal","part":"query","shape":[1,16,4,128],"sha256":"50533b71c2e539a8f56b8fa5d6a4b4979dafe21b67e8975f8461792dab1f0b67"}
{"case":"indexer","dtype":"bf16","mode":"equal","part":"pooled","shape":[1,518,128],"sha256":"c57f4d215c9d4336c4250f1f5b494cefe156e43f88e712fcec53e789209b242b"}
{"case":"indexer","dtype":"bf16","mode":"delta","part":"query","shape":[1,16,4,128],"sha256":"e95114b8b5cf606c714c06c3d23bbadc1126c502527cbf5b84fc5e7d773e218f"}
{"case":"indexer","dtype":"bf16","mode":"delta","part":"pooled","shape":[1,518,128],"sha256":"b04fe5e8940fcd7cf15760692caa1951bcf7c338ba30d20fe84f31c1b6cca3cb"}
{"case":"indexer","dtype":"bf16","mode":"empty","part":"query","shape":[1,16,4,128],"sha256":"e95114b8b5cf606c714c06c3d23bbadc1126c502527cbf5b84fc5e7d773e218f"}
{"case":"indexer","dtype":"bf16","mode":"empty","part":"pooled","shape":[1,518,128],"sha256":"b04fe5e8940fcd7cf15760692caa1951bcf7c338ba30d20fe84f31c1b6cca3cb"}
{"case":"independent_numpy","passed":true}
@@ -0,0 +1,7 @@
{"case":"environment","overrides":{"MTPLX_SKIP_VERIFY_SNAPSHOT":"0","MTPLX_FAMILY_CAPTURE_COMMIT":"1","MTPLX_FUSED_HC_V3":"1","MTPLX_FUSED_GDN_INPROJ":"1","MTPLX_FUSED_GATE_UP":"1","MTPLX_FUSED_GDN_CONVNORM":"1","MTPLX_FUSED_GDN_STEP":"1","MTPLX_FUSED_CONVNORM_VERIFY":"1","MTPLX_QSA_GATHER":"1","MTPLX_COMPILED_GDN":"1","MTPLX_QWEN4EXP_COMPILE":"1","MTPLX_QWEN4_BATCHED_TARGET_DISTRIBUTIONS":"1","MTPLX_QWEN4_FIXED_M4_VERIFY":"1","MTPLX_QWEN4_COMPILED_MTP_PREPARE":"1","MTPLX_QWEN4_RELAXED_DRAFT_TIES":"1","MTPLX_QWEN4_OPDIET":"1","MTPLX_QWEN4_PLE_PREFILL_LOOKAHEAD":"1","MTPLX_QWEN4_PLE_FIRST_GATHER_EARLY":"1","MTPLX_SESSION_BANK_SHED_BOUNDARIES":"1","MTPLX_SESSION_BANK_PROTECTED_TERMINAL":"1","MTPLX_NGRAM_PREWARM":"auto","MTPLX_QWEN4_VERIFY_GLUE":"1","MTPLX_QWEN4_VERIFY_GLUE_ITEMS":"qsa_rope,qsa_rope_idx","MTPLX_QSA_M4_FUSED_KV_GATHER":"1","MTPLX_QSA_GATHER_MAX_ROWS":"32","MTPLX_BATCH_TARGET_ARRAYS":"1","MTPLX_LAZY_TARGET_DISTRIBUTIONS":"0","MTPLX_COMPILED_VERIFY":"1","MTPLX_NAX_VERIFY":"0","MTPLX_QWEN4_PREFILL_WIDE_CHUNK":"4096","MTPLX_QSA_PREFILL_WIDE_MIN_CONTEXT":"16384","MTPLX_SUSTAINED_PREFILL":"1","MTPLX_PREFILL_CHUNK_SIZE":"2048"}}
{"case":"prefill","phase":"started","tokens_done":0,"tokens_total":2095,"cached_tokens":0,"new_prefill_tokens":2095,"elapsed_s":0.0,"started_s":174050.1008485}
{"case":"prefill","phase":"chunk","tokens_done":0,"tokens_total":2095,"cached_tokens":0,"new_prefill_tokens":2095,"elapsed_s":3.433300298638642e-05,"cache_hit":false,"reread":{"prompt_tokens":2095,"restore_point_tokens":0,"recompute_tokens":2095,"history_matched_tokens":0,"session_cached_tokens":0,"source":"none","cache_off":true,"image_changed_at":null,"image_limit_at":null}}
{"case":"prefill","phase":"chunk","tokens_done":2048,"tokens_total":2095,"cached_tokens":0,"elapsed_s":4.264302124996902,"prefill_tok_s":480.266158440049,"cumulative_prefill_tok_s":480.266158440049,"prefill_wall_tok_s":480.266158440049,"live_prefill_tok_s":480.6052339792707,"chunk_size":2048,"chunk_elapsed_s":4.26129358401522,"chunk_prefill_tok_s":480.6052339792707}
{"case":"prefill","phase":"chunk","tokens_done":2094,"tokens_total":2095,"cached_tokens":0,"elapsed_s":4.605880165996496,"prefill_tok_s":454.63623119403434,"cumulative_prefill_tok_s":454.63623119403434,"prefill_wall_tok_s":454.63623119403434,"live_prefill_tok_s":140.22877867288037,"chunk_size":46,"chunk_elapsed_s":0.32803537501604296,"chunk_prefill_tok_s":140.22877867288037}
{"case":"prefill","phase":"completed","tokens_total":2095,"cached_tokens":0,"new_prefill_tokens":2095,"elapsed_s":4.6907559579994995,"prompt_eval_time_s":4.686342919012532,"prefill_tok_s":447.04368335927103,"prefill_compute_tok_s":447.04368335927103,"prefill_wall_tok_s":446.6231069700479,"cache_hit":false}
{"case":"long_vision","prompt_tokens":2095,"text":"The","final_logits_sha256":"8b97664316bec6113c85b7dfca9b09967391f019ea1064b83d81a3d9d5191354","bank_token_count":1,"bank_token_ids_sha256":"a9cf0c5bfacb7118d245ee1a31149cbb264f7138ee585445dd76cc681d755554","last_token":760}
+16
View File
@@ -0,0 +1,16 @@
{"case":"vision_long","prompt_tokens":2095,"cached_tokens":0,"text":"","reasoning":"The","logits_sha256":"8b97664316bec6113c85b7dfca9b09967391f019ea1064b83d81a3d9d5191354","bank_token_count":2096,"bank_token_ids_sha256":"a757dd27268f65ff6926bc0b2d6d81faec709b89512673068d3c536056c5105b","last_token":760}
{"case":"unchanged","cached_tokens":2095,"prompt_tokens":2095,"state_sha256":"958ff3ac9ad31c986085a45d31a7424475660263371b5a509b9d0a4ccaf44ab3"}
{"case":"resident_followup","cached_tokens":2096,"prompt_tokens":2113,"state_sha256":"a5765c3da1ce1a75ce3b57e1b72a7a97b3f5874886c3eccd56c677127adebeef"}
{"case":"reopened_followup","cached_tokens":2096,"prompt_tokens":2113,"state_sha256":"a5765c3da1ce1a75ce3b57e1b72a7a97b3f5874886c3eccd56c677127adebeef"}
{"case":"text_before","cached_tokens":0,"prompt_tokens":2096,"state_sha256":"45a34b05a65378353e5c65df8f868dee7e75d38e381c897523058d37b64193d4"}
{"case":"text_before_cold_control","cached_tokens":0,"prompt_tokens":2096,"state_sha256":"45a34b05a65378353e5c65df8f868dee7e75d38e381c897523058d37b64193d4"}
{"case":"text_between","cached_tokens":0,"prompt_tokens":2098,"state_sha256":"69121fa827322e5308a065d61bbd9f53e6b85ced209214a0a7db4f711cc95e66"}
{"case":"text_between_cold_control","cached_tokens":0,"prompt_tokens":2098,"state_sha256":"69121fa827322e5308a065d61bbd9f53e6b85ced209214a0a7db4f711cc95e66"}
{"case":"text_after","cached_tokens":0,"prompt_tokens":2098,"state_sha256":"156daf37583f00996b960501612a77476e344eaead98726723958b79646ee67d"}
{"case":"text_after_cold_control","cached_tokens":0,"prompt_tokens":2098,"state_sha256":"156daf37583f00996b960501612a77476e344eaead98726723958b79646ee67d"}
{"case":"changed_pixels","cached_tokens":0,"prompt_tokens":2095,"state_sha256":"d1f3be2b52ca0314c9ec6c547babccb0847e29c733c9a31fdb4a55930f9af688"}
{"case":"changed_pixels_cold_control","cached_tokens":0,"prompt_tokens":2095,"state_sha256":"d1f3be2b52ca0314c9ec6c547babccb0847e29c733c9a31fdb4a55930f9af688"}
{"case":"cancel_resend","cached_tokens":0,"prompt_tokens":2095,"state_sha256":"958ff3ac9ad31c986085a45d31a7424475660263371b5a509b9d0a4ccaf44ab3"}
{"case":"inside_image_guard","cached_tokens":0,"prompt_tokens":2095,"state_sha256":"958ff3ac9ad31c986085a45d31a7424475660263371b5a509b9d0a4ccaf44ab3"}
{"case":"text_control","cached_tokens":0,"prompt_tokens":43,"state_sha256":"75bd53e84aa31a13851b02f13b025d5b7b76dddfec5236d2bd70294ab0548850"}
{"case":"compatibility","old_disk_rejected":true,"old_live_rejected":true,"old_resident_rejected":true,"stale_save_rejected":true,"new_vision_and_text_reopen_exactly":true}
@@ -0,0 +1,4 @@
{"case":"vision_positions","start":4,"rows":2,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125],"expected_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125]}
{"case":"vision_positions","start":2,"rows":4,"table_end":4,"delta":-1,"different_rows":[0,1],"actual_keys":[-0.72265625,0.275390625,0.578125,0.79296875,0.69921875,1.21875,1.390625,1.5859375,-1.2265625,0.55078125,0.84375,0.94140625,0.216796875,1.234375,1.1953125,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125],"expected_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125]}
{"case":"vision_sparse_qsa","prefix_rows":12,"topk_blocks":1,"ratio":4,"position_delta":0,"text_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125],"vision_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125]}
{"case":"active_attention_gate","gate":-6.84375,"actual":[0.0003185272216796875,-0.00074005126953125,0.00021266937255859375,0.00095367431640625,-0.00021266937255859375,0.0004253387451171875,0.000637054443359375,-0.00010633468627929688],"expected_verify":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375]}
+57
View File
@@ -0,0 +1,57 @@
# Issue 108: row-wise attention positions
Qwen attention now implements pinned MTPLX's `_vision_chunk_cos_sin` route:
covered rows use the original table slice and M-RoPE graph; uncovered rows use
plain RoPE at `index + delta`; mixed chunks concatenate those two tables. The
YaRN amplitude applies to both portions. With the shipped scaling of one, wholly
inside/outside calls build the same numerical graphs as before. The text-only
branch and indexer remain unchanged. Production changes are confined to two
private Qwen modules, with no DS4/GLM callers or shared numerical changes.
This fixes a **latent module mismatch**. Review of `vision::prepare`, owner setup,
model dispatch, suffix prefill and MTP history found no new product trigger:
`prepare` builds a table over the complete rendered prompt; prefill stops within
it, and decoding starts after it. The final post-image text positions are equal
across axes at `index + delta`. A normal MTP window crossing that text boundary
is therefore not a reproduction. No state rebase, prompt mutation or stale-table
restore was added. No new DS4Server feature is involved.
## Verification
`tools/issue108-reference.py` runs the pinned MTPLX revision
`9882703f3105363ddc37eca9f97aa09a1d387112` in isolated MLX 0.32.2. It uses the
oracle's actual frequency constructor and chunk helper, plus independent NumPy
per-row checks. Its 56 cases cover small and shipped head geometry (dim256,
24 query heads, rotary64), F32/BF16, scaling 1/1.25, wholly inside/outside,
unequal image-axis straddling, equal axes, absent/empty tables, and a full-prompt
post-image text tail. Native cosine/sine and Q/K outputs match every oracle byte.
The text-tail and equal-axis crossings also match plain shifted RoPE exactly.
The owned `vision_positions` case in `issue103_vision_position_receipts` now
requires corrected cached keys. Actual Attention calls compare one mixed chunk
with the same input split at the table end: outputs, valid K/V, offsets and the
next call's output/state agree exactly. The unrelated sparse-QSA and attention
Gate diagnostic cases retain their current separate ownership (#107/#109).
Existing whole-attention fixtures exercise the unchanged text/vision controls,
cache hashes and execution routes in both TF32 modes, with lazy and prepared
inputs. The mandatory Rust formatting, Clippy, bundle and complete ordinary test
gates are recorded in `checks.json`; the adjacent JSONL receipts retain the
owned test results. These are correctness checks, not performance claims.
## Reproduction
```sh
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue108-reference.py /path/to/pinned/mtplx /tmp/issue108-oracle
cargo test --all-features --bin ds4-server --no-run
cargo build --bin test-supervisor
export DS4_ISSUE108_ORACLE=/tmp/issue108-oracle
# Use the test executable printed by cargo, not cargo itself in the supervisor.
target/debug/test-supervisor 4096 60 120 --command TEST_EXECUTABLE \
issue108_attention_chunk_positions --ignored --nocapture --test-threads=1
target/debug/test-supervisor 4096 60 120 --command TEST_EXECUTABLE \
issue103_vision_position_receipts --ignored --nocapture --test-threads=1
# Run mtplx_qsa_attention_module_matches_reference the same way with
# MLX_ENABLE_TF32=1 and then MLX_ENABLE_TF32=0, serially.
```
@@ -0,0 +1,8 @@
{"case":"vision_positions","start":0,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875],"expected_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875]}
{"case":"vision_chunk_next_state","start":0,"rows":4,"offset":5,"exact":true}
{"case":"vision_positions","start":4,"rows":2,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125],"expected_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125]}
{"case":"vision_chunk_next_state","start":4,"rows":2,"offset":7,"exact":true}
{"case":"vision_positions","start":2,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125],"expected_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125]}
{"case":"vision_chunk_next_state","start":2,"rows":4,"offset":7,"exact":true}
{"case":"vision_sparse_qsa","prefix_rows":12,"topk_blocks":1,"ratio":4,"position_delta":0,"text_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125],"vision_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125]}
{"case":"active_attention_gate","gate":-6.84375,"actual":[0.0003185272216796875,-0.00074005126953125,0.00021266937255859375,0.00095367431640625,-0.00021266937255859375,0.0004253387451171875,0.000637054443359375,-0.00010633468627929688],"expected_verify":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375]}
+108
View File
@@ -0,0 +1,108 @@
[
{
"check": "fmt",
"passed": true
},
{
"check": "clippy",
"passed": true
},
{
"check": "bundle",
"passed": true
},
{
"check": "tests",
"passed": true,
"results": [
"test result: ok. 308 passed; 0 failed; 219 ignored; 0 measured; 0 filtered out; finished in 5.51s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.28s"
]
},
{
"check": "native",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 526 filtered out; finished in 0.27s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 316,
"peak": {
"cpu_time_ns": 172161583,
"resident_bytes": 80969728,
"physical_bytes": 159974240,
"peak_physical_bytes": 160072544,
"disk_read_bytes": 0,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "attention",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 526 filtered out; finished in 0.14s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 210,
"peak": {
"cpu_time_ns": 86198750,
"resident_bytes": 81559552,
"physical_bytes": 176505672,
"peak_physical_bytes": 176505672,
"disk_read_bytes": 0,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "module-1",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 526 filtered out; finished in 14.78s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 17201,
"peak": {
"cpu_time_ns": 13461448125,
"resident_bytes": 529022976,
"physical_bytes": 1574700328,
"peak_physical_bytes": 1602028864,
"disk_read_bytes": 8667136,
"disk_write_bytes": 393216
},
"error": null
}
},
{
"check": "module-0",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 526 filtered out; finished in 15.32s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 15380,
"peak": {
"cpu_time_ns": 14550850750,
"resident_bytes": 551796736,
"physical_bytes": 1599587768,
"peak_physical_bytes": 1607976376,
"disk_read_bytes": 0,
"disk_write_bytes": 131072
},
"error": null
}
},
{
"check": "upstream",
"passed": true,
"tests": 10
}
]
@@ -0,0 +1,56 @@
{"case":"attention_chunk","key":"8-inside-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-inside-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-inside-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-inside-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-outside-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-outside-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-outside-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-outside-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-straddle-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-straddle-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-straddle-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-straddle-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-full_text_tail-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-full_text_tail-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-full_text_tail-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-full_text_tail-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-equal-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-equal-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-equal-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-equal-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-none-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-none-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-none-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-none-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-empty-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-empty-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-empty-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"8-empty-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-inside-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-inside-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-inside-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-inside-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-outside-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-outside-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-outside-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-outside-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-straddle-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-straddle-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-straddle-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-straddle-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-full_text_tail-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-full_text_tail-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-full_text_tail-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-full_text_tail-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-equal-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-equal-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-equal-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-equal-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-none-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-none-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-none-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-none-1.25-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-empty-1.0-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-empty-1.0-bf16","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-empty-1.25-f32","exact_q_k_and_tables":true}
{"case":"attention_chunk","key":"256-empty-1.25-bf16","exact_q_k_and_tables":true}
@@ -0,0 +1,56 @@
{"key":"8-inside-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"4c5ad613aa42e9289b941fda7f83ab7e0d4b7a29292ed4962d6c664fa9bf3c4a","sin_sha256":"8832c4a47d3a73f1b3af4a836d42cf0e886520442cd14babb3beba9fba5fe70b","q_sha256":"37d290b59d0162dac59e0aee718210ad450dbdf3b9fc8f5276101fcef50d897c","k_sha256":"26d3123cd9295182186f3e8c056fc05c77e99d1475ab14fe580fd8f35247d857"}
{"key":"8-inside-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"4c5ad613aa42e9289b941fda7f83ab7e0d4b7a29292ed4962d6c664fa9bf3c4a","sin_sha256":"8832c4a47d3a73f1b3af4a836d42cf0e886520442cd14babb3beba9fba5fe70b","q_sha256":"46f6571ff18f449d64c9db397c2b8b59ecfa80d6bcdd40ec2dea5fd43ddf8d29","k_sha256":"90019757e8b38b805b200c9bf860f86371f0e118f714d211ffdd18ccd548f881"}
{"key":"8-inside-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"b33b483634eb4e50faa2050d6efd606c14fb9dae4df4a37efa90c058764dfc58","sin_sha256":"20bf788c0af8c1c96835d4fdfecfa22548f7461c32431ec8229c1bf6b89fd0f0","q_sha256":"0958a24bd3c04f8f1b85de20767fad155bca39baf38194299dd5452fd47d971d","k_sha256":"8415a43c9d0cece7fff556589f0f60a8fe0aecb2c3e48fc11770102d72f77d76"}
{"key":"8-inside-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"b33b483634eb4e50faa2050d6efd606c14fb9dae4df4a37efa90c058764dfc58","sin_sha256":"20bf788c0af8c1c96835d4fdfecfa22548f7461c32431ec8229c1bf6b89fd0f0","q_sha256":"1f9dde5ec35085dd3a3a91f3e1c7eab105e5f0a442a1cbf38f64e3f2100a2b9f","k_sha256":"d5bbac3e7d547cf7422b4120d6ec12b7ccd277ffb52e9b494397add827e51fc1"}
{"key":"8-outside-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"cfdd4c78aecc2e702a87dd914fe858580f91999e2fb1756c10fbc14e6a694557","k_sha256":"e93d00fbfd1f29403de526fc7fdcf0f73b368a817210b58814df77b7d2955246"}
{"key":"8-outside-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"16da54ce9aef87bfef69928dbd1c87800b62a3c6c7bb3d0e2c751351c366e448","k_sha256":"c97ea7805a64b06ae1d2c5f0c2cae128c6a11159cb4d0c22698e86286e92cdf4"}
{"key":"8-outside-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"c693451f235fda763aed834cafddd4219d1d35e86d2ad9a45bbb07908ae04d70","k_sha256":"e02eb2ffee19d0aa2b8a39ecc1b58584dffbcea3d4ccc8269a1928e829bd2f76"}
{"key":"8-outside-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"f24a2cc645f202052db55ace4a09ea7754858b3397cc3eeb497714edae1118e4","k_sha256":"43b0a12d9d97c39f141539be95f877305e85d8e49080abc04109aedff99e7a35"}
{"key":"8-straddle-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"c2795e059020713438fad524723534bd8ed201bc1faa9d23e6af4059cba3ea23","sin_sha256":"9d88ad2d1b6cbe738f47f37f12b169988e1b89c74fb5621b8dc1a46b57cc6457","q_sha256":"a4976c7740385d1392c1a12b585edf2000f502010bc48e31a92b776181763314","k_sha256":"c6a32b83c7b227089b51fd3168c9e6c0473a68e23b3c25dfff5053b4fd9ccffc"}
{"key":"8-straddle-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"c2795e059020713438fad524723534bd8ed201bc1faa9d23e6af4059cba3ea23","sin_sha256":"9d88ad2d1b6cbe738f47f37f12b169988e1b89c74fb5621b8dc1a46b57cc6457","q_sha256":"303190dd3d5514b4952e48353c7d5aa6efcdc3ffa2b985ae6de6796cad84b69f","k_sha256":"3c26adb50d0181f9c4e34904146460ff299aea078d4343737a78d3c57e5944e5"}
{"key":"8-straddle-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"667522d8ce6fb8b16883df34b235c881b3a90a3eb5edcfcae85984a9225d1ece","sin_sha256":"ba57f1dc77bc8cbe0998c5fdcbae4725c598fb39e5758d1138fefbbdf77988d9","q_sha256":"1d8ce44d7fca02aae1640ce4c7e7054a72e600bc750e7da091f2ffd8b2e4a156","k_sha256":"4c68bf15f527f6530941c2b705207703a6b7fee31446f564b124c19a396c583b"}
{"key":"8-straddle-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"667522d8ce6fb8b16883df34b235c881b3a90a3eb5edcfcae85984a9225d1ece","sin_sha256":"ba57f1dc77bc8cbe0998c5fdcbae4725c598fb39e5758d1138fefbbdf77988d9","q_sha256":"68e71d870c8660acd954873dad34180033e6d683da661cdc6fea5e30cbbabf65","k_sha256":"5b347b699915cf4a76aeab754c4b14afcf560ff2cbb18e33b674bbe4fd0a22c3"}
{"key":"8-full_text_tail-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"1d7db40071c56957b00e95c623d8fe33b00844923603b4f22437290844ce5189","sin_sha256":"2e86a7b75f51570f50969a7eaff682cb1c4c740a7df3047ba7d34b881d336131","q_sha256":"bd0241f4af2045f3ccc497eeedace4c31286fac1b30a7976a73d3381740d0853","k_sha256":"4aa491e9bf45098932cfac394540fe176a3cf31cd449e56b670642930c0c0cd8"}
{"key":"8-full_text_tail-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"1d7db40071c56957b00e95c623d8fe33b00844923603b4f22437290844ce5189","sin_sha256":"2e86a7b75f51570f50969a7eaff682cb1c4c740a7df3047ba7d34b881d336131","q_sha256":"5bb0fbb54b84be503ee8d1dfbec37688597d992559a2a8ffc3159433349066cc","k_sha256":"6c6a5ed10c94b751b48cb7d14837f12bf905c8b7e9a790754c71badf4f1d9335"}
{"key":"8-full_text_tail-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"011662c43e69e3be2807d33b029946094bca520f1a043630b6ae2c18a716dfda","sin_sha256":"79215ac3f560b4e8624eaa8d1baf411e7d5f9a639f1c8f90d0fd807418ca9037","q_sha256":"573d6b46366220fdf9ca71d24b1dc91906644501a6b900abc7478e5fa2dccf0c","k_sha256":"e28a2891a9cf01bd8ef3769477ea45d5363d221439b059c33e2f11f985a119f0"}
{"key":"8-full_text_tail-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"011662c43e69e3be2807d33b029946094bca520f1a043630b6ae2c18a716dfda","sin_sha256":"79215ac3f560b4e8624eaa8d1baf411e7d5f9a639f1c8f90d0fd807418ca9037","q_sha256":"3b3c3cfde7cc07dfa518fcbb5f7bf017cf79eb9e86b2b405209411762aee1d8d","k_sha256":"6df327a507adaae71834850a788a5cacf9608ab1b83f03f2260c636dbf84d9b7"}
{"key":"8-equal-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.0,"dtype":"f32","cos_sha256":"77ac83401bc7565ad83fedcfa8dab1df4e52d0a827c8a1b017b1ef5ec93ad5c1","sin_sha256":"b3dd5ba5e17b6ceb6fdeb51065df1d57d7bf35bdbd5dac4925bb75ccd87458a8","q_sha256":"eec5ad30b4abbf15079d9973083c5a70720e6a0c8aa6875200b9582b45fcd864","k_sha256":"0426043a33440a71b3830a89c34b008bcec51ed961fdee51bc7819d46b1fe478"}
{"key":"8-equal-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.0,"dtype":"bf16","cos_sha256":"77ac83401bc7565ad83fedcfa8dab1df4e52d0a827c8a1b017b1ef5ec93ad5c1","sin_sha256":"b3dd5ba5e17b6ceb6fdeb51065df1d57d7bf35bdbd5dac4925bb75ccd87458a8","q_sha256":"5f277c2a557848f452f484388ac5e46500b9942df921b72254de2bf691745fa5","k_sha256":"e200b0ee24778e290b5bb3a0d5b5dd5bff63b6754da56baa6a2c0911b6873fdd"}
{"key":"8-equal-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.25,"dtype":"f32","cos_sha256":"dd4cd7320fa29d59162a9630e078fa84c4661769091f396e75b38a5d798b1ba4","sin_sha256":"ce60e7dc9cd397d885780551f1b12f9f8cd5b6740d6673324793ecd0516b83d2","q_sha256":"aaf430af221f87419869232fe5bfba69aeaebf5dc9b0b30b9e5e80779a21e7d4","k_sha256":"36225b9a070cbc3537ce2e9b32b1b6d035de57325df1da55874c43d0a937fd68"}
{"key":"8-equal-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.25,"dtype":"bf16","cos_sha256":"dd4cd7320fa29d59162a9630e078fa84c4661769091f396e75b38a5d798b1ba4","sin_sha256":"ce60e7dc9cd397d885780551f1b12f9f8cd5b6740d6673324793ecd0516b83d2","q_sha256":"3f5eca7a6aa94afc626d070bdc69f0ae3a197790bcb75c6cac19093dfa54d9ed","k_sha256":"4bf23203d9db6382c09bd3c9abd85a473b1f557825f84983d73a94243a596b70"}
{"key":"8-none-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"cfdd4c78aecc2e702a87dd914fe858580f91999e2fb1756c10fbc14e6a694557","k_sha256":"e93d00fbfd1f29403de526fc7fdcf0f73b368a817210b58814df77b7d2955246"}
{"key":"8-none-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"16da54ce9aef87bfef69928dbd1c87800b62a3c6c7bb3d0e2c751351c366e448","k_sha256":"c97ea7805a64b06ae1d2c5f0c2cae128c6a11159cb4d0c22698e86286e92cdf4"}
{"key":"8-none-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"c693451f235fda763aed834cafddd4219d1d35e86d2ad9a45bbb07908ae04d70","k_sha256":"e02eb2ffee19d0aa2b8a39ecc1b58584dffbcea3d4ccc8269a1928e829bd2f76"}
{"key":"8-none-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"f24a2cc645f202052db55ace4a09ea7754858b3397cc3eeb497714edae1118e4","k_sha256":"43b0a12d9d97c39f141539be95f877305e85d8e49080abc04109aedff99e7a35"}
{"key":"8-empty-1.0-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"cfdd4c78aecc2e702a87dd914fe858580f91999e2fb1756c10fbc14e6a694557","k_sha256":"e93d00fbfd1f29403de526fc7fdcf0f73b368a817210b58814df77b7d2955246"}
{"key":"8-empty-1.0-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"81ca98b954346d7fabada07182b71708d7d44379f6ccf4f7b1d20592e9b2c5b1","sin_sha256":"f12f35d499314f536706031806a03760888a398360797344ed2aac4b0ca45fab","q_sha256":"16da54ce9aef87bfef69928dbd1c87800b62a3c6c7bb3d0e2c751351c366e448","k_sha256":"c97ea7805a64b06ae1d2c5f0c2cae128c6a11159cb4d0c22698e86286e92cdf4"}
{"key":"8-empty-1.25-f32","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"c693451f235fda763aed834cafddd4219d1d35e86d2ad9a45bbb07908ae04d70","k_sha256":"e02eb2ffee19d0aa2b8a39ecc1b58584dffbcea3d4ccc8269a1928e829bd2f76"}
{"key":"8-empty-1.25-bf16","dim":8,"rotary":8,"sections":[2,1,1],"heads":2,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"ffa186135e2e51b2cdf09e44efe7ba62dc7e0354b5744fd041ca98c1014382bb","sin_sha256":"f423178f62b5714a8ea8aca5d4eeaef1654b422b6b6ba3c869e664b16c8e1580","q_sha256":"f24a2cc645f202052db55ace4a09ea7754858b3397cc3eeb497714edae1118e4","k_sha256":"43b0a12d9d97c39f141539be95f877305e85d8e49080abc04109aedff99e7a35"}
{"key":"256-inside-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"6b8626092624533479bc18ba46f6de54cbd643f10f7e64fb93e8fa4118f6b361","sin_sha256":"140df4ec915b4d7cc25a17eba853438c6c6ed1f444831caff3d78ab8c51c9b8e","q_sha256":"c75ebcf3f39d56a35f6d806ef65900bec4f7941fd20d6f8fe7be8b040ae6adc4","k_sha256":"14b94cf0d44c9715f7b6b19638dffe012e255907ddd6fd5fc4170f23f57eb9de"}
{"key":"256-inside-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"6b8626092624533479bc18ba46f6de54cbd643f10f7e64fb93e8fa4118f6b361","sin_sha256":"140df4ec915b4d7cc25a17eba853438c6c6ed1f444831caff3d78ab8c51c9b8e","q_sha256":"41411eedb50ec9eb3905660429d8ccc74ac533eb24f516e2c4aabe6fb56619f1","k_sha256":"21351db5fc62c81b18dedd17079cfb94afce8fc866194991775ce5d809838b67"}
{"key":"256-inside-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"243b58223a86ef69b1528fc8e5ab57ce2d6131c95aa5fe7a11c4c54b1c5c2477","sin_sha256":"b157572375863b5a67db173d729737f5c5cdc0c19df7ae233455f373efca78e9","q_sha256":"c3e554dd73cbd076257399a1c681a73ec7146a42e64f458121bcf551fc85beda","k_sha256":"03fb9884e7adc7c6592a2b5ac8feb2121848543281aabe64596ccd02d41e87a2"}
{"key":"256-inside-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"inside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":0,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"243b58223a86ef69b1528fc8e5ab57ce2d6131c95aa5fe7a11c4c54b1c5c2477","sin_sha256":"b157572375863b5a67db173d729737f5c5cdc0c19df7ae233455f373efca78e9","q_sha256":"3768c85c6483d544e1d1332cb5b1576a5d294c45cb6d108bc9973a60da272da8","k_sha256":"fff583259aeb40f31f18482dc06be5b39bcdb887c39d5d23dd747b2a25d2517d"}
{"key":"256-outside-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"46470cd3fb0fbf04ec5a202def18080387a17e26609dfd2c898b1544922a72e3","k_sha256":"442720910c2f9e81a692fda617e7f291e7958c47767c5681dae2dc152604d2fd"}
{"key":"256-outside-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"66eaaa400cd8c426e69466f385c0da2755a27fad14533e121ac71ddff643dd22","k_sha256":"6327db96552af4550847e68302fc35db26f6ce4c6bfb974c3e86753532461436"}
{"key":"256-outside-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"9f4f70f54dc3c2a96b685867d93eebf893a2771568da279f1af09c4e290fff6f","k_sha256":"aba719fab18624f0bf4e18ca13f1445907b40ed37fc16469bcc12bc7dcf8f2e9"}
{"key":"256-outside-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"outside","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"dd02a4903be48b0a5164dc8aa7a038b4f31542d0502976229993b484b0afb161","k_sha256":"2d14d0767981255265a1c9e3de6d5ca5b9c423796643a7890e0a38defce745fc"}
{"key":"256-straddle-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"6a4ca7c67ef29078baab8a90fe31a9032962beaa63b9407daff32b23338d94d2","sin_sha256":"8ba60c8c231b9bab6af1d5e2cb09076e65b84d86b8b3e82c15a80e80da24ad19","q_sha256":"42fc5eb0f6209819b498c060256f339af41108ff6a2914aa58a582f681fce0de","k_sha256":"5388b4ea514dd361df01b5f6b741b0412f7a5c0cc5c4878b2b184b957e247ba4"}
{"key":"256-straddle-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"6a4ca7c67ef29078baab8a90fe31a9032962beaa63b9407daff32b23338d94d2","sin_sha256":"8ba60c8c231b9bab6af1d5e2cb09076e65b84d86b8b3e82c15a80e80da24ad19","q_sha256":"ad0297ee044b92d621dc63aac720816ca901d42480bd8623e367a87546a8a966","k_sha256":"ec36ced2f229b255cb47b1a048bd874d01e53194ebf13fecc53fe6e6f913e6f3"}
{"key":"256-straddle-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"569b55172bb1106384a5c3642bb90a77ac2997f93fbeefbcd7e43aac01ddece5","sin_sha256":"c3e314142270c58f2d6c769fe4eeb3f7074d7bf69b0fb79612308d440991d7ab","q_sha256":"6ea51e92e8611cc748425fd13b55b1c76409d7ba9ad55093d8e8c0915dcb2b7b","k_sha256":"dc92525bc9de0dbf52f6d0ea4aa9a2ab8e6fe4f5734dedb82737e94fde402f35"}
{"key":"256-straddle-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"straddle","table":[[0,1,2,2],[0,1,3,3],[0,1,4,4]],"start":2,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"569b55172bb1106384a5c3642bb90a77ac2997f93fbeefbcd7e43aac01ddece5","sin_sha256":"c3e314142270c58f2d6c769fe4eeb3f7074d7bf69b0fb79612308d440991d7ab","q_sha256":"cf12a1f9355e3f3fe0851f85eb4eb672e08cfa476b1caa9d5d30836aede2a7f0","k_sha256":"13b434bbdb9ac1da04ece39ff0fbbf32af6a3be4f65bc2c76955bc2eea29918e"}
{"key":"256-full_text_tail-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"02d54605178198f102a284547292f68800035f2ac14a556055fa8e2f69be6d95","sin_sha256":"94252e38d9026e6f504896c9006e9d00233c127eb35c61dd657d9339033c79da","q_sha256":"f95457ad86bec0f74c712d22ca7060b287e8d879649a2a2f6183614e371c272e","k_sha256":"94441d6b3975d66b0b856fa7a961b9e3cc9061e0dcf5ca4e99e3578531bc4eab"}
{"key":"256-full_text_tail-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"02d54605178198f102a284547292f68800035f2ac14a556055fa8e2f69be6d95","sin_sha256":"94252e38d9026e6f504896c9006e9d00233c127eb35c61dd657d9339033c79da","q_sha256":"11d14d87457a3056f2b0002e7ecdcaf731582f7977af57253f63e8e43934e794","k_sha256":"ee38a4c600c702b04372cf296321ebc6c417b99c8f26a92be582723370827bf0"}
{"key":"256-full_text_tail-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"4debf71d26dc4a7f4c90063db81e4cc281794397a6280856630cf69088f0736d","sin_sha256":"181ff89796c3ea57e75507139b06048799088b35a5b1ca734969f61ac5aa13a0","q_sha256":"243387c34260d98b0b7fc7c0402d7a22fa6a2b12dd175bac608989cb3b088e0f","k_sha256":"f01f02933997f089ad7da74e6e9e5330d48d8d5dce05e57221c82fa6616b9d97"}
{"key":"256-full_text_tail-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"full_text_tail","table":[[0,1,2,2,3,4,5,6],[0,1,3,3,3,4,5,6],[0,1,4,4,3,4,5,6]],"start":6,"rows":4,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"4debf71d26dc4a7f4c90063db81e4cc281794397a6280856630cf69088f0736d","sin_sha256":"181ff89796c3ea57e75507139b06048799088b35a5b1ca734969f61ac5aa13a0","q_sha256":"89e21bbff037e9c37b6644bba10c5147ed2f2b2ef581ecfb7a48382adca15dc0","k_sha256":"7696741b386796d165823c076759b8b333e41b38793c5f0930d8748b019644aa"}
{"key":"256-equal-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.0,"dtype":"f32","cos_sha256":"81db85ea7f6e9e5e296a301e27e4559ef47209c07bb8d5e1ef7fbde58cf31f43","sin_sha256":"ab7951404c5316d70cf2c4d23c22bda6688735aadbbbac1154c5561fefac5814","q_sha256":"a5ed90958f9cb48bbaecd95378dd4d5b799e89119a23948a21d6dbf152bfb6fd","k_sha256":"39020d2fe651af5740f3d25b75ab629b4939e756a014a2fd3ea29cc83b707a75"}
{"key":"256-equal-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.0,"dtype":"bf16","cos_sha256":"81db85ea7f6e9e5e296a301e27e4559ef47209c07bb8d5e1ef7fbde58cf31f43","sin_sha256":"ab7951404c5316d70cf2c4d23c22bda6688735aadbbbac1154c5561fefac5814","q_sha256":"a436e9110ac8c4d7caaa5dc8b3b2f26b65a1769c7e0740d1b250ed0b18044f25","k_sha256":"46c7938fc8efb1db7af8c0bb93b023b27c74a9f3c28563c601e10d1f60957be3"}
{"key":"256-equal-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.25,"dtype":"f32","cos_sha256":"aa7a3bff877ac876da92f531df5cdaeee6030357a759617c67773662257afa9c","sin_sha256":"634e86affba6725e9a548e130dc0f78519cc3b5b6d9595d0647299a9b742fcf4","q_sha256":"652d70474ef0a2f5ea94b13af4f06a9c47519dcb2875db09b8f7e2297dc1b537","k_sha256":"8200796c4b50eaeea4cfa542816bf432cd57aca9bd0e681af23efdce0965af7e"}
{"key":"256-equal-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"equal","table":[[0,1,2,3],[0,1,2,3],[0,1,2,3]],"start":2,"rows":4,"delta":0,"scaling":1.25,"dtype":"bf16","cos_sha256":"aa7a3bff877ac876da92f531df5cdaeee6030357a759617c67773662257afa9c","sin_sha256":"634e86affba6725e9a548e130dc0f78519cc3b5b6d9595d0647299a9b742fcf4","q_sha256":"f155c3d76915163001c8cfdf3a450fef536011a9ae9506062005556329bfacca","k_sha256":"f098bae1d55103eb101fe518b6461514939f6d84e0c8aefc21cc337985f4a6a7"}
{"key":"256-none-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"46470cd3fb0fbf04ec5a202def18080387a17e26609dfd2c898b1544922a72e3","k_sha256":"442720910c2f9e81a692fda617e7f291e7958c47767c5681dae2dc152604d2fd"}
{"key":"256-none-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"66eaaa400cd8c426e69466f385c0da2755a27fad14533e121ac71ddff643dd22","k_sha256":"6327db96552af4550847e68302fc35db26f6ce4c6bfb974c3e86753532461436"}
{"key":"256-none-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"9f4f70f54dc3c2a96b685867d93eebf893a2771568da279f1af09c4e290fff6f","k_sha256":"aba719fab18624f0bf4e18ca13f1445907b40ed37fc16469bcc12bc7dcf8f2e9"}
{"key":"256-none-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"none","table":null,"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"dd02a4903be48b0a5164dc8aa7a038b4f31542d0502976229993b484b0afb161","k_sha256":"2d14d0767981255265a1c9e3de6d5ca5b9c423796643a7890e0a38defce745fc"}
{"key":"256-empty-1.0-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"f32","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"46470cd3fb0fbf04ec5a202def18080387a17e26609dfd2c898b1544922a72e3","k_sha256":"442720910c2f9e81a692fda617e7f291e7958c47767c5681dae2dc152604d2fd"}
{"key":"256-empty-1.0-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.0,"dtype":"bf16","cos_sha256":"b74e1412fd4c010fe4680296bce1face53fb27a160c5942d25babe45740f532c","sin_sha256":"690e9805f9d0f5b319dd189bccb902fc94f387d41136060e3bccde090ff6f35e","q_sha256":"66eaaa400cd8c426e69466f385c0da2755a27fad14533e121ac71ddff643dd22","k_sha256":"6327db96552af4550847e68302fc35db26f6ce4c6bfb974c3e86753532461436"}
{"key":"256-empty-1.25-f32","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"f32","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"9f4f70f54dc3c2a96b685867d93eebf893a2771568da279f1af09c4e290fff6f","k_sha256":"aba719fab18624f0bf4e18ca13f1445907b40ed37fc16469bcc12bc7dcf8f2e9"}
{"key":"256-empty-1.25-bf16","dim":256,"rotary":64,"sections":[11,11,10],"heads":24,"mode":"empty","table":[[],[],[]],"start":4,"rows":2,"delta":-1,"scaling":1.25,"dtype":"bf16","cos_sha256":"08deae1f38cc2ff0673dfcee084a24d2f5202a58c65012855d97b60140e18198","sin_sha256":"8410a14d0c8c5ea90587039a782c7fab9bad800e5365cf3736f40de8146c046e","q_sha256":"dd02a4903be48b0a5164dc8aa7a038b4f31542d0502976229993b484b0afb161","k_sha256":"2d14d0767981255265a1c9e3de6d5ca5b9c423796643a7890e0a38defce745fc"}
+96
View File
@@ -0,0 +1,96 @@
# Issue 109: compiled verification gates
Qwen target forwards inside the MTP loop now carry the pinned MTPLX
`decode_verify` phase through attention, eager HC injection, captured-prefix
repair and final-primary commit. Draft/history and ordinary prefill/AR retain
their existing phase. Compiled layer replay keys include the phase to prevent
reuse of a graph with the other gate law.
The BF16 attention gate compiles exactly
`output * sigmoid(gate.astype(f32).astype(bf16))`; the casts select the fused
lowering and do not move the sigmoid to F32. F32 uses its separate compiled
expression; FP16 remains standalone. The existing native Rust graph compiler
and Metal execution implement these expressions. No global sigmoid, compiler
math flags, DS4/GLM implementation, or shared family helper changed.
Two actual eager `GatedResidual._verify_inject` calls also demonstrated a
phase/site failure (the adjacent `active-hc-sites.jsonl` records inputs and both
outputs). That sibling therefore satisfies this issue's explicit scope rule:
its verify-only divide/sigmoid/multiply now compiles as pinned MTPLX does.
Unrelated PLE/shared-expert gates remain unchanged. This is oracle parity, not a
new DS4Server feature or a full fixed-M4 verifier.
Persisted MTP snapshots without the new gate policy are rejected before
restoration; old AR snapshots remain compatible. Tests use both a constructed
old manifest and an actual pre-fix MTP file, and verify failed restoration leaves
the current live state intact. New checkpoints reproduce resident warm state
exactly after reset/reopen.
## Verification and boundaries
The pinned oracle is MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`
with MLX 0.32.2. The installed Bare-Speed artifact and hardware are recorded in
`../issue104-ar/environment.json`.
- Exhaustive finite BF16 (65,280) and FP16 (63,488), plus 65,536 dense F32
gate values, compare every output byte in all three phases. BF16 also covers
all three HC-injection phases. The owned original `active_attention_gate`
and `bf16_gate` regressions require the corrected expression and neighbors.
- Real cold/warm MTP requests compare each target forward's input IDs and all
logits/hidden bytes, generated tokens, cache offsets, final logits/hidden and
trunk/MTP state arrays. Native resident and disk-reopened full state hashes
must agree exactly.
- The complete final-primary test covers greedy/sampled, depths 1–3,
stop/max-token termination and failure/cancellation controls.
- Existing whole-attention fixtures exercise both TF32 modes and prepared/lazy
input routes; hyper fixtures control the unchanged non-verify route.
The real-model comparison explicitly sets the oracle's
`MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0` to isolate this gate change with the same
attention consumer. Independent default-oracle comparison exposed a missing
head-chunked consumer before the gate, tracked separately in
[#113](https://git.rfc1437.de/hugo/DS4Server/issues/113). This controlled run does
not establish default-route model parity. `default-route-mismatch.jsonl`
retains the evidence.
Cache receipts retain raw hashes as well as value hashes with zero signs
canonicalized. A first-position prefill key has one signed-zero bit difference;
this is reported explicitly rather than hidden by a tolerance, and is tracked
separately in [#114](https://git.rfc1437.de/hugo/DS4Server/issues/114). Target outputs,
final logits/hidden and resident-versus-reopened state use raw byte exactness.
All four mandatory gates and serial Metal/oracle checks are listed in
`checks.json`. These are correctness receipts, not performance measurements.
## Reproduction
```sh
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue109-gate-reference.py /path/to/pinned/mtplx /tmp/issue109-gate
cargo test --all-features --bin ds4-server --no-run
cargo build --bin test-supervisor
export DS4_ISSUE109_GATE=/tmp/issue109-gate
# Resolve TEST_EXECUTABLE from cargo; run Metal processes serially.
target/debug/test-supervisor 4096 60 120 --command TEST_EXECUTABLE \
issue109_gate_phase_and_dtype_laws --ignored --nocapture --test-threads=1
export MTPLX_CONTEXT_COPY=0
export DS4_QWEN38_ARTIFACTS=/path/to/model
export DS4_ISSUE109_DIR=/tmp/issue109-product
export DS4_ISSUE109_OLD=/path/to/pre-fix-mtp-checkpoint
target/debug/test-supervisor 114688 60 120 --command TEST_EXECUTABLE \
issue109_verify_rows_and_warm_checkpoint --ignored --nocapture --test-threads=1
MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0 \
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue109-model-reference.py /path/to/pinned/mtplx \
"$DS4_QWEN38_ARTIFACTS" "$DS4_ISSUE109_DIR" /tmp/issue109-model-oracle
```
## Snapshot comparison correction (#114)
The historical zero-sign receipt above measured an extra deep oracle snapshot
against a lazy native bank entry. The deep clone adds zero; this alone creates
the reported bit change. The raw/live and matching lazy snapshots agree exactly.
The corrected shared oracle now compares the server's actual snapshot stages,
requires every raw cache bit to match, and has no signed-zero exception. See
[the isolated trace and regression](../issue114-snapshot-zero/README.md). The
original receipts remain unchanged as evidence of the measurement error.
@@ -0,0 +1,2 @@
{"case":"active_sibling_gate","owner":"GatedResidual","method":"_verify_inject","phase":"decode_verify","gate_shape":[1,4,4],"different":1,"logits":[-14.5,-25.625,-27.125,-15.8125,-11.8125,-19.875,-27.375,-16.25,-12.9375,-25.75,-30.625,-17.0,-11.6875,-22.625,-26.5,-16.5],"actual":[0.052001953125,0.0033111572265625,0.0022735595703125,0.037841796875,0.099609375,0.0137939453125,0.00213623046875,0.033935546875,0.07568359375,0.003204345703125,0.000946044921875,0.0281982421875,0.10205078125,0.0069580078125,0.002655029296875,0.031982421875],"stock":[0.052001953125,0.0033111572265625,0.0022735595703125,0.037841796875,0.099609375,0.0137939453125,0.0021209716796875,0.033935546875,0.07568359375,0.003204345703125,0.000946044921875,0.0281982421875,0.10205078125,0.0069580078125,0.002655029296875,0.031982421875]}
{"case":"active_sibling_gate","owner":"GatedResidual","method":"_verify_inject","phase":"decode_verify","gate_shape":[1,4,4],"different":1,"logits":[14.4375,-5.0625,-12.4375,-1.359375,23.75,-26.25,-19.875,-8.6875,27.625,-29.125,-18.375,-8.75,27.0,-27.375,-22.625,-7.71875],"actual":[1.9453125,0.4375,0.08544921875,0.83203125,1.9921875,0.0028228759765625,0.0137939453125,0.205078125,2.0,0.001373291015625,0.02001953125,0.201171875,2.0,0.00213623046875,0.0069580078125,0.25390625],"stock":[1.9453125,0.4375,0.08544921875,0.83203125,1.9921875,0.0028228759765625,0.0137939453125,0.205078125,2.0,0.001373291015625,0.02001953125,0.201171875,2.0,0.0021209716796875,0.0069580078125,0.25390625]}
@@ -0,0 +1,8 @@
{"case":"vision_positions","start":0,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875],"expected_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875]}
{"case":"vision_chunk_next_state","start":0,"rows":4,"offset":5,"exact":true}
{"case":"vision_positions","start":4,"rows":2,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125],"expected_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125]}
{"case":"vision_chunk_next_state","start":4,"rows":2,"offset":7,"exact":true}
{"case":"vision_positions","start":2,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125],"expected_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125]}
{"case":"vision_chunk_next_state","start":2,"rows":4,"offset":7,"exact":true}
{"case":"vision_sparse_qsa","prefix_rows":12,"topk_blocks":1,"ratio":4,"position_delta":0,"text_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125],"vision_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125]}
{"case":"active_attention_gate","gate":-6.84375,"actual":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375],"expected_verify":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375]}
+219
View File
@@ -0,0 +1,219 @@
[
{
"check": "fmt",
"passed": true
},
{
"check": "clippy",
"passed": true
},
{
"check": "bundle",
"passed": true
},
{
"check": "tests",
"passed": true,
"results": [
"test result: ok. 308 passed; 0 failed; 221 ignored; 0 measured; 0 filtered out; finished in 5.57s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.29s"
]
},
{
"check": "gate-native",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.28s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 1677,
"peak": {
"cpu_time_ns": 198776708,
"resident_bytes": 82509824,
"physical_bytes": 160219976,
"peak_physical_bytes": 160744264,
"disk_read_bytes": 15327232,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "product",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 47.53s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 48500,
"peak": {
"cpu_time_ns": 50595900083,
"resident_bytes": 26181681152,
"physical_bytes": 77006202736,
"peak_physical_bytes": 77006202736,
"disk_read_bytes": 73689870336,
"disk_write_bytes": 286756864
},
"error": null
}
},
{
"check": "model-oracle",
"passed": true,
"control": "MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0; MTPLX_CONTEXT_COPY=0",
"known_separate_findings": [
113,
114
]
},
{
"check": "codec",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.13s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 1455,
"peak": {
"cpu_time_ns": 41537833,
"resident_bytes": 17907712,
"physical_bytes": 4817472,
"peak_physical_bytes": 4817472,
"disk_read_bytes": 0,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "attention",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.15s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 210,
"peak": {
"cpu_time_ns": 85113875,
"resident_bytes": 79396864,
"physical_bytes": 40239968,
"peak_physical_bytes": 40239968,
"disk_read_bytes": 65536,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "numeric",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.29s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 315,
"peak": {
"cpu_time_ns": 88259416,
"resident_bytes": 80084992,
"physical_bytes": 159744816,
"peak_physical_bytes": 159859504,
"disk_read_bytes": 4096,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "finalprimary",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 98.22s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 98338,
"peak": {
"cpu_time_ns": 98248792166,
"resident_bytes": 63166431232,
"physical_bytes": 74583434072,
"peak_physical_bytes": 74584138584,
"disk_read_bytes": 73602744320,
"disk_write_bytes": 1397932032
},
"error": null
}
},
{
"check": "module-1",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 14.20s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 14223,
"peak": {
"cpu_time_ns": 13641618583,
"resident_bytes": 548356096,
"physical_bytes": 1595852072,
"peak_physical_bytes": 1604257088,
"disk_read_bytes": 51740672,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "module-0",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 14.05s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 14115,
"peak": {
"cpu_time_ns": 13634514125,
"resident_bytes": 556367872,
"physical_bytes": 1602864448,
"peak_physical_bytes": 1604191552,
"disk_read_bytes": 278528,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "hyper",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 28.54s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 28607,
"peak": {
"cpu_time_ns": 28219361375,
"resident_bytes": 207831040,
"physical_bytes": 416056280,
"peak_physical_bytes": 416089048,
"disk_read_bytes": 1949696,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "upstream",
"passed": true,
"results": [
"9 passed in 0.12s"
]
}
]
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b","value_sha256":"1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b"},{"shape":[1,48,128,128],"sha256":"d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d","value_sha256":"d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d"}],[{"shape":[1,3,10240],"sha256":"ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a","value_sha256":"ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a"},{"shape":[1,48,128,128],"sha256":"f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831","value_sha256":"f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831"},{"shape":[1,9,10240],"sha256":"c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e","value_sha256":"c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e"},{"shape":[1,2],"sha256":"9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f","value_sha256":"9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f"}],[{"shape":[1,3,10240],"sha256":"320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3","value_sha256":"320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3"},{"shape":[1,48,128,128],"sha256":"8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08","value_sha256":"8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08"}],[{"shape":[1,2,58,256],"sha256":"404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0","value_sha256":"404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0"},{"shape":[1,2,58,256],"sha256":"f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef","value_sha256":"f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef"},{"shape":[1,58,128],"sha256":"ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12","value_sha256":"ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12"},{"shape":[1,14,128],"sha256":"a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b","value_sha256":"a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b"}],[{"shape":[1,3,10240],"sha256":"0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2","value_sha256":"0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2"},{"shape":[1,48,128,128],"sha256":"d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f","value_sha256":"d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f"}],[{"shape":[1,3,10240],"sha256":"66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb","value_sha256":"66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb"},{"shape":[1,48,128,128],"sha256":"2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098","value_sha256":"2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098"}],[{"shape":[1,3,10240],"sha256":"45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2","value_sha256":"45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2"},{"shape":[1,48,128,128],"sha256":"e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0","value_sha256":"e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0"}],[{"shape":[1,2,58,256],"sha256":"ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2","value_sha256":"ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2"},{"shape":[1,2,58,256],"sha256":"57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4","value_sha256":"57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4"},{"shape":[1,58,128],"sha256":"84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22","value_sha256":"84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22"},{"shape":[1,14,128],"sha256":"a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707","value_sha256":"a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707"}],[{"shape":[1,3,10240],"sha256":"e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c","value_sha256":"e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c"},{"shape":[1,48,128,128],"sha256":"f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c","value_sha256":"f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c"}],[{"shape":[1,3,10240],"sha256":"54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016","value_sha256":"54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016"},{"shape":[1,48,128,128],"sha256":"868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259","value_sha256":"868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259"}],[{"shape":[1,3,10240],"sha256":"0073cc8754020915aedaad03803669a61281e18cb2dd389cb19ef7b5ed769b84","value_sha256":"0073cc8754020915aedaad03803669a61281e18cb2dd389cb19ef7b5ed769b84"},{"shape":[1,48,128,128],"sha256":"abd539c013e58f489c23c48dfc168be7a9e2145deee859432cb83d0dLine truncated
@@ -0,0 +1 @@
{"trunk": [[{"shape": [1, 3, 10240], "sha256": "1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b", "value_sha256": "1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b"}, {"shape": [1, 48, 128, 128], "sha256": "d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d", "value_sha256": "d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d"}], [{"shape": [1, 3, 10240], "sha256": "ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a", "value_sha256": "ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a"}, {"shape": [1, 48, 128, 128], "sha256": "f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831", "value_sha256": "f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831"}, {"shape": [1, 9, 10240], "sha256": "c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e", "value_sha256": "c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e"}, {"shape": [1, 2], "sha256": "9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f", "value_sha256": "9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f"}], [{"shape": [1, 3, 10240], "sha256": "320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3", "value_sha256": "320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3"}, {"shape": [1, 48, 128, 128], "sha256": "8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08", "value_sha256": "8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08"}], [{"shape": [1, 2, 58, 256], "sha256": "404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0", "value_sha256": "404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0"}, {"shape": [1, 2, 58, 256], "sha256": "f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef", "value_sha256": "f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef"}, {"shape": [1, 58, 128], "sha256": "ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12", "value_sha256": "ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12"}, {"shape": [1, 14, 128], "sha256": "a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b", "value_sha256": "a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b"}], [{"shape": [1, 3, 10240], "sha256": "0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2", "value_sha256": "0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2"}, {"shape": [1, 48, 128, 128], "sha256": "d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f", "value_sha256": "d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f"}], [{"shape": [1, 3, 10240], "sha256": "66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb", "value_sha256": "66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb"}, {"shape": [1, 48, 128, 128], "sha256": "2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098", "value_sha256": "2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098"}], [{"shape": [1, 3, 10240], "sha256": "45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2", "value_sha256": "45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2"}, {"shape": [1, 48, 128, 128], "sha256": "e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0", "value_sha256": "e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0"}], [{"shape": [1, 2, 58, 256], "sha256": "ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2", "value_sha256": "ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2"}, {"shape": [1, 2, 58, 256], "sha256": "57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4", "value_sha256": "57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4"}, {"shape": [1, 58, 128], "sha256": "84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22", "value_sha256": "84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22"}, {"shape": [1, 14, 128], "sha256": "a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707", "value_sha256": "a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707"}], [{"shape": [1, 3, 10240], "sha256": "e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c", "value_sha256": "e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c"}, {"shape": [1, 48, 128, 128], "sha256": "f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c", "value_sha256": "f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c"}], [{"shape": [1, 3, 10240], "sha256": "54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016", "value_sha256": "54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016"}, {"shape": [1, 48, 128, 128], "sha256": "868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259", "value_sha256": "868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259"}], [{"shape": [1, 3, 10240], "sha256": "0073cc87540209Line truncated
@@ -0,0 +1,142 @@
{"case":"prefill_compare","phase":"cold","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"cold","part":"hidden","shape":[1,1,10240],"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":0,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1010,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1011,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1013,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1014,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1015,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":2,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1030,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1031,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1036,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1037,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1038,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1032,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1033,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1034,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1035,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":3,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":6,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1070,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1071,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1076,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1077,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1078,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1072,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1073,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1074,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1075,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":7,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":10,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1110,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1111,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1116,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1117,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1118,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1112,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1113,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1114,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1115,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":11,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":14,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1150,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1151,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1156,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1157,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1158,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1152,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1153,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1154,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1155,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":15,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":18,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1190,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1191,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1196,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1197,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1198,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1192,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1193,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1194,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1195,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":19,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":22,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1230,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1231,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1236,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1237,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1238,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1232,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1233,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1234,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1235,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":23,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":26,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1270,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1271,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1276,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1277,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1278,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1272,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1273,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1274,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1275,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":27,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":30,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1310,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1311,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1316,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1317,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1318,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1312,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1313,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1314,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1315,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":31,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":34,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1350,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1351,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1356,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1357,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1358,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1352,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1353,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1354,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1355,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":35,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":38,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1390,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1391,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1396,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1397,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1398,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1392,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1393,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1394,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1395,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":39,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":42,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1430,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1431,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1436,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1437,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1438,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1432,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1433,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1434,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1435,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":43,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":46,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1470,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1471,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1476,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1477,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1478,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1472,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1473,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1474,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1475,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":47,"exact":false}
{"case":"verify_forward","phase":"cold","index":0,"ids":[760,1156,369,9859],"logits_exact":false,"logits_sha256":"e3ba038c8570911a72fadeba867f1c33e5103108ef9881bfcdc008907de90839","logits_different":948664,"logits_max_abs":0.828125,"hidden_exact":false,"hidden_sha256":"b3c2ef7bb9c3dfa85748d7af883210ae4393bd1b5af5397f243d632fc437552b","hidden_different":39596,"hidden_max_abs":0.53125}
@@ -0,0 +1,15 @@
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"cancel","safe_final_state":false}
{"case":"forward","safe_final_state":false}
{"case":"capture_disabled","safe_final_state":false}
@@ -0,0 +1,12 @@
{"case":"gate","dtype":"bf16","phase":"prefill","values":65280,"exact":true}
{"case":"inject","phase":"prefill","values":65280,"exact":true}
{"case":"gate","dtype":"bf16","phase":"ar_decode","values":65280,"exact":true}
{"case":"inject","phase":"ar_decode","values":65280,"exact":true}
{"case":"gate","dtype":"bf16","phase":"decode_verify","values":65280,"exact":true}
{"case":"inject","phase":"decode_verify","values":65280,"exact":true}
{"case":"gate","dtype":"f16","phase":"prefill","values":63488,"exact":true}
{"case":"gate","dtype":"f16","phase":"ar_decode","values":63488,"exact":true}
{"case":"gate","dtype":"f16","phase":"decode_verify","values":63488,"exact":true}
{"case":"gate","dtype":"f32","phase":"prefill","values":65536,"exact":true}
{"case":"gate","dtype":"f32","phase":"ar_decode","values":65536,"exact":true}
{"case":"gate","dtype":"f32","phase":"decode_verify","values":65536,"exact":true}
@@ -0,0 +1,12 @@
{"case":"gate","dtype":"bf16","phase":"prefill","count":65280,"sha256":"4278d0e794d68fdac18c7528d38c1f6ea2c9412117aaba69f413caddb148b252"}
{"case":"inject","dtype":"bf16","phase":"prefill","count":65280,"sha256":"253aee360f465fb04a5aae286344a5344938fbcacdf6f5d0be2a66ad566378af"}
{"case":"gate","dtype":"bf16","phase":"ar_decode","count":65280,"sha256":"4278d0e794d68fdac18c7528d38c1f6ea2c9412117aaba69f413caddb148b252"}
{"case":"inject","dtype":"bf16","phase":"ar_decode","count":65280,"sha256":"253aee360f465fb04a5aae286344a5344938fbcacdf6f5d0be2a66ad566378af"}
{"case":"gate","dtype":"bf16","phase":"decode_verify","count":65280,"sha256":"deba612e555c81b44cb06c0bdfcaf51a9beaee1ec813215d91f762a0a0f7b88c"}
{"case":"inject","dtype":"bf16","phase":"decode_verify","count":65280,"sha256":"3ce25d59ffa6aff2992424fbd04138083ce1326ed4deacdd97038e36ca9648aa"}
{"case":"gate","dtype":"f16","phase":"prefill","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f16","phase":"ar_decode","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f16","phase":"decode_verify","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f32","phase":"prefill","count":65536,"sha256":"2c5e478f548c9bf676e1fdea6501484016f0555b0ae1383a962436c0b68608cd"}
{"case":"gate","dtype":"f32","phase":"ar_decode","count":65536,"sha256":"2c5e478f548c9bf676e1fdea6501484016f0555b0ae1383a962436c0b68608cd"}
{"case":"gate","dtype":"f32","phase":"decode_verify","count":65536,"sha256":"2d2d76ac7e415cf9c9ce1bd67fc26b03ea0a62a20ba91387a609e16ee6636050"}
@@ -0,0 +1,33 @@
{"case":"environment","overrides":{"MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK":"0","MTPLX_SKIP_VERIFY_SNAPSHOT":"0","MTPLX_FAMILY_CAPTURE_COMMIT":"1","MTPLX_FUSED_HC_V3":"1","MTPLX_FUSED_GDN_INPROJ":"1","MTPLX_FUSED_GATE_UP":"1","MTPLX_FUSED_GDN_CONVNORM":"1","MTPLX_FUSED_GDN_STEP":"1","MTPLX_FUSED_CONVNORM_VERIFY":"1","MTPLX_QSA_GATHER":"1","MTPLX_COMPILED_GDN":"1","MTPLX_QWEN4EXP_COMPILE":"1","MTPLX_QWEN4_BATCHED_TARGET_DISTRIBUTIONS":"1","MTPLX_QWEN4_FIXED_M4_VERIFY":"1","MTPLX_QWEN4_COMPILED_MTP_PREPARE":"1","MTPLX_QWEN4_RELAXED_DRAFT_TIES":"1","MTPLX_QWEN4_OPDIET":"1","MTPLX_QWEN4_PLE_PREFILL_LOOKAHEAD":"1","MTPLX_QWEN4_PLE_FIRST_GATHER_EARLY":"1","MTPLX_SESSION_BANK_SHED_BOUNDARIES":"1","MTPLX_SESSION_BANK_PROTECTED_TERMINAL":"1","MTPLX_NGRAM_PREWARM":"auto","MTPLX_QWEN4_VERIFY_GLUE":"1","MTPLX_QWEN4_VERIFY_GLUE_ITEMS":"qsa_rope,qsa_rope_idx","MTPLX_QSA_M4_FUSED_KV_GATHER":"1","MTPLX_QSA_GATHER_MAX_ROWS":"32","MTPLX_BATCH_TARGET_ARRAYS":"1","MTPLX_LAZY_TARGET_DISTRIBUTIONS":"0","MTPLX_COMPILED_VERIFY":"1","MTPLX_NAX_VERIFY":"0","MTPLX_QWEN4_PREFILL_WIDE_CHUNK":"4096","MTPLX_QSA_PREFILL_WIDE_MIN_CONTEXT":"16384","MTPLX_SUSTAINED_PREFILL":"1","MTPLX_PREFILL_CHUNK_SIZE":"2048","MTPLX_CONTEXT_COPY":"0"}}
{"case":"prefill_compare","phase":"cold","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"cold","part":"hidden","shape":[1,1,10240],"exact":true}
{"case":"tokens","phase":"cold","ids":[760]}
{"case":"verify_forward","phase":"cold","index":0,"ids":[760,1156,369,9859],"logits_exact":true,"logits_sha256":"16ff543d6e28cdbe7dbd56891e061ddd4b04291a9ca25bdf1f4437b4e3c5528d","hidden_exact":true,"hidden_sha256":"b9cc3aa8c913e508793b7486f77a10e7acd4698436060b1b6bf8abfbd59edee6"}
{"case":"tokens","phase":"cold","ids":[1156]}
{"case":"tokens","phase":"cold","ids":[6587]}
{"case":"verify_forward","phase":"cold","index":1,"ids":[6587,728,310,1698],"logits_exact":true,"logits_sha256":"24e58b3561aac59d52bf55183bc9b911432481e9613a5b98f1442945bfd6903a","hidden_exact":true,"hidden_sha256":"eddb5de99ea61034c3f0eb46ef1a515cae10c92333d069afce68cc4a5e5f9e3e"}
{"case":"tokens","phase":"cold","ids":[728,310,1698]}
{"case":"tokens","phase":"cold","ids":[494]}
{"case":"verify_forward","phase":"cold","index":2,"ids":[494,799,310,5600],"logits_exact":true,"logits_sha256":"f5f2c33a36fce4088f222ec7448389865dd74ea4c017e4e2e49f157693a33d64","hidden_exact":true,"hidden_sha256":"330d68ed62e77a12e38fe7677ffd2b9548f655c7d33e6e1607e431d1b8957e86"}
{"case":"tokens","phase":"cold","ids":[799,310,5600]}
{"case":"tokens","phase":"cold","ids":[13]}
{"case":"verify_forward","phase":"cold","index":3,"ids":[13,1061],"logits_exact":true,"logits_sha256":"f44498bbf6e6e9d8d909c0e4db24b5ef9bda5866b4a6a14e188865432538643c","hidden_exact":true,"hidden_sha256":"dec8b787a562878d091c854235120732e98f5781751b6d6a428e5cd02228deb0"}
{"case":"tokens","phase":"cold","ids":[1061]}
{"case":"cache_arrays","phase":"cold","values_exact":true,"zero_sign_differences":[["trunk",35,0]],"key35_bit_coordinates":[[0,1,0,2]]}
{"case":"turn","phase":"cold","tokens":[760,1156,6587,728,310,1698,494,799,310,5600,13,1061],"cached":0,"verify_calls":4,"final_exact":true}
{"case":"prefill_compare","phase":"warm","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"warm","part":"hidden","shape":[1,18,10240],"exact":false}
{"case":"tokens","phase":"warm","ids":[760]}
{"case":"verify_forward","phase":"warm","index":0,"ids":[760,1156,6587,728],"logits_exact":true,"logits_sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082","hidden_exact":true,"hidden_sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}
{"case":"tokens","phase":"warm","ids":[1156,6587,728]}
{"case":"tokens","phase":"warm","ids":[310]}
{"case":"verify_forward","phase":"warm","index":1,"ids":[310,2962,24217,494],"logits_exact":true,"logits_sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c","hidden_exact":true,"hidden_sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}
{"case":"tokens","phase":"warm","ids":[2962,24217]}
{"case":"tokens","phase":"warm","ids":[13]}
{"case":"verify_forward","phase":"warm","index":2,"ids":[13,353,2582,3804],"logits_exact":true,"logits_sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989","hidden_exact":true,"hidden_sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}
{"case":"tokens","phase":"warm","ids":[353]}
{"case":"tokens","phase":"warm","ids":[8334]}
{"case":"verify_forward","phase":"warm","index":3,"ids":[8334,29014,494],"logits_exact":true,"logits_sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2","hidden_exact":true,"hidden_sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}
{"case":"tokens","phase":"warm","ids":[29014,494]}
{"case":"cache_arrays","phase":"warm","values_exact":true,"zero_sign_differences":[["trunk",35,0]],"key35_bit_coordinates":[[0,1,0,2]]}
{"case":"turn","phase":"warm","tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"verify_calls":4,"final_exact":true}
+3
View File
@@ -0,0 +1,3 @@
{"case":"bf16_gate","gate":-6.84375,"eager":[0.00106048583984375,0.00106048583984375,0.00106048583984375,0.00106048583984375],"compiled":[0.001068115234375,0.001068115234375,0.001068115234375,0.001068115234375]}
{"case":"qsa_divisor","operand_bits":1093993715,"eager":[0.13258253037929535,0.13258254528045654,0.0883883461356163,0.0],"compiled":[0.13258251547813416,0.13258251547813416,0.08838833123445511,0.0]}
{"case":"yarn_amplitude","operand_bits":1066516124,"eager":[1.7079442739486694,1.707944393157959,1.13862943649292,0.0],"compiled":[1.7079435586929321,1.7079436779022217,1.1386289596557617,0.0]}
@@ -0,0 +1,21 @@
{
"case": "prefill_zero_sign",
"shape": [
1,
2,
46,
256
],
"layer": 35,
"coordinate": [
0,
1,
0,
2
],
"native_bits": "0x80000000",
"oracle_bits": "0x0",
"native_sha256": "d81b466dea1ff5b774e86c0af47069f555bbb59abb0f3f61165f5bc51aa28ac6",
"oracle_sha256": "520dd44032eda4789b123296b5499afb88f0d88d6cdccffa04ebe06c2bc3a853",
"issue": 114
}
+16
View File
@@ -0,0 +1,16 @@
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,369,9859],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"16ff543d6e28cdbe7dbd56891e061ddd4b04291a9ca25bdf1f4437b4e3c5528d"},"hidden":{"shape":[1,4,10240],"sha256":"b9cc3aa8c913e508793b7486f77a10e7acd4698436060b1b6bf8abfbd59edee6"}}}
{"case":"verify_forward","record":{"index":1,"ids":[6587,728,310,1698],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"24e58b3561aac59d52bf55183bc9b911432481e9613a5b98f1442945bfd6903a"},"hidden":{"shape":[1,4,10240],"sha256":"eddb5de99ea61034c3f0eb46ef1a515cae10c92333d069afce68cc4a5e5f9e3e"}}}
{"case":"verify_forward","record":{"index":2,"ids":[494,799,310,5600],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"f5f2c33a36fce4088f222ec7448389865dd74ea4c017e4e2e49f157693a33d64"},"hidden":{"shape":[1,4,10240],"sha256":"330d68ed62e77a12e38fe7677ffd2b9548f655c7d33e6e1607e431d1b8957e86"}}}
{"case":"verify_forward","record":{"index":3,"ids":[13,1061],"verify":true,"logits":{"shape":[1,2,248320],"sha256":"f44498bbf6e6e9d8d909c0e4db24b5ef9bda5866b4a6a14e188865432538643c"},"hidden":{"shape":[1,2,10240],"sha256":"dec8b787a562878d091c854235120732e98f5781751b6d6a428e5cd02228deb0"}}}
{"case":"cold","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,1698,494,799,310,5600,13,1061],"cached":0,"state_sha256":"eb61c20e4a89bb55c0284d86587966af49d6c601e5421b50eff0762ecf6842b1"}
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,6587,728],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082"},"hidden":{"shape":[1,4,10240],"sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}}}
{"case":"verify_forward","record":{"index":1,"ids":[310,2962,24217,494],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c"},"hidden":{"shape":[1,4,10240],"sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}}}
{"case":"verify_forward","record":{"index":2,"ids":[13,353,2582,3804],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989"},"hidden":{"shape":[1,4,10240],"sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}}}
{"case":"verify_forward","record":{"index":3,"ids":[8334,29014,494],"verify":true,"logits":{"shape":[1,3,248320],"sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2"},"hidden":{"shape":[1,3,10240],"sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}}}
{"case":"warm","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198,760,1156,6587,728,310,1698,494,799,310,5600,13,1061,198,248069,271,248046,198,248045,846,198,22791,24217,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"state_sha256":"e6cb7355aaa92a3569a365c94c55aa7a50bd731dc04f6fa320da8520d182e2f8"}
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,6587,728],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082"},"hidden":{"shape":[1,4,10240],"sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}}}
{"case":"verify_forward","record":{"index":1,"ids":[310,2962,24217,494],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c"},"hidden":{"shape":[1,4,10240],"sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}}}
{"case":"verify_forward","record":{"index":2,"ids":[13,353,2582,3804],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989"},"hidden":{"shape":[1,4,10240],"sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}}}
{"case":"verify_forward","record":{"index":3,"ids":[8334,29014,494],"verify":true,"logits":{"shape":[1,3,248320],"sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2"},"hidden":{"shape":[1,3,10240],"sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}}}
{"case":"reopened","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198,760,1156,6587,728,310,1698,494,799,310,5600,13,1061,198,248069,271,248046,198,248045,846,198,22791,24217,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"state_sha256":"e6cb7355aaa92a3569a365c94c55aa7a50bd731dc04f6fa320da8520d182e2f8"}
{"case":"checkpoint","actual_old_rejected":true,"warm_reopened_state_exact":true}
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84","value_sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"},{"shape":[1,48,128,128],"sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf","value_sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}],[{"shape":[1,3,10240],"sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232","value_sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"},{"shape":[1,48,128,128],"sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf","value_sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"},{"shape":[1,9,10240],"sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08","value_sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"},{"shape":[1,2],"sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152","value_sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}],[{"shape":[1,3,10240],"sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2","value_sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"},{"shape":[1,48,128,128],"sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34","value_sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}],[{"shape":[1,2,88,256],"sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f","value_sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"},{"shape":[1,2,88,256],"sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24","value_sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"},{"shape":[1,88,128],"sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748","value_sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"},{"shape":[1,22,128],"sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a","value_sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}],[{"shape":[1,3,10240],"sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda","value_sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"},{"shape":[1,48,128,128],"sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f","value_sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}],[{"shape":[1,3,10240],"sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a","value_sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"},{"shape":[1,48,128,128],"sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f","value_sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}],[{"shape":[1,3,10240],"sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d","value_sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"},{"shape":[1,48,128,128],"sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f","value_sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}],[{"shape":[1,2,88,256],"sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b","value_sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"},{"shape":[1,2,88,256],"sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba","value_sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"},{"shape":[1,88,128],"sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae","value_sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"},{"shape":[1,22,128],"sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb","value_sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}],[{"shape":[1,3,10240],"sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57","value_sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"},{"shape":[1,48,128,128],"sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43","value_sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}],[{"shape":[1,3,10240],"sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0","value_sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"},{"shape":[1,48,128,128],"sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52","value_sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}],[{"shape":[1,3,10240],"sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc","value_sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc"},{"shape":[1,48,128,128],"sha256":"4ce5d0905ec5e5ae834215c16b25d810a5ef6e54a6d7d96f95e47720Line truncated
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84","value_sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"},{"shape":[1,48,128,128],"sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf","value_sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}],[{"shape":[1,3,10240],"sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232","value_sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"},{"shape":[1,48,128,128],"sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf","value_sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"},{"shape":[1,9,10240],"sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08","value_sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"},{"shape":[1,2],"sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152","value_sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}],[{"shape":[1,3,10240],"sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2","value_sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"},{"shape":[1,48,128,128],"sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34","value_sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}],[{"shape":[1,2,88,256],"sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f","value_sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"},{"shape":[1,2,88,256],"sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24","value_sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"},{"shape":[1,88,128],"sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748","value_sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"},{"shape":[1,22,128],"sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a","value_sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}],[{"shape":[1,3,10240],"sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda","value_sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"},{"shape":[1,48,128,128],"sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f","value_sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}],[{"shape":[1,3,10240],"sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a","value_sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"},{"shape":[1,48,128,128],"sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f","value_sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}],[{"shape":[1,3,10240],"sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d","value_sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"},{"shape":[1,48,128,128],"sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f","value_sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}],[{"shape":[1,2,88,256],"sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b","value_sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"},{"shape":[1,2,88,256],"sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba","value_sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"},{"shape":[1,88,128],"sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae","value_sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"},{"shape":[1,22,128],"sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb","value_sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}],[{"shape":[1,3,10240],"sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57","value_sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"},{"shape":[1,48,128,128],"sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43","value_sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}],[{"shape":[1,3,10240],"sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0","value_sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"},{"shape":[1,48,128,128],"sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52","value_sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}],[{"shape":[1,3,10240],"sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc","value_sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc"},{"shape":[1,48,128,128],"sha256":"4ce5d0905ec5e5ae834215c16b25d810a5ef6e54a6d7d96f95e47720Line truncated
@@ -0,0 +1 @@
{"trunk": [[{"shape": [1, 3, 10240], "sha256": "1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84", "value_sha256": "1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"}, {"shape": [1, 48, 128, 128], "sha256": "1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf", "value_sha256": "1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}], [{"shape": [1, 3, 10240], "sha256": "1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232", "value_sha256": "1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"}, {"shape": [1, 48, 128, 128], "sha256": "b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf", "value_sha256": "b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"}, {"shape": [1, 9, 10240], "sha256": "eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08", "value_sha256": "eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"}, {"shape": [1, 2], "sha256": "b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152", "value_sha256": "b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}], [{"shape": [1, 3, 10240], "sha256": "1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2", "value_sha256": "1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"}, {"shape": [1, 48, 128, 128], "sha256": "403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34", "value_sha256": "403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}], [{"shape": [1, 2, 88, 256], "sha256": "b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f", "value_sha256": "b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"}, {"shape": [1, 2, 88, 256], "sha256": "eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24", "value_sha256": "eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"}, {"shape": [1, 88, 128], "sha256": "1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748", "value_sha256": "1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"}, {"shape": [1, 22, 128], "sha256": "4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a", "value_sha256": "4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}], [{"shape": [1, 3, 10240], "sha256": "431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda", "value_sha256": "431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"}, {"shape": [1, 48, 128, 128], "sha256": "c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f", "value_sha256": "c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}], [{"shape": [1, 3, 10240], "sha256": "f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a", "value_sha256": "f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"}, {"shape": [1, 48, 128, 128], "sha256": "8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f", "value_sha256": "8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}], [{"shape": [1, 3, 10240], "sha256": "3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d", "value_sha256": "3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"}, {"shape": [1, 48, 128, 128], "sha256": "bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f", "value_sha256": "bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}], [{"shape": [1, 2, 88, 256], "sha256": "9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b", "value_sha256": "9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"}, {"shape": [1, 2, 88, 256], "sha256": "b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba", "value_sha256": "b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"}, {"shape": [1, 88, 128], "sha256": "491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae", "value_sha256": "491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"}, {"shape": [1, 22, 128], "sha256": "104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb", "value_sha256": "104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}], [{"shape": [1, 3, 10240], "sha256": "e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57", "value_sha256": "e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"}, {"shape": [1, 48, 128, 128], "sha256": "0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43", "value_sha256": "0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}], [{"shape": [1, 3, 10240], "sha256": "f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0", "value_sha256": "f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"}, {"shape": [1, 48, 128, 128], "sha256": "75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52", "value_sha256": "75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}], [{"shape": [1, 3, 10240], "sha256": "c23b7e52452271Line truncated
@@ -0,0 +1 @@
{"case":"turn","chunk":2048,"phase":"cold","cached":0,"prompt_len":7374,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,10Line truncated
@@ -0,0 +1 @@
{"case":"turn","chunk":2048,"phase":"warm","cached":7377,"prompt_len":10655,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,1Line truncated
@@ -0,0 +1 @@
{"case":"turn","chunk":4096,"phase":"cold","cached":0,"prompt_len":7374,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,10Line truncated
@@ -0,0 +1 @@
{"case":"turn","chunk":4096,"phase":"warm","cached":7377,"prompt_len":10655,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,1Line truncated
+85
View File
@@ -0,0 +1,85 @@
# Issue 110: guarded stock expert gathers
Qwen's stock MoE gathers now mirror pinned MTPLX's
`moe_sorted_gather._call_pad` / `gather_qmm` wrapper. On hardware that actually
uses NAX, an expert-sorted affine transposed `[rows, 1, K]` call above 32,767
rows is padded to the next multiple of 64 unless already aligned. Activations
are zero padded, the final expert ID is repeated, explicit left indices append
an arange in their own dtype, and the output is sliced back to its real rows.
Both separate/fused Gate/Up and Down use this entry point. The ordinary runtime
primitive and pinned 0.32.2 shader remain unchanged.
The hardware test deliberately ignores the MTPLX route-fallback switch, as the
stock MLX shader does. Unit controls exercise non-NAX and ineligible shapes;
no physical M1–M4 hardware result is claimed. This implementation is confined
to Qwen; DS4/GLM have no callers of the new wrapper. It is an oracle correctness
fix, not a new DS4Server feature.
Old checkpoint manifests lack both producer hardware and prefill chunk sizes.
Files with at least 3,277 tokens may contain affected rows and are rejected
before state restoration unless they carry the new guard policy. Short old
files remain compatible; new files retain the existing container format.
The admission test verifies rejection leaves healthy live state unchanged.
## Verification
- Original initialized-NaN low-level sentinels still demonstrate the pinned
shader defect. The same five token counts (3,276 / 3,277 / 3,404 / 4,095 /
4,096) now additionally execute the real guarded graph and require every
returned row to equal the exact expected BF16 value, with original shape.
- Installed layer-0 weights exercise 512 experts, fused Gate/Up K=2560/N=1280
and Down K=640/N=2560, group64/4-bit. All output bytes match the pinned guarded
oracle at 20,480 / 32,760 / 32,770 / 34,040 / 40,950 / 40,960 rows. Explicit
reverse left indices at 34,040 rows also match. Sentinel weights control
group32/4-bit; the unchanged runtime-gather suites cover other dispatches.
- The current optimized oracle's row-map SwiGLU equals its guarded stock chain
byte-for-byte at 2,048 / 3,277 / 4,095 / 4,096 tokens, with successful first-use
canaries in both narrow/wide regimes and actual kernel engagement recorded.
This is an oracle control. The native optimized route belongs to #112.
- Allocation refusal releases the failed padded graph; a fresh valid retry
computes all rows exactly and returns allocator activity to zero.
- Full-model cold and warm checks use actual server execution defaults, greedy
generation, 7,374 cold tokens, then a 3,278-token suffix. Both 2,048 and 4,096
chunk sizes are exercised. `MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0` is explicit:
default boundary splitting would divide the final partial span into 256-row
pieces and conceal this reproduction. Cold and warm affected body spans are
3,277 tokens; cancellation occurs after a settled affected chunk and preserves
the committed state for retry. The default 2,048 size remains a control.
All four full-model cases match the oracle byte-for-byte in final logits, token
IDs and every saved trunk/cache tensor. The required formatting, warnings-denied
Clippy, signed bundle and ordinary tests pass (309 application + 8 tool tests).
The official focused upstream suite passes 16 tests, including both block
equivalence variants with the canary/kernel active. One ordinary-suite run hit
the unrelated numeric Git-revision YAML fixture flake tracked as #115; the
unchanged suite passed on rerun.
The oracle is MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112` with MLX exactly
0.32.2 and the unchanged installed Bare-Speed revision from
`../issue104-ar/environment.json`. No runtime/assets/default chunk changes or
performance claims accompany this correctness fix. See `checks.json` and
adjacent receipts for actual completed results.
## Reproduction
```sh
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue110-reference.py /path/to/pinned/mtplx /path/to/model \
> /tmp/issue110-oracle.jsonl
cargo test --all-features --bin ds4-server --no-run
cargo build --bin test-supervisor
export DS4_QWEN38_ARTIFACTS=/path/to/model
export DS4_ISSUE110_ORACLE=/tmp/issue110-oracle.jsonl
# Use the executable printed by cargo; run GPU processes serially.
target/debug/test-supervisor 4096 60 120 --command TEST_EXECUTABLE \
issue103_sorted_gather_receipts --ignored --nocapture --test-threads=1
target/debug/test-supervisor 16384 60 120 --command TEST_EXECUTABLE \
issue110_actual_projection_rows_match_oracle --ignored --nocapture --test-threads=1
export DS4_ISSUE110_DIR=/tmp/issue110-product
export MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0
target/debug/test-supervisor 114688 60 120 --command TEST_EXECUTABLE \
issue110_large_cold_and_warm_prefill --ignored --nocapture --test-threads=1
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue110-model-reference.py /path/to/pinned/mtplx \
"$DS4_QWEN38_ARTIFACTS" "$DS4_ISSUE110_DIR" /tmp/issue110-model-oracle
```
@@ -0,0 +1,2 @@
{"case":"allocation_refusal","limit":1,"partial_peak":4096,"released":true,"retry_exact":true}
{"case":"allocation_refusal","limit":2,"partial_peak":151552,"released":true,"retry_exact":true}
+138
View File
@@ -0,0 +1,138 @@
[
{
"check": "fmt",
"passed": true
},
{
"check": "clippy",
"passed": true
},
{
"check": "bundle",
"passed": true
},
{
"check": "tests",
"passed": true,
"results": [
"test result: ok. 309 passed; 0 failed; 224 ignored; 0 measured; 0 filtered out; finished in 5.31s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.36s"
],
"prior_run": "Unrelated all-decimal Git SHA YAML fixture failure (9839678), tracked separately as #115; unchanged rerun passed."
},
{
"check": "sentinel",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 531 filtered out; finished in 2.15s"
],
"resources": {
"elapsed_ms": 3104,
"error": null,
"peak_physical_bytes": 551748736
}
},
{
"check": "projections",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 531 filtered out; finished in 57.88s"
],
"resources": {
"elapsed_ms": 57987,
"error": null,
"peak_physical_bytes": 5888003816
}
},
{
"check": "allocation",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 0.69s"
],
"resources": {
"elapsed_ms": 1711,
"error": null,
"peak_physical_bytes": 224527224
}
},
{
"check": "codec",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 0.06s"
],
"resources": {
"elapsed_ms": 105,
"error": null,
"peak_physical_bytes": 180296
}
},
{
"check": "final-product",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 119.17s"
],
"profile": "Server defaults, MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0; chunks 2048/4096",
"resources": {
"elapsed_ms": 120155,
"error": null,
"peak_physical_bytes": 102111559024
}
},
{
"check": "model-oracle",
"passed": true,
"profile": "Server defaults, MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0; chunks 2048/4096",
"resources": {
"elapsed_ms": 34036,
"error": null,
"peak_physical_bytes": 93475651360
}
},
{
"check": "graph-control",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 0.72s"
],
"resources": {
"elapsed_ms": 751,
"error": null,
"peak_physical_bytes": 155943800
}
},
{
"check": "runtime-control",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 7.43s"
],
"resources": {
"elapsed_ms": 7515,
"error": null,
"peak_physical_bytes": 313934784
}
},
{
"check": "route-switch",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 532 filtered out; finished in 2.23s"
],
"resources": {
"elapsed_ms": 2264,
"error": null,
"peak_physical_bytes": 528237648
}
},
{
"check": "upstream",
"passed": true,
"results": [
"16 passed in 0.74s"
]
}
]
@@ -0,0 +1,16 @@
{"case":"token","chunk":2048,"phase":"cold","ids":[374]}
{"case":"token","chunk":2048,"phase":"cold","ids":[264]}
{"case":"token","chunk":2048,"phase":"cold","ids":[1092]}
{"case":"turn","chunk":2048,"phase":"cold","exact":true,"cached":0,"tokens":[374,264,1092],"guard_before":{"padded_calls":0,"padded_rows":0},"guard_after":{"padded_calls":0,"padded_rows":0},"kernel":{"calls":192,"fallbacks":0,"canaries":1,"canary_failures":0,"header_failures":0}}
{"case":"token","chunk":2048,"phase":"warm","ids":[1075]}
{"case":"token","chunk":2048,"phase":"warm","ids":[374]}
{"case":"token","chunk":2048,"phase":"warm","ids":[264]}
{"case":"turn","chunk":2048,"phase":"warm","exact":true,"cached":7377,"tokens":[1075,374,264],"guard_before":{"padded_calls":0,"padded_rows":0},"guard_after":{"padded_calls":0,"padded_rows":0},"kernel":{"calls":288,"fallbacks":0,"canaries":1,"canary_failures":0,"header_failures":0}}
{"case":"token","chunk":4096,"phase":"cold","ids":[374]}
{"case":"token","chunk":4096,"phase":"cold","ids":[264]}
{"case":"token","chunk":4096,"phase":"cold","ids":[1092]}
{"case":"turn","chunk":4096,"phase":"cold","exact":true,"cached":0,"tokens":[374,264,1092],"guard_before":{"padded_calls":0,"padded_rows":0},"guard_after":{"padded_calls":48,"padded_rows":2976},"kernel":{"calls":384,"fallbacks":0,"canaries":2,"canary_failures":0,"header_failures":0}}
{"case":"token","chunk":4096,"phase":"warm","ids":[1075]}
{"case":"token","chunk":4096,"phase":"warm","ids":[374]}
{"case":"token","chunk":4096,"phase":"warm","ids":[264]}
{"case":"turn","chunk":4096,"phase":"warm","exact":true,"cached":7377,"tokens":[1075,374,264],"guard_before":{"padded_calls":48,"padded_rows":2976},"guard_after":{"padded_calls":96,"padded_rows":5952},"kernel":{"calls":432,"fallbacks":0,"canaries":2,"canary_failures":0,"header_failures":0}}
@@ -0,0 +1,5 @@
{"case":"turn","chunk":2048,"phase":"cold","cached":0,"prompt_len":7374,"generated":[374,264,1092],"padded_calls":0}
{"case":"turn","chunk":2048,"phase":"warm","cached":7377,"prompt_len":10655,"generated":[1075,374,264],"padded_calls":0}
{"case":"turn","chunk":4096,"phase":"cold","cached":0,"prompt_len":7374,"generated":[374,264,1092],"padded_calls":96}
{"case":"cancel","chunk":4096,"saved_state_unchanged":true}
{"case":"turn","chunk":4096,"phase":"warm","cached":7377,"prompt_len":10655,"generated":[1075,374,264],"padded_calls":96}
@@ -0,0 +1,18 @@
{"case": "projection", "projection": "gate_up", "rows": 20480, "k": 2560, "n": 1280, "left": false, "sha256": "ae97282624851e970b417c37b5a0f3896c6f1c56cbfb0735d76790d81cfc1d1b", "pad": 0, "guard_before": {"padded_calls": 0, "padded_rows": 0}, "guard_after": {"padded_calls": 0, "padded_rows": 0}}
{"case": "projection", "projection": "down", "rows": 20480, "k": 640, "n": 2560, "left": false, "sha256": "2d1a21b02bedf3f6c34df282d898c18fa9f7d71a67b5245f5967605e5457e13a", "pad": 0, "guard_before": {"padded_calls": 0, "padded_rows": 0}, "guard_after": {"padded_calls": 0, "padded_rows": 0}}
{"case": "projection", "projection": "gate_up", "rows": 32760, "k": 2560, "n": 1280, "left": false, "sha256": "f3d7fd1a7df2efd8a43d365f1a30aa480efe61b7655641fcf71cb0f0492d7c52", "pad": 0, "guard_before": {"padded_calls": 0, "padded_rows": 0}, "guard_after": {"padded_calls": 0, "padded_rows": 0}}
{"case": "projection", "projection": "down", "rows": 32760, "k": 640, "n": 2560, "left": false, "sha256": "ee5f7dd6cc53fa680c985a1c56ca752dd7243f6a2663a9a870eccb4f2b8f68e8", "pad": 0, "guard_before": {"padded_calls": 0, "padded_rows": 0}, "guard_after": {"padded_calls": 0, "padded_rows": 0}}
{"case": "projection", "projection": "gate_up", "rows": 32770, "k": 2560, "n": 1280, "left": false, "sha256": "92dd7f20255bcf2e205a6d8e708ae450b47024ff12839cb393c1160db5af33aa", "pad": 62, "guard_before": {"padded_calls": 0, "padded_rows": 0}, "guard_after": {"padded_calls": 1, "padded_rows": 62}}
{"case": "projection", "projection": "down", "rows": 32770, "k": 640, "n": 2560, "left": false, "sha256": "66e37f134a0183977ee1a39a3afd70e09160efab3ceee2b68d8caa7c49390e2a", "pad": 62, "guard_before": {"padded_calls": 1, "padded_rows": 62}, "guard_after": {"padded_calls": 2, "padded_rows": 124}}
{"case": "projection", "projection": "gate_up", "rows": 34040, "k": 2560, "n": 1280, "left": false, "sha256": "ca7dcdcd30ad27c0936420180e42d637009d90372f1e702f79847851831de071", "pad": 8, "guard_before": {"padded_calls": 2, "padded_rows": 124}, "guard_after": {"padded_calls": 3, "padded_rows": 132}}
{"case": "projection", "projection": "gate_up", "rows": 34040, "k": 2560, "n": 1280, "left": true, "sha256": "d79b05579846810a34b955ef65535adba962d9d02a17bb0ecace423c6ce0791c", "pad": 8, "guard_before": {"padded_calls": 3, "padded_rows": 132}, "guard_after": {"padded_calls": 4, "padded_rows": 140}}
{"case": "projection", "projection": "down", "rows": 34040, "k": 640, "n": 2560, "left": false, "sha256": "53768e60df9fad3dc06641f5245e6f67ac28e1278dc8fec8e62486858f2de341", "pad": 8, "guard_before": {"padded_calls": 4, "padded_rows": 140}, "guard_after": {"padded_calls": 5, "padded_rows": 148}}
{"case": "projection", "projection": "down", "rows": 34040, "k": 640, "n": 2560, "left": true, "sha256": "f02f45549d38acd5979cdd768305b39268493449191a0a232514978a4015a658", "pad": 8, "guard_before": {"padded_calls": 5, "padded_rows": 148}, "guard_after": {"padded_calls": 6, "padded_rows": 156}}
{"case": "projection", "projection": "gate_up", "rows": 40950, "k": 2560, "n": 1280, "left": false, "sha256": "393e33c2576b26e23f6b91bf2ff2ea7e590322a8cfb88a237d7e90cfea74acc8", "pad": 10, "guard_before": {"padded_calls": 6, "padded_rows": 156}, "guard_after": {"padded_calls": 7, "padded_rows": 166}}
{"case": "projection", "projection": "down", "rows": 40950, "k": 640, "n": 2560, "left": false, "sha256": "e66a8a49018a918e26e3f56a8859ab7894e3d75f0951858e43856fbe6052616e", "pad": 10, "guard_before": {"padded_calls": 7, "padded_rows": 166}, "guard_after": {"padded_calls": 8, "padded_rows": 176}}
{"case": "projection", "projection": "gate_up", "rows": 40960, "k": 2560, "n": 1280, "left": false, "sha256": "29b3628139c5f7c49d5b5b46134a3141958e9a9bc3360956a770ec3d5b65af5d", "pad": 0, "guard_before": {"padded_calls": 8, "padded_rows": 176}, "guard_after": {"padded_calls": 8, "padded_rows": 176}}
{"case": "projection", "projection": "down", "rows": 40960, "k": 640, "n": 2560, "left": false, "sha256": "d40d0c9c449d3ac4631a43f775815d1baea299dbfbee39c7585bad4997e61237", "pad": 0, "guard_before": {"padded_calls": 8, "padded_rows": 176}, "guard_after": {"padded_calls": 8, "padded_rows": 176}}
{"case": "optimized_oracle_control", "tokens": 2048, "rows": 20480, "exact": true, "sha256": "c53aac85f49f4c1b6c11e3da858d2abf4e43de241bf3c0347d2590d0181e2249", "kernel_before": {"calls": 0, "fallbacks": 0, "canaries": 0, "canary_failures": 0, "header_failures": 0}, "kernel_after": {"calls": 1, "fallbacks": 0, "canaries": 1, "canary_failures": 0, "header_failures": 0}}
{"case": "optimized_oracle_control", "tokens": 3277, "rows": 32770, "exact": true, "sha256": "10f573d0eaf5169475781c4f75eb923fa06d7f88d1684a6d5d2ce8acfdc526a4", "kernel_before": {"calls": 1, "fallbacks": 0, "canaries": 1, "canary_failures": 0, "header_failures": 0}, "kernel_after": {"calls": 2, "fallbacks": 0, "canaries": 2, "canary_failures": 0, "header_failures": 0}}
{"case": "optimized_oracle_control", "tokens": 4095, "rows": 40950, "exact": true, "sha256": "738212404e537f0608d4e9c9b8d0e5ff2061587197c3391b1220975f93dd8d9f", "kernel_before": {"calls": 2, "fallbacks": 0, "canaries": 2, "canary_failures": 0, "header_failures": 0}, "kernel_after": {"calls": 3, "fallbacks": 0, "canaries": 2, "canary_failures": 0, "header_failures": 0}}
{"case": "optimized_oracle_control", "tokens": 4096, "rows": 40960, "exact": true, "sha256": "e1a6630ec5cd7e523c98eb352e328560fdd733a640fc7dd69a5a96e14b462d15", "kernel_before": {"calls": 3, "fallbacks": 0, "canaries": 2, "canary_failures": 0, "header_failures": 0}, "kernel_after": {"calls": 4, "fallbacks": 0, "canaries": 2, "canary_failures": 0, "header_failures": 0}}
@@ -0,0 +1,13 @@
{"case":"projection","projection":"down","rows":20480,"k":640,"n":2560,"left":false,"exact":true,"sha256":"2d1a21b02bedf3f6c34df282d898c18fa9f7d71a67b5245f5967605e5457e13a","dispatches":"[(\"arangeuint32\", [20480, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_32_bn_64_bk_64_wm_2_wn_2\", [40, 640, 1], [32, 2, 2], false)]"}
{"case":"projection","projection":"gate_up","rows":32760,"k":2560,"n":1280,"left":false,"exact":true,"sha256":"f3d7fd1a7df2efd8a43d365f1a30aa480efe61b7655641fcf71cb0f0492d7c52","dispatches":"[(\"arangeuint32\", [32760, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_32_bn_64_bk_64_wm_2_wn_2\", [20, 1024, 1], [32, 2, 2], false)]"}
{"case":"projection","projection":"down","rows":32760,"k":640,"n":2560,"left":false,"exact":true,"sha256":"ee5f7dd6cc53fa680c985a1c56ca752dd7243f6a2663a9a870eccb4f2b8f68e8","dispatches":"[(\"arangeuint32\", [32760, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_32_bn_64_bk_64_wm_2_wn_2\", [40, 1024, 1], [32, 2, 2], false)]"}
{"case":"projection","projection":"gate_up","rows":32770,"k":2560,"n":1280,"left":false,"exact":true,"sha256":"92dd7f20255bcf2e205a6d8e708ae450b47024ff12839cb393c1160db5af33aa","dispatches":"[(\"sn_copybfloat16bfloat16\", [39680, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [32770, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [62, 1, 1], [32, 1, 1], true), (\"arangeuint32\", [32832, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [83891200, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [158720, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [20, 513, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [41945600, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"down","rows":32770,"k":640,"n":2560,"left":false,"exact":true,"sha256":"66e37f134a0183977ee1a39a3afd70e09160efab3ceee2b68d8caa7c49390e2a","dispatches":"[(\"s_copybfloat16bfloat16\", [39680, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [32770, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [62, 1, 1], [32, 1, 1], true), (\"arangeuint32\", [32832, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [20972800, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [39680, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [40, 513, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [83891200, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"gate_up","rows":34040,"k":2560,"n":1280,"left":false,"exact":true,"sha256":"ca7dcdcd30ad27c0936420180e42d637009d90372f1e702f79847851831de071","dispatches":"[(\"s_copybfloat16bfloat16\", [20480, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [8, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [34048, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [87142400, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [20480, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [20, 532, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [43571200, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"gate_up","rows":34040,"k":2560,"n":1280,"left":true,"exact":true,"sha256":"d79b05579846810a34b955ef65535adba962d9d02a17bb0ecace423c6ce0791c","dispatches":"[(\"arangeint32\", [8, 1, 1], [8, 1, 1], true), (\"gg1_copyint32int32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyint32int32\", [8, 1, 1], [8, 1, 1], true), (\"s_copybfloat16bfloat16\", [20480, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [8, 1, 1], [8, 1, 1], true), (\"v_copyint32uint32\", [34048, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [87142400, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [20480, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmv_fast_bfloat16_t_gs_64_b_4\", [1, 160, 34048], [32, 2, 1], false), (\"g1_copybfloat16bfloat16\", [43571200, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"down","rows":34040,"k":640,"n":2560,"left":false,"exact":true,"sha256":"53768e60df9fad3dc06641f5245e6f67ac28e1278dc8fec8e62486858f2de341","dispatches":"[(\"s_copybfloat16bfloat16\", [5120, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [8, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [34048, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [21785600, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [5120, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [40, 532, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [87142400, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"down","rows":34040,"k":640,"n":2560,"left":true,"exact":true,"sha256":"f02f45549d38acd5979cdd768305b39268493449191a0a232514978a4015a658","dispatches":"[(\"arangeint32\", [8, 1, 1], [8, 1, 1], true), (\"gg1_copyint32int32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyint32int32\", [8, 1, 1], [8, 1, 1], true), (\"s_copybfloat16bfloat16\", [5120, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [8, 1, 1], [8, 1, 1], true), (\"v_copyint32uint32\", [34048, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [21785600, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [5120, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmv_bfloat16_t_gs_64_b_4\", [1, 320, 34048], [32, 2, 1], false), (\"g1_copybfloat16bfloat16\", [87142400, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"gate_up","rows":40950,"k":2560,"n":1280,"left":false,"exact":true,"sha256":"393e33c2576b26e23f6b91bf2ff2ea7e590322a8cfb88a237d7e90cfea74acc8","dispatches":"[(\"s_copybfloat16bfloat16\", [25600, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [40950, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [10, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [104832000, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [25600, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [20, 640, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [52416000, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"down","rows":40950,"k":640,"n":2560,"left":false,"exact":true,"sha256":"e66a8a49018a918e26e3f56a8859ab7894e3d75f0951858e43856fbe6052616e","dispatches":"[(\"s_copybfloat16bfloat16\", [6400, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [40950, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [10, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [26208000, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [6400, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [40, 640, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [104832000, 1, 1], [1024, 1, 1], true)]"}
{"case":"projection","projection":"gate_up","rows":40960,"k":2560,"n":1280,"left":false,"exact":true,"sha256":"29b3628139c5f7c49d5b5b46134a3141958e9a9bc3360956a770ec3d5b65af5d","dispatches":"[(\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [20, 640, 1], [32, 2, 2], false)]"}
{"case":"projection","projection":"down","rows":40960,"k":640,"n":2560,"left":false,"exact":true,"sha256":"d40d0c9c449d3ac4631a43f775815d1baea299dbfbee39c7585bad4997e61237","dispatches":"[(\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_64_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [40, 640, 1], [32, 2, 2], false)]"}
@@ -0,0 +1,9 @@
{"case":"guarded_sentinel","tokens":3276,"rows":32760,"bad_rows":0,"shape":[32760,1,256],"dispatches":"[(\"arangeuint32\", [32760, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 512, 1], [32, 2, 2], false)]"}
{"case":"sorted_gather","tokens":3277,"routed_rows":32770,"bad_rows":32,"first_bad":0,"last_bad":31,"dispatches":"[(\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 513, 1], [32, 2, 2], false)]"}
{"case":"guarded_sentinel","tokens":3277,"rows":32770,"bad_rows":0,"shape":[32770,1,256],"dispatches":"[(\"s_copybfloat16bfloat16\", [15872, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [32770, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [62, 1, 1], [32, 1, 1], true), (\"arangeuint32\", [32832, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [8389120, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [15872, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 513, 1], [32, 2, 2], false), (\"g1_copybfloat16bfloat16\", [8389120, 1, 1], [1024, 1, 1], true)]"}
{"case":"sorted_gather","tokens":3404,"routed_rows":34040,"bad_rows":1280,"first_bad":0,"last_bad":1279,"dispatches":"[(\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 532, 1], [32, 2, 2], false)]"}
{"case":"guarded_sentinel","tokens":3404,"rows":34040,"bad_rows":0,"shape":[34040,1,256],"dispatches":"[(\"s_copybfloat16bfloat16\", [2048, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [34040, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [8, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [34048, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [8714240, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [2048, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 532, 1], [32, 2, 2], false)]"}
{"case":"sorted_gather","tokens":4095,"routed_rows":40950,"bad_rows":8192,"first_bad":0,"last_bad":8191,"dispatches":"[(\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 640, 1], [32, 2, 2], false)]"}
{"case":"guarded_sentinel","tokens":4095,"rows":40950,"bad_rows":0,"shape":[40950,1,256],"dispatches":"[(\"s_copybfloat16bfloat16\", [2560, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [40950, 1, 1], [1024, 1, 1], true), (\"gg1_copyuint32uint32\", [10, 1, 1], [8, 1, 1], true), (\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [10483200, 1, 1], [1024, 1, 1], true), (\"gg1_copybfloat16bfloat16\", [2560, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 640, 1], [32, 2, 2], false)]"}
{"case":"sorted_gather","tokens":4096,"routed_rows":40960,"bad_rows":0,"first_bad":null,"last_bad":null,"dispatches":"[(\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 640, 1], [32, 2, 2], false)]"}
{"case":"guarded_sentinel","tokens":4096,"rows":40960,"bad_rows":0,"shape":[40960,1,256],"dispatches":"[(\"arangeuint32\", [40960, 1, 1], [1024, 1, 1], true), (\"affine_gather_qmm_rhs_nax_nt_bfloat16_t_gs_32_b_4_bm_64_bn_64_bk_64_wm_2_wn_2\", [4, 640, 1], [32, 2, 2], false)]"}
+96
View File
@@ -0,0 +1,96 @@
# Qwen Unicode number boundaries (#111)
The Qwen-only splitter now implements the trained Qwen3 expression using the
existing Rust regex dependency. Its unsupported whitespace lookahead is handled
by retaining the last whitespace scalar for the following match. Both plain and
rendered tokenization dispatch to it. GLM still calls the unchanged DS4 GPT4
splitter with three-digit grouping; DeepSeek still calls unchanged JoyAI code.
Vocabulary, merges, Unicode tables, sampling and checkpoint formats are unchanged.
Oracle: MTPLX 2.12.2 `9882703f3105363ddc37eca9f97aa09a1d387112`, installed
Bare-Speed artifact `74559cdf34fbfc0b593de72d17e93f37fd4f9ea7`, MLX 0.32.2.
Artifact and environment fingerprints are in ../issue104-ar/environment.json.
DS4 `ec7642cdd9ec81d01ad4b1fd8f8a3d1511533748`; exact executable hash in ds4.json.
Native baseline is `990abb4755f3aa38babfb819f84fe1ab9bb018da`.
## Isolated results and review
- All 1,112,064 Unicode scalars in letter/space context: 2,082,513 split pieces,
exactly the oracle digest `7ef8755fb56062d9695b38bc132f325ea59c3c65f198e1b1ab20bff1afef632a`.
- All 1,911 oracle number characters (Nd/Nl/No) with spaces, neighboring letters
and combining marks, plus language/code/punctuation/contraction/newline/tail
whitespace controls: 5,752 exact split and BPE cases, both entry points, exact
original-byte decode round trips. Original #103 regression: zero mismatches.
- Full three-message requests and history+continuation IDs match the unmodified
pinned server in direct/low/medium/xhigh modes: 59/93/63/105 context tokens.
- GLM and DeepSeek: exact DS4 IDs on 19 shared controls, plain and rendered,
before and after. Existing three-turn DS4 chat fixtures also pass both before
and after. Baseline executable used the committed tokenizer source plus only
the test module; legacy-requests.json contains its actual rendered request IDs.
- Installed-model product owner: prefill/save/reopen actual old IDs (89 tokens),
align against corrected request (93 tokens), verify complete cache reset, then
generate cold. Corrected warm and disk-restored continuations each reuse 95
tokens and produce byte-identical complete snapshot hashes. Peak supervised
physical footprint about 77.2 GB; no memory or idle limit violation.
- Caller review: only the two Qwen dispatch arms change. Both feed the existing
byte BPE. Shared DS4 Unicode tables and three-digit rule remain unchanged.
`QwenExecutor::align_prompt` retains exact token-prefix selection and clears
incompatible state; compatible new checkpoints continue to load normally.
### Separate pre-existing contracts
This issue explicitly excludes Unicode normalization. qwen.json retains both
component `ids` and unmodified full-oracle `full_ids`. The component oracle removes
only NFC, leaving trained split/BPE intact. 5,751 cases match the full oracle too;
one decomposed combining-mark control differs because native NFC is missing.
normalization-gap.json preserves that exact difference, tracked as #116. This is
not a claim of complete Qwen tokenizer parity before #116.
Direct-mode history fixtures use empty reasoning, as generated in that mode.
Switching a reasoning conversation to direct mode exposes another existing
renderer difference: native preserves its historical reasoning while MTPLX drops
it. This is separately tracked as #117. Nonempty reasoning history is tested in
all three reasoning modes here.
## Reproduce
Generate fixtures with the unchanged model assets and isolated oracle environment:
```sh
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue111-reference.py /path/to/pinned/mtplx "$DS4_QWEN38_ARTIFACTS" /tmp/issue111-oracle \
--ds4 /path/to/ds4/ds4 --glm /path/to/GLM.gguf --deepseek /path/to/DeepSeek.gguf
cargo test --all-features --bin ds4-server issue111 --no-run
cargo build --bin test-supervisor
export DS4_ISSUE111_ORACLE="$PWD/docs/issue111-tokenizer"
export DS4_ISSUE111_DIR=/tmp/issue111-product
# Use the emitted test executable after compilation finishes.
target/debug/test-supervisor 4096 60 120 --command /path/to/test-binary \
engine::tokenizer::issue111 --ignored --nocapture --test-threads=1
# Run GPU work serially.
target/debug/test-supervisor 114688 60 120 --command /path/to/test-binary \
issue111_token_prefix_cache --ignored --nocapture --test-threads=1
DS4SERVER_CHAT_REFERENCE="$PWD/docs/issue111-tokenizer/deepseek-chat.json" \
/path/to/test-binary ds4_chat_matches_original_session_tokens --ignored --nocapture
DS4SERVER_CHAT_REFERENCE="$PWD/docs/issue111-tokenizer/glm-chat.json" \
/path/to/test-binary ds4_chat_matches_original_session_tokens --ignored --nocapture
```
Set DS4_QWEN38_ARTIFACTS to the model directory. DS4 fixture model paths can be
updated for another machine without changing IDs. Baseline and native logs,
product receipt, exact oracle IDs and split digest are retained here. The small
`qwen_split_boundaries` regression also runs without model assets in ordinary tests.
This is an MTPLX compatibility fix; DS4/GLM behavior is intentionally preserved.
Commit gates passed: rustfmt check, all-target/all-feature Clippy with warnings
denied, release app bundle with ad-hoc signing, and 310 application + 8 tool tests
(228 opt-in tests ignored by the ordinary gate). Pinned upstream tokenizer tests:
5 passed; the one 27B Quality-pack test skipped because that distinct model pack
is not installed. The installed Flash Next model was exercised above.
## Follow-up #116
NFC is now implemented. The component-stage test still checks every original
normalization-free split/BPE ID; it additionally checks the full tokenizer against
all `full_ids` and the normalized decode, closing the one-case gap documented
above. See `../issue116-nfc/` for full normalization and cache migration receipts.
+9
View File
@@ -0,0 +1,9 @@
running 2 tests
test engine::tokenizer::issue111::issue111_ds4_families ... {"case":"ds4_control","family":"glm","cases":19,"plain_rendered_exact":true}
{"case":"ds4_control","family":"deepseek","cases":19,"plain_rendered_exact":true}
ok
test engine::tokenizer::issue111::issue111_legacy_requests ... ok
test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 533 filtered out; finished in 0.80s
+8
View File
@@ -0,0 +1,8 @@
cargo build --release --all-targets --all-features
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `release` profile [optimized] target(s) in 38.38s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
cargo packager --release --formats app
codesign --force --deep --sign - --timestamp=none target/release/DS4Server.app
target/release/DS4Server.app: replacing existing signature
+4
View File
@@ -0,0 +1,4 @@
Checking ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
Finished `dev` profile [unoptimized + debuginfo] target(s) in 4.95s
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
File diff suppressed because it is too large. Load diff
+28
View File
@@ -0,0 +1,28 @@
before chat-token-fixture.json
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 534 filtered out; finished in 0.14s
before glm-chat-token-fixture.json
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 534 filtered out; finished in 0.23s
after chat-token-fixture.json
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 537 filtered out; finished in 0.15s
after glm-chat-token-fixture.json
running 1 test
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 537 filtered out; finished in 0.23s
+1
View File
@@ -0,0 +1 @@
{"revision": "ec7642cdd9ec81d01ad4b1fd8f8a3d1511533748", "binary_sha256": "53eae11b7d98f4f73435d28753870b6338a8740cd6084e028d8ed9fdd45d3111", "families": [{"family": "glm", "model": "/Users/gb/Library/Application Support/de.rfc1437.ds4server/models/glm-5.3-flash/GLM-5.3-Flash-Q2.gguf", "cases": [{"text": " ①", "ids": [111229]}, {"text": " Ⅷ", "ids": [2858, 91001]}, {"text": " ²", "ids": [2139, 110]}, {"text": " 𝟘", "ids": [80590, 253, 246]}, {"text": "Item ①, Ⅷ, ², 𝟘 and 123.", "ids": [1234, 111229, 11, 2858, 91001, 11, 2139, 110, 11, 80590, 253, 246, 323, 220, 108714, 13]}, {"text": "भारत एक विशाल देश है जिसकी संस्कृति बहुत पुरानी है।", "ids": [151387, 31280, 108, 78601, 14913, 237, 64234, 14913, 113, 42069, 114, 31280, 110, 14913, 99, 54418, 114, 83615, 151404, 14913, 250, 42069, 116, 64234, 43397, 67662, 71759, 77740, 30366, 243, 151400, 78601, 38643, 14913, 105, 93158, 72094, 78601, 82946, 72094, 43923, 31280, 101, 43397, 83615, 151404, 151430]}, {"text": "ประเทศไทยมีวัฒนธรรมที่เก่าแก่และสวยงามมาก", "ids": [54318, 22230, 71712, 27796, 35705, 153221, 49438, 35705, 34339, 26201, 28221, 37019, 23208, 153214, 20144, 153215, 22230, 22230, 26201, 35705, 46880, 27796, 25122, 64270, 70767, 25122, 18592, 70767, 31649, 71712, 35470, 37019, 34339, 30317, 20728, 26201, 26201, 20728, 25122]}, {"text": "الْعَرَبِيَّةُ", "ids": [31251, 58985, 23161, 27815, 11066, 27815, 21310, 52357, 14548, 132158, 25790, 64137]}, {"text": "The quick brown fox jumps over the lazy dog.", "ids": [785, 3974, 13867, 38627, 34041, 916, 279, 15666, 5562, 13]}, {"text": "中文,标点。", "ids": [102169, 3837, 98593, 98428, 1773]}, {"text": "def f(x):\n return x + 123\n", "ids": [750, 282, 2075, 982, 262, 470, 856, 488, 220, 108714, 198]}, {"text": "I'm WE'RE it's he'd I'll you've can't 'ſx", "ids": [40, 2776, 19640, 93362, 432, 594, 566, 4172, 358, 3278, 498, 3003, 646, 944, 364, 153000, 87]}, {"text": "́a á ́ १́b", "ids": [53481, 64, 264, 53481, 220, 53481, 220, 151433, 53481, 65]}, {"text": "a\r\n b\t\t", "ids": [64, 319, 220, 293, 298]}, {"text": "a ", "ids": [64, 262]}, {"text": "a\t  b", "ids": [64, 3677, 103245, 65]}, {"text": "a… b", "ids": [64, 126, 227, 4102, 65]}, {"text": "x \n \r\n y", "ids": [87, 715, 2529, 256, 379]}, {"text": "😀 ①🙂Ⅷ ²+𝟘", "ids": [152336, 111229, 152402, 69942, 100, 2139, 110, 10, 55873, 253, 246]}]}, {"family": "deepseek", "model": "/Users/gb/Library/Application Support/de.rfc1437.ds4server/models/deepseek-v4-flash-0731/DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-0731.gguf", "cases": [{"text": " ①", "ids": [1327, 242, 257]}, {"text": " Ⅷ", "ids": [1327, 230, 103]}, {"text": " ²", "ids": [1203, 113]}, {"text": " 𝟘", "ids": [223, 70958, 249]}, {"text": "Item ①, Ⅷ, ², 𝟘 and 123.", "ids": [7519, 1327, 242, 257, 14, 1327, 230, 103, 14, 1203, 113, 14, 223, 70958, 249, 305, 223, 6895, 16]}, {"text": "भारत एक विशाल देश है जिसकी संस्कृति बहुत पुरानी है।", "ids": [34952, 17989, 8422, 66862, 48957, 117, 31639, 26227, 79882, 35674, 27039, 64689, 11018, 8714, 58501, 11931, 61515, 32774, 52058, 28568, 18359, 11634, 8422, 14410, 56275, 22336, 8714, 35674, 4361]}, {"text": "ประเทศไทยมีวัฒนธรรมที่เก่าแก่และสวยงามมาก", "ids": [113424, 9289, 125977, 5689, 13307, 15316, 64120, 8429, 2952, 22401, 1979, 6565, 24208]}, {"text": "الْعَرَبِيَّةُ", "ids": [1712, 9821, 1183, 52748, 61079, 47029, 106817, 7680]}, {"text": "The quick brown fox jumps over the lazy dog.", "ids": [671, 4787, 13769, 46012, 54994, 1060, 270, 41638, 6397, 16]}, {"text": "中文,标点。", "ids": [21134, 303, 1701, 985, 320]}, {"text": "def f(x):\n return x + 123\n", "ids": [3465, 285, 4042, 3395, 361, 1354, 1527, 940, 223, 6895, 201]}, {"text": "I'm WE'RE it's he'd I'll you've can't 'ſx", "ids": [43, 4571, 33418, 9, 3827, 436, 734, 468, 7485, 342, 5922, 440, 5270, 588, 1664, 905, 75929, 90]}, {"text": "́a á ́ १́b", "ids": [17793, 67, 260, 17793, 223, 17793, 223, 26020, 17793, 68]}, {"text": "a\r\n b\t\t", "ids": [67, 204, 201, 223, 291, 998]}, {"text": "a ", "ids": [67, 361]}, {"text": "a\t  b", "ids": [67, 200, 663, 228, 68]}, {"text": "a… b", "ids": [67, 129, 230, 2162, 68]}, {"text": "x \n \r\n y", "ids": [90, 539, 223, 204, 201, 262, 383]}, {"text": "😀 ①🙂Ⅷ ²+𝟘", "ids": [28927, 225, 1327, 242, 257, 80300, 227, 23603, 103, 1203, 113, 13, 70958, 249]}]}]}
File diff suppressed because it is too large. Load diff
@@ -0,0 +1 @@
[[248045,846,198,46701,254,2765,88608,2071,110,78449,253,246,199049,220,52033,64,248046,198,248045,74455,198,248068,271,248069,271,3833,2765,239,254,13,248046,198,248045,846,198,22791,2765,88608,321,78449,253,246,13,198,256,830,248046,198,248045,74455,198,248068,271,248069,271],[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,46701,254,2765,88608,2071,110,78449,253,246,199049,220,52033,64,248046,198,248045,74455,198,248068,198,83017,2071,110,3272,13,198,248069,271,3833,2765,239,254,13,248046,198,248045,846,198,22791,2765,88608,321,78449,253,246,13,198,256,830,248046,198,248045,74455,198,248068,198],[248045,846,198,46701,254,2765,88608,2071,110,78449,253,246,199049,220,52033,64,248046,198,248045,74455,198,248068,198,83017,2071,110,3272,13,198,248069,271,3833,2765,239,254,13,248046,198,248045,846,198,22791,2765,88608,321,78449,253,246,13,198,256,830,248046,198,248045,74455,198,248068,198],[248045,8678,198,24342,286,4879,369,716,310,830,11553,13,5044,1683,15060,1472,279,3274,11,9307,1328,30800,11,2814,47675,25605,11,321,60445,55404,11,27224,11,321,30246,303,279,1534,4087,13,248046,198,248045,846,198,46701,254,2765,88608,2071,110,78449,253,246,199049,220,52033,64,248046,198,248045,74455,198,248068,198,83017,2071,110,3272,13,198,248069,271,3833,2765,239,254,13,248046,198,248045,846,198,22791,2765,88608,321,78449,253,246,13,198,256,830,248046,198,248045,74455,198,248068,198]]
+16
View File
@@ -0,0 +1,16 @@
running 3 tests
test engine::tokenizer::issue111::issue111_ds4_families ... {"case":"ds4_control","family":"glm","cases":19,"plain_rendered_exact":true}
{"case":"ds4_control","family":"deepseek","cases":19,"plain_rendered_exact":true}
ok
test engine::tokenizer::issue111::issue111_every_unicode_scalar_split ... {"case":"unicode_split","scalars":1112064,"pieces":2082513,"sha256":"7ef8755fb56062d9695b38bc132f325ea59c3c65f198e1b1ab20bff1afef632a","exact":true}
ok
test engine::tokenizer::issue111::issue111_qwen_tokens_and_requests ... {"case":"request","effort":"direct","context_tokens":59,"exact":true}
{"case":"request","effort":"low","context_tokens":93,"exact":true}
{"case":"request","effort":"medium","context_tokens":63,"exact":true}
{"case":"request","effort":"xhigh","context_tokens":105,"exact":true}
{"case":"tokenizer","number_count":1911,"cases":5752,"plain_rendered_roundtrip_exact":true}
ok
test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 534 filtered out; finished in 6.13s
@@ -0,0 +1,38 @@
[
{
"text": "́a á ́ १́b",
"ids": [
52033,
64,
264,
52033,
220,
52033,
220,
12256,
100,
52033,
65
],
"full_ids": [
52033,
64,
18135,
220,
52033,
220,
12256,
100,
52033,
65
],
"pieces": [
"́a",
" á",
" ́",
" ",
"१",
"́b"
]
}
]
@@ -0,0 +1,19 @@
running 1 test
test engine::metal::qwen_mtplx::issue103_analysis::issue103_tokenizer_receipts ... {"case":"native_tokenizer","text":"भारत एक विशाल देश है जिसकी संस्कृति बहुत पुरानी है।","actual_ids":[149755,148504,76519,171549,165997,151224,197734,170046,184864,160357,172281,237627,158827,153570,199638,80752,151859,181117,170046,154845],"expected_ids":[149755,148504,76519,171549,165997,151224,197734,170046,184864,160357,172281,237627,158827,153570,199638,80752,151859,181117,170046,154845],"matches":true}
{"case":"native_tokenizer","text":"ประเทศไทยมีวัฒนธรรมที่เก่าแก่และสวยงามมาก","actual_ids":[156150,148450,186319,148285,178118,155545,149119,162566,149196],"expected_ids":[156150,148450,186319,148285,178118,155545,149119,162566,149196],"matches":true}
{"case":"native_tokenizer","text":"إِنَّ اللُّغَةَ الْعَرَبِيَّةَ جَمِيلَةٌ","actual_ids":[88792,164372,148784,159613,78958,191556,205629,153458,150765,151003,178402,27004,79333,152397,216808,233790],"expected_ids":[88792,164372,148784,159613,78958,191556,205629,153458,150765,151003,178402,27004,79333,152397,216808,233790],"matches":true}
{"case":"native_tokenizer","text":"The quick brown fox jumps over the lazy dog near the river bank.","actual_ids":[760,3841,13477,37550,33075,888,279,15217,5388,3043,279,14367,5883,13],"expected_ids":[760,3841,13477,37550,33075,888,279,15217,5388,3043,279,14367,5883,13],"matches":true}
{"case":"native_tokenizer","text":"def foo(x):\n return x + 1\n","actual_ids":[727,14785,2007,1590,198,262,460,830,478,220,16,198],"expected_ids":[727,14785,2007,1590,198,262,460,830,478,220,16,198],"matches":true}
{"case":"native_tokenizer","text":"中国的文化历史悠久。","actual_ids":[108733,96655,125188,1710],"expected_ids":[108733,96655,125188,1710],"matches":true}
{"case":"native_tokenizer","text":"a🙂b ©c ∑d —e …f €g ™h\n","actual_ids":[64,169171,65,7013,66,11654,239,67,1892,68,4444,69,12612,70,27717,95,71,198],"expected_ids":[64,169171,65,7013,66,11654,239,67,1892,68,4444,69,12612,70,27717,95,71,198],"matches":true}
{"case":"native_tokenizer","text":"x́y १२३ ١٢٣ ①Ⅷ²‍Z","actual_ids":[87,52033,88,220,12256,100,12256,101,12256,102,220,149,94,149,95,149,96,220,46701,254,68086,100,28495,373,235,57],"expected_ids":[87,52033,88,220,12256,100,12256,101,12256,102,220,149,94,149,95,149,96,220,46701,254,68086,100,28495,373,235,57],"matches":true}
{"case":"native_tokenizer","text":" ①","actual_ids":[220,46701,254],"expected_ids":[220,46701,254],"matches":true}
{"case":"native_tokenizer","text":" Ⅷ","actual_ids":[220,68086,100],"expected_ids":[220,68086,100],"matches":true}
{"case":"native_tokenizer","text":" ²","actual_ids":[220,28495],"expected_ids":[220,28495],"matches":true}
{"case":"native_tokenizer","text":" 𝟘","actual_ids":[220,54362,253,246],"expected_ids":[220,54362,253,246],"matches":true}
{"case":"tokenizer_summary","mismatches":0}
ok
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 537 filtered out; finished in 0.53s
Loaded 100 of 378 files, more files were not shown because too many files have changed in this diff. Show more