Match Qwen compiled verification gate math

This commit is contained in:
Georg Bauer committed 2026-10-04 14:50:29 +02:00
1 parent 892f8a70b9
commit 57b8ac28a7
33 files changed
+1250 -40

No files matched your search

+86
View File
@@ -0,0 +1,86 @@
# Issue 109: compiled verification gates
Qwen target forwards inside the MTP loop now carry the pinned MTPLX
`decode_verify` phase through attention, eager HC injection, captured-prefix
repair and final-primary commit. Draft/history and ordinary prefill/AR retain
their existing phase. Compiled layer replay keys include the phase to prevent
reuse of a graph with the other gate law.
The BF16 attention gate compiles exactly
`output * sigmoid(gate.astype(f32).astype(bf16))`; the casts select the fused
lowering and do not move the sigmoid to F32. F32 uses its separate compiled
expression; FP16 remains standalone. The existing native Rust graph compiler
and Metal execution implement these expressions. No global sigmoid, compiler
math flags, DS4/GLM implementation, or shared family helper changed.
Two actual eager `GatedResidual._verify_inject` calls also demonstrated a
phase/site failure (the adjacent `active-hc-sites.jsonl` records inputs and both
outputs). That sibling therefore satisfies this issue's explicit scope rule:
its verify-only divide/sigmoid/multiply now compiles as pinned MTPLX does.
Unrelated PLE/shared-expert gates remain unchanged. This is oracle parity, not a
new DS4Server feature or a full fixed-M4 verifier.
Persisted MTP snapshots without the new gate policy are rejected before
restoration; old AR snapshots remain compatible. Tests use both a constructed
old manifest and an actual pre-fix MTP file, and verify failed restoration leaves
the current live state intact. New checkpoints reproduce resident warm state
exactly after reset/reopen.
## Verification and boundaries
The pinned oracle is MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`
with MLX 0.32.2. The installed Bare-Speed artifact and hardware are recorded in
`../issue104-ar/environment.json`.
- Exhaustive finite BF16 (65,280) and FP16 (63,488), plus 65,536 dense F32
gate values, compare every output byte in all three phases. BF16 also covers
all three HC-injection phases. The owned original `active_attention_gate`
and `bf16_gate` regressions require the corrected expression and neighbors.
- Real cold/warm MTP requests compare each target forward's input IDs and all
logits/hidden bytes, generated tokens, cache offsets, final logits/hidden and
trunk/MTP state arrays. Native resident and disk-reopened full state hashes
must agree exactly.
- The complete final-primary test covers greedy/sampled, depths 1–3,
stop/max-token termination and failure/cancellation controls.
- Existing whole-attention fixtures exercise both TF32 modes and prepared/lazy
input routes; hyper fixtures control the unchanged non-verify route.
The real-model comparison explicitly sets the oracle's
`MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0` to isolate this gate change with the same
attention consumer. Independent default-oracle comparison exposed a missing
head-chunked consumer before the gate, tracked separately in
[#113](https://git.rfc1437.de/hugo/DS4Server/issues/113). This controlled run does
not establish default-route model parity. `default-route-mismatch.jsonl`
retains the evidence.
Cache receipts retain raw hashes as well as value hashes with zero signs
canonicalized. A first-position prefill key has one signed-zero bit difference;
this is reported explicitly rather than hidden by a tolerance, and is tracked
separately in [#114](https://git.rfc1437.de/hugo/DS4Server/issues/114). Target outputs,
final logits/hidden and resident-versus-reopened state use raw byte exactness.
All four mandatory gates and serial Metal/oracle checks are listed in
`checks.json`. These are correctness receipts, not performance measurements.
## Reproduction
```sh
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue109-gate-reference.py /path/to/pinned/mtplx /tmp/issue109-gate
cargo test --all-features --bin ds4-server --no-run
cargo build --bin test-supervisor
export DS4_ISSUE109_GATE=/tmp/issue109-gate
# Resolve TEST_EXECUTABLE from cargo; run Metal processes serially.
target/debug/test-supervisor 4096 60 120 --command TEST_EXECUTABLE \
issue109_gate_phase_and_dtype_laws --ignored --nocapture --test-threads=1
export MTPLX_CONTEXT_COPY=0
export DS4_QWEN38_ARTIFACTS=/path/to/model
export DS4_ISSUE109_DIR=/tmp/issue109-product
export DS4_ISSUE109_OLD=/path/to/pre-fix-mtp-checkpoint
target/debug/test-supervisor 114688 60 120 --command TEST_EXECUTABLE \
issue109_verify_rows_and_warm_checkpoint --ignored --nocapture --test-threads=1
MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0 \
local-eval-results/mtplx-reference-env-0.32.2/bin/python \
tools/issue109-model-reference.py /path/to/pinned/mtplx \
"$DS4_QWEN38_ARTIFACTS" "$DS4_ISSUE109_DIR" /tmp/issue109-model-oracle
```
@@ -0,0 +1,2 @@
{"case":"active_sibling_gate","owner":"GatedResidual","method":"_verify_inject","phase":"decode_verify","gate_shape":[1,4,4],"different":1,"logits":[-14.5,-25.625,-27.125,-15.8125,-11.8125,-19.875,-27.375,-16.25,-12.9375,-25.75,-30.625,-17.0,-11.6875,-22.625,-26.5,-16.5],"actual":[0.052001953125,0.0033111572265625,0.0022735595703125,0.037841796875,0.099609375,0.0137939453125,0.00213623046875,0.033935546875,0.07568359375,0.003204345703125,0.000946044921875,0.0281982421875,0.10205078125,0.0069580078125,0.002655029296875,0.031982421875],"stock":[0.052001953125,0.0033111572265625,0.0022735595703125,0.037841796875,0.099609375,0.0137939453125,0.0021209716796875,0.033935546875,0.07568359375,0.003204345703125,0.000946044921875,0.0281982421875,0.10205078125,0.0069580078125,0.002655029296875,0.031982421875]}
{"case":"active_sibling_gate","owner":"GatedResidual","method":"_verify_inject","phase":"decode_verify","gate_shape":[1,4,4],"different":1,"logits":[14.4375,-5.0625,-12.4375,-1.359375,23.75,-26.25,-19.875,-8.6875,27.625,-29.125,-18.375,-8.75,27.0,-27.375,-22.625,-7.71875],"actual":[1.9453125,0.4375,0.08544921875,0.83203125,1.9921875,0.0028228759765625,0.0137939453125,0.205078125,2.0,0.001373291015625,0.02001953125,0.201171875,2.0,0.00213623046875,0.0069580078125,0.25390625],"stock":[1.9453125,0.4375,0.08544921875,0.83203125,1.9921875,0.0028228759765625,0.0137939453125,0.205078125,2.0,0.001373291015625,0.02001953125,0.201171875,2.0,0.0021209716796875,0.0069580078125,0.25390625]}
@@ -0,0 +1,8 @@
{"case":"vision_positions","start":0,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875],"expected_keys":[0.1982421875,0.396484375,0.59375,0.79296875,0.98828125,1.1875,1.3828125,1.5859375,-0.478515625,0.671875,0.85546875,0.9453125,1.1484375,1.171875,1.1875,1.2578125,-1.265625,0.515625,0.875,0.96484375,0.326171875,1.28125,1.15625,1.1640625,-1.2890625,0.55859375,0.90234375,0.9765625,0.373046875,1.265625,1.125,1.1171875]}
{"case":"vision_chunk_next_state","start":0,"rows":4,"offset":5,"exact":true}
{"case":"vision_positions","start":4,"rows":2,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125],"expected_keys":[-0.3359375,0.02783203125,0.55078125,0.7890625,-0.94921875,1.25,1.3984375,1.5859375,0.3125,0.294921875,0.8203125,0.94140625,-1.203125,1.3203125,1.2109375,1.2578125]}
{"case":"vision_chunk_next_state","start":4,"rows":2,"offset":7,"exact":true}
{"case":"vision_positions","start":2,"rows":4,"table_end":4,"delta":-1,"different_rows":[],"actual_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125],"expected_keys":[-0.98046875,0.02783203125,0.5390625,0.7890625,-0.2314453125,1.25,1.40625,1.5859375,-1.2265625,0.423828125,0.8203125,0.94140625,0.216796875,1.28125,1.2109375,1.2578125,-0.9609375,0.515625,0.88671875,0.96484375,-0.890625,1.28125,1.140625,1.1640625,0.1962890625,0.4296875,0.90234375,0.9765625,-1.328125,1.3203125,1.125,1.125]}
{"case":"vision_chunk_next_state","start":2,"rows":4,"offset":7,"exact":true}
{"case":"vision_sparse_qsa","prefix_rows":12,"topk_blocks":1,"ratio":4,"position_delta":0,"text_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125],"vision_output":[0.10986328125,-0.1923828125,0.08544921875,0.498046875,-0.0791015625,0.16796875,0.31640625,-0.03173828125]}
{"case":"active_attention_gate","gate":-6.84375,"actual":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375],"expected_verify":[0.0003204345703125,-0.0007476806640625,0.000213623046875,0.0009613037109375,-0.000213623046875,0.00042724609375,0.000640869140625,-0.0001068115234375]}
+219
View File
@@ -0,0 +1,219 @@
[
{
"check": "fmt",
"passed": true
},
{
"check": "clippy",
"passed": true
},
{
"check": "bundle",
"passed": true
},
{
"check": "tests",
"passed": true,
"results": [
"test result: ok. 308 passed; 0 failed; 221 ignored; 0 measured; 0 filtered out; finished in 5.57s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s",
"test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.29s"
]
},
{
"check": "gate-native",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.28s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 1677,
"peak": {
"cpu_time_ns": 198776708,
"resident_bytes": 82509824,
"physical_bytes": 160219976,
"peak_physical_bytes": 160744264,
"disk_read_bytes": 15327232,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "product",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 47.53s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 48500,
"peak": {
"cpu_time_ns": 50595900083,
"resident_bytes": 26181681152,
"physical_bytes": 77006202736,
"peak_physical_bytes": 77006202736,
"disk_read_bytes": 73689870336,
"disk_write_bytes": 286756864
},
"error": null
}
},
{
"check": "model-oracle",
"passed": true,
"control": "MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK=0; MTPLX_CONTEXT_COPY=0",
"known_separate_findings": [
113,
114
]
},
{
"check": "codec",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.13s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 1455,
"peak": {
"cpu_time_ns": 41537833,
"resident_bytes": 17907712,
"physical_bytes": 4817472,
"peak_physical_bytes": 4817472,
"disk_read_bytes": 0,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "attention",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.15s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 210,
"peak": {
"cpu_time_ns": 85113875,
"resident_bytes": 79396864,
"physical_bytes": 40239968,
"peak_physical_bytes": 40239968,
"disk_read_bytes": 65536,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "numeric",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 0.29s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 315,
"peak": {
"cpu_time_ns": 88259416,
"resident_bytes": 80084992,
"physical_bytes": 159744816,
"peak_physical_bytes": 159859504,
"disk_read_bytes": 4096,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "finalprimary",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 98.22s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 98338,
"peak": {
"cpu_time_ns": 98248792166,
"resident_bytes": 63166431232,
"physical_bytes": 74583434072,
"peak_physical_bytes": 74584138584,
"disk_read_bytes": 73602744320,
"disk_write_bytes": 1397932032
},
"error": null
}
},
{
"check": "module-1",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 14.20s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 14223,
"peak": {
"cpu_time_ns": 13641618583,
"resident_bytes": 548356096,
"physical_bytes": 1595852072,
"peak_physical_bytes": 1604257088,
"disk_read_bytes": 51740672,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "module-0",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 14.05s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 14115,
"peak": {
"cpu_time_ns": 13634514125,
"resident_bytes": 556367872,
"physical_bytes": 1602864448,
"peak_physical_bytes": 1604191552,
"disk_read_bytes": 278528,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "hyper",
"passed": true,
"results": [
"test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 528 filtered out; finished in 28.54s"
],
"resources": {
"event": "test_resource_summary",
"elapsed_ms": 28607,
"peak": {
"cpu_time_ns": 28219361375,
"resident_bytes": 207831040,
"physical_bytes": 416056280,
"peak_physical_bytes": 416089048,
"disk_read_bytes": 1949696,
"disk_write_bytes": 0
},
"error": null
}
},
{
"check": "upstream",
"passed": true,
"results": [
"9 passed in 0.12s"
]
}
]
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b","value_sha256":"1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b"},{"shape":[1,48,128,128],"sha256":"d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d","value_sha256":"d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d"}],[{"shape":[1,3,10240],"sha256":"ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a","value_sha256":"ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a"},{"shape":[1,48,128,128],"sha256":"f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831","value_sha256":"f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831"},{"shape":[1,9,10240],"sha256":"c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e","value_sha256":"c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e"},{"shape":[1,2],"sha256":"9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f","value_sha256":"9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f"}],[{"shape":[1,3,10240],"sha256":"320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3","value_sha256":"320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3"},{"shape":[1,48,128,128],"sha256":"8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08","value_sha256":"8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08"}],[{"shape":[1,2,58,256],"sha256":"404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0","value_sha256":"404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0"},{"shape":[1,2,58,256],"sha256":"f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef","value_sha256":"f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef"},{"shape":[1,58,128],"sha256":"ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12","value_sha256":"ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12"},{"shape":[1,14,128],"sha256":"a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b","value_sha256":"a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b"}],[{"shape":[1,3,10240],"sha256":"0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2","value_sha256":"0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2"},{"shape":[1,48,128,128],"sha256":"d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f","value_sha256":"d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f"}],[{"shape":[1,3,10240],"sha256":"66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb","value_sha256":"66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb"},{"shape":[1,48,128,128],"sha256":"2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098","value_sha256":"2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098"}],[{"shape":[1,3,10240],"sha256":"45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2","value_sha256":"45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2"},{"shape":[1,48,128,128],"sha256":"e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0","value_sha256":"e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0"}],[{"shape":[1,2,58,256],"sha256":"ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2","value_sha256":"ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2"},{"shape":[1,2,58,256],"sha256":"57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4","value_sha256":"57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4"},{"shape":[1,58,128],"sha256":"84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22","value_sha256":"84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22"},{"shape":[1,14,128],"sha256":"a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707","value_sha256":"a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707"}],[{"shape":[1,3,10240],"sha256":"e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c","value_sha256":"e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c"},{"shape":[1,48,128,128],"sha256":"f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c","value_sha256":"f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c"}],[{"shape":[1,3,10240],"sha256":"54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016","value_sha256":"54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016"},{"shape":[1,48,128,128],"sha256":"868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259","value_sha256":"868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259"}],[{"shape":[1,3,10240],"sha256":"0073cc8754020915aedaad03803669a61281e18cb2dd389cb19ef7b5ed769b84","value_sha256":"0073cc8754020915aedaad03803669a61281e18cb2dd389cb19ef7b5ed769b84"},{"shape":[1,48,128,128],"sha256":"abd539c013e58f489c23c48dfc168be7a9e2145deee859432cb83d0dLine truncated
@@ -0,0 +1 @@
{"trunk": [[{"shape": [1, 3, 10240], "sha256": "1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b", "value_sha256": "1dadce7f74c7b48ad423170b8884bf5024c3d6dd91b2f9d800afca7d32679d7b"}, {"shape": [1, 48, 128, 128], "sha256": "d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d", "value_sha256": "d7436faf9d50e278f7fa095e9c217467020a6f534a48195775c212caa0ece52d"}], [{"shape": [1, 3, 10240], "sha256": "ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a", "value_sha256": "ca1b3cf93598b62575f01aea05ff0d0f087c00fdf1b63654626ef5ec3487715a"}, {"shape": [1, 48, 128, 128], "sha256": "f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831", "value_sha256": "f1364bb8165b9189279b7769e4081f213c562f4e0541acc5962cf2ae9f42a831"}, {"shape": [1, 9, 10240], "sha256": "c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e", "value_sha256": "c9110c820fc39f8c19c770594c15e0997693015090a3c7af4b6c8ec9a31ebc4e"}, {"shape": [1, 2], "sha256": "9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f", "value_sha256": "9febaa06152dac026dba5f2c1151c11ff6a1b2f00e92278cdfd2905c87cf2c2f"}], [{"shape": [1, 3, 10240], "sha256": "320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3", "value_sha256": "320fdcf9c7ab899133952e093d1f3de613ba5581b3aaad45c4ad7b1b4e43f1f3"}, {"shape": [1, 48, 128, 128], "sha256": "8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08", "value_sha256": "8cae4ba20fd0e54f8da130e5f8681ece7c54672b7a6404800cded8e64a977e08"}], [{"shape": [1, 2, 58, 256], "sha256": "404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0", "value_sha256": "404510256f371f0bc2e7b8af2d1f7eb2ae0322d42eb9a0ee5827a9a5c8d489c0"}, {"shape": [1, 2, 58, 256], "sha256": "f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef", "value_sha256": "f14afc7fe1c5e4c62c84121e804e14aa484db378861904d4e234ffeef10252ef"}, {"shape": [1, 58, 128], "sha256": "ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12", "value_sha256": "ca2d0b2f09e87fab8d0a6aede7073ec53bc37b584851f0342c76244f05ca3e12"}, {"shape": [1, 14, 128], "sha256": "a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b", "value_sha256": "a609a4f52c9b3dc0fb5d6554019786bebecdad220bf5ae6b40d4939821f12c8b"}], [{"shape": [1, 3, 10240], "sha256": "0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2", "value_sha256": "0c5bdce8d9cbd2a24162139582f1889f0413632feafdba4e79cdd88353e6abc2"}, {"shape": [1, 48, 128, 128], "sha256": "d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f", "value_sha256": "d47c0c965fb6c41a7e1824144ef61546a7e40ead8d8606822173e21a17a4fc0f"}], [{"shape": [1, 3, 10240], "sha256": "66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb", "value_sha256": "66014c1bce9cbbd223ec6af2f5517de66f71ce443721088167dad0c0186289fb"}, {"shape": [1, 48, 128, 128], "sha256": "2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098", "value_sha256": "2593987c9ca9aeb30910e7eb69f8d6bd61c1e035861915cbe27b0838e26f3098"}], [{"shape": [1, 3, 10240], "sha256": "45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2", "value_sha256": "45a3dbbf3dc7a79b7db631fe4c2802d6e1f4433f4b03e961df072147e8c242a2"}, {"shape": [1, 48, 128, 128], "sha256": "e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0", "value_sha256": "e266e3456f01268de8868258a750ee18c5f8b1ff4391f647aec60a39d56f98a0"}], [{"shape": [1, 2, 58, 256], "sha256": "ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2", "value_sha256": "ba60b2860a5717f46a4a7ffef0257799f96acb37de1a00ba88ddfc149bf44ca2"}, {"shape": [1, 2, 58, 256], "sha256": "57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4", "value_sha256": "57d040a722a1427e9b0744ee652aecca9ec30cc7b617e3db9534e772d79f42e4"}, {"shape": [1, 58, 128], "sha256": "84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22", "value_sha256": "84d339a2f8558893f3d73e751d5ee3d81bb1f3b1184c0b35555bf5456fdc5a22"}, {"shape": [1, 14, 128], "sha256": "a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707", "value_sha256": "a5378133f448c4b6380dc4711420d3b069dd8491ffc797fd16e023294405b707"}], [{"shape": [1, 3, 10240], "sha256": "e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c", "value_sha256": "e6d4afab81c6a58f08c8d252991e91d25d2d60e497c3fc00614451edd0ea908c"}, {"shape": [1, 48, 128, 128], "sha256": "f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c", "value_sha256": "f94349b9898b0d1a5770f4aca791d4c114abad341641688012de2e2fcaa6237c"}], [{"shape": [1, 3, 10240], "sha256": "54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016", "value_sha256": "54d2e63c68f9fc1412178f3f21bcf5897ab228967e01f709ed9d5ba0e6d0c016"}, {"shape": [1, 48, 128, 128], "sha256": "868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259", "value_sha256": "868155f0fd6a62a46decb4f87c3e2f27310f9da38796fe0a8d926844248c7259"}], [{"shape": [1, 3, 10240], "sha256": "0073cc87540209Line truncated
@@ -0,0 +1,142 @@
{"case":"prefill_compare","phase":"cold","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"cold","part":"hidden","shape":[1,1,10240],"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":0,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1010,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1011,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1013,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1014,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1015,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":2,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1030,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1031,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1036,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1037,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1038,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1032,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1033,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1034,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1035,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":3,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":6,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1070,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1071,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1076,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1077,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1078,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1072,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1073,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1074,"exact":true}
{"case":"layer","phase":"cold","index":0,"layer":1075,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":7,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":10,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1110,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1111,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1116,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1117,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1118,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1112,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1113,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1114,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1115,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":11,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":14,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1150,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1151,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1156,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1157,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1158,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1152,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1153,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1154,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1155,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":15,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":18,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1190,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1191,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1196,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1197,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1198,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1192,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1193,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1194,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1195,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":19,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":22,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1230,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1231,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1236,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1237,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1238,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1232,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1233,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1234,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1235,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":23,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":26,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1270,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1271,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1276,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1277,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1278,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1272,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1273,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1274,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1275,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":27,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":30,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1310,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1311,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1316,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1317,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1318,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1312,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1313,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1314,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1315,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":31,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":34,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1350,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1351,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1356,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1357,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1358,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1352,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1353,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1354,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1355,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":35,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":38,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1390,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1391,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1396,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1397,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1398,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1392,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1393,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1394,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1395,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":39,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":42,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1430,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1431,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1436,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1437,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1438,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1432,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1433,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1434,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1435,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":43,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":46,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1470,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1471,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1476,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1477,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1478,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1472,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1473,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1474,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":1475,"exact":false}
{"case":"layer","phase":"cold","index":0,"layer":47,"exact":false}
{"case":"verify_forward","phase":"cold","index":0,"ids":[760,1156,369,9859],"logits_exact":false,"logits_sha256":"e3ba038c8570911a72fadeba867f1c33e5103108ef9881bfcdc008907de90839","logits_different":948664,"logits_max_abs":0.828125,"hidden_exact":false,"hidden_sha256":"b3c2ef7bb9c3dfa85748d7af883210ae4393bd1b5af5397f243d632fc437552b","hidden_different":39596,"hidden_max_abs":0.53125}
@@ -0,0 +1,15 @@
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":1,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":2,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"max_tokens","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.0,"exit":"stop","tokens":[11],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"9c41c06e776592492d6b69f6d20bad4de6c99e30c9abea1333f667755a40c49c","next_sha256":"1068b9e791272fda13d0c00cd623f7fb14807753f8536b92d9d688f7864b4f3a","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"max_tokens","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"complete_state","depth":3,"temperature":0.6,"exit":"stop","tokens":[314],"key_length":4,"trunk_offsets":[4,4,4,4,4,4,4,4,4,4,4,4],"mtp_offset":3,"reopened_cached_tokens":4,"state_sha256":"06e36aaaee43822c7fc71fd1ed554fb4cd5ab92a94dd88218894f25d56f69b89","next_sha256":"e819026b44ad53bcee190e9121bf347e1f9825171ad5c7e97a051062f2cf91b4","old_checkpoint_rejected":true}
{"case":"cancel","safe_final_state":false}
{"case":"forward","safe_final_state":false}
{"case":"capture_disabled","safe_final_state":false}
@@ -0,0 +1,12 @@
{"case":"gate","dtype":"bf16","phase":"prefill","values":65280,"exact":true}
{"case":"inject","phase":"prefill","values":65280,"exact":true}
{"case":"gate","dtype":"bf16","phase":"ar_decode","values":65280,"exact":true}
{"case":"inject","phase":"ar_decode","values":65280,"exact":true}
{"case":"gate","dtype":"bf16","phase":"decode_verify","values":65280,"exact":true}
{"case":"inject","phase":"decode_verify","values":65280,"exact":true}
{"case":"gate","dtype":"f16","phase":"prefill","values":63488,"exact":true}
{"case":"gate","dtype":"f16","phase":"ar_decode","values":63488,"exact":true}
{"case":"gate","dtype":"f16","phase":"decode_verify","values":63488,"exact":true}
{"case":"gate","dtype":"f32","phase":"prefill","values":65536,"exact":true}
{"case":"gate","dtype":"f32","phase":"ar_decode","values":65536,"exact":true}
{"case":"gate","dtype":"f32","phase":"decode_verify","values":65536,"exact":true}
@@ -0,0 +1,12 @@
{"case":"gate","dtype":"bf16","phase":"prefill","count":65280,"sha256":"4278d0e794d68fdac18c7528d38c1f6ea2c9412117aaba69f413caddb148b252"}
{"case":"inject","dtype":"bf16","phase":"prefill","count":65280,"sha256":"253aee360f465fb04a5aae286344a5344938fbcacdf6f5d0be2a66ad566378af"}
{"case":"gate","dtype":"bf16","phase":"ar_decode","count":65280,"sha256":"4278d0e794d68fdac18c7528d38c1f6ea2c9412117aaba69f413caddb148b252"}
{"case":"inject","dtype":"bf16","phase":"ar_decode","count":65280,"sha256":"253aee360f465fb04a5aae286344a5344938fbcacdf6f5d0be2a66ad566378af"}
{"case":"gate","dtype":"bf16","phase":"decode_verify","count":65280,"sha256":"deba612e555c81b44cb06c0bdfcaf51a9beaee1ec813215d91f762a0a0f7b88c"}
{"case":"inject","dtype":"bf16","phase":"decode_verify","count":65280,"sha256":"3ce25d59ffa6aff2992424fbd04138083ce1326ed4deacdd97038e36ca9648aa"}
{"case":"gate","dtype":"f16","phase":"prefill","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f16","phase":"ar_decode","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f16","phase":"decode_verify","count":63488,"sha256":"4348e497cfa1e2d4cc5bbc56a068237bb57b8a4e644145c1eb0feefa94790154"}
{"case":"gate","dtype":"f32","phase":"prefill","count":65536,"sha256":"2c5e478f548c9bf676e1fdea6501484016f0555b0ae1383a962436c0b68608cd"}
{"case":"gate","dtype":"f32","phase":"ar_decode","count":65536,"sha256":"2c5e478f548c9bf676e1fdea6501484016f0555b0ae1383a962436c0b68608cd"}
{"case":"gate","dtype":"f32","phase":"decode_verify","count":65536,"sha256":"2d2d76ac7e415cf9c9ce1bd67fc26b03ea0a62a20ba91387a609e16ee6636050"}
@@ -0,0 +1,33 @@
{"case":"environment","overrides":{"MTPLX_QWEN4_VERIFY_SDPA_HEAD_CHUNK":"0","MTPLX_SKIP_VERIFY_SNAPSHOT":"0","MTPLX_FAMILY_CAPTURE_COMMIT":"1","MTPLX_FUSED_HC_V3":"1","MTPLX_FUSED_GDN_INPROJ":"1","MTPLX_FUSED_GATE_UP":"1","MTPLX_FUSED_GDN_CONVNORM":"1","MTPLX_FUSED_GDN_STEP":"1","MTPLX_FUSED_CONVNORM_VERIFY":"1","MTPLX_QSA_GATHER":"1","MTPLX_COMPILED_GDN":"1","MTPLX_QWEN4EXP_COMPILE":"1","MTPLX_QWEN4_BATCHED_TARGET_DISTRIBUTIONS":"1","MTPLX_QWEN4_FIXED_M4_VERIFY":"1","MTPLX_QWEN4_COMPILED_MTP_PREPARE":"1","MTPLX_QWEN4_RELAXED_DRAFT_TIES":"1","MTPLX_QWEN4_OPDIET":"1","MTPLX_QWEN4_PLE_PREFILL_LOOKAHEAD":"1","MTPLX_QWEN4_PLE_FIRST_GATHER_EARLY":"1","MTPLX_SESSION_BANK_SHED_BOUNDARIES":"1","MTPLX_SESSION_BANK_PROTECTED_TERMINAL":"1","MTPLX_NGRAM_PREWARM":"auto","MTPLX_QWEN4_VERIFY_GLUE":"1","MTPLX_QWEN4_VERIFY_GLUE_ITEMS":"qsa_rope,qsa_rope_idx","MTPLX_QSA_M4_FUSED_KV_GATHER":"1","MTPLX_QSA_GATHER_MAX_ROWS":"32","MTPLX_BATCH_TARGET_ARRAYS":"1","MTPLX_LAZY_TARGET_DISTRIBUTIONS":"0","MTPLX_COMPILED_VERIFY":"1","MTPLX_NAX_VERIFY":"0","MTPLX_QWEN4_PREFILL_WIDE_CHUNK":"4096","MTPLX_QSA_PREFILL_WIDE_MIN_CONTEXT":"16384","MTPLX_SUSTAINED_PREFILL":"1","MTPLX_PREFILL_CHUNK_SIZE":"2048","MTPLX_CONTEXT_COPY":"0"}}
{"case":"prefill_compare","phase":"cold","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"cold","part":"hidden","shape":[1,1,10240],"exact":true}
{"case":"tokens","phase":"cold","ids":[760]}
{"case":"verify_forward","phase":"cold","index":0,"ids":[760,1156,369,9859],"logits_exact":true,"logits_sha256":"16ff543d6e28cdbe7dbd56891e061ddd4b04291a9ca25bdf1f4437b4e3c5528d","hidden_exact":true,"hidden_sha256":"b9cc3aa8c913e508793b7486f77a10e7acd4698436060b1b6bf8abfbd59edee6"}
{"case":"tokens","phase":"cold","ids":[1156]}
{"case":"tokens","phase":"cold","ids":[6587]}
{"case":"verify_forward","phase":"cold","index":1,"ids":[6587,728,310,1698],"logits_exact":true,"logits_sha256":"24e58b3561aac59d52bf55183bc9b911432481e9613a5b98f1442945bfd6903a","hidden_exact":true,"hidden_sha256":"eddb5de99ea61034c3f0eb46ef1a515cae10c92333d069afce68cc4a5e5f9e3e"}
{"case":"tokens","phase":"cold","ids":[728,310,1698]}
{"case":"tokens","phase":"cold","ids":[494]}
{"case":"verify_forward","phase":"cold","index":2,"ids":[494,799,310,5600],"logits_exact":true,"logits_sha256":"f5f2c33a36fce4088f222ec7448389865dd74ea4c017e4e2e49f157693a33d64","hidden_exact":true,"hidden_sha256":"330d68ed62e77a12e38fe7677ffd2b9548f655c7d33e6e1607e431d1b8957e86"}
{"case":"tokens","phase":"cold","ids":[799,310,5600]}
{"case":"tokens","phase":"cold","ids":[13]}
{"case":"verify_forward","phase":"cold","index":3,"ids":[13,1061],"logits_exact":true,"logits_sha256":"f44498bbf6e6e9d8d909c0e4db24b5ef9bda5866b4a6a14e188865432538643c","hidden_exact":true,"hidden_sha256":"dec8b787a562878d091c854235120732e98f5781751b6d6a428e5cd02228deb0"}
{"case":"tokens","phase":"cold","ids":[1061]}
{"case":"cache_arrays","phase":"cold","values_exact":true,"zero_sign_differences":[["trunk",35,0]],"key35_bit_coordinates":[[0,1,0,2]]}
{"case":"turn","phase":"cold","tokens":[760,1156,6587,728,310,1698,494,799,310,5600,13,1061],"cached":0,"verify_calls":4,"final_exact":true}
{"case":"prefill_compare","phase":"warm","part":"logits","shape":[1,1,248320],"exact":true}
{"case":"prefill_compare","phase":"warm","part":"hidden","shape":[1,18,10240],"exact":false}
{"case":"tokens","phase":"warm","ids":[760]}
{"case":"verify_forward","phase":"warm","index":0,"ids":[760,1156,6587,728],"logits_exact":true,"logits_sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082","hidden_exact":true,"hidden_sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}
{"case":"tokens","phase":"warm","ids":[1156,6587,728]}
{"case":"tokens","phase":"warm","ids":[310]}
{"case":"verify_forward","phase":"warm","index":1,"ids":[310,2962,24217,494],"logits_exact":true,"logits_sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c","hidden_exact":true,"hidden_sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}
{"case":"tokens","phase":"warm","ids":[2962,24217]}
{"case":"tokens","phase":"warm","ids":[13]}
{"case":"verify_forward","phase":"warm","index":2,"ids":[13,353,2582,3804],"logits_exact":true,"logits_sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989","hidden_exact":true,"hidden_sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}
{"case":"tokens","phase":"warm","ids":[353]}
{"case":"tokens","phase":"warm","ids":[8334]}
{"case":"verify_forward","phase":"warm","index":3,"ids":[8334,29014,494],"logits_exact":true,"logits_sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2","hidden_exact":true,"hidden_sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}
{"case":"tokens","phase":"warm","ids":[29014,494]}
{"case":"cache_arrays","phase":"warm","values_exact":true,"zero_sign_differences":[["trunk",35,0]],"key35_bit_coordinates":[[0,1,0,2]]}
{"case":"turn","phase":"warm","tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"verify_calls":4,"final_exact":true}
+3
View File
@@ -0,0 +1,3 @@
{"case":"bf16_gate","gate":-6.84375,"eager":[0.00106048583984375,0.00106048583984375,0.00106048583984375,0.00106048583984375],"compiled":[0.001068115234375,0.001068115234375,0.001068115234375,0.001068115234375]}
{"case":"qsa_divisor","operand_bits":1093993715,"eager":[0.13258253037929535,0.13258254528045654,0.0883883461356163,0.0],"compiled":[0.13258251547813416,0.13258251547813416,0.08838833123445511,0.0]}
{"case":"yarn_amplitude","operand_bits":1066516124,"eager":[1.7079442739486694,1.707944393157959,1.13862943649292,0.0],"compiled":[1.7079435586929321,1.7079436779022217,1.1386289596557617,0.0]}
@@ -0,0 +1,21 @@
{
"case": "prefill_zero_sign",
"shape": [
1,
2,
46,
256
],
"layer": 35,
"coordinate": [
0,
1,
0,
2
],
"native_bits": "0x80000000",
"oracle_bits": "0x0",
"native_sha256": "d81b466dea1ff5b774e86c0af47069f555bbb59abb0f3f61165f5bc51aa28ac6",
"oracle_sha256": "520dd44032eda4789b123296b5499afb88f0d88d6cdccffa04ebe06c2bc3a853",
"issue": 114
}
+16
View File
@@ -0,0 +1,16 @@
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,369,9859],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"16ff543d6e28cdbe7dbd56891e061ddd4b04291a9ca25bdf1f4437b4e3c5528d"},"hidden":{"shape":[1,4,10240],"sha256":"b9cc3aa8c913e508793b7486f77a10e7acd4698436060b1b6bf8abfbd59edee6"}}}
{"case":"verify_forward","record":{"index":1,"ids":[6587,728,310,1698],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"24e58b3561aac59d52bf55183bc9b911432481e9613a5b98f1442945bfd6903a"},"hidden":{"shape":[1,4,10240],"sha256":"eddb5de99ea61034c3f0eb46ef1a515cae10c92333d069afce68cc4a5e5f9e3e"}}}
{"case":"verify_forward","record":{"index":2,"ids":[494,799,310,5600],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"f5f2c33a36fce4088f222ec7448389865dd74ea4c017e4e2e49f157693a33d64"},"hidden":{"shape":[1,4,10240],"sha256":"330d68ed62e77a12e38fe7677ffd2b9548f655c7d33e6e1607e431d1b8957e86"}}}
{"case":"verify_forward","record":{"index":3,"ids":[13,1061],"verify":true,"logits":{"shape":[1,2,248320],"sha256":"f44498bbf6e6e9d8d909c0e4db24b5ef9bda5866b4a6a14e188865432538643c"},"hidden":{"shape":[1,2,10240],"sha256":"dec8b787a562878d091c854235120732e98f5781751b6d6a428e5cd02228deb0"}}}
{"case":"cold","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,1698,494,799,310,5600,13,1061],"cached":0,"state_sha256":"eb61c20e4a89bb55c0284d86587966af49d6c601e5421b50eff0762ecf6842b1"}
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,6587,728],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082"},"hidden":{"shape":[1,4,10240],"sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}}}
{"case":"verify_forward","record":{"index":1,"ids":[310,2962,24217,494],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c"},"hidden":{"shape":[1,4,10240],"sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}}}
{"case":"verify_forward","record":{"index":2,"ids":[13,353,2582,3804],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989"},"hidden":{"shape":[1,4,10240],"sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}}}
{"case":"verify_forward","record":{"index":3,"ids":[8334,29014,494],"verify":true,"logits":{"shape":[1,3,248320],"sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2"},"hidden":{"shape":[1,3,10240],"sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}}}
{"case":"warm","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198,760,1156,6587,728,310,1698,494,799,310,5600,13,1061,198,248069,271,248046,198,248045,846,198,22791,24217,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"state_sha256":"e6cb7355aaa92a3569a365c94c55aa7a50bd731dc04f6fa320da8520d182e2f8"}
{"case":"verify_forward","record":{"index":0,"ids":[760,1156,6587,728],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"dbab0d12f25f2be2234d58d45f86219af62deb20e22b0d73a77aa5e7b722d082"},"hidden":{"shape":[1,4,10240],"sha256":"8f9aebc38d1a3e550bed6a4663eedac7a5ed3ce61d836d1cecdfa11da67ebd0d"}}}
{"case":"verify_forward","record":{"index":1,"ids":[310,2962,24217,494],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"d6b8e6afe3c6f5af068f240e0e69b3875311aac6929b3d5a38ab3aeaa1bf227c"},"hidden":{"shape":[1,4,10240],"sha256":"52f20217ed43d8e59ddbe037cb77f56cc3d8ef473fd1963948fff6faf8ad4212"}}}
{"case":"verify_forward","record":{"index":2,"ids":[13,353,2582,3804],"verify":true,"logits":{"shape":[1,4,248320],"sha256":"048e9343d4268d98455a01f7c73ee47af78bc811ef9e7680a72cae59336b9989"},"hidden":{"shape":[1,4,10240],"sha256":"8e8b07fb20baa33ad64cc76ff64403a434d520c627a182a224cf033a5a14e5d4"}}}
{"case":"verify_forward","record":{"index":3,"ids":[8334,29014,494],"verify":true,"logits":{"shape":[1,3,248320],"sha256":"82d671c6ac7b3a0952e60ef554ca670562fd01ef25c37bd10bc27025768ea0f2"},"hidden":{"shape":[1,3,10240],"sha256":"d1bc90f284364eae8bac80a5da6ab64c9c76d6994bb09ed463a17d67e25c016e"}}}
{"case":"reopened","prompt":[248045,8678,198,24342,286,4879,369,716,310,3238,13,13262,678,7047,9522,321,10419,11,6992,5774,310,279,16198,1973,24366,24150,362,13,248046,198,248045,846,198,2427,494,799,310,5600,13,248046,198,248045,74455,198,248068,198,760,1156,6587,728,310,1698,494,799,310,5600,13,1061,198,248069,271,248046,198,248045,846,198,22791,24217,13,248046,198,248045,74455,198,248068,198],"tokens":[760,1156,6587,728,310,2962,24217,13,353,8334,29014,494],"cached":58,"state_sha256":"e6cb7355aaa92a3569a365c94c55aa7a50bd731dc04f6fa320da8520d182e2f8"}
{"case":"checkpoint","actual_old_rejected":true,"warm_reopened_state_exact":true}
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84","value_sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"},{"shape":[1,48,128,128],"sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf","value_sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}],[{"shape":[1,3,10240],"sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232","value_sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"},{"shape":[1,48,128,128],"sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf","value_sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"},{"shape":[1,9,10240],"sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08","value_sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"},{"shape":[1,2],"sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152","value_sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}],[{"shape":[1,3,10240],"sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2","value_sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"},{"shape":[1,48,128,128],"sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34","value_sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}],[{"shape":[1,2,88,256],"sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f","value_sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"},{"shape":[1,2,88,256],"sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24","value_sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"},{"shape":[1,88,128],"sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748","value_sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"},{"shape":[1,22,128],"sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a","value_sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}],[{"shape":[1,3,10240],"sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda","value_sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"},{"shape":[1,48,128,128],"sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f","value_sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}],[{"shape":[1,3,10240],"sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a","value_sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"},{"shape":[1,48,128,128],"sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f","value_sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}],[{"shape":[1,3,10240],"sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d","value_sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"},{"shape":[1,48,128,128],"sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f","value_sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}],[{"shape":[1,2,88,256],"sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b","value_sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"},{"shape":[1,2,88,256],"sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba","value_sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"},{"shape":[1,88,128],"sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae","value_sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"},{"shape":[1,22,128],"sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb","value_sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}],[{"shape":[1,3,10240],"sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57","value_sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"},{"shape":[1,48,128,128],"sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43","value_sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}],[{"shape":[1,3,10240],"sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0","value_sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"},{"shape":[1,48,128,128],"sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52","value_sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}],[{"shape":[1,3,10240],"sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc","value_sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc"},{"shape":[1,48,128,128],"sha256":"4ce5d0905ec5e5ae834215c16b25d810a5ef6e54a6d7d96f95e47720Line truncated
@@ -0,0 +1 @@
{"trunk":[[{"shape":[1,3,10240],"sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84","value_sha256":"1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"},{"shape":[1,48,128,128],"sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf","value_sha256":"1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}],[{"shape":[1,3,10240],"sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232","value_sha256":"1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"},{"shape":[1,48,128,128],"sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf","value_sha256":"b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"},{"shape":[1,9,10240],"sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08","value_sha256":"eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"},{"shape":[1,2],"sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152","value_sha256":"b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}],[{"shape":[1,3,10240],"sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2","value_sha256":"1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"},{"shape":[1,48,128,128],"sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34","value_sha256":"403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}],[{"shape":[1,2,88,256],"sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f","value_sha256":"b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"},{"shape":[1,2,88,256],"sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24","value_sha256":"eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"},{"shape":[1,88,128],"sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748","value_sha256":"1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"},{"shape":[1,22,128],"sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a","value_sha256":"4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}],[{"shape":[1,3,10240],"sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda","value_sha256":"431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"},{"shape":[1,48,128,128],"sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f","value_sha256":"c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}],[{"shape":[1,3,10240],"sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a","value_sha256":"f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"},{"shape":[1,48,128,128],"sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f","value_sha256":"8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}],[{"shape":[1,3,10240],"sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d","value_sha256":"3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"},{"shape":[1,48,128,128],"sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f","value_sha256":"bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}],[{"shape":[1,2,88,256],"sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b","value_sha256":"9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"},{"shape":[1,2,88,256],"sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba","value_sha256":"b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"},{"shape":[1,88,128],"sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae","value_sha256":"491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"},{"shape":[1,22,128],"sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb","value_sha256":"104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}],[{"shape":[1,3,10240],"sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57","value_sha256":"e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"},{"shape":[1,48,128,128],"sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43","value_sha256":"0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}],[{"shape":[1,3,10240],"sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0","value_sha256":"f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"},{"shape":[1,48,128,128],"sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52","value_sha256":"75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}],[{"shape":[1,3,10240],"sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc","value_sha256":"c23b7e524522714aaf620c9e0bbb6b1d3db3585971f0cffafd7fe7e2018176dc"},{"shape":[1,48,128,128],"sha256":"4ce5d0905ec5e5ae834215c16b25d810a5ef6e54a6d7d96f95e47720Line truncated
@@ -0,0 +1 @@
{"trunk": [[{"shape": [1, 3, 10240], "sha256": "1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84", "value_sha256": "1df54fa91eb80b88e8b4c0d566828d36540f3508099fc1751dd700d9bd904a84"}, {"shape": [1, 48, 128, 128], "sha256": "1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf", "value_sha256": "1cc66986fdbef7d449d321ff6c558b4e862d2d9211d74038325c72c4f2f0cebf"}], [{"shape": [1, 3, 10240], "sha256": "1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232", "value_sha256": "1ba5aa461d83294641ab065813f2a27ce3a1aa280890046cdc6d839d49c86232"}, {"shape": [1, 48, 128, 128], "sha256": "b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf", "value_sha256": "b789c69d02395058a02c548725e7897e906176c9647e88b5c413a9c743a73aaf"}, {"shape": [1, 9, 10240], "sha256": "eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08", "value_sha256": "eaffcb3f7958776a888b3134ef5f9fa1285f21c242d76b0ebc19c64d75d26c08"}, {"shape": [1, 2], "sha256": "b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152", "value_sha256": "b5e055307f70d9b61bc8427b1da30e8f711b4da0c73d28a34879de8c3f253152"}], [{"shape": [1, 3, 10240], "sha256": "1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2", "value_sha256": "1ebb9fb3628cf830f4c16a815ecaa0c9ccc2049bff2b14d32cb4e3f08f1b91b2"}, {"shape": [1, 48, 128, 128], "sha256": "403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34", "value_sha256": "403226ed2eeae9becd4b498b0fa14de8152beac9138bff0c118698cd4c4fcc34"}], [{"shape": [1, 2, 88, 256], "sha256": "b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f", "value_sha256": "b4995a3d443eb57598940e4a80ece426f8e8442e07f30b8168b247baebfc422f"}, {"shape": [1, 2, 88, 256], "sha256": "eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24", "value_sha256": "eb25629ce30b96850b39bf034124fb8d627c82402baeb89d72e24869005ace24"}, {"shape": [1, 88, 128], "sha256": "1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748", "value_sha256": "1561cf66bb84117ff09036ee128d5c2e5aa21f69db459b82000dc467527df748"}, {"shape": [1, 22, 128], "sha256": "4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a", "value_sha256": "4366612cb46ecc942d06aabe6043fea79b494a34f08f797fec5e0a76ff067a1a"}], [{"shape": [1, 3, 10240], "sha256": "431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda", "value_sha256": "431c351776e8973a28d2206fee9c9262c74df879b561ecb28fdf53f1c6941dda"}, {"shape": [1, 48, 128, 128], "sha256": "c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f", "value_sha256": "c8d64ecbf9dab273a4be2d0b7b00b4fccbb59d25d99ef47ba26a3488dc1ba28f"}], [{"shape": [1, 3, 10240], "sha256": "f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a", "value_sha256": "f4ce935821cd12c5981db92dc849ca6fb25d845a8b38f0ca2ac7f98afa99666a"}, {"shape": [1, 48, 128, 128], "sha256": "8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f", "value_sha256": "8093f937ad983da7c65154990a2a163c7ab09d7e776c7d2b84a8310469433d6f"}], [{"shape": [1, 3, 10240], "sha256": "3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d", "value_sha256": "3c1051a65bbd484bd5bc7ff79919bbb0f8b99f899215efc47ad415541c4ccc7d"}, {"shape": [1, 48, 128, 128], "sha256": "bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f", "value_sha256": "bcbf58854152187ff9556062117970701ac56898d9af860d2b9b3840eaf84b1f"}], [{"shape": [1, 2, 88, 256], "sha256": "9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b", "value_sha256": "9e6bc46ee9a8170bf6bfe9a0cd592543b15d24225ba39e71bddb4aeef947555b"}, {"shape": [1, 2, 88, 256], "sha256": "b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba", "value_sha256": "b84ee35f5c3e0ac8181df0ae66e2278a03db0783c0ea83e4bbabc21bdf47f7ba"}, {"shape": [1, 88, 128], "sha256": "491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae", "value_sha256": "491cccffe6e1c810e6ce8d32fe160005762d1964da055d58746febef7000f5ae"}, {"shape": [1, 22, 128], "sha256": "104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb", "value_sha256": "104bbc74bbb75851ad6a7466e2f2e1a1421a9c93fc0d62aaaf37aa60e2a1dcdb"}], [{"shape": [1, 3, 10240], "sha256": "e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57", "value_sha256": "e87be44991fddef0510651dc23006f2a056a56cf0a61a5f8b38daa34be0c8b57"}, {"shape": [1, 48, 128, 128], "sha256": "0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43", "value_sha256": "0645fe9e0d09d4d55d3919d729ea1340b4ade128dec572010ebb07a5de306f43"}], [{"shape": [1, 3, 10240], "sha256": "f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0", "value_sha256": "f2904788ae98c816e237db5ecc398c269205f38acb680a17e7d00b53289400d0"}, {"shape": [1, 48, 128, 128], "sha256": "75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52", "value_sha256": "75f9e87f1c559b714f5d07911976152045b4b283c50d49794c68cdc66a3cea52"}], [{"shape": [1, 3, 10240], "sha256": "c23b7e52452271Line truncated