Port Qwen row-map SwiGLU expert gathers
This commit is contained in:
Georg Bauer committed
1 parent
8965e77ea1
commit
7b894fbfee
42 files changed
+11489
-65
No files matched your search
@@ -0,0 +1,157 @@
|
||||
# Qwen row-map expert gather (#112)
|
||||
|
||||
The sorted Qwen gate/up path now retains the uint32 token row map, builds GPU
|
||||
per-expert row/tile prefix sums, and dispatches the pinned 64×64×64 NAX kernel.
|
||||
The kernel reads original token rows and emits SwiGLU directly. Down projection
|
||||
continues through the #110 guarded stock gather. The unsorted decode/verify
|
||||
path is unchanged. Packed and separate gate/up weights preserve their original
|
||||
activation rounding and fallback ordering.
|
||||
|
||||
Oracle: MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`, MLX 0.32.2.
|
||||
Installed Bare-Speed artifact: `74559cdf34fbfc0b593de72d17e93f37fd4f9ea7`;
|
||||
artifact hashes and machine details are in ../issue104-ar/environment.json.
|
||||
Native pre-port baseline: `8965e77ea173c932e00f70759d0a83ac1c5072f0`.
|
||||
|
||||
Only GPU shader source is shipped from the oracle: the MTPLX kernel body and
|
||||
its MLX 0.32.2 GPU template/functor closure, with MIT licenses in `metal/`.
|
||||
`tools/issue112-extract-metal.py` reproduces those files from the pinned
|
||||
reference environment. All scheduling, policy, graph construction, checking,
|
||||
model loading and sessions remain Rust. There is no production Python/MLX/C
|
||||
runtime dependency and the pinned runtime metallib is unchanged.
|
||||
|
||||
## Route and failure contract
|
||||
|
||||
- All original tensor/layout predicates, affine BF16/F16, b4/b8, groups
|
||||
32/64/128, N/K multiples of 64, and the 4,096-routed-row threshold apply.
|
||||
- Below-threshold, non-NAX and ineligible inputs retain the stock path.
|
||||
`MTPLX_MOE_SORTED_GATHER_KERNEL=0` and the GPU-family rehearsal switch are
|
||||
resolved by Qwen policy without mutating the process environment.
|
||||
- Whole-first-call canaries are keyed by compiled instantiation and the
|
||||
under/from-64-rows-per-expert regime. They compare uint16 bits, including
|
||||
signed zero, then reuse the checked result. Compile/dispatch failures or
|
||||
mismatches disable that key for the process with a reason and counters.
|
||||
- A failed packed SwiGLU canary tries the separately checked plain row-map
|
||||
gather before guarded stock fallback, as upstream does. Separate SwitchGLU
|
||||
returns to its original up/gate/compiled-activation chain.
|
||||
- The only generalized helper is Qwen's GatherQMM: its existing BF16 behavior
|
||||
is retained, with the F16/group-128 specializations needed for the oracle's
|
||||
supported canary/fallback contract. All callers are in the Qwen module.
|
||||
|
||||
## Isolated verification
|
||||
|
||||
The native synthetic matrix covers 72 cases: BF16/F16 × b4/b8 × g32/64/128 ×
|
||||
packed/separate × 4,096/8,193/32,769 routed rows. It includes empty expert runs,
|
||||
partial tiles, both canary regimes, a strided uint32 row map and int64 expert
|
||||
IDs. Every result equals guarded stock and the pinned oracle bit for bit;
|
||||
48 first-use canaries pass. Actual installed layer-0 projections additionally
|
||||
cover 410/2,048/3,277/4,095/4,096/8,192 tokens (12 packed/separate cases).
|
||||
|
||||
Failure injection uses actual invalid Metal source, a changed output sign bit,
|
||||
and explicitly differing positive/negative zero. Each disables its key and
|
||||
subsequent calls use exact stock output without another canary. Metadata and
|
||||
policy tests cover all exclusion predicates and switch spellings. The full
|
||||
model off-switch run checks the unchanged output/state and absence of kernel
|
||||
activation.
|
||||
|
||||
The full-model large-prefix control reuses #110's 7,374-token cold prompt and
|
||||
3,278-token warm suffix at chunks 2,048 and 4,096. It checks every logit and
|
||||
cache array against the pre-port, pinned-oracle receipts, plus cancellation
|
||||
and retry. Explicit hidden-state tests use an MTP-capable runtime with cold
|
||||
4,096-token and warm 2,048-token-suffix prefills; an AR-only runtime correctly
|
||||
omits warm hidden arrays in the oracle. The AR timing tests compare complete
|
||||
state after one generated token. State reads occur after measured intervals.
|
||||
|
||||
## Paired release measurements
|
||||
|
||||
M5 Max, 128 GiB; serial before/after processes, three repetitions per chunk
|
||||
and phase, identical installed artifacts and token IDs. Both default boundary
|
||||
splitting (tail interval 256) and full chunks (tail interval 0) are measured.
|
||||
The latter exercises the wide row regime and guarded partial tails. The
|
||||
release baseline uses unchanged committed production source with only the
|
||||
same measurement test module added. No other GPU workload or build ran during
|
||||
these measurements.
|
||||
|
||||
Cells show median ± sample standard deviation across all three repetitions.
|
||||
Repetition zero includes first-use initialization/canary work; this is not an
|
||||
isolated measurement of canary overhead. All individual times and means are
|
||||
in release-performance.json. TTFT starts at the request call and ends at its
|
||||
first token callback, after model loading.
|
||||
|
||||
| Tail policy / chunk / phase | Before TTFT s | After TTFT s | Before prefill tok/s | After prefill tok/s |
|
||||
|---|---:|---:|---:|---:|
|
||||
| Default / 2048 / cold | 2.959 ± 0.473 | 2.953 ± 0.480 | 1385.831 ± 183.340 | 1388.955 ± 186.819 |
|
||||
| Default / 2048 / warm | 1.839 ± 0.075 | 1.900 ± 0.088 | 1115.426 ± 45.227 | 1079.363 ± 52.619 |
|
||||
| Default / 4096 / cold | 3.690 ± 0.063 | 3.684 ± 0.029 | 1111.739 ± 19.009 | 1113.593 ± 8.843 |
|
||||
| Default / 4096 / warm | 2.012 ± 0.013 | 1.989 ± 0.019 | 1019.529 ± 6.863 | 1031.159 ± 10.182 |
|
||||
| Full / 2048 / cold | 2.411 ± 0.475 | 2.504 ± 0.428 | 1699.510 ± 259.818 | 1636.600 ± 239.080 |
|
||||
| Full / 2048 / warm | 1.262 ± 0.063 | 1.334 ± 0.052 | 1623.785 ± 78.593 | 1536.347 ± 64.230 |
|
||||
| Full / 4096 / cold | 3.100 ± 0.116 | 2.999 ± 0.136 | 1321.520 ± 49.755 | 1366.360 ± 58.429 |
|
||||
| Full / 4096 / warm | 1.767 ± 0.057 | 1.634 ± 0.086 | 1159.717 ± 36.444 | 1254.103 ± 61.907 |
|
||||
|
||||
Peak physical footprint: default 84.724 → 84.669 GB; full chunks
|
||||
88.579 → 87.952 GB. The results are mixed and do not establish an overall
|
||||
speedup. In particular, the default 256-token tail grid often keeps the small
|
||||
stock route; setting chunk size 4096 does not imply every body call has that
|
||||
width. The port fulfills the current-route obligation without assuming the
|
||||
upstream isolated-kernel speedup applies to this server benchmark.
|
||||
|
||||
## Reproduction
|
||||
|
||||
Set `DS4_QWEN38_ARTIFACTS` to the installed artifact directory. Build the release
|
||||
test executable with `cargo test --release --all-features --bin ds4-server
|
||||
issue112 --no-run`, then copy the executable reported by Cargo outside `target`
|
||||
before running it. Run each ignored test in its own serial process under
|
||||
`target/debug/test-supervisor MEMORY_MIB 60 120 --command TEST_EXECUTABLE FILTER
|
||||
--ignored --nocapture --test-threads=1`:
|
||||
|
||||
- `issue112_all_kernel_variants` and `issue112_canary_failures`: 4096 MiB.
|
||||
- `issue112_installed_gate_up`: 16384 MiB.
|
||||
- `issue112_full_model_state`: 114688 MiB,
|
||||
`DS4_ISSUE110_DIR=OUTPUT_DIRECTORY`, `MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0`.
|
||||
- `issue112_hidden_prefill`: 114688 MiB,
|
||||
`DS4_ISSUE112_DIR=OUTPUT_DIRECTORY`, `MTPLX_GDN_BOUNDARY_TAIL_INTERVAL=0`.
|
||||
- `issue112_paired_prefill`: 114688 MiB,
|
||||
`DS4_ISSUE112_DIR=OUTPUT_DIRECTORY`, optionally tail interval 0;
|
||||
`DS4_ISSUE112_REPEATS` defaults to 3. Also run a one-repetition full-chunk
|
||||
control with `MTPLX_MOE_SORTED_GATHER_KERNEL=0`.
|
||||
|
||||
Keep child stdout/stderr separate from the supervisor's resource output to
|
||||
avoid interleaved JSON writes. Under the isolated MLX 0.32.2 reference Python,
|
||||
run `tools/issue112-reference.py PINNED_CHECKOUT NATIVE_VARIANT_OUTPUT`,
|
||||
`tools/issue112-installed-reference.py PINNED_CHECKOUT MODEL_DIR NATIVE_OUTPUT`,
|
||||
and `tools/issue112-model-reference.py PINNED_CHECKOUT MODEL_DIR NATIVE_DIR
|
||||
ORACLE_DIR` (add `--hidden` for the hidden-state run; use matching tail policy).
|
||||
The full-model oracle uses the server's lazy-snapshot policy for cache
|
||||
fingerprints, matching the native session entry; a deep clone adds zero and
|
||||
would change negative-zero key bits during measurement itself.
|
||||
|
||||
For the before arm, build commit `8965e77` with only `issue112_bench.rs` and its
|
||||
`#[cfg(test)] mod issue112_bench;` registration added. Do not use an off-switch
|
||||
run as the only baseline: the preserved pre-port executable is the baseline.
|
||||
Both arms use the same test harness. Run timing arms without other builds or
|
||||
GPU work; correctness checks may run alongside CPU-only compilation.
|
||||
|
||||
## Completion review
|
||||
|
||||
All 72 synthetic and 12 installed projection receipts match guarded stock
|
||||
and pinned MTPLX; compile/sign-bit/signed-zero failures pass sticky-fallback
|
||||
checks. All four large-prefix snapshots match #110's pre-port/oracle fixtures.
|
||||
The 24 release before/after state comparisons and four explicit hidden-state
|
||||
comparisons are exact. The direct pinned oracle matches all four representative
|
||||
release states and all four hidden-prefill states, including every cache bit.
|
||||
The off-switch matches all four baseline states with zero kernel activation.
|
||||
|
||||
DeepSeek's `resident_multi_session_switching_preserves_each_kv_frontier` and
|
||||
GLM's `glm53_two_row_verifier_restores_recurrent_state` both pass on the preserved
|
||||
before binary and the final after binary with installed models. Source review
|
||||
confirms no DS4/GLM model, sampling, cache, shader, or orchestration path changed.
|
||||
Their DS4 oracle behavior remains assigned to those families; this is the Qwen
|
||||
MTPLX route port, not a new DS4Server-only feature. Non-NAX predicates are tested;
|
||||
no physical M1–M4 run is claimed.
|
||||
|
||||
All required commit gates pass: formatting, warning-free Clippy, signed app
|
||||
bundle, and all-features tests (312 application + 8 tool tests; 234 explicitly
|
||||
ignored hardware/reference tests). Relevant ignored tests above were run
|
||||
separately under the resource supervisor. Machine-readable evidence, exact
|
||||
state fingerprints, gate logs, resource summaries and binary/source provenance
|
||||
are stored beside this file. No acceptance item is deferred to a stub.
|
||||
@@ -0,0 +1,10 @@
|
||||
|
||||
running 1 test
|
||||
test engine::metal::tests::resident_multi_session_switching_preserves_each_kv_frontier ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
|
||||
ds4: Metal 4 tensor API enabled for Tensor kernels
|
||||
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
|
||||
ds4: Metal model views created in 2.169 ms, residency requested in 7304.599 ms, warmup 5.656 ms (mapped 82697.67 MiB from offset 5.09 MiB)
|
||||
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
|
||||
ok
|
||||
|
||||
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 539 filtered out; finished in 7.89s
|
||||
@@ -0,0 +1,11 @@
|
||||
ds4: GLM MTP draft 5733 at position 12 in 2.3 ms
|
||||
verify2 scalar boundary cap=2 cancelled=true passed
|
||||
verify2 prefill 0
|
||||
verify2 prefill 4
|
||||
verify2 prefill 8
|
||||
verify2 prefill 12
|
||||
ds4: GLM MTP draft 5733 at position 12 in 2.4 ms
|
||||
engine-lifetime counters across new and restored chats passed
|
||||
ok
|
||||
|
||||
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 539 filtered out; finished in 9.18s
|
||||
@@ -0,0 +1,8 @@
|
||||
cargo build --release --all-targets --all-features
|
||||
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
|
||||
Finished `release` profile [optimized] target(s) in 29.05s
|
||||
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
|
||||
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
|
||||
cargo packager --release --formats app
|
||||
codesign --force --deep --sign - --timestamp=none target/release/DS4Server.app
|
||||
target/release/DS4Server.app: replacing existing signature
|
||||
@@ -0,0 +1,4 @@
|
||||
Checking ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
|
||||
Finished `dev` profile [unoptimized + debuginfo] target(s) in 5.14s
|
||||
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
|
||||
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
|
||||
@@ -0,0 +1,10 @@
|
||||
|
||||
running 1 test
|
||||
test engine::metal::tests::resident_multi_session_switching_preserves_each_kv_frontier ... ds4: Metal device Apple M5 Max, 128.00 GiB RAM
|
||||
ds4: Metal 4 tensor API enabled for Tensor kernels
|
||||
ds4: drift-patch flags hc_stable=on norm_unify=on kv_raw_f32=off rope_exp2_log2=off math_safe=off tensor_matmul=on
|
||||
ds4: Metal model views created in 1.781 ms, residency requested in 8958.289 ms, warmup 2.850 ms (mapped 82697.67 MiB from offset 5.09 MiB)
|
||||
ds4: Metal mapped mmaped model as 2 overlapping shared buffers
|
||||
ok
|
||||
|
||||
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 545 filtered out; finished in 9.53s
|
||||
Whitespace-only changes.
@@ -0,0 +1 @@
|
||||
{"metrics":{"chunk":2048,"rep":0,"phase":"cold","prompt":4096,"cached":0,"ttft_seconds":3.126132542,"prefill_seconds":3.1225067920000003,"prefill_tokens_per_second":1311.766562203846,"elapsed_seconds":3.147092209},"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"metrics":{"chunk":2048,"rep":0,"phase":"warm","prompt":6145,"cached":4097,"ttft_seconds":1.262224125,"prefill_seconds":1.258582084,"prefill_tokens_per_second":1627.2279941337542,"elapsed_seconds":1.282883709},"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"metrics":{"chunk":4096,"rep":0,"phase":"cold","prompt":4096,"cached":0,"ttft_seconds":2.955218083,"prefill_seconds":2.9541866239999997,"prefill_tokens_per_second":1386.50685326507,"elapsed_seconds":2.9757388750000002},"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"metrics":{"chunk":4096,"rep":0,"phase":"warm","prompt":6145,"cached":4097,"ttft_seconds":1.606924,"prefill_seconds":1.6059842079999997,"prefill_tokens_per_second":1275.2304722538095,"elapsed_seconds":1.62792175},"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,Line truncated
|
||||
@@ -0,0 +1,11 @@
|
||||
ds4: GLM MTP draft 5733 at position 12 in 2.3 ms
|
||||
verify2 scalar boundary cap=2 cancelled=true passed
|
||||
verify2 prefill 0
|
||||
verify2 prefill 4
|
||||
verify2 prefill 8
|
||||
verify2 prefill 12
|
||||
ds4: GLM MTP draft 5733 at position 12 in 2.4 ms
|
||||
engine-lifetime counters across new and restored chats passed
|
||||
ok
|
||||
|
||||
test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 545 filtered out; finished in 11.86s
|
||||
@@ -0,0 +1 @@
|
||||
{"case":"hidden_prefill","chunk":2048,"phase":"cold","cached":0,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,2Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"case":"hidden_prefill","chunk":2048,"phase":"warm","cached":4096,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,37Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"case":"hidden_prefill","chunk":4096,"phase":"cold","cached":0,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,2Line truncated
|
||||
@@ -0,0 +1 @@
|
||||
{"case":"hidden_prefill","chunk":4096,"phase":"warm","cached":4096,"state":{"ids":[9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,374,264,1092,13,9707,11,1075,37Line truncated
|
||||
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,19 @@
|
||||
{
|
||||
"baseline": "8965e77ea173c932e00f70759d0a83ac1c5072f0",
|
||||
"mtplx": "9882703f3105363ddc37eca9f97aa09a1d387112",
|
||||
"mlx": "0.32.2",
|
||||
"artifact": "74559cdf34fbfc0b593de72d17e93f37fd4f9ea7",
|
||||
"sha256": {
|
||||
"metal/mtplx-moe-sorted-body.metal": "b639a135d2b9532d45c9587d94a503a093553078d8f5b5a9470c34d1bd9fca2e",
|
||||
"metal/mtplx-moe-sorted-header.metal": "d3251a6cfcdbac5372c3e7e1f97720df48a91f0e456a44883c42b98cc8520e4a",
|
||||
"metal/mtplx-runtime-0.32.2.metallib": "dc59d1cceb1a5c7e578232e6e41e28e2c73c9463ac6dbc3886c3ee17ffc270ed",
|
||||
"/private/tmp/ds4-issue112-before-release-test": "9718805d3827bf5e998e2f574b48b7e453a45ed3de578ea9df6a450019aea0d6",
|
||||
"/private/tmp/ds4-issue112-after-release-test": "9bcc33ddebe79fa026d7cb4a7c2a4dfcdba2645f66861a1e74778cf55e434912",
|
||||
"/private/tmp/ds4-issue112-final-test": "f313f1ae0a43a05d359ce234977f00dba87ef8d1320034acf856592f2e2eba72"
|
||||
},
|
||||
"binary_scope": {
|
||||
"before-release-test": "Full-chunk timing, hidden-state and family controls. The earlier default-tail run used the same baseline production source before the hidden-only test configuration was corrected.",
|
||||
"after-release-test": "Default-tail and full-chunk timings; production identical to final-test.",
|
||||
"final-test": "Final kernel, model, hidden-state, off-switch and family checks; corrected hidden-only test configuration."
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,838 @@
|
||||
[
|
||||
{
|
||||
"configuration": "default-tail",
|
||||
"arm": "before",
|
||||
"records": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.7007944999999998,
|
||||
"prefill_seconds": 3.6969075010000005,
|
||||
"prefill_tokens_per_second": 1107.9530658779117,
|
||||
"elapsed_seconds": 3.721188
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.7724733750000001,
|
||||
"prefill_seconds": 1.769735542,
|
||||
"prefill_tokens_per_second": 1157.23505088536,
|
||||
"elapsed_seconds": 1.793335125
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.820473209,
|
||||
"prefill_seconds": 2.81689246,
|
||||
"prefill_tokens_per_second": 1454.0846191906098,
|
||||
"elapsed_seconds": 2.841268834
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.838782375,
|
||||
"prefill_seconds": 1.836070168,
|
||||
"prefill_tokens_per_second": 1115.4257803942492,
|
||||
"elapsed_seconds": 1.8597940419999999
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.959423792,
|
||||
"prefill_seconds": 2.9556270000000002,
|
||||
"prefill_tokens_per_second": 1385.831162051233,
|
||||
"elapsed_seconds": 2.98031925
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.922527375,
|
||||
"prefill_seconds": 1.919643709,
|
||||
"prefill_tokens_per_second": 1066.8646428492007,
|
||||
"elapsed_seconds": 1.9441567499999999
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.626180458,
|
||||
"prefill_seconds": 3.6201352510000007,
|
||||
"prefill_tokens_per_second": 1131.4494393181994,
|
||||
"elapsed_seconds": 3.64758525
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.994229042,
|
||||
"prefill_seconds": 1.9914031639999998,
|
||||
"prefill_tokens_per_second": 1028.4205815392588,
|
||||
"elapsed_seconds": 2.016047875
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.6903119589999998,
|
||||
"prefill_seconds": 3.6843170420000004,
|
||||
"prefill_tokens_per_second": 1111.7392866322168,
|
||||
"elapsed_seconds": 3.711886
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 2.011648875,
|
||||
"prefill_seconds": 2.0087712079999998,
|
||||
"prefill_tokens_per_second": 1019.5287506331085,
|
||||
"elapsed_seconds": 2.033881333
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.752376958,
|
||||
"prefill_seconds": 3.7459722089999996,
|
||||
"prefill_tokens_per_second": 1093.4411072669013,
|
||||
"elapsed_seconds": 3.774499291
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 2.020803542,
|
||||
"prefill_seconds": 2.017895623,
|
||||
"prefill_tokens_per_second": 1014.918698795354,
|
||||
"elapsed_seconds": 2.043202292
|
||||
}
|
||||
],
|
||||
"summary": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.1602305003333333,
|
||||
"median": 2.959423792,
|
||||
"sample_stddev": 0.47326936772912714
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1315.9562823732515,
|
||||
"median": 1385.831162051233,
|
||||
"sample_stddev": 183.340222420435
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.844594375,
|
||||
"median": 1.838782375,
|
||||
"sample_stddev": 0.07519564639658331
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1113.1751580429366,
|
||||
"median": 1115.4257803942492,
|
||||
"sample_stddev": 45.227222310038556
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.689623125,
|
||||
"median": 3.6903119589999998,
|
||||
"sample_stddev": 0.06310106989799923
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1112.2099444057726,
|
||||
"median": 1111.7392866322168,
|
||||
"sample_stddev": 19.00853664502584
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 2.0088938196666666,
|
||||
"median": 2.011648875,
|
||||
"sample_stddev": 0.013499768886162316
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1020.9560103225738,
|
||||
"median": 1019.5287506331085,
|
||||
"sample_stddev": 6.863163415905101
|
||||
}
|
||||
}
|
||||
],
|
||||
"resources": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 41097,
|
||||
"peak": {
|
||||
"cpu_time_ns": 19599062416,
|
||||
"resident_bytes": 25489604608,
|
||||
"physical_bytes": 84724073856,
|
||||
"peak_physical_bytes": 84724139512,
|
||||
"disk_read_bytes": 64097386496,
|
||||
"disk_write_bytes": 442368
|
||||
},
|
||||
"error": null
|
||||
}
|
||||
},
|
||||
{
|
||||
"configuration": "default-tail",
|
||||
"arm": "after",
|
||||
"records": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.699041667,
|
||||
"prefill_seconds": 3.6953074989999997,
|
||||
"prefill_tokens_per_second": 1108.4327897227588,
|
||||
"elapsed_seconds": 3.719328292
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.776398,
|
||||
"prefill_seconds": 1.7737045,
|
||||
"prefill_tokens_per_second": 1154.6455455235075,
|
||||
"elapsed_seconds": 1.797202167
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.80434375,
|
||||
"prefill_seconds": 2.8008109150000005,
|
||||
"prefill_tokens_per_second": 1462.4336038050606,
|
||||
"elapsed_seconds": 2.825135334
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.900156542,
|
||||
"prefill_seconds": 1.897415875,
|
||||
"prefill_tokens_per_second": 1079.3627411808177,
|
||||
"elapsed_seconds": 1.9216478750000001
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.952652333,
|
||||
"prefill_seconds": 2.948979292,
|
||||
"prefill_tokens_per_second": 1388.9551585226932,
|
||||
"elapsed_seconds": 2.973752041
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.947212708,
|
||||
"prefill_seconds": 1.944330169,
|
||||
"prefill_tokens_per_second": 1053.3190466582735,
|
||||
"elapsed_seconds": 1.9688718330000001
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.637618958,
|
||||
"prefill_seconds": 3.631528458,
|
||||
"prefill_tokens_per_second": 1127.8997390139687,
|
||||
"elapsed_seconds": 3.659774833
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.9611875410000001,
|
||||
"prefill_seconds": 1.958409373,
|
||||
"prefill_tokens_per_second": 1045.7466289914453,
|
||||
"elapsed_seconds": 1.982932208
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.6904271250000003,
|
||||
"prefill_seconds": 3.684310291,
|
||||
"prefill_tokens_per_second": 1111.7413237440048,
|
||||
"elapsed_seconds": 3.71194925
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.988992875,
|
||||
"prefill_seconds": 1.98611425,
|
||||
"prefill_tokens_per_second": 1031.159209496634,
|
||||
"elapsed_seconds": 2.010877
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.684088083,
|
||||
"prefill_seconds": 3.6781829150000003,
|
||||
"prefill_tokens_per_second": 1113.5933406944227,
|
||||
"elapsed_seconds": 3.705752166
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.998740333,
|
||||
"prefill_seconds": 1.9958163330000003,
|
||||
"prefill_tokens_per_second": 1026.1465276825147,
|
||||
"elapsed_seconds": 2.021001667
|
||||
}
|
||||
],
|
||||
"summary": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.1520125833333332,
|
||||
"median": 2.952652333,
|
||||
"sample_stddev": 0.4795096169325091
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1319.940517350171,
|
||||
"median": 1388.9551585226932,
|
||||
"sample_stddev": 186.81918963228082
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.8745890833333332,
|
||||
"median": 1.900156542,
|
||||
"sample_stddev": 0.0882308751191163
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1095.775777787533,
|
||||
"median": 1079.3627411808177,
|
||||
"sample_stddev": 52.619441949355554
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.6707113886666667,
|
||||
"median": 3.684088083,
|
||||
"sample_stddev": 0.02883361907462447
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1117.7448011507988,
|
||||
"median": 1113.5933406944227,
|
||||
"sample_stddev": 8.843051732845977
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.9829735830000002,
|
||||
"median": 1.988992875,
|
||||
"sample_stddev": 0.019486583946006573
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1034.3507887235314,
|
||||
"median": 1031.159209496634,
|
||||
"sample_stddev": 10.18236840333609
|
||||
}
|
||||
}
|
||||
],
|
||||
"resources": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 40871,
|
||||
"peak": {
|
||||
"cpu_time_ns": 19458778041,
|
||||
"resident_bytes": 25328418816,
|
||||
"physical_bytes": 84668646808,
|
||||
"peak_physical_bytes": 84668761376,
|
||||
"disk_read_bytes": 69973549056,
|
||||
"disk_write_bytes": 18446744073709289472
|
||||
},
|
||||
"error": null
|
||||
}
|
||||
},
|
||||
{
|
||||
"configuration": "full-chunks",
|
||||
"arm": "before",
|
||||
"records": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.182152,
|
||||
"prefill_seconds": 3.17999279,
|
||||
"prefill_tokens_per_second": 1288.0532348628376,
|
||||
"elapsed_seconds": 3.202144875
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.219195625,
|
||||
"prefill_seconds": 1.21829175,
|
||||
"prefill_tokens_per_second": 1681.042328325707,
|
||||
"elapsed_seconds": 1.240087208
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.317122125,
|
||||
"prefill_seconds": 2.3159108330000002,
|
||||
"prefill_tokens_per_second": 1768.6345871503593,
|
||||
"elapsed_seconds": 2.338011208
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.26216725,
|
||||
"prefill_seconds": 1.261251084,
|
||||
"prefill_tokens_per_second": 1623.7845310743853,
|
||||
"elapsed_seconds": 1.283571459
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.411353459,
|
||||
"prefill_seconds": 2.410105791,
|
||||
"prefill_tokens_per_second": 1699.510459373026,
|
||||
"elapsed_seconds": 2.431755125
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.34331275,
|
||||
"prefill_seconds": 1.34238875,
|
||||
"prefill_tokens_per_second": 1525.6385305672443,
|
||||
"elapsed_seconds": 1.364779
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.2133175,
|
||||
"prefill_seconds": 3.212275166,
|
||||
"prefill_tokens_per_second": 1275.1086965879188,
|
||||
"elapsed_seconds": 3.233724875
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.7273878329999999,
|
||||
"prefill_seconds": 1.7264041659999998,
|
||||
"prefill_tokens_per_second": 1186.2807332915115,
|
||||
"elapsed_seconds": 1.7481919160000001
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.980801042,
|
||||
"prefill_seconds": 2.979894292,
|
||||
"prefill_tokens_per_second": 1374.5454028340412,
|
||||
"elapsed_seconds": 3.001205167
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.7668409999999999,
|
||||
"prefill_seconds": 1.765948334,
|
||||
"prefill_tokens_per_second": 1159.7168278197203,
|
||||
"elapsed_seconds": 1.787861709
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.100441792,
|
||||
"prefill_seconds": 3.0994622499999998,
|
||||
"prefill_tokens_per_second": 1321.5195635952657,
|
||||
"elapsed_seconds": 3.121023875
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.838995291,
|
||||
"prefill_seconds": 1.838062583,
|
||||
"prefill_tokens_per_second": 1114.216686059378,
|
||||
"elapsed_seconds": 1.860065208
|
||||
}
|
||||
],
|
||||
"summary": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 2.6368758613333334,
|
||||
"median": 2.411353459,
|
||||
"sample_stddev": 0.4745676312458291
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1585.3994271287409,
|
||||
"median": 1699.510459373026,
|
||||
"sample_stddev": 259.81840735698063
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.274891875,
|
||||
"median": 1.26216725,
|
||||
"sample_stddev": 0.06302937601316841
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1610.1551299891123,
|
||||
"median": 1623.7845310743853,
|
||||
"sample_stddev": 78.59329182503896
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.098186778,
|
||||
"median": 3.100441792,
|
||||
"sample_stddev": 0.11627463019215153
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1323.7245543390752,
|
||||
"median": 1321.5195635952657,
|
||||
"sample_stddev": 49.755011058230345
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.7777413746666666,
|
||||
"median": 1.7668409999999999,
|
||||
"sample_stddev": 0.05659655286508827
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1153.4047490568698,
|
||||
"median": 1159.7168278197203,
|
||||
"sample_stddev": 36.444320265304924
|
||||
}
|
||||
}
|
||||
],
|
||||
"resources": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 35856,
|
||||
"peak": {
|
||||
"cpu_time_ns": 21540742125,
|
||||
"resident_bytes": 25113673728,
|
||||
"physical_bytes": 88578784936,
|
||||
"peak_physical_bytes": 88578866928,
|
||||
"disk_read_bytes": 69525413888,
|
||||
"disk_write_bytes": 524288
|
||||
},
|
||||
"error": null
|
||||
}
|
||||
},
|
||||
{
|
||||
"configuration": "full-chunks",
|
||||
"arm": "after",
|
||||
"records": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.126132542,
|
||||
"prefill_seconds": 3.1225067920000003,
|
||||
"prefill_tokens_per_second": 1311.766562203846,
|
||||
"elapsed_seconds": 3.147092209
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.262224125,
|
||||
"prefill_seconds": 1.258582084,
|
||||
"prefill_tokens_per_second": 1627.2279941337542,
|
||||
"elapsed_seconds": 1.282883709
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.304937333,
|
||||
"prefill_seconds": 2.303636208,
|
||||
"prefill_tokens_per_second": 1778.058525810426,
|
||||
"elapsed_seconds": 2.325319833
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.333947917,
|
||||
"prefill_seconds": 1.3330325,
|
||||
"prefill_tokens_per_second": 1536.346638210246,
|
||||
"elapsed_seconds": 1.354474625
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.504060958,
|
||||
"prefill_seconds": 2.502749457,
|
||||
"prefill_tokens_per_second": 1636.6000953646394,
|
||||
"elapsed_seconds": 2.524487958
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.363442375,
|
||||
"prefill_seconds": 1.362460209,
|
||||
"prefill_tokens_per_second": 1503.1631650388993,
|
||||
"elapsed_seconds": 1.3840412500000001
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.955218083,
|
||||
"prefill_seconds": 2.9541866239999997,
|
||||
"prefill_tokens_per_second": 1386.50685326507,
|
||||
"elapsed_seconds": 2.9757388750000002
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 0,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.606924,
|
||||
"prefill_seconds": 1.6059842079999997,
|
||||
"prefill_tokens_per_second": 1275.2304722538095,
|
||||
"elapsed_seconds": 1.62792175
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 3.209116167,
|
||||
"prefill_seconds": 3.2081535000000003,
|
||||
"prefill_tokens_per_second": 1276.7468888256126,
|
||||
"elapsed_seconds": 3.230131833
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 1,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.767990417,
|
||||
"prefill_seconds": 1.767019791,
|
||||
"prefill_tokens_per_second": 1159.0136174088839,
|
||||
"elapsed_seconds": 1.789304875
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "cold",
|
||||
"prompt": 4096,
|
||||
"cached": 0,
|
||||
"ttft_seconds": 2.998665042,
|
||||
"prefill_seconds": 2.997745792,
|
||||
"prefill_tokens_per_second": 1366.3600198959098,
|
||||
"elapsed_seconds": 3.019893375
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"rep": 2,
|
||||
"phase": "warm",
|
||||
"prompt": 6145,
|
||||
"cached": 4097,
|
||||
"ttft_seconds": 1.633976833,
|
||||
"prefill_seconds": 1.633039209,
|
||||
"prefill_tokens_per_second": 1254.1033850951462,
|
||||
"elapsed_seconds": 1.656772416
|
||||
}
|
||||
],
|
||||
"summary": [
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 2.645043611,
|
||||
"median": 2.504060958,
|
||||
"sample_stddev": 0.4283660515917751
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1575.475061126304,
|
||||
"median": 1636.6000953646394,
|
||||
"sample_stddev": 239.08001001547228
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 2048,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.3198714723333334,
|
||||
"median": 1.333947917,
|
||||
"sample_stddev": 0.052056635063226324
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1555.5792657942998,
|
||||
"median": 1536.346638210246,
|
||||
"sample_stddev": 64.22959541694213
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "cold",
|
||||
"ttft_seconds": {
|
||||
"mean": 3.054333097333333,
|
||||
"median": 2.998665042,
|
||||
"sample_stddev": 0.1357949135761868
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1343.2045873288641,
|
||||
"median": 1366.3600198959098,
|
||||
"sample_stddev": 58.42895678910406
|
||||
}
|
||||
},
|
||||
{
|
||||
"chunk": 4096,
|
||||
"phase": "warm",
|
||||
"ttft_seconds": {
|
||||
"mean": 1.6696304166666667,
|
||||
"median": 1.633976833,
|
||||
"sample_stddev": 0.0862495286509525
|
||||
},
|
||||
"prefill_tokens_per_second": {
|
||||
"mean": 1229.4491582526132,
|
||||
"median": 1254.1033850951462,
|
||||
"sample_stddev": 61.90688583198103
|
||||
}
|
||||
}
|
||||
],
|
||||
"resources": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 34614,
|
||||
"peak": {
|
||||
"cpu_time_ns": 20995139625,
|
||||
"resident_bytes": 25576030208,
|
||||
"physical_bytes": 87952375368,
|
||||
"peak_physical_bytes": 87952457288,
|
||||
"disk_read_bytes": 64869085184,
|
||||
"disk_write_bytes": 442368
|
||||
},
|
||||
"error": null
|
||||
}
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,184 @@
|
||||
{
|
||||
"final-variants": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 440,
|
||||
"peak": {
|
||||
"cpu_time_ns": 245994500,
|
||||
"resident_bytes": 281100288,
|
||||
"physical_bytes": 399917944,
|
||||
"peak_physical_bytes": 419464080,
|
||||
"disk_read_bytes": 0,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-failures": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 219,
|
||||
"peak": {
|
||||
"cpu_time_ns": 53213250,
|
||||
"resident_bytes": 70057984,
|
||||
"physical_bytes": 177390336,
|
||||
"peak_physical_bytes": 177636096,
|
||||
"disk_read_bytes": 0,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-installed": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 760,
|
||||
"peak": {
|
||||
"cpu_time_ns": 504222750,
|
||||
"resident_bytes": 2076639232,
|
||||
"physical_bytes": 4867475808,
|
||||
"peak_physical_bytes": 5012703704,
|
||||
"disk_read_bytes": 0,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-variants-oracle": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 762,
|
||||
"peak": {
|
||||
"cpu_time_ns": 562100250,
|
||||
"resident_bytes": 142884864,
|
||||
"physical_bytes": 359269216,
|
||||
"peak_physical_bytes": 387105656,
|
||||
"disk_read_bytes": 0,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-installed-oracle": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 1200,
|
||||
"peak": {
|
||||
"cpu_time_ns": 959967166,
|
||||
"resident_bytes": 2091220992,
|
||||
"physical_bytes": 3261778056,
|
||||
"peak_physical_bytes": 4137257216,
|
||||
"disk_read_bytes": 421888,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"after-hidden": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 19796,
|
||||
"peak": {
|
||||
"cpu_time_ns": 16081049958,
|
||||
"resident_bytes": 25542393856,
|
||||
"physical_bytes": 87610048312,
|
||||
"peak_physical_bytes": 87611588312,
|
||||
"disk_read_bytes": 65141735424,
|
||||
"disk_write_bytes": 147456
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-model": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 29057,
|
||||
"peak": {
|
||||
"cpu_time_ns": 23619215916,
|
||||
"resident_bytes": 25820266496,
|
||||
"physical_bytes": 101435424688,
|
||||
"peak_physical_bytes": 101440126416,
|
||||
"disk_read_bytes": 71619133440,
|
||||
"disk_write_bytes": 208896
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"off": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 18110,
|
||||
"peak": {
|
||||
"cpu_time_ns": 14743490958,
|
||||
"resident_bytes": 25949437952,
|
||||
"physical_bytes": 88457051624,
|
||||
"peak_physical_bytes": 88460278864,
|
||||
"disk_read_bytes": 66400653312,
|
||||
"disk_write_bytes": 147456
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"final-model-oracle": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 19987,
|
||||
"peak": {
|
||||
"cpu_time_ns": 17635902708,
|
||||
"resident_bytes": 25024905216,
|
||||
"physical_bytes": 84086635888,
|
||||
"peak_physical_bytes": 84086652296,
|
||||
"disk_read_bytes": 103826788352,
|
||||
"disk_write_bytes": 311296
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"hidden-oracle": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 19800,
|
||||
"peak": {
|
||||
"cpu_time_ns": 17457184041,
|
||||
"resident_bytes": 25029591040,
|
||||
"physical_bytes": 84092452352,
|
||||
"peak_physical_bytes": 84092468760,
|
||||
"disk_read_bytes": 103815700480,
|
||||
"disk_write_bytes": 18446744073709027328
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"deepseek": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 9561,
|
||||
"peak": {
|
||||
"cpu_time_ns": 2757894458,
|
||||
"resident_bytes": 130564096,
|
||||
"physical_bytes": 307839816,
|
||||
"peak_physical_bytes": 319898440,
|
||||
"disk_read_bytes": 86739410944,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"glm": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 11928,
|
||||
"peak": {
|
||||
"cpu_time_ns": 3587549375,
|
||||
"resident_bytes": 905478144,
|
||||
"physical_bytes": 1335444992,
|
||||
"peak_physical_bytes": 1488717432,
|
||||
"disk_read_bytes": 96510627840,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"before-deepseek": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 7984,
|
||||
"peak": {
|
||||
"cpu_time_ns": 2510786166,
|
||||
"resident_bytes": 130416640,
|
||||
"physical_bytes": 301171504,
|
||||
"peak_physical_bytes": 319750984,
|
||||
"disk_read_bytes": 69381001216,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
},
|
||||
"before-glm": {
|
||||
"event": "test_resource_summary",
|
||||
"elapsed_ms": 9244,
|
||||
"peak": {
|
||||
"cpu_time_ns": 2799064958,
|
||||
"resident_bytes": 905216000,
|
||||
"physical_bytes": 1335182800,
|
||||
"peak_physical_bytes": 1488471648,
|
||||
"disk_read_bytes": 68293218304,
|
||||
"disk_write_bytes": 0
|
||||
},
|
||||
"error": null
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,218 @@
|
||||
[
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-0-cold",
|
||||
"before": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"after": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-0-warm",
|
||||
"before": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"after": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-1-cold",
|
||||
"before": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"after": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-1-warm",
|
||||
"before": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"after": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-2-cold",
|
||||
"before": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"after": "a2703e87cc7c4ad2875ce10acfbf1f3d9f52f9a2e60ebb0deca96eabdbe1df8a",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "2048-2-warm",
|
||||
"before": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"after": "01419a6cc7e7df73215f36a5f0f69516cb19ed537e54d379ffa105f0b258b3b4",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-0-cold",
|
||||
"before": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"after": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-0-warm",
|
||||
"before": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"after": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-1-cold",
|
||||
"before": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"after": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-1-warm",
|
||||
"before": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"after": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-2-cold",
|
||||
"before": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"after": "40261bef7a25aea30203d13bf91d34dc27c6ecfb2be56c777a1ed7e2defbb48f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "default",
|
||||
"case": "4096-2-warm",
|
||||
"before": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"after": "b4bf12137a534f71947b81f413a956e14d4bb42d493907f82ce5fb1be8fca3e8",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-0-cold",
|
||||
"before": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"after": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-0-warm",
|
||||
"before": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"after": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-1-cold",
|
||||
"before": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"after": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-1-warm",
|
||||
"before": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"after": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-2-cold",
|
||||
"before": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"after": "8458c6beaa14c37b7adab9708f4d74d2d491726d5b80241398ecbdc37081b352",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "2048-2-warm",
|
||||
"before": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"after": "84b32d2e43daf4b57f6e6c58f5a9625227ce996e89e7f3a6f029df720892a891",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-0-cold",
|
||||
"before": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"after": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-0-warm",
|
||||
"before": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"after": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-1-cold",
|
||||
"before": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"after": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-1-warm",
|
||||
"before": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"after": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-2-cold",
|
||||
"before": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"after": "466f9143f42f0520e3d51cde389e6cfca65a2396b1fcc9356bad3cf7fb3f3a8b",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "full",
|
||||
"case": "4096-2-warm",
|
||||
"before": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"after": "2e0e79e826860dc131b0ac7b458981658a3b4af838e2b6b2953bd542f0fd609f",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "hidden",
|
||||
"case": "2048-cold",
|
||||
"before": "9616a339d8ec57e48fd4342d244b0fbeb86148722f1e6733f5ff4ea5c4862bf5",
|
||||
"after": "9616a339d8ec57e48fd4342d244b0fbeb86148722f1e6733f5ff4ea5c4862bf5",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "hidden",
|
||||
"case": "2048-warm",
|
||||
"before": "fe0116cf8aebc195d3fb01970cb8be133d17750bf0284db1825747e6e21f0e0b",
|
||||
"after": "fe0116cf8aebc195d3fb01970cb8be133d17750bf0284db1825747e6e21f0e0b",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "hidden",
|
||||
"case": "4096-cold",
|
||||
"before": "40d9efadffeeec8cc6e42d31241276a1fb727bac9fba3e0621343057e7588403",
|
||||
"after": "40d9efadffeeec8cc6e42d31241276a1fb727bac9fba3e0621343057e7588403",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "hidden",
|
||||
"case": "4096-warm",
|
||||
"before": "2a40fec32283b8a2434181655260daa14fe9b3731b37e6a82c842a75df14d586",
|
||||
"after": "2a40fec32283b8a2434181655260daa14fe9b3731b37e6a82c842a75df14d586",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "off",
|
||||
"case": "2048-0-cold",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "off",
|
||||
"case": "4096-0-warm",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "off",
|
||||
"case": "4096-0-cold",
|
||||
"exact": true
|
||||
},
|
||||
{
|
||||
"configuration": "off",
|
||||
"case": "2048-0-warm",
|
||||
"exact": true
|
||||
}
|
||||
]
|
||||
@@ -0,0 +1,589 @@
|
||||
Compiling ds4-server v0.1.0 (/Users/gb/Projects/DS4Server)
|
||||
Finished `test` profile [unoptimized + debuginfo] target(s) in 6.12s
|
||||
warning: the following packages contain code that will be rejected by a future version of Rust: block v0.1.6
|
||||
note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
|
||||
Running unittests src/main.rs (target/debug/deps/ds4_server-5679c54d8848b708)
|
||||
|
||||
running 546 tests
|
||||
test agent::tests::anchored_edits_require_unique_head_and_tail ... ok
|
||||
test agent::tests::ai_risk_response_requires_structured_risk_and_reason ... ok
|
||||
test a2ui::tests::streaming_parser_only_accepts_complete_a2ui_jsonl_lines ... ok
|
||||
test agent::tests::ai_shell_risk_assessment_receives_the_dev_brain_root ... ok
|
||||
test a2ui::tests::embedded_catalog_and_validator_cover_the_same_components ... ok
|
||||
test agent::tests::dev_brain_paths_are_trusted_by_shell_risk_assessment ... ok
|
||||
test a2ui::tests::basic_formatters_follow_catalog_examples ... ok
|
||||
test a2ui::tests::catalog_validation_rejects_invalid_variants_and_function_arguments ... ok
|
||||
test a2ui::tests::catalog_accepts_pie_donut_and_heatmap_charts ... ok
|
||||
test a2ui::tests::dismissal_boundaries_replay_history_and_a_fresh_active_epoch ... ok
|
||||
test a2ui::tests::lifecycle_updates_incrementally_and_json_pointer_upserts ... ok
|
||||
test a2ui::tests::latest_created_surface_is_the_active_surface ... ok
|
||||
test agent::tests::present_svg_parsers_recover_exact_source_for_both_model_transports ... ok
|
||||
test a2ui::tests::catalog_validation_and_actions_use_current_local_data ... ok
|
||||
test agent::tests::ralph_loop_stops_on_cap_blocker_failure_and_cancellation ... ok
|
||||
test a2ui::tests::all_basics_compose_into_one_surface ... ok
|
||||
test a2ui::tests::v1_action_and_function_round_trips_follow_current_schema ... ok
|
||||
test agent::tests::ralph_report_semantics_and_handoff_bound_are_enforced ... ok
|
||||
test agent::tests::risky_shell_commands_require_one_time_approval ... ok
|
||||
test agent::tests::generated_schemas_match_the_executable_tool_contracts ... ok
|
||||
test agent::tests::model_adapters_preserve_primitives_and_report_recoverable_syntax_errors ... ok
|
||||
test agent::tests::scripted_ralph_backend_gets_fresh_prompts_and_only_validated_handoffs ... ok
|
||||
test agent::tests::repeated_call_advisories_use_canonical_arguments_and_reset_per_user_turn ... ok
|
||||
test agent::tests::project_boundary_rejects_parent_paths ... ok
|
||||
test a2ui::export::tests::static_svg_renderer_covers_the_complete_catalog ... ok
|
||||
test agent::tests::ralph_report_schemas_are_child_only_and_parse_for_both_models ... ok
|
||||
test agent::tests::stored_tool_cards_restore_ai_approval_reasons_by_call ... ok
|
||||
test agent::tests::tool_output_keeps_terminal_lines_but_parameter_summaries_do_not ... ok
|
||||
test agent::tests::present_svg_executes_without_side_effects_and_maps_only_completed_cards ... ok
|
||||
test agent::web::tests::browser_helpers_preserve_ds4_wire_values ... ok
|
||||
test agent::web::tests::headless_browser_extracts_a_local_page ... ignored, requires an installed Chrome browser
|
||||
test agent::tests::prompts_and_parsers_expose_the_reference_tool_set ... ok
|
||||
test agent::tests::validation_is_precise_and_prevents_side_effects_until_corrected ... ok
|
||||
test app::generation::tests::attached_image_marker_is_model_only ... ok
|
||||
test agent::tests::present_svg_validation_enforces_the_static_vector_boundary ... ok
|
||||
test agent::tests::glob_confinement_skips_symlinks_and_honors_cancellation ... ok
|
||||
test agent::tests::successful_structured_file_tools_report_project_paths ... ok
|
||||
test agent::tests::glob_finds_all_regular_file_names_deterministically_without_reading_them ... ok
|
||||
test agent::tests::standard_agent_skills_are_discovered_prompted_and_read_only ... ok
|
||||
test agent::tests::shell_commands_skip_user_startup_files ... ok
|
||||
test app::generation::tests::plain_chat_uses_the_same_unmodified_prompt_in_ui_and_headless ... ok
|
||||
test app::generation::tests::queued_guidance_is_one_reference_style_user_turn ... ok
|
||||
test app::generation::tests::title_context_starts_at_the_first_user_and_ignores_system_rows ... ok
|
||||
test app::generation::tests::turn_summary_accumulates_model_continuations ... ok
|
||||
test agent::tests::shell_environment_is_loaded_once_from_login_and_interactive_startup_files ... ok
|
||||
test agent::tests::standard_file_tools_can_maintain_only_managed_dev_brain_pages ... ok
|
||||
test app::git::tests::configured_git_diff_options_change_the_rendered_patch ... ok
|
||||
test app::git::tests::unified_diff_parser_aligns_replacements_for_split_view ... ok
|
||||
test agent::tests::ralph_round_contexts_are_unique_and_child_jobs_are_cleaned_up ... ok
|
||||
test app::git::tests::unstage_works_before_the_first_commit ... ok
|
||||
test app::preferences::tests::runtime_config_updates_after_lock_poisoning ... ok
|
||||
test app::git::tests::libgit2_status_merges_staged_and_worktree_changes ... ok
|
||||
test app::projects::tests::discarding_a_session_removes_every_checkpoint_stage ... ok
|
||||
test app::projects::tests::draft_titles_follow_the_stored_session_count ... ok
|
||||
test agent::tests::denial_and_stop_cancel_commands_awaiting_approval ... ok
|
||||
test app::projects::tests::session_states_are_exclusive_and_ordered ... ok
|
||||
test app::projects::tests::sweeping_removes_checkpoints_of_sessions_that_no_longer_exist ... ok
|
||||
test app::projects::tests::git_state_lists_and_switches_local_branches ... ok
|
||||
test app::tests::background_activity_drives_polling_indicators_and_quit_confirmation ... ok
|
||||
test agent::tests::shell_environment_probe_stops_blocked_startup_files ... ok
|
||||
test app::git::tests::origin_fetch_pull_and_push_use_the_current_branch ... ok
|
||||
test app::tests::chat_html_export_embeds_loaded_a2ui_images_as_data_urls ... ok
|
||||
test agent::tests::oversized_shell_output_is_bounded_and_retained_until_cleanup ... ok
|
||||
test app::tests::chat_only_follows_updates_while_near_the_tail ... ok
|
||||
test app::tests::ds4_gib_and_streaming_cache_inputs_are_typed ... ok
|
||||
test app::tests::one_shot_titles_are_reduced_to_a_single_sidebar_line ... ok
|
||||
test app::tests::owned_runtime_paths_stay_in_application_support ... ok
|
||||
test app::tests::preferences_shortcut_and_dspark_support_are_explicit ... ok
|
||||
test app::tests::source_does_not_depend_on_a_sibling_ds4_checkout ... ok
|
||||
test app::tests::stored_session_always_selects_its_model ... ok
|
||||
test app::tests::tab_scrolls_a_field_back_into_the_preferences_viewport ... ok
|
||||
test app::view::a2ui::tests::renderer_input_helpers_cover_dates_numbers_choices_and_weights ... ok
|
||||
test app::view::chat::tests::chat_divider_groups_token_counts_by_thousands ... ok
|
||||
test app::view::chat::tests::composer_uses_shift_enter_for_line_breaks ... ok
|
||||
test app::view::git::tests::split_diff_width_covers_the_longest_side_and_tabs ... ok
|
||||
test app::tests::chat_export_preserves_completed_svg_and_keeps_failures_generic ... ok
|
||||
test app::view::tests::action_buttons_share_geometry ... ok
|
||||
test app::view::tests::context_pie_wedge_follows_the_fill_grade ... ok
|
||||
test app::view::tests::download_measurements_are_readable ... ok
|
||||
test app::view::tests::raised_surfaces_stay_dark ... ok
|
||||
test compaction::tests::a_new_summary_replaces_the_previous_rebuild_summary ... ok
|
||||
test compaction::tests::hard_trigger_and_retry_reserve_match_the_reference ... ok
|
||||
test compaction::tests::soft_trigger_matches_reference_thresholds ... ok
|
||||
test compaction::tests::summary_budget_keeps_answer_room_and_rejects_exhausted_contexts ... ok
|
||||
test compaction::tests::summary_control_markup_is_private ... ok
|
||||
test compaction::tests::tail_prefers_the_first_user_boundary_after_target ... ok
|
||||
test config::tests::defaults_write_an_empty_file_and_reload_unchanged ... ok
|
||||
test config::tests::deprecated_flash_config_migrates_and_persists_only_0731 ... ok
|
||||
test config::tests::explicit_0731_dspark_opt_out_survives_the_default ... ok
|
||||
test config::tests::invalid_files_are_reported_instead_of_reset ... ok
|
||||
test config::tests::legacy_flat_model_settings_are_dropped_but_the_prompt_is_kept ... ok
|
||||
test config::tests::model_profiles_expose_only_their_upstream_thinking_modes ... ok
|
||||
test app::preferences::tests::selectors_rehydrate_their_generation_and_model_profiles ... ok
|
||||
test config::tests::only_changed_values_are_written_and_read_back ... ok
|
||||
test config::tests::qwen_selection_and_native_defaults_survive_restart ... ok
|
||||
test app::preferences::tests::multiline_system_prompt_round_trips_through_the_editor ... ok
|
||||
test app::generation::tests::legacy_generation_rows_collapse_into_their_user_turn ... ok
|
||||
test app::generation::tests::model_history_uses_persisted_content_without_changing_the_transcript ... ok
|
||||
test app::view::stats::tests::current_session_summary_uses_persisted_chat_facts ... ok
|
||||
test app::generation::tests::assistant_markdown_keeps_llm_tables ... ok
|
||||
test app::generation::tests::forced_compaction_requires_new_visible_chat ... ok
|
||||
test app::generation::tests::last_compaction_selects_its_tail_without_hiding_history ... ok
|
||||
test app::tests::assistant_stream_keeps_reasoning_separate_from_the_answer ... ok
|
||||
test app::generation::tests::extension_context_deduplicates_session_start_and_rearms_after_compaction ... ok
|
||||
test app::generation::tests::complete_tool_call_in_reasoning_gets_one_correction ... ok
|
||||
test app::tests::chat_export_formats_visible_turns_reasoning_and_bash_tools ... ok
|
||||
test app::tests::chat_html_export_is_safe_standalone_and_renders_embedded_surfaces ... ok
|
||||
test app::generation::tests::a2ui_auto_switch_waits_for_a_renderable_surface ... ok
|
||||
test dev_brain::tests::path_confinement_and_unrelated_notes_are_preserved ... ok
|
||||
test database::tests::context_work_reactivates_an_archived_session ... ok
|
||||
test dsml::tests::parses_reference_and_legacy_dsml_syntaxes ... ok
|
||||
test dsml::tests::recovers_complete_invokes_before_an_incomplete_one ... ok
|
||||
test dsml::tests::recovers_complete_invokes_without_the_outer_closing_tag ... ok
|
||||
test engine::ds4_sampling::tests::heap_fallback_preserves_rng_and_signed_zero_ties ... ok
|
||||
test engine::gguf::tests::accepts_exact_mxfp4_block_layout ... ok
|
||||
test database::tests::a2ui_dismissal_persists_a_fresh_surface_boundary ... ok
|
||||
test engine::gguf::tests::keeps_unknown_tensor_kinds_rejected ... ok
|
||||
test engine::gguf::tests::mxfp4_scalar_dot_matches_independent_values ... ok
|
||||
test engine::gguf::tests::maps_metadata_and_tensor_payload_without_copying_weights ... ok
|
||||
test engine::gguf::tests::rejects_mxfp4_dimension_overflow ... ok
|
||||
test database::tests::inline_svg_tool_call_survives_session_switch_compaction_and_reopen ... ok
|
||||
test database::tests::sessions_are_ordered_by_recent_use_within_sidebar_groups ... ok
|
||||
test engine::gguf::tests::rejects_mxfp4_rows_that_are_not_block_aligned ... ok
|
||||
test engine::gguf::tests::rejects_truncated_mxfp4_payload ... ok
|
||||
test engine::metal::glm::tests::dsa_indexer_schedule_matches_the_reference ... ok
|
||||
test engine::metal::glm::tests::glm53_m5_text_performance_gate ... ignored, requires the installed GLM 5.3 Flash Q2 checkpoint and Apple Metal
|
||||
test engine::metal::glm::tests::glm53_m5_vision_performance_and_oracle_gate ... ignored, requires GLM 5.3 Q2, its vision sidecar, a fixed image, and Apple Metal
|
||||
test engine::metal::glm::tests::glm53_reference_logits_replay_separates_sampling_from_execution ... ignored, requires the installed GLM 5.3 Flash Q2 checkpoint and Apple Metal
|
||||
test engine::metal::glm::tests::glm53_reference_prompt_tokens_match_shared_runtime ... ignored, installed GLM and DS4SERVER_GLM_REFERENCE_LOG from the standalone reference
|
||||
test engine::metal::glm::tests::glm53_two_row_verifier_restores_recurrent_state ... ignored, installed GLM 5.3 and Metal; run under test-supervisor
|
||||
test engine::metal::glm::tests::glm_byte_budget_reserves_prefill_before_dynamic_experts ... ok
|
||||
test engine::metal::glm::tests::glm_mtp_preserves_target_tokens_and_drafts ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
|
||||
test engine::metal::glm::tests::glm_prefill_schedule_matches_ds4_boundaries ... ok
|
||||
test engine::metal::glm::tests::glm_resident_decode_flushes_periodically_without_a_final_or_ssd_flush ... ok
|
||||
test engine::metal::glm::tests::repeated_glm_prompt_rewinds_one_token_for_logits ... ok
|
||||
test engine::metal::glm::tests::resident_and_streamed_glm_match_ds4_decode_oracles ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
|
||||
test engine::metal::glm::tests::streamed_glm_uses_ds4_indexed_prefill_for_long_prompts ... ignored, requires the 197 GiB GLM 5.2 checkpoint and Apple Metal
|
||||
test engine::metal::gpu::qwen_mtplx_allocation_tests::backend_allocation_policy_is_explicit_inside_and_outside_qwen_scope ... ignored, requires Apple Metal; allocation only, no GPU dispatch or model
|
||||
test engine::metal::gpu::qwen_mtplx_allocation_tests::dispatch_retains_allocation_without_changing_data_donation ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::gpu::qwen_mtplx_allocation_tests::empty_storage_preserves_data_identity_views_and_zero_allocator_usage ... ignored, requires Apple Metal context; empty descriptors, no GPU allocation
|
||||
test engine::metal::gpu::qwen_mtplx_allocation_tests::mtplx_tensor_cpu_access_releases_native_storage ... ignored, requires Apple Metal; CPU buffer access only, no GPU dispatch or model
|
||||
test engine::metal::markov::tests::installed_markov_worker_dispatch ... ignored, requires installed 0731 DSpark support; CPU dispatch diagnostic, not parity acceptance
|
||||
test engine::metal::markov::tests::markov_workers_reuse_threads_and_buffers_with_ordered_ties ... ok
|
||||
test engine::metal::power_throttle_keeps_ds4_ewma_and_full_power_bypass ... ok
|
||||
test engine::kvstore::tests::opening_reclaims_checkpoints_the_index_cannot_reach ... ok
|
||||
test engine::metal::qwen::tests::affine_split_k_matches_reference_shapes_and_scratch_bound ... ok
|
||||
test engine::metal::qwen::tests::dense_attention_crossover_is_phase_specific ... ok
|
||||
test engine::kvstore::tests::budget_evicts_the_least_valuable_unprotected_entry ... ok
|
||||
test engine::metal::qwen::tests::qwen_affine_qmv_and_qmm_match_mlx_reference ... ignored, requires the pinned Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_affine_qmv_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_core_boundary_and_checkpoint_are_stable ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_fused_gdn_input_rows_match_separate_projections ... ignored, requires the pinned Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_gdn_conv_norm_rows_matches_mtplx ... ignored, requires Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_gdn_delta_rows_matches_mtplx ... ignored, requires Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_layer_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_lazy_target_probabilities_match_batched_sampling ... ignored, requires the pinned Qwen metadata and Apple Metal; no model inference
|
||||
test dev_brain::tests::skill_index_migration_does_not_overwrite_an_unrelated_root_note ... ok
|
||||
test engine::metal::qwen::tests::qwen_m5_performance_gate ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_metal_primitives_match_reference_vectors ... ignored, requires Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_mtp_matches_target_and_restores_its_cache ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_ple_gather_copies_only_the_requested_row ... ok
|
||||
test database::tests::session_model_migration_preserves_data_and_accepts_catalog ... ok
|
||||
test engine::metal::qwen::tests::qwen_qsa_dense_mask_accepts_unsorted_blocks ... ignored, requires Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_qsa_full_context_preallocation_succeeds ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qsa_selection_and_capacity_cover_the_full_native_window ... ok
|
||||
test engine::metal::qwen::tests::qwen_qsa_logical_depth_oracles_cover_prefill_decode_and_state ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_qsa_real_layer_executes_the_first_sparse_token ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_qsa_selection_and_attention_remain_bounded_at_native_depths ... ignored, requires Apple Metal and allocates the full QSA score window
|
||||
test engine::metal::qwen::tests::qwen_reference_layer_trace ... ignored, diagnostic trace against the pinned MLX-LM reference
|
||||
test engine::metal::qwen::tests::qwen_reference_sdpa_trace ... ignored, diagnostic comparison with captured MTPLX SDPA inputs
|
||||
test engine::metal::qwen::tests::qwen_reference_stateful_trace ... ignored, diagnostic trace against the pinned MLX-LM reference
|
||||
test engine::metal::qwen::tests::qwen_reference_verify_trace ... ignored, diagnostic trace against the pinned MTPLX verifier
|
||||
test engine::metal::qwen::tests::qwen_sorted_routed_prefill_matches_grouped_output ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_stage_counters_preserve_async_batches ... ignored, requires pinned Qwen embeddings and Apple Metal; stage profiler opt-in
|
||||
test engine::metal::qwen::tests::qwen_target_submission_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen::tests::qwen_verify_layer_profile ... ignored, requires the pinned 105 GB Qwen artifact set and Apple Metal
|
||||
test engine::metal::qwen_mtplx::allocator::mtplx_allocations_preserve_logical_bounds_with_reference_rounding ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::allocator::mtplx_native_allocator_heap_limits_and_gpu_lifetime ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::allocator::mtplx_native_allocator_replays_reference_allocations ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::ar::mtplx_ar_driver_matches_reference ... ignored, requires Apple Metal; unchanged MTPLX generate_ar orchestration oracle
|
||||
test engine::metal::qwen_mtplx::array::mtplx_array_detach_clears_every_siblings_inputs_and_primitive ... ok
|
||||
test engine::metal::qwen::tests::qwen_ple_hash_contract_matches_golden_boundaries ... ok
|
||||
test engine::metal::qwen_mtplx::array::mtplx_array_materialization_keeps_geometry_and_rejects_short_storage ... ignored, requires Apple Metal; typed materialized descriptors without model weights
|
||||
test engine::metal::qwen_mtplx::array::mtplx_array_layout_preserves_dtype_shape_stride_and_materialization_flags ... ok
|
||||
test engine::metal::qwen_mtplx::array::mtplx_dtype_promotion_matches_all_reference_pairs ... ok
|
||||
test engine::kvstore::tests::longest_compatible_prefix_wins_and_hits_survive_reopen ... ok
|
||||
test engine::metal::qwen_mtplx::attention::mtplx_qsa_dense_mask_graph_matches_reference ... ignored, requires Apple Metal; original MTPLX block mask including sentinel and tails
|
||||
test engine::metal::qwen_mtplx::attention::mtplx_qsa_eager_array_graph_matches_reference ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::attention::mtplx_qsa_prefill_gather_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX tiled prefill gather
|
||||
test engine::metal::qwen_mtplx::attention::mtplx_qsa_rows_gather_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX QSA rows-gather attention
|
||||
test engine::metal::qwen_mtplx::attention::mtplx_sdpa_fallback_graph_matches_reference ... ignored, requires Apple M5 Max; actual Qwen SDPA fallback reference
|
||||
test engine::metal::qwen_mtplx::binary::mtplx_graph_binary_preserves_reference_branches ... ignored, requires Apple Metal; binary graph broadcast/layout and donation branches
|
||||
test engine::metal::qwen_mtplx::binding::mtplx_installed_module_binding_matches_reference ... ignored, requires installed DS4_QWEN38_ARTIFACTS and SSD policy; only small norms and four table rows evaluated
|
||||
test engine::metal::qwen_mtplx::cache::mtplx_kv_cache_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX KVCache growth, trim and state receipts
|
||||
test engine::metal::qwen_mtplx::cache::mtplx_qsa_cache_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX positional cache, mirror and held state aliases
|
||||
test engine::metal::qwen_mtplx::compile_graph::mtplx_compile_scalar_bits_and_custom_kernel_identity ... ignored, requires Metal buffers and external supervisor; scalar ownership only, no GPU dispatch
|
||||
test engine::metal::qwen_mtplx::context_copy::prompt_copy_match_and_backoff_preserve_reference_policy ... ok
|
||||
test engine::metal::qwen_mtplx::decoder::mtplx_decoder_connected_attention_and_moe_advance_caches ... ignored, requires Apple Metal and external test-supervisor; complete decoder/cache smoke
|
||||
test engine::metal::qwen_mtplx::decoder::mtplx_decoder_residual_preserves_graph_order ... ok
|
||||
test engine::metal::qwen_mtplx::dense::mtplx_dense_attention_batches_match_reference ... ignored, requires Apple M5 Max; actual BF16 batched matmul reference
|
||||
test engine::metal::qwen_mtplx::dense::mtplx_dense_float_graph_matches_reference ... ignored, requires Apple M5 Max; floating Matmul factory and original dispatch
|
||||
test engine::metal::qwen_mtplx::compiled::mtplx_replay_replaces_descriptors_without_rebuilding_primitives ... ok
|
||||
test engine::metal::qwen_mtplx::dense::mtplx_qsa_score_array_graph_matches_reference ... ignored, requires Apple M5 Max; canonical QSA F32 graph with the original TF32 setting
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_empty_bindings_preserve_nil_dependencies_without_dummy_storage ... ignored, requires Apple Metal; empty original-kernel grids and nil bindings
|
||||
test engine::metal::qwen_mtplx::allocator::mtplx_allocator_cache_matches_live_reference_trace ... ok
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_commits_after_primitives_and_balances_completion ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_scope_routes_operators_and_allocator ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_shared_events_and_error_completion_order ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_untracked_dependencies_across_encoders_and_commands ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_drains_failure_preserves_cause_and_retries_only_failed_nodes ... ignored, requires Apple Metal; supervised evaluator failure and retry
|
||||
test database::tests::migrations_and_crud_work ... ok
|
||||
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_releases_intermediates_and_preserves_descriptor_donation ... ignored, requires Apple Metal; graph ownership and last-consumer release
|
||||
test engine::metal::qwen_mtplx::encoder::mtplx_encoder_barrier_epochs_and_commit_thresholds ... ok
|
||||
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_retains_tracer_topology_without_input_donation ... ignored, requires Apple Metal; evaluator tracer donation and retained topology
|
||||
test engine::metal::qwen_mtplx::eval::execution_tests::mtplx_eval_runs_cpu_gpu_siblings_and_async_continuations ... ignored, requires Apple Metal; tiny supervised CPU/GPU evaluator graph
|
||||
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_preserves_scheduled_detach_and_tracer_errors ... ok
|
||||
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_ar_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_AR_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_tracks_stream_fences_per_leaf_and_cross_device_union ... ok
|
||||
test engine::metal::qwen_mtplx::eval::mtplx_eval_tape_preserves_bfs_width_and_sibling_choice ... ok
|
||||
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_mtp_prefill_matches_reference ... ignored, full installed MTP model; external guard and DS4_QWEN38_MTP_PREFILL_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::execution::mtplx_full_installed_ping_forward_matches_reference ... ignored, full installed model; requires external memory guard and DS4_QWEN38_FORWARD_REFERENCE
|
||||
test engine::metal::qwen_mtplx::execution::qwen_power_throttle_drains_before_sleep_and_bypasses_at_full_power ... ignored, requires Apple Metal; run under test-supervisor
|
||||
test engine::metal::qwen_mtplx::fused::mtplx_compiled_fusion_gpu_matches_reference ... ignored, requires Metal and external supervisor; generated fusion vs pinned SiLU plus multi-output/scalar dispatch
|
||||
test engine::metal::qwen_mtplx::fused::mtplx_compiled_constant_spelling ... ok
|
||||
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_forward_matches_model_reference ... ignored, requires Apple Metal; actual MTPLX GDN forward and cache receipts
|
||||
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_prefill_and_verify_match_model_reference ... ignored, requires Apple Metal; complete GDN Conv1d prefill and fused verify graphs
|
||||
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_staged_primitives_match_reference ... ignored, requires Apple Metal; 80 actual delta-update receipts and six conv-normalization kernels
|
||||
test engine::metal::qwen_mtplx::gdn::mtplx_graph_gdn_step_preserves_views_and_siblings ... ignored, requires Apple Metal; GDN custom primitive strided copies and sibling roots
|
||||
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_event_snapshots_preserve_values_streams_and_shared_errors ... ignored, requires Apple Metal events, no model weights
|
||||
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_fence_coherence_preserves_empty_and_partial_word_spans ... ignored, requires Apple Metal3, model-free empty coherent dispatch
|
||||
test engine::metal::qwen_mtplx::graph_sync::mtplx_graph_fences_transfer_cpu_gpu_gpu_cpu_in_both_modes ... ignored, requires Apple Metal3, tiny model-free coherent fence kernels
|
||||
test engine::metal::qwen_mtplx::hyper::mtplx_graph_hyper_forward_matches_reference ... ignored, requires Apple M5 Max; actual MTPLX GatedResidual reference receipts
|
||||
test engine::metal::qwen_mtplx::hyper::mtplx_graph_hyper_pack_and_reads_match_reference ... ignored, requires Apple Metal; original hyper primitives and runtime pack
|
||||
test engine::metal::qwen_mtplx::indexing::mtplx_graph_indexing_preserves_layouts_and_offsets ... ignored, requires Apple Metal; Select layout branches, GatherAxis views and empty arguments
|
||||
test engine::metal::qwen_mtplx::indexing::mtplx_scatter_axis_graph_matches_reference ... ignored, requires Apple Metal; pinned Bool ScatterAxis layout and broadcast paths
|
||||
test engine::metal::qwen_mtplx::issue103_analysis::issue103_numeric_receipts ... ignored, #103 diagnostic; Metal required, eager versus compiled numeric operands
|
||||
test engine::metal::qwen_mtplx::issue103_analysis::issue103_sampling_receipts ... ignored, #103 diagnostic; Metal required, pins currently broken sampling law and invalid rows
|
||||
test engine::metal::qwen_mtplx::issue103_analysis::issue103_sorted_gather_receipts ... ignored, #103 diagnostic; M5 and pinned runtime shader required; initialized sentinels
|
||||
test engine::metal::qwen_mtplx::issue103_analysis::issue103_tokenizer_receipts ... ignored, #103 diagnostic; installed tokenizer and latest oracle JSONL; no GPU
|
||||
test engine::metal::qwen_mtplx::issue103_analysis::issue103_vision_position_receipts ... ignored, #103 diagnostic; small active attention module on Metal; mixed position boundary
|
||||
test engine::metal::qwen_mtplx::issue104::issue104_installed_ar_stream_and_state ... ignored, full pinned Bare-Speed model; external memory guard required
|
||||
test engine::metal::qwen_mtplx::issue105::issue105_batched_greedy_rejects_each_invalid_row ... ignored, Metal required; run serially under test-supervisor
|
||||
test engine::metal::qwen_mtplx::issue106::issue106_complete_state_and_checkpoint_recovery ... ignored, installed model and actual pre-fix checkpoint; external memory guard required
|
||||
test engine::metal::qwen_mtplx::issue106::issue106_upstream_exit_matrix ... ignored, installed model, scripted logits on real caches; external memory guard required
|
||||
test engine::metal::qwen_mtplx::issue108::issue108_attention_chunk_positions ... ignored, Metal and pinned MTPLX chunk fixtures; external supervisor required
|
||||
test engine::metal::qwen_mtplx::issue109::issue109_gate_phase_and_dtype_laws ... ignored, Metal and exhaustive pinned gate fixtures; external supervisor required
|
||||
test engine::metal::qwen_mtplx::issue110::issue110_actual_projection_rows_match_oracle ... ignored, installed layer weights and pinned oracle receipts; external memory supervisor required
|
||||
test engine::metal::qwen_mtplx::issue110::issue110_guard_allocation_refusal_releases_graph_and_retries ... ignored, Metal allocation refusal and retry; external supervisor required
|
||||
test engine::metal::qwen_mtplx::issue110::issue110_large_cold_and_warm_prefill ... ignored, full installed model and large partial chunks; serial memory supervisor required
|
||||
test engine::metal::qwen_mtplx::issue112_bench::issue112_hidden_prefill ... ignored, full installed model hidden-state prefill; serial supervisor required
|
||||
test engine::metal::qwen_mtplx::issue112_bench::issue112_paired_prefill ... ignored, full installed model; serial memory supervisor and explicit output directory
|
||||
test engine::metal::qwen_mtplx::linear::mtplx_graph_affine_dequantize_matches_reference ... ignored, requires Apple Metal; original table dequantize dtype/group/bit/layout receipts
|
||||
test engine::metal::qwen_mtplx::linear::mtplx_graph_affine_quantize_matches_reference ... ignored, requires Apple Metal; original affine quantize dtype/group/bit/layout receipts
|
||||
test engine::metal::qwen_mtplx::linear::mtplx_graph_gather_qmm_matches_reference ... ignored, requires Apple Metal; original GatherQMM array layouts and expert routing
|
||||
test engine::metal::qwen_mtplx::linear::mtplx_graph_quantized_linear_batched_identity ... ignored, requires Apple Metal and external supervisor; strided/broadcast batched affine dispatch
|
||||
test engine::metal::qwen_mtplx::linear::mtplx_graph_quantized_linear_matches_reference ... ignored, requires Apple M5 Max Metal; 78 pinned affine fixtures through lazy graph
|
||||
test engine::metal::qwen_mtplx::load::mtplx_safetensors_load_laziness_boundaries_and_lifetime ... ignored, requires Apple Metal; bounded CPU Load and dependent GPU graph
|
||||
test engine::metal::qwen_mtplx::mlp::mtplx_graph_shared_mlp_matches_reference ... ignored, requires Apple M5 Max; actual MTPLX shared MLP reference receipts
|
||||
test engine::metal::qwen_mtplx::linear::sorted_gather_guard_matches_pinned_call_predicates ... ok
|
||||
test engine::metal::qwen_mtplx::mlp::mtplx_graph_split_and_compiled_silu_layouts ... ignored, requires Apple Metal; Split sibling ownership and compiled SiLU layouts
|
||||
test engine::metal::qwen_mtplx::moe::mtplx_graph_sparse_moe_matches_reference ... ignored, requires Apple M5 Max; full MoE Array graph, no model weights; use test-supervisor
|
||||
test engine::metal::qwen_mtplx::model::mtplx_model_compile_policy_and_run_boundaries ... ok
|
||||
test engine::metal::qwen_mtplx::moe_sorted::issue112_all_kernel_variants ... ignored, Metal synthetic all supported row-map variants; external supervisor
|
||||
test engine::metal::qwen_mtplx::moe_sorted::issue112_canary_failures ... ignored, Metal canary rejection and sticky fallback; external supervisor
|
||||
test engine::metal::qwen_mtplx::moe_sorted::issue112_full_model_state ... ignored, full installed model; validates all cold/warm state receipts against the pre-port oracle
|
||||
test engine::metal::qwen_mtplx::moe_sorted::issue112_installed_gate_up ... ignored, installed projection weights; external supervisor required
|
||||
test engine::metal::qwen_mtplx::moe_sorted::row_map_applicability ... ok
|
||||
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_embedding_matches_reference ... ignored, requires Apple Metal; full resident NGram graph and lazy decode history
|
||||
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_gpu_rows_and_history_match_reference ... ignored, requires Apple Metal; original lazy NGram GPU row graph, no table
|
||||
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_resident_matches_reference ... ignored, requires Apple Metal; original NGramTable resident gather/dequantize receipts
|
||||
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_table_priority ... ignored, requires Apple Metal; NGram table routing and missing-sidecar behavior
|
||||
test engine::metal::qwen_mtplx::ngram_sidecar::mtplx_ngram_sidecar_matches_reference ... ignored, requires Apple Metal; actual file-backed MTPLX sidecar/LRU/dequantization receipts
|
||||
test database::tests::chat_and_compaction_history_survive_reopen_and_session_deletion ... ok
|
||||
test engine::metal::qwen_mtplx::ngram_stage::mtplx_ngram_stage_allclose_branches ... ignored, requires Apple Metal; stage verification special values and original reduction branches
|
||||
test engine::metal::qwen_mtplx::ngram_stage::mtplx_ngram_stage_matches_reference ... ignored, requires Apple Metal; original complete stage lifecycle and file-backed tables
|
||||
test engine::metal::qwen_mtplx::normalization::mtplx_graph_norm_modules_match_reference ... ignored, requires Apple Metal; connected Qwen normalization graph golden fixtures
|
||||
test engine::metal::qwen_mtplx::normalization::mtplx_graph_rms_norm_preserves_reference_layout_and_values ... ignored, requires Apple Metal; graph RMSNorm donation, copy, broadcast and looped kernels
|
||||
test engine::metal::qwen_mtplx::normalization::mtplx_logsumexp_graph_matches_reference ... ignored, requires Apple Metal; original sampler LogSumExp branches
|
||||
test engine::metal::qwen_mtplx::normalization::mtplx_softmax_graph_storage_matches_reference ... ignored, requires Apple Metal; original Softmax type and storage branches
|
||||
test engine::metal::qwen_mtplx::ops::mtplx_concatenate_preserves_general_general_copy_semantics ... ignored, requires Apple Metal; Concatenate promotion, offsets, strided writers and validation
|
||||
test engine::metal::qwen_mtplx::ops::mtplx_owned_operations_build_and_execute_qsa_layout_graph ... ignored, requires Apple Metal; self-contained lazy QSA-layout recipe, no callback map
|
||||
test engine::metal::qwen_mtplx::ops::mtplx_slice_and_contiguous_preserve_cache_window_semantics ... ignored, requires Apple Metal; normalized Slice and Contiguous cache-window graph
|
||||
test engine::metal::qwen_mtplx::owner::issue105_product::issue105_product_ar_cleanup_and_http_retry ... ignored, installed Qwen model; serial test-supervisor with memory guard required
|
||||
test engine::metal::qwen_mtplx::owner::issue105_product::issue105_product_mtp_cleanup_and_http_retry ... ignored, installed Qwen MTP model; serial test-supervisor with memory guard required
|
||||
test engine::metal::qwen_mtplx::owner::issue106_product::issue106_product_discards_old_checkpoint_and_recovers_cold ... ignored, installed model and actual pre-fix checkpoint; external memory guard required
|
||||
test engine::metal::qwen_mtplx::owner::issue107_product::issue107_vision_product ... ignored, installed model plus vision tower; serial external memory supervisor required
|
||||
test engine::metal::qwen_mtplx::owner::issue109_product::issue109_verify_rows_and_warm_checkpoint ... ignored, installed model; serial external memory supervisor required
|
||||
test engine::metal::qwen_mtplx::fused::mtplx_compiled_emitter_matches_all_pinned_silu_bodies ... ok
|
||||
test engine::metal::qwen_mtplx::owner::issue111_product::issue111_token_prefix_cache ... ignored, installed model; serial external memory supervisor required
|
||||
test engine::metal::qwen_mtplx::owner::qwen_product_generator_chat_matches_reference ... ignored, full installed model through product Generator; external supervisor and chat reference required
|
||||
test engine::metal::qwen_mtplx::owner::qwen_vision_chat_checkpoint_preserves_image_identity ... ignored, requires installed Qwen, Metal, and DS4_QWEN_VISION_IMAGE; run under test-supervisor
|
||||
test engine::metal::qwen_mtplx::fused::mtplx_compile_fusion_preserves_parent_and_output_boundaries ... ok
|
||||
test engine::metal::qwen_mtplx::owner::qwen_mtp_progress_publishes_without_turn_completion_or_double_counting ... ok
|
||||
test engine::metal::qwen_mtplx::ple::mtplx_graph_ple_connected_matches_reference ... ignored, requires Apple M5 Max; complete original PLELayer with real lookup
|
||||
test engine::metal::qwen_mtplx::ple::mtplx_graph_ple_projection_and_cache_match_reference ... ignored, requires Apple M5 Max; actual MTPLX PLELayer after embedding lookup
|
||||
test engine::metal::qwen_mtplx::policy::qwen_server_policy_matches_original_functions ... ignored, requires DS4_QWEN38_POLICY_REFERENCE from pinned MTPLX; CPU-only
|
||||
test engine::metal::qwen_mtplx::prefill::mtplx_mtp_prefill_driver_matches_reference ... ignored, requires Apple Metal; original streaming MTP history prefill
|
||||
test engine::metal::qwen_mtplx::policy::sorted_moe_switch_and_family_rehearsal ... ok
|
||||
test engine::metal::qwen_mtplx::prefill::mtplx_prefill_driver_matches_reference ... ignored, requires Apple Metal; original _prefill control flow and raw cache roots
|
||||
test engine::metal::qwen_mtplx::qsa_attention::mtplx_qsa_attention_module_matches_reference ... ignored, requires Metal and unchanged whole-Attention receipts; no model download
|
||||
test engine::metal::qwen_mtplx::qsa_compile::mtplx_compiled_indexer_array_replay_matches_reference ... ignored, requires Metal and original compiled indexer receipts; no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_core::mtplx_qsa_core_host_matches_reference ... ignored, requires Metal and original host-core receipts; no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_graph::qsa_cache_donation_requires_descriptor_data_and_allocation_contract ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_graph::qsa_completion_owns_buffers_until_gpu_finishes ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_graph::qsa_evaluator_retains_inputs_and_siblings_not_primary_data ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_indexer::issue107::issue107_real_geometry_query_and_block_start_positions ... ignored, Metal and independently verified pinned indexer fixtures; external supervisor required
|
||||
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_canonical_indexer_routes_match_reference ... ignored, requires Metal and original ongoing indexer routing receipts; no weights
|
||||
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_indexer_compiled_commit_matches_reference ... ignored, requires Metal and original indexer lifecycle receipts; no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_indexer::mtplx_qsa_indexer_prefix_matches_reference ... ignored, requires Apple Metal, original stateful QSAIndexer receipts, no model weights
|
||||
test engine::metal::qwen_mtplx::qsa_prefill::mtplx_qsa_prefill_graph_matches_reference ... ignored, requires Metal and original two-stage prefill receipts, no weights
|
||||
test engine::metal::qwen_mtplx::qsa_prepare::mtplx_qsa_prepare_graph_matches_reference ... ignored, requires Apple Metal; parameterized original QSA preparation and traced positions
|
||||
test engine::metal::qwen_mtplx::qsa_select::mtplx_qsa_fused_graph_matches_reference ... ignored, requires Apple Metal and original QSA selector receipts; no model weights
|
||||
test engine::metal::qwen_mtplx::random::mtplx_sampler_prefix_matches_reference ... ignored, requires Apple Metal; original target-prefix sampler and default RNG
|
||||
test engine::metal::qwen_mtplx::random::mtplx_sampler_resident_matches_reference ... ignored, requires Apple Metal; original MTPLX resident sampling and keyed RNG
|
||||
test engine::metal::qwen_mtplx::qsa_graph::qsa_schedule_preserves_the_selected_sibling ... ok
|
||||
test engine::metal::qwen_mtplx::policy::retired_ar_pipeline_flag_cannot_change_server_or_turn_policy ... ok
|
||||
test engine::metal::qwen_mtplx::reduce::mtplx_sampler_argmax_matches_reference ... ignored, requires Apple Metal; original MTPLX greedy ArgReduce and storage
|
||||
test engine::metal::qwen_mtplx::reduce::mtplx_sum_graph_matches_reference ... ignored, requires Apple Metal; original shared sum dispatch and QSA mean
|
||||
test engine::metal::qwen_mtplx::residency::mtplx_residency_matches_reference_lifecycle_cases ... ignored, requires Apple Metal 3 / macOS 15, no model weights
|
||||
test engine::metal::qwen_mtplx::rope::mtplx_rope_graph_matches_reference ... ignored, requires Apple Metal; actual MTPLX RoPE, static YaRN and multi-axis receipts
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_batched_matches_reference ... ignored, requires Apple Metal; original MTPLX bound and serial batch distributions
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_entry_matches_reference ... ignored, requires Apple Metal; actual MTPLX generator sampling entry
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_fallback_matches_reference ... ignored, requires Apple Metal; original sparse fallback and host dense sampler
|
||||
test engine::metal::qwen_mtplx::request::qwen_request_progress_uses_ui_frontiers_and_decode_timer ... ok
|
||||
test engine::metal::qwen_mtplx::request::qwen_request_settings_override_backend_policy ... ok
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_penalties_match_reference ... ignored, requires Apple Metal; original GPU and CPU raw-logit penalties
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_selection_matches_reference ... ignored, requires Apple Metal; original MTPLX sampler selection, no model weights
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_serial_support_matches_reference ... ignored, requires Apple Metal; actual MTPLX serial candidate route, no weights
|
||||
test engine::metal::qwen_mtplx::scheduler::mtplx_cpu_primitive_holds_data_and_temporaries_in_fifo_order ... ignored, requires Apple Metal shared storage, no GPU dispatch or model weights
|
||||
test engine::metal::qwen_mtplx::scheduler::mtplx_cpu_dispatch_counts_tenth_and_completes_after_failed_work ... ok
|
||||
test engine::metal::qwen_mtplx::compile_graph::mtplx_compile_simplify_preserves_reference_parent_rules ... ok
|
||||
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_cpu_events_propagate_errors_without_consuming_source ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::sdpa::mtplx_sdpa_vector_matches_reference ... ignored, requires Apple M5 Max; actual pinned fused SDPA kernels
|
||||
test engine::metal::qwen_mtplx::session_cache::mtplx_full_installed_chat_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_CHAT_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::session_cache::mtplx_session_boundary_policy ... ok
|
||||
test engine::metal::qwen_mtplx::session_cache::mtplx_session_final_state_requires_capture_and_safe_cache ... ok
|
||||
test engine::metal::qwen_mtplx::session_checkpoint::qwen_checkpoint_roundtrip_and_failed_restore_preserve_live_state ... ignored, model-free Metal checkpoint; external supervisor and DS4_QWEN38_CHECKPOINT_DIR required
|
||||
test engine::metal::qwen_mtplx::session_codec::mtplx_session_codec_host_import_matches_reference ... ignored, model-free Metal imports; external supervisor and DS4_HOST_IMPORT_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::session_codec::mtplx_session_codec_matches_original_blobs_and_restore ... ignored, tiny GPU arrays; external supervisor and DS4_SESSION_CODEC_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::sort::mtplx_sort_graph_matches_reference ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_streams_preserve_fifo_errors_and_shutdown ... ok
|
||||
test engine::metal::qwen_mtplx::sparse_attention::mtplx_sparse_attention_graph_matches_reference ... ignored, requires Apple M5; actual MTPLX sparse Decode and TensorOps Prefill consumers
|
||||
test engine::metal::qwen_mtplx::speculative::mtplx_full_installed_mtp_generation_matches_reference ... ignored, full installed model; external guard and DS4_QWEN38_MTP_GENERATION_REFERENCE required
|
||||
test engine::metal::qwen_mtplx::stream::mtplx_stream_routes_queues_events_and_finalizes_all_under_pressure ... ignored, requires Apple Metal, tiny model-free two-queue copy
|
||||
test engine::metal::profile::tests::profile_reports_locality_and_lru_hits ... ok
|
||||
test engine::metal::qwen_mtplx::submission::mtplx_submission_attaches_at_flush_eval_finish_and_drop ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::unary::mtplx_graph_unary_preserves_reference_layout_and_values ... ignored, requires Apple Metal; graph unary layout, donation and kernel boundaries
|
||||
test engine::metal::qwen_mtplx::views::mtplx_dtype_conversion_and_views_preserve_values_layout_and_donation ... ignored, requires Apple Metal; original conversion/view kernels and donation in lazy eval
|
||||
test engine::metal::qwen_mtplx::views::mtplx_dynamic_slice_graph_matches_reference ... ignored, requires Metal and original dynamic slice receipts; no model weights
|
||||
test engine::metal::qwen_mtplx::views::mtplx_reshape_shares_or_copies_in_the_connected_evaluator ... ignored, requires Apple Metal; original Reshape copy kernels and shared backing
|
||||
test engine::metal::qwen_mtplx::views::mtplx_views_preserve_aliases_offsets_strides_and_gpu_output ... ignored, requires Apple Metal; connected zero-copy views and offset-aware original copy kernel
|
||||
test engine::metal::qwen_mtplx::vision::qwen_vision_tower_matches_mtplx_image ... ignored, requires Metal and pinned Qwen vision artifacts/reference values
|
||||
test engine::metal::qwen_mtplx::weights::mtplx_checkpoint_projection_fusions_match_reference ... ignored, requires Apple Metal; bounded lazy checkpoint Load and fusion
|
||||
test engine::metal::qwen_mtplx::weights::mtplx_installed_checkpoint_fusion_metadata_matches_reference ... ignored, requires installed DS4_QWEN38_ARTIFACTS; headers only, never evaluate weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_affine_selection_preserves_reference_boundaries ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_canonical_hyper_and_gdn_kernels_match_reference ... ignored, requires Apple Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::stream::mtplx_stream_registry_preserves_thread_defaults_templates_and_clear ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_delta_update_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_gather_sort_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_decode_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_forward_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_gdn_staged_matches_model_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_norm_modules_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_router_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_sparse_moe_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_connected_switch_glu_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_gate_up_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_cache_lifecycle_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_backings_and_dynamic_copies_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_cache_routing_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_cache_window_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_capacity_matches_reference ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_indexer_modes_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_compiled_scalar_sources_match_reference ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_connected_cache_selection_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_eager_topk_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_f32_scores_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_indexer_preparation_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_indexer_routes_match_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_producer_dispatch_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_canonical_source_bodies_preserve_pinned_hashes ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_selector_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_runtime_affine_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_runtime_argsort_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_runtime_gather_matches_reference ... ignored, requires Apple M5 Max Metal, no model weights
|
||||
test engine::metal::qwen_mtplx::scheduler::mtplx_scheduler_activity_preserves_reference_pressure_and_wait_rules ... ok
|
||||
test engine::metal::tests::batch_raw_span_includes_the_chunk_and_previous_window ... ok
|
||||
test engine::metal::tests::compression_schedule_tracks_the_deepseek_model_shape ... ok
|
||||
test engine::metal::tests::decode_feature_policy_keeps_device_generations_and_rollbacks_separate ... ok
|
||||
test engine::metal::tests::decode_raw_span_tracks_the_logical_sliding_window ... ok
|
||||
test engine::metal::tests::directional_steering_matches_the_ds4_token_oracle ... ignored, requires the installed Flash GGUF, DS4 steering fixture, and a Metal device
|
||||
test engine::metal::tests::dspark_confidence_quantizes_q8_input_like_ds4 ... ok
|
||||
test engine::metal::tests::dspark_markov_activation_matches_q8_rounding ... ok
|
||||
test engine::metal::tests::dspark_matches_original_summary_cycles ... ignored, requires installed 0731/DSpark and DS4SERVER_DSPARK_REFERENCE cycle recording
|
||||
test engine::metal::tests::dspark_runs_a_target_owned_greedy_cycle ... ignored, requires the installed 0731 Flash and checkpoint-specific DSpark GGUF fixtures
|
||||
test engine::metal::tests::dspark_scheduler_matches_the_ds4_default_window ... ok
|
||||
test engine::metal::tests::dspark_verifier_selects_only_the_committed_row ... ok
|
||||
test engine::metal::tests::flash_0731_long_context_crosses_indexed_prefill_boundary ... ignored, requires a 0731 Flash GGUF and an Apple M5 device
|
||||
test engine::metal::tests::flash_0731_m5_decode_performance_gate ... ignored, requires a 0731 Flash GGUF and an Apple M5 device
|
||||
test engine::metal::tests::flash_0731_resident_and_ssd_streaming_choose_the_same_tokens ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
|
||||
test engine::metal::tests::flash_0731_runs_exact_sampled_dspark ... ignored, requires the installed 0731 target and checkpoint-specific DSpark GGUF fixtures
|
||||
test engine::metal::tests::flash_0731_ssd_streaming_maps_and_seeds_batched_prefill_layers ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
|
||||
test engine::metal::tests::generated_hotlists_match_each_model_shape ... ok
|
||||
test engine::metal::tests::half_conversion_handles_normal_and_subnormal_values ... ok
|
||||
test engine::metal::tests::pro_q4_model_spans_remain_isolated ... ok
|
||||
test engine::metal::tests::pro_resident_admission_includes_weights_context_and_scratch ... ok
|
||||
test engine::metal::tests::pro_ssd_streaming_full_layer_and_selected_batch_agree ... ignored, requires the installed DeepSeek V4 Pro GGUF and Apple Metal
|
||||
test engine::metal::tests::resident_multi_session_switching_preserves_each_kv_frontier ... ignored, requires the installed 81 GiB Flash GGUF fixture and a Metal device
|
||||
test engine::metal::tests::ssd_streaming_supports_dspark ... ignored, requires the installed 0731 Flash and checkpoint-specific DSpark GGUF fixtures
|
||||
test engine::metal::tests::streaming_memory_plan_matches_ds4_graph_formulas ... ok
|
||||
test engine::metal::vision::tests::glm53_resize_matches_reference_token_grids ... ok
|
||||
test engine::metal::qwen_mtplx::submission::mtplx_all_native_command_commits_pass_the_submission_hook ... ok
|
||||
test engine::qwen::tests::metadata_and_safetensors_boundaries_fail_closed ... ok
|
||||
test engine::qwen::tests::pinned_artifact_set_loads_and_renders_goldens ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
|
||||
test engine::qwen::tests::pinned_qwen_metadata_matches_product_without_executor_state ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
|
||||
test engine::qwen_vision::qwen_image_cache_keys_distinguish_pixels_and_preserve_prior_text ... ok
|
||||
test engine::qwen::tests::frozen_inventory_and_memory_categories_are_exact ... ok
|
||||
test engine::qwen_vision::qwen_vision_positions_and_resize_contract ... ok
|
||||
test dev_brain::tests::parser_and_index_rebuild_ignore_links_in_code ... ok
|
||||
test engine::sampling_tests::checkpoint_rebuilds_explain_compatibility_and_history_misses ... ok
|
||||
test engine::sampling_tests::checkpoint_tag_accepts_an_unchanged_prefix_before_reminders ... ok
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_distribution_and_rng_match_reference ... ok
|
||||
test engine::sampling_tests::checkpoint_headers_identify_the_exact_model ... ok
|
||||
test engine::sampling_tests::checkpoint_tag_covers_the_canonical_chat_state ... ok
|
||||
test engine::sampling_tests::ds4_sampler_real_logits_cpu_benchmark ... ignored, CPU-only; requires DS4_SAMPLER_RECORDING with the recorded GLM logits
|
||||
test engine::sampling_tests::exact_delta_sampling_accepts_or_corrects_the_draft ... ok
|
||||
test engine::sampling_tests::generated_text_drains_incomplete_bytes_before_phase_changes_and_finish ... ok
|
||||
test engine::sampling_tests::metal_executes_real_flash_token ... ignored, requires the 80 GiB Flash checkpoint and Apple Metal
|
||||
test engine::sampling_tests::generated_text_preserves_thinking_utf8_and_split_stops ... ok
|
||||
test engine::sampling_tests::qwen_rng_matches_numpy_pcg64 ... ok
|
||||
test engine::sampling_tests::qwen_sampling_uses_mtplx_global_nucleus_mass_before_top_k ... ok
|
||||
test engine::sampling_tests::resumed_prefill_crossover_matches_each_ds4_graph ... ok
|
||||
test engine::sampling_tests::sampling_probabilities_match_ds4_filter_order ... ok
|
||||
test engine::sampling_tests::split_utf8_token_bytes_are_joined_before_decoding ... ok
|
||||
test engine::sampling_tests::top_k_and_stream_stops_are_applied_before_output ... ok
|
||||
test engine::sampling_tests::workspace_instruction_identity_participates_in_append_only_kv_keys ... ok
|
||||
test engine::sampling_tests::zero_temperature_is_greedy ... ok
|
||||
test engine::tokenizer::issue111::issue111_ds4_families ... ignored, CPU-only; installed DS4 GGUFs and exact oracle IDs
|
||||
test engine::tokenizer::issue111::issue111_every_unicode_scalar_split ... ignored, CPU-only; exhaustive pinned Qwen split receipt
|
||||
test engine::tokenizer::issue111::issue111_qwen_tokens_and_requests ... ignored, CPU-only; installed Qwen tokenizer and pinned exact IDs
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_qsa_prefill_workspace_matches_reference ... ok
|
||||
test engine::tokenizer::tests::character_helpers_are_total_at_every_byte_offset ... ok
|
||||
test engine::tokenizer::tests::ds4_chat_matches_original_session_tokens ... ignored, CPU-only; requires DS4SERVER_CHAT_REFERENCE and its installed GGUF
|
||||
test engine::tokenizer::tests::qwen_checkpoint_continuation_matches_full_conversation ... ignored, requires the installed Qwen tokenizer, but no GPU or model weights
|
||||
test engine::tokenizer::tests::qwen_plain_chat_matches_mtplx_server_tokens ... ignored, requires local tokenizer and tools/qwen-chat-reference.py output; no inference
|
||||
test engine::tokenizer::tests::reasoning_prefixes_match_each_model_family_contract ... ok
|
||||
test engine::validation::tests::configured_glm53_main_fixture_passes_the_exact_layout ... ok
|
||||
test engine::validation::tests::configured_glm53_vision_fixture_passes_the_exact_layout ... ok
|
||||
test engine::tokenizer::issue111::qwen_split_boundaries ... ok
|
||||
test engine::validation::tests::installed_dspark_fixture_passes_the_target_layout ... ok
|
||||
test engine::validation::tests::mxfp4_is_limited_to_routed_experts ... ok
|
||||
test engine::metal::qwen_mtplx::ngram::mtplx_ngram_cpu_rows_and_raw_history_match_reference ... ok
|
||||
test extensions::tests::duplicate_skill_names_and_update_rollback_are_deterministic ... ok
|
||||
test dev_brain::tests::validation_names_every_drifted_source_and_requires_semantic_refresh ... ok
|
||||
test extensions::tests::hook_output_is_bounded_typed_and_event_matched ... ok
|
||||
test engine::sampling_tests::probability_ratio_speculation_preserves_the_target_distribution ... ok
|
||||
test extensions::tests::manifest_and_paths_are_validated_without_following_escapes ... ok
|
||||
test extensions::tests::pinned_ponytail_runs_all_lifecycle_modes ... ignored, downloads the pinned Ponytail reference integration
|
||||
test extensions::tests::registry_persists_enable_disable_errors_and_uninstall ... ok
|
||||
test extensions::tests::symlink_and_variable_escapes_are_rejected ... ok
|
||||
test instructions::tests::changes_removals_resume_and_compaction_are_append_only ... ok
|
||||
test engine::metal::qwen_mtplx::array::mtplx_array_releases_sibling_cycles_and_deep_input_graphs ... ok
|
||||
test instructions::tests::discovery_is_global_to_local_deduplicated_and_confined ... ok
|
||||
test instructions::tests::empty_and_repaired_baselines_do_not_repeat_prompt_content ... ok
|
||||
test instructions::tests::newly_crossed_scope_is_added_once_and_unavailable_content_is_retained ... ok
|
||||
test metrics::tests::cache_report_splits_buckets_and_folds_index_files_into_their_checkpoint ... ok
|
||||
test metrics::tests::decode_timer_excludes_later_work_and_resets_between_requests ... ok
|
||||
test metrics::tests::prompt_timing_keeps_unmeasured_components_distinct_from_zero ... ok
|
||||
test metrics::tests::removed_preview_metric_code_stays_decodable ... ok
|
||||
test metrics::tests::snapshots_track_runtime_and_server_counters ... ok
|
||||
test model::qwen::qwen_vision_is_an_independent_managed_artifact_set ... ok
|
||||
test model::qwen::tests::embedded_manifest_is_the_frozen_complete_set ... ok
|
||||
test model::qwen::tests::verification_rejects_hash_mismatch_and_honors_cancellation ... ok
|
||||
test model::transfer::tests::cancellation_keeps_the_partial_file_for_the_next_run ... ok
|
||||
test model::transfer::tests::catalog_and_checksum_verification_are_explicit ... ok
|
||||
test model::transfer::tests::managed_artifact_inventory_and_delete_include_partial_files ... ok
|
||||
test model::transfer::tests::qwen_set_verifies_reloads_and_removes_as_one_managed_artifact ... ignored, requires DS4_QWEN38_ARTIFACTS to point at the pinned 105 GB source
|
||||
test instructions::tests::frames_escape_control_tags_and_enforce_utf8_byte_limits ... ok
|
||||
test model::transfer::tests::restart_resumes_at_the_existing_partial_byte ... ok
|
||||
test model::transfer::tests::verification_reports_bytes_read ... ok
|
||||
test model_eval::tests::acceleration_receipt_reports_effective_sampling_contract ... ok
|
||||
test dev_brain::tests::skill_validation_and_default_guide_restore_are_strict ... ok
|
||||
test model_eval::tests::acceleration_switch_uses_each_models_native_path ... ok
|
||||
test model_eval::tests::canary_cross_phase_samples_keep_their_start_phase ... ok
|
||||
test model_eval::tests::evaluations_exclude_overlapping_workers_and_release_on_exit ... ok
|
||||
test model_eval::tests::external_canary_observes_phases_and_finishes_on_eof ... ignored, Metal probe only; DS4SERVER_CANARY_BINARY must point to the current release binary
|
||||
test model_eval::tests::external_canary_protocol_accepts_only_known_phases ... ok
|
||||
test model_eval::tests::parses_safe_defaults_and_overrides ... ok
|
||||
test model_eval::tests::rejects_unbounded_or_invalid_limits ... ok
|
||||
test model_eval::tests::repeated_prompts_form_one_ordered_conversation ... ok
|
||||
test model_eval::tests::warmup_timing_separates_loading_without_inventing_missing_durations ... ok
|
||||
test model_eval::tests::worker_progress_events_advance_the_watchdog ... ok
|
||||
test native_edit::tests::edit_history_supports_undo_and_redo ... ok
|
||||
test native_edit::tests::paste_replays_a_complete_command_shortcut ... ok
|
||||
test native_media::tests::media_player_only_accepts_remote_http_urls ... ok
|
||||
test native_menu::tests::edit_items_are_custom_menu_events ... ok
|
||||
test native_menu::tests::user_guide_uses_unmodified_f1 ... ok
|
||||
test native_menu::tests::view_items_keep_the_selected_pane_checked ... ok
|
||||
test runtime::tests::dropping_active_generation_cancels_it ... ok
|
||||
test runtime::tests::operation_failures_use_the_matching_event ... ok
|
||||
test runtime::tests::operation_tracking_is_consistent ... ok
|
||||
test runtime::tests::runtime_panic_recovery_accepts_the_next_operation ... ok
|
||||
test server::request::tests::reasoning_requests_preserve_each_models_exact_modes ... ok
|
||||
test server::tests::canonical_tool_replay_preserves_argument_types ... ok
|
||||
test server::tests::connection_slots_enforce_the_limit_and_release_on_drop ... ok
|
||||
test server::tests::content_arrays_match_ds4_text_projection ... ok
|
||||
test server::tests::context_limit_errors_use_protocol_standard_fields ... ok
|
||||
test server::tests::cors_headers_are_opt_in_and_cover_preflight ... ok
|
||||
test server::tests::dsml_tool_stream_projects_incremental_json_arguments ... ok
|
||||
test server::tests::generated_dsml_becomes_openai_tool_calls ... ok
|
||||
test server::tests::generated_tool_parser_accepts_ds4_recovery_syntaxes ... ok
|
||||
test server::tests::model_metadata_uses_the_requested_alias_and_default_token_limit ... ok
|
||||
test server::tests::protocol_tool_results_require_live_or_replayed_call_ids ... ok
|
||||
test dev_brain::tests::source_hash_drift_excludes_page_from_authoritative_queries ... ok
|
||||
test server::tests::responses_parser_rejects_dropped_state_and_preserves_hosted_calls ... ok
|
||||
test server::tests::sampled_tool_replay_survives_server_restart ... ok
|
||||
test server::tests::streaming_errors_match_ds4_server_framing ... ok
|
||||
test dev_brain::tests::verified_skills_are_indexed_and_injected_on_demand ... ok
|
||||
test server::tests::tool_prompt_matches_ds4_server_text ... ok
|
||||
test server::tests::tool_stream_projects_ds4_recovery_syntaxes ... ok
|
||||
test settings::tests::captured_ds4_cli_options_are_uniquely_classified ... ok
|
||||
test settings::tests::effective_settings_build_one_engine_and_turn_configuration ... ok
|
||||
test settings::tests::effective_settings_preserve_unset_model_defaults ... ok
|
||||
test settings::tests::execution_settings_keep_ds4_automatic_values_and_glm_rules ... ok
|
||||
test settings::tests::kv_cache_gates_follow_the_ds4_store_rules ... ok
|
||||
test settings::tests::reasoning_selection_is_exact_and_model_specific ... ok
|
||||
test settings::tests::runtime_settings_preserve_automatic_values_and_cross_field_rules ... ok
|
||||
test settings::tests::speculative_settings_match_acceleration_defaults_and_dependencies ... ok
|
||||
test dev_brain::tests::validation_keeps_broken_links_editable_and_reports_provenance_errors ... ok
|
||||
test server::tests::streaming_prefill_keeps_the_client_connection_alive ... ok
|
||||
test dev_brain::tests::source_versions_follow_that_file_instead_of_the_whole_worktree ... ok
|
||||
test model_eval::tests::cpu_accounting_matches_getrusage_units ... ok
|
||||
test engine::validation::tests::installed_ds4_fixture_opens_and_renders_a_prompt ... ok
|
||||
test model::transfer::tests::stalled_download_times_out_and_keeps_the_partial_file ... ok
|
||||
test server::tests::request_deadline_stops_slow_clients ... ok
|
||||
test extensions::tests::direct_hook_runner_isolated_environment_and_handles_failures ... ok
|
||||
test engine::sampling_tests::ds4_sampler_matches_original_reference_tokens_and_rng ... ok
|
||||
test agent::tests::execution_failures_and_timeouts_have_distinct_codes ... ok
|
||||
kill: 91003: No such process
|
||||
test agent::tests::dropping_session_tools_stops_live_jobs_and_removes_output ... ok
|
||||
test agent::tests::local_file_and_bash_tools_execute_in_the_project ... ok
|
||||
test engine::qwen_vision::qwen_image_preprocessing_matches_pillow_mtplx ... ok
|
||||
test extensions::tests::lifecycle_matchers_preserve_declared_event_order ... ok
|
||||
test engine::metal::qwen_mtplx_tests::mtplx_runtime_shaders_are_pinned ... ok
|
||||
test extensions::tests::hook_failures_are_bounded_actionable_and_non_shell ... ok
|
||||
test engine::metal::qwen_mtplx::sampling::mtplx_sampler_mixed_distributions_match_reference ... ok
|
||||
|
||||
test result: ok. 312 passed; 0 failed; 234 ignored; 0 measured; 0 filtered out; finished in 5.76s
|
||||
|
||||
Running unittests tools/qwen38-artifacts.rs (target/debug/deps/qwen38_artifacts-1288d410762a1a77)
|
||||
|
||||
running 4 tests
|
||||
test tests::artifact_names_cannot_escape_the_output_directory ... ok
|
||||
test tests::affine_sample_digest_uses_packed_values_scales_and_biases ... ok
|
||||
test tests::safetensors_validation_rejects_duplicate_names_and_invalid_ranges ... ok
|
||||
test tests::artifact_download_resumes_an_authenticated_partial ... ok
|
||||
|
||||
test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
|
||||
|
||||
Running unittests tools/test-supervisor.rs (target/debug/deps/test_supervisor-df80f419c8443a12)
|
||||
|
||||
running 4 tests
|
||||
test supervisor::tests::direct_worker_arguments_are_not_rust_test_arguments ... ok
|
||||
test supervisor::tests::split_records_cannot_be_interleaved_with_watchdog_samples ... ok
|
||||
test supervisor::tests::split_probe_records_do_not_reset_progress ... ok
|
||||
ready{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
ready
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
{"event":"gpu_canary_sample","ok":true}
|
||||
progressprogressprogressprogressprogressprogressprogressprogresstest supervisor::tests::watchdog_stops_memory_and_silence_but_not_total_runtime ... ok
|
||||
|
||||
test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.38s
|
||||
Reference in new issue
Block a user