diff --git a/docs/issue105-invalid-logits/README.md b/docs/issue105-invalid-logits/README.md new file mode 100644 index 0000000..c2ff814 --- /dev/null +++ b/docs/issue105-invalid-logits/README.md @@ -0,0 +1,95 @@ +# Issue 105: reject invalid Qwen logits and invalidate the failed session + +Qwen now reports numerical failure instead of emitting fabricated IDs for NaN, +positive infinity or all-masked logits. Negative-infinity masks with a finite +winner remain legal. Failed sessions lose their live, resident and persisted +state, while unrelated healthy conversations remain reusable. + +## Oracle and approved exception + +The oracle is MTPLX `9882703f3105363ddc37eca9f97aa09a1d387112`, MLX 0.32.2. +The unchanged installed Bare-Speed model and environment were verified for +`../issue104-ar/environment.json` immediately before this issue. + +Ordinary greedy uses the upstream `any(isnan(row)) | isinf(max(row))` graph, +evaluated with argmax. Only failures read the full row for the NaN/infinity +census. Sampled support retains its existing GPU route and host-softmax fallback; +invalid mass now raises the same numerical error instead of selecting token 0. +SparseDistribution no longer invents an ID when positive mass is absent. + +The pinned oracle remains inconsistent in specialized greedy MTP paths: +`generation.py:7577,13295,15371` still use unchecked argmax. The user explicitly +approved extending rejection throughout MTP on 2026-10-04. This deliberate +invalid-row exception is not claimed as upstream parity. `oracle.jsonl` records +the ordinary error, lazy sentinel and specialized-MTP token 0 side by side. +Batched verification validates every row, so a healthy row cannot conceal an +all-masked neighbor. Valid choices and RNG draws are unchanged. + +The old lazy sampler is only a historical #104/RNG test diagnostic. Its finite +law remains historical and its invalid result is now the checked -1 sentinel. +No product path calls it. The unrelated diagnostic prefix sampler retains its +upstream contract; it is not a production target/draft sampling route. + +## Ownership and family boundary review + +| Requirement | Implementation and evidence | +| --- | --- | +| Reject before consuming a fabricated ID | Ordinary AR, MTP primary/target/draft and context-copy target all reach checked sampling; invalid prefill emits no text. | +| Clear a prefix captured before failure | LiveSession discards current and prefix; QwenExecutor resets trunk/head/boundary caches. Installed faults occur after real prefill and prefix capture. | +| Clear selected, resident and disk state | Generator invalidates the failed conversation's checkpoints, resident aliases, indexes and staging files, and clears selection/store frontier. | +| No stale bootstrap or later persistence | First local fault creates then removes a real system bootstrap. A later explicit save fails without a committed snapshot. All failed requests retry cold. | +| Preserve other sessions | A real healthy checkpoint remains byte-identical and resident throughout both product matrices, then restores successfully. | +| Final capture ownership | A test-only fault consumes an invalid row through the real numerical guard during final capture; the resulting error crosses the actual snapshot/request/Generator owners and prevents persistence. Normal capture adds no sampling pass. | +| Streaming and non-streaming | Actual Generator events pass through the production HTTP response adapters; explicit SSE errors/HTTP 500 are checked, followed by valid requests using the same Generator. | +| DS4/GLM unchanged | Shared cleanup requires both QwenMtplx and the numerical-error discriminator. DS4 `ds4.c:39410-39460` retains its greedy/no-finite-mass fallback; shared RNG, samplers and checkpoint formats are untouched. Default tests include exact DS4 token/RNG controls. | + +DS4Server uses content-addressed API conversations rather than MTPLX session IDs. +Its cleanup therefore invalidates every ancestor of the failed API request and +its selected source. Local chats invalidate their file and system bootstrap. +Shared bootstrap prefixes belonging to the failed ancestry are invalidated, +while other conversations' complete checkpoints remain intact. This is the +DS4Server-specific persistence integration of MTPLX's session-bank eviction. + +Checkpoint writes are synchronous on the serialized model worker. Errors return +before final persistence; the cleared owner cannot later save or be banked by an +outgoing resident swap. Filesystem cleanup failures are reported explicitly. +Production remains Rust/Metal; Python is used solely for isolated oracle receipts. + +## Validation + +- Fresh ordinary-entry fixtures: 1,080 cases, three consecutive draws each, + including evaluation boundaries, valid tokens/probabilities and next RNG. +- Sparse fallback: 150 cases; batched fallback: 653; mixed distributions: 100; + historical keyed/lazy diagnostics: 387. Mixed and distribution/RNG tests run + in the ordinary cargo suite, not with `--ignored`. +- Four synthetic rows at temperatures 0/.6/1, with exact oracle error census, + legal tokens and invalid lazy sentinel: `native-invalid-rows.jsonl`. +- Batched greedy: both row orders, widths 64/4097, all four rows, including a + healthy neighbor beside an all-masked row. +- Installed AR: 24 cases (prefill, later forward, final capture; four rows; + both HTTP modes), 18 invalid/cold-retry cases and six legal-mask successes. +- Installed MTP: 32 cases, additionally exercising draft-head faults; 24 + invalid/cold-retry cases and eight legal-mask successes. A real supported + penalty disables context-copy for draft tests and half the target tests, + ensuring both target routes and the actual draft head are exercised. +- All four commit gates: formatting, Clippy with warnings denied, signed app + bundle, and all-feature cargo tests. Exact outcomes are in `checks.json`. + +These are correctness and cleanup tests, not throughput measurements. Test-only +injection fields, output substitution and HTTP harness are absent from release +code. The initial test runs deliberately failed if the requested fault boundary +was bypassed; the final matrices reach every specified boundary. + +## Reproduction + +Build with `cargo test --all-features --bin ds4-server --no-run` and +`cargo build --bin test-supervisor`. Resolve the executable printed by Cargo. +Run model-free ignored tests serially under `test-supervisor 4096 60 120 +--command --ignored --nocapture --test-threads=1`. + +For `issue105_product_ar_cleanup_and_http_retry` and +`issue105_product_mtp_cleanup_and_http_retry`, use memory limit 114688 MiB, +`DS4_QWEN38_ARTIFACTS` pointing to the installed unchanged model, and a fresh +`DS4_ISSUE105_DIR` per run. Keep model processes serial. For the oracle, run +`tools/issue105-reference.py` in the isolated MLX 0.32.2 environment with +`PYTHONPATH` pointing at the pinned MTPLX checkout. diff --git a/docs/issue105-invalid-logits/ar-product-receipts.jsonl b/docs/issue105-invalid-logits/ar-product-receipts.jsonl new file mode 100644 index 0000000..24809b5 --- /dev/null +++ b/docs/issue105-invalid-logits/ar-product-receipts.jsonl @@ -0,0 +1,25 @@ +{"case":0,"mtp":false,"stage":"Prefill","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":1,"mtp":false,"stage":"Prefill","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":2,"mtp":false,"stage":"Prefill","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":3,"mtp":false,"stage":"Prefill","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":4,"mtp":false,"stage":"Prefill","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":5,"mtp":false,"stage":"Prefill","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":6,"mtp":false,"stage":"Prefill","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":7,"mtp":false,"stage":"Prefill","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":8,"mtp":false,"stage":"Target","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":9,"mtp":false,"stage":"Target","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":10,"mtp":false,"stage":"Target","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":11,"mtp":false,"stage":"Target","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":12,"mtp":false,"stage":"Target","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":13,"mtp":false,"stage":"Target","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":14,"mtp":false,"stage":"Target","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":15,"mtp":false,"stage":"Target","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":16,"mtp":false,"stage":"Capture","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":17,"mtp":false,"stage":"Capture","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":18,"mtp":false,"stage":"Capture","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":19,"mtp":false,"stage":"Capture","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":20,"mtp":false,"stage":"Capture","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":21,"mtp":false,"stage":"Capture","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":22,"mtp":false,"stage":"Capture","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":23,"mtp":false,"stage":"Capture","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"event":"test_resource_summary","elapsed_ms":58704,"peak":{"cpu_time_ns":62056161375,"resident_bytes":25310855168,"physical_bytes":77867608424,"peak_physical_bytes":77867624808,"disk_read_bytes":68731633664,"disk_write_bytes":9359335424},"error":null} diff --git a/docs/issue105-invalid-logits/checks.json b/docs/issue105-invalid-logits/checks.json new file mode 100644 index 0000000..491d2b5 --- /dev/null +++ b/docs/issue105-invalid-logits/checks.json @@ -0,0 +1,37 @@ +{ + "mtplx_sampler_entry_matches_reference": [ + "test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 521 filtered out; finished in 59.33s" + ], + "mtplx_sampler_fallback_matches_reference": [ + "test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 3.76s" + ], + "mtplx_sampler_resident_matches_reference": [ + "test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 11.51s" + ], + "mtplx_sampler_batched": [ + "test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 520 filtered out; finished in 115.98s" + ], + "product_ar": { + "cases": 24, + "invalid": 18, + "legal_mask": 6, + "status": "passed" + }, + "product_mtp": { + "cases": 32, + "invalid": 24, + "legal_mask": 8, + "status": "passed" + }, + "completion": "Acceptance, source review and all four commit gates passed.", + "commit_gates": { + "fmt": "passed", + "clippy_all_targets_all_features": "passed", + "make_bundle": "passed; ad-hoc codesigned", + "cargo_test_all_features": "308 application tests passed, 214 ignored; two tools each 4 passed" + }, + "invalid_rows_vs_pinned_oracle": "passed; exact census/error text and valid tokens; invalid lazy sentinel -1", + "mtplx_sampler_mixed_distributions_match_reference": "100 cases passed in default cargo test", + "approved_exception": "User approved rejection throughout Qwen MTP on 2026-10-04, including specialized paths where the pinned oracle still fabricates token 0.", + "batched_greedy": "passed: each of 4 rows in both positions beside a healthy neighbor, widths 64 and 4097" +} diff --git a/docs/issue105-invalid-logits/mtp-product-receipts.jsonl b/docs/issue105-invalid-logits/mtp-product-receipts.jsonl new file mode 100644 index 0000000..b4a3a5a --- /dev/null +++ b/docs/issue105-invalid-logits/mtp-product-receipts.jsonl @@ -0,0 +1,33 @@ +{"case":0,"mtp":true,"stage":"Prefill","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":1,"mtp":true,"stage":"Prefill","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":2,"mtp":true,"stage":"Prefill","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":3,"mtp":true,"stage":"Prefill","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":4,"mtp":true,"stage":"Prefill","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":5,"mtp":true,"stage":"Prefill","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":6,"mtp":true,"stage":"Prefill","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":7,"mtp":true,"stage":"Prefill","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":8,"mtp":true,"stage":"Target","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":9,"mtp":true,"stage":"Target","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":10,"mtp":true,"stage":"Target","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":11,"mtp":true,"stage":"Target","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":12,"mtp":true,"stage":"Target","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":13,"mtp":true,"stage":"Target","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":14,"mtp":true,"stage":"Target","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":15,"mtp":true,"stage":"Target","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":16,"mtp":true,"stage":"Capture","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":17,"mtp":true,"stage":"Capture","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":18,"mtp":true,"stage":"Capture","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":19,"mtp":true,"stage":"Capture","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":20,"mtp":true,"stage":"Capture","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":21,"mtp":true,"stage":"Capture","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":22,"mtp":true,"stage":"Capture","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":23,"mtp":true,"stage":"Capture","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":24,"mtp":true,"stage":"Draft","row":"Nan","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":25,"mtp":true,"stage":"Draft","row":"Nan","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":26,"mtp":true,"stage":"Draft","row":"PositiveInf","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":27,"mtp":true,"stage":"Draft","row":"PositiveInf","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":28,"mtp":true,"stage":"Draft","row":"Masked","streaming":false,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":29,"mtp":true,"stage":"Draft","row":"Masked","streaming":true,"legal":false,"healthy_preserved":true,"cold_retry":true} +{"case":30,"mtp":true,"stage":"Draft","row":"LegalMask","streaming":false,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"case":31,"mtp":true,"stage":"Draft","row":"LegalMask","streaming":true,"legal":true,"healthy_preserved":true,"cold_retry":false} +{"event":"test_resource_summary","elapsed_ms":81120,"peak":{"cpu_time_ns":83647679458,"resident_bytes":27535687680,"physical_bytes":78398221632,"peak_physical_bytes":78399221056,"disk_read_bytes":70370205696,"disk_write_bytes":12404834304},"error":null} diff --git a/docs/issue105-invalid-logits/native-invalid-rows.jsonl b/docs/issue105-invalid-logits/native-invalid-rows.jsonl new file mode 100644 index 0000000..f98c9cd --- /dev/null +++ b/docs/issue105-invalid-logits/native-invalid-rows.jsonl @@ -0,0 +1,16 @@ +{"case":"invalid_logits","row":"nan","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=64, inf=0, vocab=64)"}} +{"case":"invalid_logits","row":"nan","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=64, inf=0, vocab=64)"}} +{"case":"invalid_logits","row":"nan","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=64, inf=0, vocab=64)"}} +{"case":"invalid_logits_lazy","row":"nan","result":{"Ok":[-1]}} +{"case":"invalid_logits","row":"positive_inf","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=0, inf=1, vocab=64)"}} +{"case":"invalid_logits","row":"positive_inf","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=1, vocab=64)"}} +{"case":"invalid_logits","row":"positive_inf","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=1, vocab=64)"}} +{"case":"invalid_logits_lazy","row":"positive_inf","result":{"Ok":[-1]}} +{"case":"invalid_logits","row":"all_negative_inf","temperature":0.0,"ordinary":{"Err":"Qwen non-finite logits in greedy argmax (nan=0, inf=64, vocab=64)"}} +{"case":"invalid_logits","row":"all_negative_inf","temperature":0.6,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=64, vocab=64)"}} +{"case":"invalid_logits","row":"all_negative_inf","temperature":1.0,"ordinary":{"Err":"Qwen non-finite logits in softmax (nan=0, inf=64, vocab=64)"}} +{"case":"invalid_logits_lazy","row":"all_negative_inf","result":{"Ok":[-1]}} +{"case":"invalid_logits","row":"valid_mask","temperature":0.0,"ordinary":{"Ok":1}} +{"case":"invalid_logits","row":"valid_mask","temperature":0.6,"ordinary":{"Ok":1}} +{"case":"invalid_logits","row":"valid_mask","temperature":1.0,"ordinary":{"Ok":1}} +{"case":"invalid_logits_lazy","row":"valid_mask","result":{"Ok":[3]}} diff --git a/docs/issue105-invalid-logits/oracle.jsonl b/docs/issue105-invalid-logits/oracle.jsonl new file mode 100644 index 0000000..29e6f72 --- /dev/null +++ b/docs/issue105-invalid-logits/oracle.jsonl @@ -0,0 +1,20 @@ +{"case": "ordinary", "row": "nan", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64} +{"case": "ordinary", "row": "nan", "temperature": 0.6, "error": "non-finite logits in softmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64} +{"case": "ordinary", "row": "nan", "temperature": 1.0, "error": "non-finite logits in softmax (nan=64, inf=0, vocab=64)", "nan": 64, "inf": 0, "vocab": 64} +{"case": "lazy", "row": "nan", "token": -1} +{"case": "mtp_greedy_specialized", "row": "nan", "token": 0} +{"case": "ordinary", "row": "positive_inf", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64} +{"case": "ordinary", "row": "positive_inf", "temperature": 0.6, "error": "non-finite logits in softmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64} +{"case": "ordinary", "row": "positive_inf", "temperature": 1.0, "error": "non-finite logits in softmax (nan=0, inf=1, vocab=64)", "nan": 0, "inf": 1, "vocab": 64} +{"case": "lazy", "row": "positive_inf", "token": -1} +{"case": "mtp_greedy_specialized", "row": "positive_inf", "token": 0} +{"case": "ordinary", "row": "all_negative_inf", "temperature": 0.0, "error": "non-finite logits in greedy argmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64} +{"case": "ordinary", "row": "all_negative_inf", "temperature": 0.6, "error": "non-finite logits in softmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64} +{"case": "ordinary", "row": "all_negative_inf", "temperature": 1.0, "error": "non-finite logits in softmax (nan=0, inf=64, vocab=64)", "nan": 0, "inf": 64, "vocab": 64} +{"case": "lazy", "row": "all_negative_inf", "token": -1} +{"case": "mtp_greedy_specialized", "row": "all_negative_inf", "token": 0} +{"case": "ordinary", "row": "valid_mask", "temperature": 0.0, "token": 1} +{"case": "ordinary", "row": "valid_mask", "temperature": 0.6, "token": 1} +{"case": "ordinary", "row": "valid_mask", "temperature": 1.0, "token": 1} +{"case": "lazy", "row": "valid_mask", "token": 3} +{"case": "mtp_greedy_specialized", "row": "valid_mask", "token": 1} diff --git a/src/engine.rs b/src/engine.rs index ceb3cf0..7d2d845 100644 --- a/src/engine.rs +++ b/src/engine.rs @@ -844,54 +844,68 @@ impl Generator { mut progress: impl FnMut(u32, u32, Option), mut phase: impl FnMut(&'static str), ) -> Result { - let checkpoint_present = checkpoint.is_file(); - let selected = self.select_checkpoint(checkpoint, |tag| { - checkpoint_matches_prefix( - tag, - &settings.system_prompt, - settings.reasoning_mode, - messages, - ) - })?; - if checkpoint_present && !selected.found { - phase(checkpoint_rebuild_activity(selected.incompatible)); - } - if !selected.found - && let Some(directory) = bootstrap - { - self.prepare_bootstrap(directory, settings, cancelled, &mut progress, &mut phase)?; - } - let result = self.generate_inner(messages, settings, cancelled, &mut emit, &mut progress); - self.publish_execution_stats(); - let (mut output, prompt_complete) = result?; - if prompt_complete { - self.executor.finalize_pending_sampled_token()?; - } - let mut completed = messages.to_vec(); - completed.push(output.message.clone()); - output.previous_checkpoint_bytes = - std::fs::metadata(checkpoint).ok().map(|item| item.len()); - if matches!(self.executor, metal::Executor::QwenMtplx(_)) && !prompt_complete { - // The whole-turn owner retains only committed state. Do not stamp - // an old prefix as the partially emitted conversation or replace a - // valid file on cancellation/literal-stop. - output.checkpoint_bytes = output.previous_checkpoint_bytes.unwrap_or(0); - return Ok(output); - } - self.save_checkpoint( - checkpoint, + let result: Result<_, String> = (|| { + let checkpoint_present = checkpoint.is_file(); + let selected = self.select_checkpoint(checkpoint, |tag| { + checkpoint_matches_prefix( + tag, + &settings.system_prompt, + settings.reasoning_mode, + messages, + ) + })?; + if checkpoint_present && !selected.found { + phase(checkpoint_rebuild_activity(selected.incompatible)); + } + if !selected.found + && let Some(directory) = bootstrap + { + self.prepare_bootstrap(directory, settings, cancelled, &mut progress, &mut phase)?; + } + let result = + self.generate_inner(messages, settings, cancelled, &mut emit, &mut progress); + self.publish_execution_stats(); + let (mut output, prompt_complete) = result?; if prompt_complete { - conversation_tag(&settings.system_prompt, settings.reasoning_mode, &completed) - } else { - [0; 32] - }, - )?; - output.checkpoint_bytes = std::fs::metadata(checkpoint) - .map(|item| item.len()) - .unwrap_or(0); - self.checkpoint = Some(checkpoint.to_owned()); - self.resident_active = Some(checkpoint.to_owned()); - Ok(output) + self.executor.finalize_pending_sampled_token()?; + } + let mut completed = messages.to_vec(); + completed.push(output.message.clone()); + output.previous_checkpoint_bytes = + std::fs::metadata(checkpoint).ok().map(|item| item.len()); + if matches!(self.executor, metal::Executor::QwenMtplx(_)) && !prompt_complete { + // The whole-turn owner retains only committed state. Do not stamp + // an old prefix as the partially emitted conversation or replace a + // valid file on cancellation/literal-stop. + output.checkpoint_bytes = output.previous_checkpoint_bytes.unwrap_or(0); + return Ok(output); + } + self.save_checkpoint( + checkpoint, + if prompt_complete { + conversation_tag(&settings.system_prompt, settings.reasoning_mode, &completed) + } else { + [0; 32] + }, + )?; + output.checkpoint_bytes = std::fs::metadata(checkpoint) + .map(|item| item.len()) + .unwrap_or(0); + self.checkpoint = Some(checkpoint.to_owned()); + self.resident_active = Some(checkpoint.to_owned()); + Ok(output) + })(); + if let Err(error) = &result { + let mut paths = vec![checkpoint.to_owned()]; + if let Some(directory) = bootstrap { + let key = conversation_key(&settings.system_prompt, settings.reasoning_mode, &[]); + let tag = Sha256::digest(&key).into(); + paths.push(directory.join(format!("{}.bin", kvstore::key_hash(&key)))); + paths.push(resident_key(directory, tag)); + } + self.invalidate_qwen_failure(error, paths)?; + } + result } fn publish_execution_stats(&self) { @@ -939,73 +953,140 @@ impl Generator { mut emit: impl FnMut(bool, String), mut progress: impl FnMut(u32, u32, Option), ) -> Result { - let history = messages - .split_last() - .map_or(messages, |(_, history)| history); - let store = KvStore::open(directory, settings.kv_cache.budget_bytes)?; - let history_key = - conversation_key(&settings.system_prompt, settings.reasoning_mode, history); - let history_tag: [u8; 32] = Sha256::digest(&history_key).into(); - let previous_checkpoint = - self.restore_cached_prefix(directory, &store, &history_key, history_tag)?; + let result: Result<_, String> = (|| { + let history = messages + .split_last() + .map_or(messages, |(_, history)| history); + let store = KvStore::open(directory, settings.kv_cache.budget_bytes)?; + let history_key = + conversation_key(&settings.system_prompt, settings.reasoning_mode, history); + let history_tag: [u8; 32] = Sha256::digest(&history_key).into(); + let previous_checkpoint = + self.restore_cached_prefix(directory, &store, &history_key, history_tag)?; - let result = self.generate_inner(messages, settings, cancelled, &mut emit, &mut progress); - self.publish_execution_stats(); - let (mut output, prompt_complete) = result?; - if prompt_complete { - self.executor.finalize_pending_sampled_token()?; - } - let mut completed = messages.to_vec(); - completed.push(output.message.clone()); - output.previous_checkpoint_bytes = previous_checkpoint - .as_deref() - .and_then(|path| std::fs::metadata(path).ok()) - .map(|item| item.len()); - if prompt_complete { - let completed_key = - conversation_key(&settings.system_prompt, settings.reasoning_mode, &completed); - let completed_tag: [u8; 32] = Sha256::digest(&completed_key).into(); - if !settings.kv_cache.stores( - self.executor.position(), - history.is_empty(), - self.last_store_tokens, - ) { - // A gated store still leaves the finished conversation in the - // live KV, so mark it and drop the stale file association. - self.executor.note_checkpoint_tag(completed_tag); - self.checkpoint = None; - self.resident_active = Some(resident_key(directory, completed_tag)); - return Ok(output); + let result = + self.generate_inner(messages, settings, cancelled, &mut emit, &mut progress); + self.publish_execution_stats(); + let (mut output, prompt_complete) = result?; + if prompt_complete { + self.executor.finalize_pending_sampled_token()?; } - let completed_checkpoint = store.checkpoint_path(&completed_key); - self.save_checkpoint(&completed_checkpoint, completed_tag)?; - let retained = store.record( - &completed_checkpoint, - &completed_key, - completed_tag, - self.executor.position(), - self.executor.context(), - if history.is_empty() { - StoreReason::Cold + let mut completed = messages.to_vec(); + completed.push(output.message.clone()); + output.previous_checkpoint_bytes = previous_checkpoint + .as_deref() + .and_then(|path| std::fs::metadata(path).ok()) + .map(|item| item.len()); + if prompt_complete { + let completed_key = + conversation_key(&settings.system_prompt, settings.reasoning_mode, &completed); + let completed_tag: [u8; 32] = Sha256::digest(&completed_key).into(); + if !settings.kv_cache.stores( + self.executor.position(), + history.is_empty(), + self.last_store_tokens, + ) { + // A gated store still leaves the finished conversation in the + // live KV, so mark it and drop the stale file association. + self.executor.note_checkpoint_tag(completed_tag); + self.checkpoint = None; + self.resident_active = Some(resident_key(directory, completed_tag)); + return Ok(output); + } + let completed_checkpoint = store.checkpoint_path(&completed_key); + self.save_checkpoint(&completed_checkpoint, completed_tag)?; + let retained = store.record( + &completed_checkpoint, + &completed_key, + completed_tag, + self.executor.position(), + self.executor.context(), + if history.is_empty() { + StoreReason::Cold + } else { + StoreReason::Continued + }, + )?; + output.checkpoint_bytes = retained + .then(|| std::fs::metadata(&completed_checkpoint).ok()) + .flatten() + .map_or(0, |item| item.len()); + if retained { + self.last_store_tokens = self.executor.position(); + } + self.checkpoint = retained.then_some(completed_checkpoint); + if let Some(checkpoint) = &self.checkpoint { + self.resident_active = Some(checkpoint.clone()); } else { - StoreReason::Continued - }, - )?; - output.checkpoint_bytes = retained - .then(|| std::fs::metadata(&completed_checkpoint).ok()) - .flatten() - .map_or(0, |item| item.len()); - if retained { - self.last_store_tokens = self.executor.position(); + self.resident_active = Some(resident_key(directory, completed_tag)); + } } - self.checkpoint = retained.then_some(completed_checkpoint); - if let Some(checkpoint) = &self.checkpoint { - self.resident_active = Some(checkpoint.clone()); - } else { - self.resident_active = Some(resident_key(directory, completed_tag)); + Ok(output) + })(); + if let Err(error) = &result { + // This server uses content-addressed conversation prefixes rather + // than MTPLX session IDs. Invalidate every ancestor of this turn, + // including prefixes no longer selected in memory or on disk. + let mut paths = Vec::new(); + for count in 0..=messages.len() { + let key = conversation_key( + &settings.system_prompt, + settings.reasoning_mode, + &messages[..count], + ); + let tag = Sha256::digest(&key).into(); + paths.push(directory.join(format!("{}.bin", kvstore::key_hash(&key)))); + paths.push(resident_key(directory, tag)); + } + self.invalidate_qwen_failure(error, paths)?; + } + result + } + + fn invalidate_qwen_failure( + &mut self, + error: &str, + mut paths: Vec, + ) -> Result<(), String> { + if !matches!(self.executor, metal::Executor::QwenMtplx(_)) + || !qwen::is_non_finite_logits(error) + { + return Ok(()); + } + paths.extend(self.checkpoint.take()); + paths.extend(self.resident_active.take()); + self.last_store_tokens = 0; + paths.sort(); + paths.dedup(); + let mut failures = Vec::new(); + for path in paths { + self.resident_sessions.remove(&path); + for file in [ + path.clone(), + path.with_extension("meta"), + path.with_extension("tmp"), + ] { + if let Err(failure) = std::fs::remove_file(&file) + && failure.kind() != std::io::ErrorKind::NotFound + { + failures.push(format!("{}: {failure}", file.display())); + } } } - Ok(output) + // Persistence is synchronous on the serialized model worker. Clearing + // the owner before returning the error also forbids a later save or + // outgoing resident swap from republishing the failed turn. + if let Err(failure) = self.executor.reset() { + failures.push(failure); + } + if failures.is_empty() { + Ok(()) + } else { + Err(format!( + "{error}; Qwen session invalidation failed: {}", + failures.join("; ") + )) + } } fn prepare_bootstrap( @@ -1119,7 +1200,7 @@ impl Generator { let _ = std::fs::remove_file(checkpoint); self.executor.reset()?; self.checkpoint = None; - let result = (|| { + let result: Result<_, String> = (|| { phase("Compacting durable task state…"); let mut private_messages = messages.to_vec(); private_messages.push(ChatTurn { @@ -1224,7 +1305,8 @@ impl Generator { checkpoint: checkpoint.to_owned(), }) })(); - if result.is_err() { + if let Err(error) = &result { + self.invalidate_qwen_failure(error, vec![checkpoint.to_owned()])?; let _ = std::fs::remove_file(checkpoint); self.executor.reset()?; self.checkpoint = None; diff --git a/src/engine/kvstore.rs b/src/engine/kvstore.rs index a72aa6f..48a3e5b 100644 --- a/src/engine/kvstore.rs +++ b/src/engine/kvstore.rs @@ -305,7 +305,7 @@ fn index_size(key: &[u8]) -> Result { .ok_or_else(|| "KV cache index is too large".to_owned()) } -fn key_hash(key: &[u8]) -> String { +pub(super) fn key_hash(key: &[u8]) -> String { let digest: [u8; 32] = Sha256::digest(key).into(); const HEX: &[u8; 16] = b"0123456789abcdef"; let mut output = String::with_capacity(64); diff --git a/src/engine/metal/qwen_mtplx.rs b/src/engine/metal/qwen_mtplx.rs index c4a945e..58756c5 100644 --- a/src/engine/metal/qwen_mtplx.rs +++ b/src/engine/metal/qwen_mtplx.rs @@ -31,6 +31,8 @@ mod indexing; mod issue103_analysis; #[cfg(test)] mod issue104; +#[cfg(test)] +mod issue105; mod linear; mod load; mod mlp; diff --git a/src/engine/metal/qwen_mtplx/binary.rs b/src/engine/metal/qwen_mtplx/binary.rs index c634ff5..326261b 100644 --- a/src/engine/metal/qwen_mtplx/binary.rs +++ b/src/engine/metal/qwen_mtplx/binary.rs @@ -7,6 +7,7 @@ use super::{bytes, dispatch_geometry, ops, tensor, views}; #[derive(Clone, Copy, Debug)] pub(super) enum Binary { Equal, + NotEqual, Greater, GreaterEqual, Less, @@ -106,6 +107,7 @@ pub(super) fn binary(a: &Array, b: &Array, op: Binary, stream: Stream) -> Result if matches!( op, Binary::Equal + | Binary::NotEqual | Binary::Greater | Binary::GreaterEqual | Binary::Less diff --git a/src/engine/metal/qwen_mtplx/execution.rs b/src/engine/metal/qwen_mtplx/execution.rs index f67595c..fbeb9a8 100644 --- a/src/engine/metal/qwen_mtplx/execution.rs +++ b/src/engine/metal/qwen_mtplx/execution.rs @@ -226,6 +226,10 @@ pub(super) struct Execution { pub(super) prefill_throttle: Throttle, pub(super) decode_throttle: Throttle, runtime_overrides: super::policy::Overrides, + #[cfg(test)] + pub(super) fault: Option, + #[cfg(test)] + pub(super) captured_prefixes: usize, _context: Context, } @@ -335,6 +339,10 @@ impl Execution { prefill_throttle, decode_throttle, runtime_overrides, + #[cfg(test)] + fault: None, + #[cfg(test)] + captured_prefixes: 0, _context: context, }) } @@ -347,7 +355,7 @@ impl Execution { ) -> Result { let ids = self.input(ids)?; let options = self.graph_options(phase_prefill, capture)?; - self.model.with_dependent_mut(|_, model| { + let output = self.model.with_dependent_mut(|_, model| { model.call( &ids, Some(&mut self.cache), @@ -362,7 +370,10 @@ impl Execution { &self.streams, self.stream, ) - }) + })?; + #[cfg(test)] + let output = self.inject_output(super::issue105::Stage::Target, output)?; + Ok(output) } /// Cold text _prefill. Session restore and optional owner-level cleanup / @@ -775,7 +786,7 @@ impl Execution { pub(super) fn draft(&mut self, hidden: &Array, ids: &[i32]) -> Result { let ids = self.input(ids)?; let options = self.graph_options(false, false)?; - self.model.with_dependent_mut(|_, model| { + let output = self.model.with_dependent_mut(|_, model| { model.mtp_forward( hidden, &ids, @@ -786,7 +797,10 @@ impl Execution { &self.streams, self.stream, ) - }) + })?; + #[cfg(test)] + let output = self.inject_output(super::issue105::Stage::Draft, output)?; + Ok(output) } pub(super) fn append_mtp_history( @@ -835,7 +849,7 @@ impl Execution { self.stream, &mut self.decode_throttle, |ids, hidden| { - self.model.with_dependent_mut(|_, model| { + let output = self.model.with_dependent_mut(|_, model| { model.call( ids, Some(&mut self.cache), @@ -850,7 +864,24 @@ impl Execution { &self.streams, self.stream, ) - }) + })?; + #[cfg(test)] + let output = Output { + logits: output + .logits + .map(|row| { + super::issue105::inject_logits( + &mut self.fault, + super::issue105::Stage::Target, + &row, + &self.streams, + self.stream, + ) + }) + .transpose()?, + ..output + }; + Ok(output) }, emit, ); diff --git a/src/engine/metal/qwen_mtplx/fused.rs b/src/engine/metal/qwen_mtplx/fused.rs index 04f537a..374f354 100644 --- a/src/engine/metal/qwen_mtplx/fused.rs +++ b/src/engine/metal/qwen_mtplx/fused.rs @@ -51,6 +51,7 @@ pub(super) fn operator(op: &Operation) -> Option<&'static str> { }, Operation::Binary(op) => match op { B::Equal => "Equal", + B::NotEqual => "NotEqual", B::GreaterEqual => "GreaterEqual", B::Greater => "Greater", B::Less => "Less", diff --git a/src/engine/metal/qwen_mtplx/issue103_analysis.rs b/src/engine/metal/qwen_mtplx/issue103_analysis.rs index 09c9b3d..2e8c280 100644 --- a/src/engine/metal/qwen_mtplx/issue103_analysis.rs +++ b/src/engine/metal/qwen_mtplx/issue103_analysis.rs @@ -91,6 +91,10 @@ fn issue103_sampling_receipts() { serde_json::json!({"case":"sampling_matrix","temperature":temperature,"top_k":top_k,"top_p":top_p,"ordinary_probabilities":probabilities,"lazy_counts":counts.to_vec()}) ); } + let oracle = include_str!("../../../../docs/issue105-invalid-logits/oracle.jsonl") + .lines() + .map(|line| serde_json::from_str::(line).unwrap()) + .collect::>(); for (name, values) in [ ("nan", vec![f32::NAN; 64]), ("positive_inf", [vec![f32::INFINITY], vec![0.; 63]].concat()), @@ -123,10 +127,21 @@ fn issue103_sampling_receipts() { "{}", serde_json::json!({"case":"invalid_logits","row":name,"temperature":temperature,"ordinary":result.as_ref().map(|r|r.0).map_err(Clone::clone)}) ); + let expected = oracle + .iter() + .find(|r| { + r["case"] == "ordinary" && r["row"] == name && r["temperature"] == temperature + }) + .unwrap(); if name == "valid_mask" { - assert!([1, 3].contains(&result.unwrap().0)); + assert_eq!(result.unwrap().0, expected["token"].as_i64().unwrap()); } else { - assert!(result.is_ok(), "diagnosis no longer reproduces"); + let error = result.err().unwrap(); + assert!(crate::engine::qwen::is_non_finite_logits(&error)); + assert_eq!( + error, + format!("Qwen {}", expected["error"].as_str().unwrap()) + ); } } let config = SamplerConfig { @@ -139,6 +154,12 @@ fn issue103_sampling_receipts() { "{}", serde_json::json!({"case":"invalid_logits_lazy","row":name,"result":result}) ); + let id = result.unwrap()[0]; + if name == "valid_mask" { + assert!([1, 3].contains(&id)); + } else { + assert_eq!(id, -1); + } } } diff --git a/src/engine/metal/qwen_mtplx/issue105.rs b/src/engine/metal/qwen_mtplx/issue105.rs new file mode 100644 index 0000000..cfe4422 --- /dev/null +++ b/src/engine/metal/qwen_mtplx/issue105.rs @@ -0,0 +1,141 @@ +//! Test-only, owner-local injection at real model output boundaries. +use super::array::{Array, Dtype}; +use super::execution::Execution; +use super::{model::Output, ops, sampling}; + +#[derive(Clone, Copy, Debug, PartialEq, Eq)] +pub(super) enum Stage { + Prefill, + Target, + Draft, + Capture, +} + +#[derive(Clone, Copy, Debug)] +pub(super) enum Row { + Nan, + PositiveInf, + Masked, + LegalMask, +} + +pub(super) struct Fault { + pub(super) stage: Stage, + pub(super) row: Row, +} + +impl Execution { + pub(super) fn inject_logits(&mut self, stage: Stage, logits: &Array) -> Result { + inject_logits(&mut self.fault, stage, logits, &self.streams, self.stream) + } + + pub(super) fn inject_output(&mut self, stage: Stage, output: Output) -> Result { + Ok(Output { + logits: output + .logits + .map(|row| self.inject_logits(stage, &row)) + .transpose()?, + ..output + }) + } + + pub(super) fn inject_capture_failure(&mut self, logits: &Array) -> Result<(), String> { + if self + .fault + .as_ref() + .is_some_and(|f| f.stage == Stage::Capture) + { + // Exercise final-capture error ownership, using the real numerical + // error produced by consuming a faulty row. Normal capture does not + // sample or add a validity pass to the oracle's execution route. + let row = self.inject_logits(Stage::Capture, logits)?; + sampling::checked_argmax(&row, &self.streams, self.stream)?; + } + Ok(()) + } +} + +pub(super) fn inject_logits( + fault: &mut Option, + stage: Stage, + logits: &Array, + streams: &super::stream::Streams, + stream: super::stream::Stream, +) -> Result { + let Some(pending) = &*fault else { + return Ok(logits.clone()); + }; + if pending.stage != stage { + return Ok(logits.clone()); + } + let fault = fault.take().unwrap(); + // Settle the real computation before replacing its output. The normal + // caches, prefix capture and request/persistence owners all remain live. + ops::evaluate(streams, std::slice::from_ref(logits), stream, false)?; + let shape = logits.layout().shape().to_vec(); + let vocab = *shape.last().unwrap() as usize; + let data = (0..logits.layout().size()) + .flat_map(|i| { + let value = match fault.row { + Row::Nan => f32::NAN, + Row::PositiveInf if i % vocab == 0 => f32::INFINITY, + Row::PositiveInf => 0., + Row::Masked => f32::NEG_INFINITY, + Row::LegalMask if i % vocab == 1 => 2., + Row::LegalMask if i % vocab == 3 => 1., + Row::LegalMask => f32::NEG_INFINITY, + }; + value.to_le_bytes() + }) + .collect::>(); + Array::new(&shape, Dtype::F32, super::scalar_buffer(&data)?) +} + +#[test] +#[ignore = "Metal required; run serially under test-supervisor"] +fn issue105_batched_greedy_rejects_each_invalid_row() { + super::configure_sources().unwrap(); + let _context = super::super::gpu::Context::open_qwen(0).unwrap(); + let streams = super::stream::Streams::new(Some(super::allocator::Allocator::new().unwrap())); + let stream = streams.default_stream(super::stream::Device::Gpu).unwrap(); + for width in [64, 4097] { + for row in [Row::Nan, Row::PositiveInf, Row::Masked, Row::LegalMask] { + for position in [0, 1] { + let healthy = Array::new( + &[1, width], + Dtype::F32, + super::scalar_buffer(&vec![0; width as usize * 4]).unwrap(), + ) + .unwrap(); + let injected = inject_logits( + &mut Some(Fault { + stage: Stage::Target, + row, + }), + Stage::Target, + &healthy, + &streams, + stream, + ) + .unwrap(); + let rows = if position == 0 { + [injected, healthy] + } else { + [healthy, injected] + }; + let logits = ops::concatenate(&rows, 0, stream).unwrap(); + let result = sampling::checked_argmax(&logits, &streams, stream); + if matches!(row, Row::LegalMask) { + let ids = ops::read_i64(&result.unwrap(), &streams, stream).unwrap(); + assert_eq!(ids[position], 1); + assert_eq!(ids[1 - position], 0); + } else { + assert!(crate::engine::qwen::is_non_finite_logits( + &result.err().unwrap() + )); + } + } + } + } + streams.clear_streams().unwrap(); +} diff --git a/src/engine/metal/qwen_mtplx/issue105_product.rs b/src/engine/metal/qwen_mtplx/issue105_product.rs new file mode 100644 index 0000000..9ab6753 --- /dev/null +++ b/src/engine/metal/qwen_mtplx/issue105_product.rs @@ -0,0 +1,298 @@ +//! Installed-model faults through Generator and both HTTP response adapters. +use super::super::issue105::{Fault, Row, Stage}; +use super::*; +use crate::engine::{ + Generator, conversation_key, conversation_tag, + kvstore::{KvStore, StoreReason}, + metal::Executor, +}; +use crate::runtime::{ActiveGeneration, GenerationEvent}; +use crate::settings::{ + ExecutionPreferences, GenerationPreferences, ReasoningMode, RuntimePreferences, + SpeculativePreferences, effective_settings, +}; +use std::sync::{Arc, mpsc}; + +fn owner(generator: &mut Generator) -> &mut QwenExecutor { + match &mut generator.executor { + Executor::QwenMtplx(owner) => owner, + _ => unreachable!(), + } +} +fn message(text: &str) -> ChatTurn { + ChatTurn { + user: true, + tool: false, + system: false, + skip_previous_eos: false, + reasoning: None, + reasoning_complete: true, + content: text.into(), + } +} +fn generate( + generator: &mut Generator, + path: &Path, + messages: &[ChatTurn], + settings: &TurnSettings, +) -> GenerationOutput { + generator + .generate( + path, + None, + messages, + settings, + &AtomicBool::new(false), + |_, _| {}, + |_, _, _| {}, + |_| {}, + ) + .unwrap() +} + +#[test] +#[ignore = "installed Qwen model; serial test-supervisor with memory guard required"] +fn issue105_product_ar_cleanup_and_http_retry() { + product(false); +} +#[test] +#[ignore = "installed Qwen MTP model; serial test-supervisor with memory guard required"] +fn issue105_product_mtp_cleanup_and_http_retry() { + product(true); +} + +fn product(mtp: bool) { + let root = std::path::PathBuf::from(std::env::var_os("DS4_QWEN38_ARTIFACTS").unwrap()); + let directory = std::path::PathBuf::from(std::env::var_os("DS4_ISSUE105_DIR").unwrap()); + std::fs::create_dir_all(&directory).unwrap(); + let effective = effective_settings( + crate::model::ModelChoice::Qwen38FlashNext, + &GenerationPreferences { + context_tokens: 4096, + max_generated_tokens: 4, + system_prompt: "Be concise.".into(), + temperature: Some(0.6), + top_p: Some(0.95), + min_p: Some(0.), + reasoning_mode: ReasoningMode::Low, + ..Default::default() + }, + &RuntimePreferences { + execution: ExecutionPreferences { + power_percent: Some(100), + ..Default::default() + }, + speculative: SpeculativePreferences { + glm_mtp: mtp, + ..Default::default() + }, + ..Default::default() + }, + root.parent().unwrap(), + ) + .unwrap(); + let mut settings = effective.turn; + settings.seed = Some(7); + settings.kv_cache.min_tokens = 0; + settings.kv_cache.cold_max_tokens = 4096; + settings.kv_cache.continued_interval_tokens = 1; + let metrics = Arc::new(Metrics::new(&directory.join("metrics"))); + eprintln!("#105 load product mtp={mtp}"); + let mut generator = Generator::open(&effective.engine, metrics).unwrap(); + generator.resident_limit = 8; + owner(&mut generator).policy.store_min_suffix = Some(0); + let baseline_path = directory.join("baseline.bin"); + let mut messages = vec![message("Count from one.")]; + let baseline = generate(&mut generator, &baseline_path, &messages, &settings); + messages.push(baseline.message); + let tag = conversation_tag(&settings.system_prompt, settings.reasoning_mode, &messages); + let key = conversation_key(&settings.system_prompt, settings.reasoning_mode, &messages); + messages.push(message("Continue.")); + let healthy_path = directory.join("healthy.bin"); + generate( + &mut generator, + &healthy_path, + &[message("Say hello.")], + &settings, + ); + let healthy_bytes = std::fs::read(&healthy_path).unwrap(); + let bootstrap = directory.join("bootstrap"); + let transient = directory.join("transient"); + let mut cases = Vec::new(); + for stage in [Stage::Prefill, Stage::Target, Stage::Capture] + .into_iter() + .chain(mtp.then_some(Stage::Draft)) + { + for row in [Row::Nan, Row::PositiveInf, Row::Masked, Row::LegalMask] { + for streaming in [false, true] { + cases.push((stage, row, streaming)); + } + } + } + for (index, (stage, row, streaming)) in cases.into_iter().enumerate() { + settings.temperature = if index % 4 < 2 { 0. } else { 0.6 }; + // The real context-copy route can satisfy this short prompt without + // visiting the draft head. A supported penalty disables copy, ensuring + // draft injection is reached; target cases cover both routes. + owner(&mut generator).policy.sampler.presence_penalty = + if stage == Stage::Draft || (stage == Stage::Target && streaming) { + 0.1 + } else { + 0.0 + }; + let path = if streaming { + let store = KvStore::open(&transient, settings.kv_cache.budget_bytes).unwrap(); + let path = store.checkpoint_path(&key); + std::fs::copy(&baseline_path, &path).unwrap(); + store + .record(&path, &key, tag, 1, 4096, StoreReason::Cold) + .unwrap(); + path + } else { + let path = directory.join("failed.bin"); + if index == 0 { + // Exercise a real bootstrap created by this failing cold turn. + assert!(!path.exists()); + } else { + std::fs::copy(&baseline_path, &path).unwrap(); + } + path + }; + let before = owner(&mut generator).execution.captured_prefixes; + owner(&mut generator).execution.fault = Some(Fault { stage, row }); + let (events, receiver) = mpsc::channel(); + let cancelled = Arc::new(AtomicBool::new(false)); + eprintln!( + "#105 case {index}: mtp={mtp} stage={stage:?} row={row:?} streaming={streaming} temperature={}", + settings.temperature + ); + let chunks = Cell::new(0); + let emit = |reasoning, content| { + chunks.set(chunks.get() + 1); + events + .send(GenerationEvent::Chunk { reasoning, content }) + .unwrap(); + }; + let progress = |used, limit, tokens_per_second| { + events + .send(GenerationEvent::Context { + used, + limit, + tokens_per_second, + }) + .unwrap(); + }; + let result = if streaming { + generator + .generate_transient(&transient, &messages, &settings, &cancelled, emit, progress) + } else { + generator.generate( + &path, + Some(&bootstrap), + &messages, + &settings, + &cancelled, + emit, + progress, + |_| {}, + ) + }; + assert!( + owner(&mut generator).execution.fault.is_none(), + "fault site must be reached: result={:?}", + result.as_ref().map(|o| o.completion_tokens) + ); + assert!( + owner(&mut generator).execution.captured_prefixes > before, + "prefill snapshot before failure" + ); + let valid = matches!(row, Row::LegalMask); + if !valid { + if stage == Stage::Prefill { + assert_eq!(chunks.get(), 0, "no fabricated token reaches the response"); + } + assert!(crate::engine::qwen::is_non_finite_logits( + result.as_ref().err().unwrap() + )); + assert!(owner(&mut generator).live.current.is_none()); + assert!(owner(&mut generator).live.prefix.is_none()); + assert!(owner(&mut generator).execution.boundaries.is_empty()); + assert!(generator.checkpoint.is_none()); + assert!(generator.resident_active.is_none()); + assert_eq!(generator.last_store_tokens, 0); + assert!(!generator.resident_sessions.contains_key(&path)); + assert!(!path.exists()); + assert!(!path.with_extension("meta").exists()); + assert!(!path.with_extension("tmp").exists()); + let delayed = directory.join("delayed.bin"); + assert!(generator.save_checkpoint(&delayed, tag).is_err()); + assert!(!delayed.exists()); + if !streaming { + let store = KvStore::open(&bootstrap, settings.kv_cache.budget_bytes).unwrap(); + assert!(store.find(&key, 4096).is_none()); + } + } else { + assert!(result.is_ok(), "legal masks: {:?}", result.as_ref().err()); + } + events.send(GenerationEvent::Finished(result)).unwrap(); + drop(events); + let wire = crate::server::issue105_wire( + ActiveGeneration { + events: receiver, + cancel: cancelled, + }, + streaming, + ); + if valid { + assert!(wire.starts_with("HTTP/1.1 200")); + assert!(!wire.contains("non-finite logits")); + } else if streaming { + assert!(wire.contains("event: error\n")); + assert!(wire.contains("Qwen non-finite logits")); + } else { + assert!(wire.starts_with("HTTP/1.1 500")); + assert!(wire.contains("Qwen non-finite logits")); + } + assert_eq!(std::fs::read(&healthy_path).unwrap(), healthy_bytes); + assert!( + generator.resident_sessions.contains_key(&healthy_path), + "unrelated healthy session remains resident" + ); + if !valid { + let retried = if streaming { + generator + .generate_transient( + &transient, + &messages, + &settings, + &AtomicBool::new(false), + |_, _| {}, + |_, _, _| {}, + ) + .unwrap() + } else { + generate(&mut generator, &path, &messages, &settings) + }; + assert_eq!(retried.cached_tokens, 0, "failure retries cold"); + assert!(retried.completion_tokens > 0); + } + println!( + "{}", + serde_json::json!({"case":index,"mtp":mtp,"stage":format!("{stage:?}"),"row":format!("{row:?}"),"streaming":streaming,"legal":valid,"healthy_preserved":true,"cold_retry":!valid}) + ); + // Do not let successful diagnostic requests evict the healthy control. + generator.executor.reset().unwrap(); + generator.checkpoint = None; + generator.resident_active = None; + generator + .resident_sessions + .retain(|path, _| path == &healthy_path); + } + assert!( + generator + .select_checkpoint(&healthy_path, |_| true) + .unwrap() + .found + ); + assert!(owner(&mut generator).live.current.is_some()); +} diff --git a/src/engine/metal/qwen_mtplx/ops.rs b/src/engine/metal/qwen_mtplx/ops.rs index e43b863..6f0be91 100644 --- a/src/engine/metal/qwen_mtplx/ops.rs +++ b/src/engine/metal/qwen_mtplx/ops.rs @@ -80,6 +80,7 @@ pub(super) enum Operation { Sum(Vec), Min(Vec), Max(Vec), + Any(Vec), RandomBits, SearchSorted(bool), ArgMax(usize), @@ -175,6 +176,9 @@ impl Operation { Self::Min(axes) => { super::reduce::evaluate(input, output, axes, super::reduce::Reduction::Min) } + Self::Any(axes) => { + super::reduce::evaluate(input, output, axes, super::reduce::Reduction::Or) + } Self::Max(axes) => { super::reduce::evaluate(input, output, axes, super::reduce::Reduction::Max) } diff --git a/src/engine/metal/qwen_mtplx/owner.rs b/src/engine/metal/qwen_mtplx/owner.rs index 880d8be..883d10f 100644 --- a/src/engine/metal/qwen_mtplx/owner.rs +++ b/src/engine/metal/qwen_mtplx/owner.rs @@ -74,92 +74,113 @@ impl QwenExecutor { progress: impl FnMut(u32, u32, Option), emit: impl FnMut(bool, String), ) -> Result<(GenerationOutput, bool), String> { - if settings.context_tokens != self.identity.context as i32 { - return Err("Qwen turn context differs from the loaded engine".into()); - } - self.execution.vision_prompt = None; - self.execution - .model - .with_dependent_mut(|_, model| model.vision = None); - if messages - .iter() - .any(|m| m.content.contains(crate::engine::VISION_DATA_START)) - { - let root = self - .vision_path - .as_ref() - .ok_or("Qwen vision encoder is not installed; download it in Model Manager")?; - if self.vision_tower.is_none() { - self.vision_tower = Some(super::vision::Tower::load( - root, + let result = (|| { + if settings.context_tokens != self.identity.context as i32 { + return Err("Qwen turn context differs from the loaded engine".into()); + } + self.execution.vision_prompt = None; + self.execution + .model + .with_dependent_mut(|_, model| model.vision = None); + if messages + .iter() + .any(|m| m.content.contains(crate::engine::VISION_DATA_START)) + { + let root = self + .vision_path + .as_ref() + .ok_or("Qwen vision encoder is not installed; download it in Model Manager")?; + if self.vision_tower.is_none() { + self.vision_tower = Some(super::vision::Tower::load( + root, + &self.execution.streams, + self.execution.stream, + )?); + } + let prepared = super::vision::prepare( + cancelled, + &self.metadata, + messages, + settings, + self.vision_tower.as_ref().unwrap(), &self.execution.streams, self.execution.stream, - )?); + ); + if !self.keep_vision_loaded { + self.vision_tower = None; + } + let (ids, input, identities) = prepared?; + self.execution + .model + .with_dependent_mut(|_, model| model.vision = Some(input)); + self.execution.vision_prompt = Some((ids, identities)); } - let prepared = super::vision::prepare( - cancelled, + let baseline = self.stats; + let stats = &mut self.stats; + let result = self.live.generate( + &mut self.execution, &self.metadata, messages, settings, - self.vision_tower.as_ref().unwrap(), - &self.execution.streams, - self.execution.stream, - ); - if !self.keep_vision_loaded { - self.vision_tower = None; + &self.policy, + cancelled, + metrics, + progress, + emit, + |event| { + record_speculative_progress(stats, baseline, &event, metrics); + Ok(()) + }, + )?; + let complete = result + .session + .as_ref() + .is_some_and(|s| s.final_snapshot_error.is_none()) + && self.live.current.is_some(); + if let Some(session) = &result.session { + let state_error = match &session.decoded { + TurnDecoded::Ar(decoded) => decoded.final_state_error.as_ref(), + TurnDecoded::Mtp(decoded) => decoded.final_state_error.as_ref(), + }; + if let Some(error) = state_error { + return Err(if crate::engine::qwen::is_non_finite_logits(error) { + error.clone() + } else { + format!("Qwen final decode state failed: {error}") + }); + } + if let Some(error) = &session.final_snapshot_error { + return Err(if crate::engine::qwen::is_non_finite_logits(error) { + error.clone() + } else { + format!("Qwen final state capture failed: {error}") + }); + } + if let Some(error) = &session.prefix_snapshot_error { + eprintln!("Qwen prefix capture failed: {error}"); + } + debug_assert_eq!(result.output.cached_tokens as usize, session.cached_tokens); + debug_assert!(session.prefill_seconds >= 0.0 && session.restore_seconds >= 0.0); + debug_assert!(session.decoded.decode_seconds() >= 0.0); + if let TurnDecoded::Mtp(decoded) = &session.decoded + && decoded.pending.is_some() + { + return Err("Qwen final state still has a pending correction".into()); + } } - let (ids, input, identities) = prepared?; - self.execution - .model - .with_dependent_mut(|_, model| model.vision = Some(input)); - self.execution.vision_prompt = Some((ids, identities)); - } - let baseline = self.stats; - let stats = &mut self.stats; - let result = self.live.generate( - &mut self.execution, - &self.metadata, - messages, - settings, - &self.policy, - cancelled, - metrics, - progress, - emit, - |event| { - record_speculative_progress(stats, baseline, &event, metrics); - Ok(()) - }, - )?; - let complete = result - .session - .as_ref() - .is_some_and(|s| s.final_snapshot_error.is_none()) - && self.live.current.is_some(); - if let Some(session) = &result.session { - let state_error = match &session.decoded { - TurnDecoded::Ar(decoded) => decoded.final_state_error.as_ref(), - TurnDecoded::Mtp(decoded) => decoded.final_state_error.as_ref(), - }; - if let Some(error) = state_error { - return Err(format!("Qwen final decode state failed: {error}")); - } - if let Some(error) = &session.final_snapshot_error { - return Err(format!("Qwen final state capture failed: {error}")); - } - if let Some(error) = &session.prefix_snapshot_error { - eprintln!("Qwen prefix capture failed: {error}"); - } - debug_assert_eq!(result.output.cached_tokens as usize, session.cached_tokens); - debug_assert!(session.prefill_seconds >= 0.0 && session.restore_seconds >= 0.0); - debug_assert!(session.decoded.decode_seconds() >= 0.0); - if let TurnDecoded::Mtp(decoded) = &session.decoded - && decoded.pending.is_some() - { - return Err("Qwen final state still has a pending correction".into()); + Ok((result.output, complete)) + })(); + if let Err(error) = &result + && crate::engine::qwen::is_non_finite_logits(error) + { + // Drop all snapshots before synchronization, even if the device + // reports a second error while draining outstanding work. + self.live = LiveSession::default(); + if let Err(cleanup) = self.clear_execution_cache() { + return Err(format!("{error}; Qwen cache cleanup failed: {cleanup}")); } } - Ok((result.output, complete)) + result } pub(in crate::engine) fn prefill( @@ -1040,3 +1061,7 @@ fn qwen_vision_chat_checkpoint_preserves_image_identity() { assert_ne!(changed.message.content, first.message.content); std::fs::remove_dir_all(directory).unwrap(); } + +#[cfg(test)] +#[path = "issue105_product.rs"] +mod issue105_product; diff --git a/src/engine/metal/qwen_mtplx/random.rs b/src/engine/metal/qwen_mtplx/random.rs index cb130ff..c2742b2 100644 --- a/src/engine/metal/qwen_mtplx/random.rs +++ b/src/engine/metal/qwen_mtplx/random.rs @@ -533,9 +533,16 @@ fn mtplx_sampler_resident_matches_reference() { .iter() .map(|t| ops::read_i64(t, &streams, gpu).unwrap()[0]) .collect::>(); + // Preserve the retired lane's finite-law/RNG fixture for #104. + // #105 replaces only its invalid IDs with the current checked sentinel. + let expected = if case["mode"] == "nonfinite" { + serde_json::json!(vec![-1; 4]) + } else { + case["tokens"].clone() + }; assert_eq!( serde_json::json!(actual), - case["tokens"], + expected, "sampler case {index}: {case}" ); assert_eq!( diff --git a/src/engine/metal/qwen_mtplx/reduce.rs b/src/engine/metal/qwen_mtplx/reduce.rs index 3e6e5af..bb43189 100644 --- a/src/engine/metal/qwen_mtplx/reduce.rs +++ b/src/engine/metal/qwen_mtplx/reduce.rs @@ -227,6 +227,7 @@ pub(super) enum Reduction { Sum, Min, Max, + Or, } impl Reduction { @@ -245,10 +246,21 @@ impl Reduction { Self::Sum => "sum", Self::Min => "min", Self::Max => "max", + Self::Or => "or", } } } +pub(super) fn any( + input: &Array, + axes: &[i32], + keepdims: bool, + stream: Stream, +) -> Result { + let input = ops::astype(input, Dtype::Bool, false, stream)?; + reduction(&input, axes, keepdims, stream, Reduction::Or) +} + pub(super) fn sum( input: &Array, axes: &[i32], @@ -289,7 +301,7 @@ fn reduction( let layout = input.layout(); let dtype = layout.dtype(); if !matches!(dtype, Dtype::BF16 | Dtype::F16 | Dtype::F32 | Dtype::I32) - && !(dtype == Dtype::Bool && matches!(op, Reduction::Sum)) + && !(dtype == Dtype::Bool && matches!(op, Reduction::Sum | Reduction::Or)) { return Err("Qwen reduction requires BF16/F16/F32/I32".into()); } @@ -303,7 +315,7 @@ fn reduction( for &axis in &axes { shape[axis] = 1; } - let out_dtype = if dtype == Dtype::Bool { + let out_dtype = if dtype == Dtype::Bool && matches!(op, Reduction::Sum) { Dtype::I32 } else { dtype @@ -319,6 +331,7 @@ fn reduction( Reduction::Sum => ops::Operation::Sum(axes.clone()), Reduction::Min => ops::Operation::Min(axes.clone()), Reduction::Max => ops::Operation::Max(axes.clone()), + Reduction::Or => ops::Operation::Any(axes.clone()), }, )? }; diff --git a/src/engine/metal/qwen_mtplx/request.rs b/src/engine/metal/qwen_mtplx/request.rs index 6bde3ba..5d2e6b8 100644 --- a/src/engine/metal/qwen_mtplx/request.rs +++ b/src/engine/metal/qwen_mtplx/request.rs @@ -190,6 +190,13 @@ impl LiveSession { Ok(()) }, ); + if result + .as_ref() + .is_err_and(|error| crate::engine::qwen::is_non_finite_logits(error)) + { + *self = Self::default(); + return result; + } // A valid prefill capture survives cancellation and unrelated callback // errors. Never tag those partial turns as a completed conversation. if let Some(prefix) = captured_prefix { diff --git a/src/engine/metal/qwen_mtplx/sampling.rs b/src/engine/metal/qwen_mtplx/sampling.rs index ea223ad..e48d9d9 100644 --- a/src/engine/metal/qwen_mtplx/sampling.rs +++ b/src/engine/metal/qwen_mtplx/sampling.rs @@ -3,7 +3,7 @@ use super::array::{Array, Dtype}; use super::binary::{Binary, binary}; use super::stream::{Stream, Streams}; use super::{indexing, normalization, ops, reduce, sort, unary}; -use crate::engine::Rng; +use crate::engine::{Rng, qwen::non_finite_logits_error}; use std::borrow::Cow; #[derive(Clone, Copy)] @@ -238,7 +238,18 @@ pub(super) fn lazy_sample( } else { categorical_row(&top_vals, key, stream)? }; - indexing::take(&top_idx, &local, 0, stream) + let selected = ops::astype( + &indexing::take(&top_idx, &local, 0, stream)?, + Dtype::I32, + false, + stream, + )?; + let sentinel = Array::new( + &[], + Dtype::I32, + super::scalar_buffer(&(-1_i32).to_le_bytes())?, + )?; + indexing::select(&invalid_logits(row, stream)?, &sentinel, &selected, stream) } /// generation._distribution_from_mlx_logits, including the single-row GPU @@ -300,7 +311,7 @@ pub(super) fn distribution_from_logits( } /// The ordinary generation._sample_from_logits path. Greedy evaluates model -/// logits before constructing/evaluating ArgMax and never advances PCG64. +/// logits and their validity flag together and never advances PCG64. pub(super) fn sample_from_logits( logits: &Array, config: &SamplerConfig, @@ -326,8 +337,7 @@ pub(super) fn sample_from_logits( } else { logits.clone() }; - ops::evaluate(streams, std::slice::from_ref(&logits), stream, false)?; - let token = reduce::argmax(&logits, -1, false, stream)?; + let token = checked_argmax(&logits, streams, stream)?; if token.layout().size() != 1 { return Err("greedy sampler requires a scalar token result".into()); } @@ -338,6 +348,72 @@ pub(super) fn sample_from_logits( } } +/// The pinned greedy validity graph: any(isnan(row)) | isinf(max(row)). +/// A finite maximum permits negative-infinity masks. Read the full row only +/// on failure; valid turns evaluate the token and scalar fault flag together. +fn invalid_logits(logits: &Array, stream: Stream) -> Result { + let vocab = logits.layout().dim(-1)?; + // A valid row must not hide an all-masked neighbour in a batched verify. + // Preserve the ordinary scalar reduction when there is only one row. + let shape = if logits.layout().size() == vocab as usize { + vec![-1] + } else { + vec![-1, vocab] + }; + let row = ops::reshape(logits, &shape, stream)?; + let nan = reduce::any( + &binary(&row, &row, Binary::NotEqual, stream)?, + &[-1], + false, + stream, + )?; + let maximum = reduce::max(&row, &[-1], false, stream)?; + let infinity = |value: f32| -> Result { + let scalar = ops::astype( + &super::random::scalar(value)?, + row.layout().dtype(), + false, + stream, + )?; + binary(&maximum, &scalar, Binary::Equal, stream) + }; + binary( + &nan, + &binary( + &infinity(f32::INFINITY)?, + &infinity(f32::NEG_INFINITY)?, + Binary::LogicalOr, + stream, + )?, + Binary::LogicalOr, + stream, + ) +} + +pub(super) fn checked_argmax( + logits: &Array, + streams: &Streams, + stream: Stream, +) -> Result { + let token = reduce::argmax(logits, -1, false, stream)?; + let bad = invalid_logits(logits, stream)?; + ops::evaluate(streams, &[token.clone(), bad.clone()], stream, false)?; + if ops::read_i64(&bad, streams, stream)? + .iter() + .any(|&bad| bad != 0) + { + return Err(non_finite_logits_error( + &ops::read_f32_as_f64( + &ops::astype(logits, Dtype::F32, false, stream)?, + streams, + stream, + )?, + "greedy argmax", + )); + } + Ok(token) +} + /// Sparse maps retain their iteration order. Counts cover generated tokens, /// not prompt tokens. A disabled penalty is an identity, including storage. pub(super) fn apply_penalties_host<'a>( @@ -609,7 +685,7 @@ pub(super) struct SparseDistribution { impl SparseDistribution { pub(super) fn new( - mut ids: Vec, + ids: Vec, mut probabilities: Vec, vocabulary: usize, ) -> Result { @@ -619,21 +695,15 @@ impl SparseDistribution { if probabilities.iter().any(|p| p.is_finite() && *p < 0.0) { return Err("sparse distribution probabilities must be nonnegative".into()); } + let original = probabilities.clone(); for p in &mut probabilities { if !p.is_finite() || *p <= 0.0 { *p = 0.0; } } - let mut total = pairwise_sum(&probabilities); + let total = pairwise_sum(&probabilities); if !total.is_finite() || total <= 0.0 { - let token = ids - .iter() - .copied() - .find(|&i| i >= 0 && (i as u64) < vocabulary as u64) - .ok_or("sparse distribution has neither positive mass nor a valid token")?; - ids = vec![token]; - probabilities = vec![1.0]; - total = 1.0; + return Err(non_finite_logits_error(&original, "SparseDistribution")); } for p in &mut probabilities { *p /= total; @@ -978,7 +1048,7 @@ pub(super) fn dense_probabilities( .collect::>(); let total = pairwise_sum(&p); if !total.is_finite() || total <= 0.0 { - return Err("cannot normalize logits into a probability distribution".into()); + return Err(non_finite_logits_error(logits, "softmax")); } for value in &mut p { *value /= total; @@ -1053,18 +1123,14 @@ pub(super) fn dense_probabilities( Ok(probabilities) } -/// Original fast_sampling._host_sparse_distribution. Its invalid-mass result -/// is token zero; the ordinary dense generator path instead propagates error. +/// fast_sampling._host_sparse_distribution propagates invalid-mass failures. fn host_sparse( logits: &[f64], temperature: f64, top_p: f64, top_k: i32, ) -> Result { - let probabilities = match dense_probabilities(logits, temperature, top_p, top_k) { - Ok(p) => p, - Err(_) => return SparseDistribution::new(vec![0], vec![1.0], logits.len()), - }; + let probabilities = dense_probabilities(logits, temperature, top_p, top_k)?; let (ids, probabilities) = probabilities .into_iter() .enumerate() @@ -1757,13 +1823,16 @@ fn mtplx_sampler_entry_matches_reference() { .iter() .filter(|v| **v == "eval") .count(); - let expected_commits = if profile == "greedy" { - explicit_evals + 1 - } else if profile == "sparse" && mode == "nonfinite" { - explicit_evals - 1 - } else { - explicit_evals - }; + // NumPy's error census implicitly evaluates the F32 cast, which + // the mx.eval trace does not include. + let expected_commits = + if profile == "greedy" && mode == "nonfinite" && dtype != Dtype::F32 { + explicit_evals + 1 + } else if profile == "sparse" && mode == "nonfinite" { + explicit_evals - 1 + } else { + explicit_evals + }; assert_eq!( commits() - before, expected_commits, @@ -2013,15 +2082,21 @@ fn mtplx_sampler_mixed_distributions_match_reference() { .map(|i| (i * (vocab - 1) / (count - 1).max(1)) as i64) .collect::>(); let selected = ids.iter().map(|&i| p[i as usize]).collect(); - Distribution::Sparse(SparseDistribution::new(ids, selected, vocab).unwrap()) + SparseDistribution::new(ids, selected, vocab).map(Distribution::Sparse) } else { let total = pairwise_sum(&p); - Distribution::Dense(p.iter().map(|p| p / total).collect()) + Ok(Distribution::Dense(p.iter().map(|p| p / total).collect())) } }; let kinds = case["kinds"].as_str().unwrap().as_bytes(); let target = make(p, kinds[0]); let draft = make(q, kinds[1]); + if case["construction_error"] == true { + assert!(target.is_err() || draft.is_err()); + continue; + } + let target = target.unwrap(); + let draft = draft.unwrap(); let mut rng = Rng::new_qwen(12345); let samples = (0..32) .map(|_| target.sample(&mut rng)) @@ -2176,9 +2251,14 @@ fn mtplx_sampler_fallback_matches_reference() { .unwrap(), ) .unwrap(); - let result = sparse_distributions(&logits, 0.6, top_p, 20, &streams, gpu) - .unwrap() - .unwrap(); + let result = sparse_distributions(&logits, 0.6, top_p, 20, &streams, gpu); + if case["error"] == true { + assert!(crate::engine::qwen::is_non_finite_logits( + &result.err().unwrap() + )); + continue; + } + let result = result.unwrap().unwrap(); assert_eq!(result.len(), 4); for (row, distribution) in result.iter().enumerate() { assert_eq!( @@ -2304,10 +2384,10 @@ fn mtplx_sampler_distribution_and_rng_match_reference() { assert!(SparseDistribution::new(vec![], vec![], 10).is_err()); assert!(SparseDistribution::new(vec![1], vec![-0.1], 10).is_err()); assert!(SparseDistribution::new(vec![-1, 10], vec![0.0, f64::NAN], 10).is_err()); - let fallback = - SparseDistribution::new(vec![-1, 7, 3], vec![f64::NAN, f64::INFINITY, 0.0], 10).unwrap(); - assert_eq!(fallback.ids, [7]); - assert_eq!(fallback.probabilities, [1.0]); + let failure = SparseDistribution::new(vec![-1, 7, 3], vec![f64::NAN, f64::INFINITY, 0.0], 10) + .err() + .unwrap(); + assert!(crate::engine::qwen::is_non_finite_logits(&failure)); eprintln!( "MTPLX distributions: {accepted} accepts and {rejected} corrections; exact probabilities, samples and subsequent RNG draws" ); diff --git a/src/engine/metal/qwen_mtplx/session_cache.rs b/src/engine/metal/qwen_mtplx/session_cache.rs index bb7bd83..f062c17 100644 --- a/src/engine/metal/qwen_mtplx/session_cache.rs +++ b/src/engine/metal/qwen_mtplx/session_cache.rs @@ -1158,6 +1158,11 @@ impl Execution { } = self.prepare_session(prompt, saved, options, |event| { observe(TurnProgress::Prefill(event)) })?; + #[cfg(test)] + let prepared = super::prefill::Prepared { + logits: self.inject_logits(super::issue105::Stage::Prefill, &prepared.logits)?, + ..prepared + }; // Publish before decode (and before prefix storage) so a cancelled // response retains the completed prompt timings, just like MTPLX. observe(TurnProgress::PromptReady(crate::metrics::PromptTiming { @@ -1183,6 +1188,10 @@ impl Execution { .and_then(store_prefix) }) .and_then(Result::err); + #[cfg(test)] + if options.store_min_suffix.is_some() && prefix_snapshot_error.is_none() { + self.captured_prefixes += 1; + } observe(TurnProgress::Decode)?; let decoded = match &options.decode { DecodeOptions::Ar(decode) => TurnDecoded::Ar(self.decode_ar( @@ -1216,7 +1225,13 @@ impl Execution { for &id in decoded.tokens() { committed.push(i32::try_from(id).map_err(|_| "generated token exceeds int32")?); } - Some(self.capture_session(&committed, logits, hidden, history, options.lazy_kv)) + #[cfg(test)] + let result = self.inject_capture_failure(logits).and_then(|()| { + self.capture_session(&committed, logits, hidden, history, options.lazy_kv) + }); + #[cfg(not(test))] + let result = self.capture_session(&committed, logits, hidden, history, options.lazy_kv); + Some(result) } else { None }; diff --git a/src/engine/metal/qwen_mtplx/speculative.rs b/src/engine/metal/qwen_mtplx/speculative.rs index 9e661c9..ebc570e 100644 --- a/src/engine/metal/qwen_mtplx/speculative.rs +++ b/src/engine/metal/qwen_mtplx/speculative.rs @@ -440,7 +440,7 @@ impl Execution { let logits = verified.logits.ok_or("copy verify omitted logits")?; let hidden = verified.hidden.ok_or("copy verify omitted hidden")?; let greedy = if sampler.temperature <= 0.0 { - let choices = super::reduce::argmax(&logits, -1, false, self.stream)?; + let choices = sampling::checked_argmax(&logits, &self.streams, self.stream)?; Some(ops::read_i64(&choices, &self.streams, self.stream)?) } else { ops::evaluate( diff --git a/src/engine/qwen.rs b/src/engine/qwen.rs index 8d1626c..1184274 100644 --- a/src/engine/qwen.rs +++ b/src/engine/qwen.rs @@ -17,6 +17,23 @@ use std::path::{Path, PathBuf}; use std::sync::mpsc; use std::thread; +// The engine's public error channel is String. Keep this family-specific +// discriminator intact through request and persistence owners. +const NON_FINITE_LOGITS: &str = "Qwen non-finite logits in "; + +pub(super) fn non_finite_logits_error(row: &[f64], location: &str) -> String { + format!( + "{NON_FINITE_LOGITS}{location} (nan={}, inf={}, vocab={})", + row.iter().filter(|x| x.is_nan()).count(), + row.iter().filter(|x| x.is_infinite()).count(), + row.len() + ) +} + +pub(super) fn is_non_finite_logits(error: &str) -> bool { + error.starts_with(NON_FINITE_LOGITS) +} + const MAX_SAFETENSORS_HEADER: u64 = 16 * 1024 * 1024; const MANIFEST: &[u8] = include_bytes!("../../assets/models/qwen38-flash-next-bare-speed.json"); const INVENTORY: &str = diff --git a/src/server.rs b/src/server.rs index d748e85..cb4db98 100644 --- a/src/server.rs +++ b/src/server.rs @@ -578,6 +578,57 @@ fn empty_arguments() -> String { "{}".into() } +/// Feed actual Generator events through the production HTTP response adapters. +#[cfg(test)] +pub(crate) fn issue105_wire(active: crate::runtime::ActiveGeneration, streaming: bool) -> String { + let listener = TcpListener::bind("127.0.0.1:0").unwrap(); + let address = listener.local_addr().unwrap(); + let client = thread::spawn(move || { + let mut stream = TcpStream::connect(address).unwrap(); + let mut response = String::new(); + stream.read_to_string(&mut response).unwrap(); + response + }); + let (mut stream, _) = listener.accept().unwrap(); + let metrics = Arc::new(Metrics::new(std::path::Path::new("/nonexistent-issue105"))); + let state = State { + generation: GenerationService::spawn(Arc::clone(&metrics)).unwrap(), + config: Arc::new(RwLock::new(Config::default())), + models_path: PathBuf::new(), + cache_path: PathBuf::new(), + sequence: AtomicU64::new(0), + connections: Arc::new(AtomicUsize::new(0)), + tool_memory: Mutex::new(HashMap::new()), + metrics, + cors: false, + }; + let options = ResponseOptions { + protocol: Protocol::Chat, + reasoning_summary: false, + model_id: "qwen3.8-flash-next".into(), + stream: streaming, + include_usage: true, + has_tools: false, + cors: false, + }; + let result = if streaming { + response::stream_response(&mut stream, &state, options, active, "issue105") + } else { + response::final_response(&mut stream, &state, options, active, "issue105") + }; + if let Err((status, message)) = result { + send_json_with_cors( + &mut stream, + status, + &json!({"error":{"message":message,"type":"server_error"}}), + false, + ) + .unwrap(); + } + drop(stream); + client.join().unwrap() +} + #[cfg(test)] mod tests { use super::*; diff --git a/tests/fixtures/mtplx-sampler-batched.jsonl b/tests/fixtures/mtplx-sampler-batched.jsonl index bd0581f..9d59ea3 100644 --- a/tests/fixtures/mtplx-sampler-batched.jsonl +++ b/tests/fixtures/mtplx-sampler-batched.jsonl @@ -10,11 +10,11 @@ {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2bc5ba91b46b1bff6393ca967c058bd076d5b9b7644d48fe3a033239cdd55b75","probs":"43cc70d5d592c238f3223a8c55d1ff57dfa817fe057f1faaa535ecf7cc381bac","shape":[4,17],"samples":[0,14,7,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,5,0,2,0,7,0,15,0,13,0,14,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"93dbdbaf1e50d6c85e099ac30968ad8caeaa112aa76ea1e5e6d2af3d7e9a6bea"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"73d3e2a4493d2fc3e6c48bc3a8f27da44f8d3ee33deff18fe22a16fda85718cd"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"02705ede8f2ee1a8f2d13ec0afc4a5aa19d67f823937cfd41da33d6d86f44789"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4592431925506992485,0,4593858823785442413,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"920409e6a6e7d2070321d05de7558af938d619eb2e2360847ac7f7dbec5305df","shape":[4,17],"samples":[0,13,6,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,4,0,2,0,6,0,15,0,16,0,13,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"3ad2939a07c982ca599a74795c4cdcc84597b9220f3feda5be9302520643ee54"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"39afc2cb69f468bfb59ae2c6b1da88b9b6b94282e5e5ac7d93ef8498d1e89983"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"abaf13bff71079ee32a8b71bf7572a85b5bd8e9bd5496fd31799a3350b716440"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4591812262758790332,4577187368229962638,4593067858290555644,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"86486498d999df0429bc5f8c81bdd4958610a50581a7b632ddd67208b6f2fa3c","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0],"next_rng":4594500682135173736,"converted":[{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"b0bd73e6922c0d2496dbcb99eac08eb5870090e59f6e06b1eb477d540002a5cd","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"d915556fadaa4b979bea7768f4d4f75a862d3890b4c9e279685404737756b5ee","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"051642a71d515ed947133dbfe91e8f487a9acc538b7ec8886af9ed7b8591916c"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"f4243287af88e63369f99f735e4a1683472d856fe04d77b1ae7679ea3c3846f9"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"8ded529a5ff83d7aae91b05286535ac704aa3fe0871e6b477a293be51361164e"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"2738aaeab226bddb2feb7dd0b4f715a5a7d863a66a94e3db26e6a22cfeba02d5"}],"lookups":[0,4594551319643887265,4581647193272864996,0,0,0,4589189572537241937,0,4591308762060361395,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"9b6c54be4a105e1fccc190615f7430b706d589cbbcf79850a5082b324c602818","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"948dfbeae90a1bf589797ddf71af66b6b00762160ee4bdfc105c5092f6eb38de"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"7a8833ac6b31fff392c1412d0c7d1390ad1dc8ffe0c815bcc2dcb862f18c1e99"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"b18c02f825115a12b286cf97814000de31423c24ce890431c9bcb1a0e6b443eb"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"f2de8e9b214a86072cdc3a6135d724753e77cf34173ce4d2f5396b180bbd7b66"}],"lookups":[0,4594551319496361361,4581647193261826774,0,0,0,4589189572654537137,0,4591308763219517877,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -28,11 +28,11 @@ {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"9ee23e9c635e66eccbaa2a4b992586e9721d47aa91337131fb973d0f4a6e5fa6","probs":"ae91df9976213fa559dcdb0e8e38f4c949f160d08723ebd75e96bc0ea73c0013","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,6,1,3,0,14,2,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"948dfbeae90a1bf589797ddf71af66b6b00762160ee4bdfc105c5092f6eb38de"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"e465ce86a9a8198969f8054b97319ef0054faa231e39a5ae20da3d91808ccc04"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"7e0d1928384b31ce754851a9d3509d31fb952b83d1b5492a10a465a6bd2a83b6"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4594551319496361361,4581647193261826774,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"2b3e64c61f47f830eb19b85594460469d1c67031dd0a5d75d2d8153ff7f9dc13","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,5,1,3,0,14,1,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"5c39581c98cfef62a03e51c9640369b26e49002de4f19f49163c8ea9aab83764"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"630dece2527afcf4746840ee68ba8a512c28bae53bd7e04395a477b98ccbbb4f"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"c0a7d58171018264e9760bfcc69d931265b7b429d9337d2329bb1ead7aa67596"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593940714266855271,4582696489832804903,4577563376925418420,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"0470297c3c38e54aaa909c1d5fbe16ed73ace5bdd079ba340d7c630b7c5bbf29","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"23d7f42b1cdc1f0d492ebd756ed0fe8003995dda554d99418d47a81813650207","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"f0a0278e4372459cca6159cd5e71cfee638302a7b9ca9b05c34181ac0a65ac5d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"6e269bb528af029c6ad63f23876db5e898f0fbb5e513ea85b0a004179484921b","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"7a52d80798e1548175db4067892d32b961484d92cfef94852bf3a2a318e799da"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"b3d45a01c21a16e03a55845e08c164767ba3430ac1ff669b05d50213a030c1c6"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"21d3db3a09b4c262ba06038415a423f99a77ecde40ee8d5c58f37f9fc82d6963"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"feb63a3d7ef542e60b6b43b679ced4e1a82232930ede8a584511fd2d6bd0fa11"}],"lookups":[0,4593858823498974729,4589572902702859374,4592431926047128614,0,0,4582173453362682550,0,4581034803236747678,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"ca7df2094df901eb9fb6403ae3e94e4f04c8ee2a4c0a3bc5c36d3be79235fbc5","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"fd1e7e4a13fff63f547f63a986e86a02548c23981cd510b8ca1c2c0f82b1bec7"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"1a0da8fcd19f2081317918d51cbf90d3eca34917b9579ea76581dc29903f9d2d"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"d4608cad53089583c71d61c517482e6f61cb5a74b1574f90f72eb068d83bf761"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"9a3ec98ffc772d6518279aed120628ed9b2a6e8bd8b19ce5bdc287871b573c1f"}],"lookups":[0,4593858823785442413,4589572902083233252,4592431925506992486,0,0,4582173452454553029,0,4581034803548003923,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -46,11 +46,11 @@ {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"97c293b7f305196bea2d654891754563a78786db72ca063387638cdac3bf6f1d","probs":"fabd501093f0349ac950f85e9a53e56bf28bcf5218ad8f6c08a1158aab02075f","shape":[4,17],"samples":[0,7,3,0,1,16,4,0,0,6,5,0,5,4,7,0,16,1,3,0,2,1,3,0,15,1,15,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"66389d3a4d9b4a120a53aeb43030b486d0a591e6e85c2145f778ad31b5c95102"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"1a0da8fcd19f2081317918d51cbf90d3eca34917b9579ea76581dc29903f9d2d"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"d4608cad53089583c71d61c517482e6f61cb5a74b1574f90f72eb068d83bf761"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593858823785442413,4589572902083233251,4592431925506992486,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"a398ca6c30548b5700107cca7b5d058ecd9d4bcfb628acefd22ed783db36c9aa","shape":[4,17],"samples":[0,8,3,0,1,15,3,0,0,7,5,0,6,4,7,0,16,1,3,0,2,1,3,0,15,1,16,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"5af7a97af8499d4e5ab0143935ffa4964f464f4e51b88f4fc8a03927fb0097c0"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"ab4f155ade363ced7137bd6ebb2abc73fde08cf062b832b2ce31e5a4b67ca289"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"a8ed5097db5ae5fb5069484a9df1722d6033061709f6e0c83bbc2295733e0e31"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593067858290555642,4589487416740561688,4591812262758790330,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"59ec6035f4669d2aa016677ff13e657eb8e0f0b0f3da73702f8f91dce44c9843","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0],"next_rng":4594500682135173736,"converted":[{"ids":"18d8d609947c6b82b9607704ae40d3317038e709238514de750b5c7411ba4c20","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"5eb6da0e0e522104c6d50b0748e6893762f7f2c00a7163a46ccbb535bfd61a0d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35be322d094f9d154a8aba4733b8497f180353bd7ae7b0a15f90b586b549f28b","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"42ddf3b5a24de8689261ce54878c4af77a1c115198c5f0ddf6af419d2198ec66","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf"}],"lookups":[0,4592431926047128614,0,4593858823498974729,0,0,4592431926047128614,0,4593858823498974729,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"99e3427ec2e2dbc8577035da40633b38afe84758fe12b77c7654f135ac8b453c","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"cb1f08707ab90ce62a4c442a0ae433d74cbf7740e7246f2ebbf09c9c2a86d761"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"cb1f08707ab90ce62a4c442a0ae433d74cbf7740e7246f2ebbf09c9c2a86d761"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"cb1f08707ab90ce62a4c442a0ae433d74cbf7740e7246f2ebbf09c9c2a86d761"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"cb1f08707ab90ce62a4c442a0ae433d74cbf7740e7246f2ebbf09c9c2a86d761"}],"lookups":[0,4592431925506992486,0,4593858823785442413,0,0,4592431925506992486,0,4593858823785442413,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -64,11 +64,11 @@ {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"6f8d73e8a2f40da97cc3e9c003e2eb4498b70074472ef358f25a465dd9f9709e","shape":[4,17],"samples":[0,14,7,11,1,15,7,5,0,13,10,10,9,11,12,9,16,0,5,7,2,0,7,10,15,0,13,11,14,12,9,4],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"3a87e347c142fe48895d26809b6dcc3782d55118bae2599b3a8c9989c0b55494"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"e2fd870a2e0620d9cdcf890dc8bfc5a10fe23d67a6bcce08f7caba7ab2d7b584"},{"ids":"5371eaf2ff30065284f929a26be06c99892fcec9511cce23d2ae252403711bac","probs":"fe4579c349bc28165fe375553f8ad1836c4b4ac5a051f8f6e4abb535da55b49d"}],"lookups":[0,4592419361563782668,0,4593862683949524819,0,0,4581038663765150679,4585309891621400276,4582172824844043733,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"95e4899a97dae83faf716d168b3b2770bb2da2375d223284c137390b7003bdde","shape":[4,17],"samples":[0,14,7,11,1,15,7,5,0,13,10,10,9,11,12,9,16,0,5,7,2,0,7,10,15,0,13,11,14,12,9,4],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"4f26cde120fa59dce00d3a64cfc022f80e665ba9bda17596c5446ae36acf24a7"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"2c0c38f87a25c113170582f134db0dd07e03dfde5a0f83772d56ca1b7eaa1c21"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"504433495e440b06ee618368c0216c0aad654d7d0b845fbd9ccaa33c8383f60d"},{"ids":"5371eaf2ff30065284f929a26be06c99892fcec9511cce23d2ae252403711bac","probs":"91381fb6fd49c82c9901bd699bb31a587eb70d55115a3c93d4b3be75f823961e"}],"lookups":[0,4592419362359926315,0,4593862684491802387,0,0,4581038662516818819,4585309891382699929,4582172823952117752,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -82,11 +82,11 @@ {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2bc5ba91b46b1bff6393ca967c058bd076d5b9b7644d48fe3a033239cdd55b75","probs":"ca2c65a75e59bb39800e806e0ef2c2c1e787981e93a91c7fcee887d0fc7c38b0","shape":[4,17],"samples":[0,14,7,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,5,0,2,0,7,0,15,0,13,0,14,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"655f261f3e304b21c44cfde4bd59b9d9921db5335176c8e9bdebd5838dd3b84f"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"2c0c38f87a25c113170582f134db0dd07e03dfde5a0f83772d56ca1b7eaa1c21"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"504433495e440b06ee618368c0216c0aad654d7d0b845fbd9ccaa33c8383f60d"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4592419362359926316,0,4593862684491802388,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"8bf75c4aa1788e8adfe4c86fbfdd8447c048269ebd4e73382c2fcc369564bf90","shape":[4,17],"samples":[0,13,6,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,4,0,2,0,6,0,15,0,16,0,13,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"051cdaf4e4125bd01a55f0263fb631f5026a4089940674e8a6c210861e15a6ee"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"497ddf6976f0c8a988f8883583737394a75483f18507b92811c335e4c3681528"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"bf9285989a016f957fc81dbc9bd41be481b3d1e000acd4370f8e4482d0ffdba5"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4591802373085730817,4577195855419970211,4593073810764825108,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"86486498d999df0429bc5f8c81bdd4958610a50581a7b632ddd67208b6f2fa3c","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0],"next_rng":4594500682135173736,"converted":[{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"b0bd73e6922c0d2496dbcb99eac08eb5870090e59f6e06b1eb477d540002a5cd","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"55a7ef692e4500bd026ed8b33b4423b59c4ffee846453cd62827acfea18647b3","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"87f1c51aaec780bff5ea0e02c429f8303bc19192d90ee0fe5c076ae2f3fea134"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"8b095c6c7ee856662d4ea415d944d8e98d8a75388e366babb4d4fd8f145367c2"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"f785f84fac35754c3f1461bb9bc6d27f2abc5b2506fdf8491b35e4e2950c74e6"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"d734b7d0e1276d93422c9f136d7566084cebf62bedfd734962b25bc129cb8bcf"}],"lookups":[0,4594549538798678935,4581650087817052665,0,0,0,4589190199547088458,0,4591293480664281333,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"e5e143a66a097bbcda34c59e5969df2898505a4a53aaa5831c24d10428b467d0","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"71a2e4c83339c527792cbe3cfd08cea270f5c274578bd375ea6fcf44735e050d"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"ac1ede51212ecd7d4b90a77ab319099a34b6c58e8dd101e0b6a1a0d64f729ecd"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"37e794d402445d81ede72ab648a8f3f6f2b883be462f7bb75e292dd51061aae9"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"d60ca1f852e39b95ed9a1e7ece5fb64ab6005dbb373cad54fd763d96671b31ae"}],"lookups":[0,4594549538727073991,4581650086830612750,0,0,0,4589190199996719719,0,4591293480354637103,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -100,11 +100,11 @@ {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"9ee23e9c635e66eccbaa2a4b992586e9721d47aa91337131fb973d0f4a6e5fa6","probs":"f51630c729b30a4e5e78336b4bd3ea242c8bf1dd592e3100f14a31baeb62669d","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,6,1,3,0,14,2,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"06e17201fd0973aae4600e5b1f1467f2c24f792f7ce59061f1a11b74961de482"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"cc6264f038e8eb88349980b8f65de84c991df13c5ebc0368828cf073134b0d7f"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"37e794d402445d81ede72ab648a8f3f6f2b883be462f7bb75e292dd51061aae9"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4594549538727073992,4581650086830612751,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"dab7dcab0a5e1a2aec6cf1c9171b87ffbdc4a33ba87c6a708d20a7b93b3df6c8","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,5,1,3,0,14,1,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f057f7a66a95a8562b6acbe5b5203bb44ba33f54d0d04ce1824c6e355921610"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"7000eff08366d97ad20fc4102c2d2968fd660b4acb5a6a0993805a9fc9b6aea3"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"04911aa79c14d9d6868f9126b0e898d08c40fb87cbdb2605005571b6bec60414"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593939802819018126,4582700056513058629,4577575577596975520,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"0470297c3c38e54aaa909c1d5fbe16ed73ace5bdd079ba340d7c630b7c5bbf29","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"23d7f42b1cdc1f0d492ebd756ed0fe8003995dda554d99418d47a81813650207","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"f0a0278e4372459cca6159cd5e71cfee638302a7b9ca9b05c34181ac0a65ac5d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c0542cde9829d387bb8d9892daaf6f918ec2c3f4d5f0cbb81dd3470e3380aea7","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"c07c78d685415be98481539286fd87008d6481a59abda1498e36d94ae7e9ef6d"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"4ea0e3717c4923308cd7baa218cb78a646636b657dd5fea95e9493bde9ab8bd8"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"3a5662f1d2a4e25f00471f038010e7f6166895c26f4d46d89218c5e63b1073ed"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"15aec4313c67a44e7db5a269de64838d68b90b99f33810f7082f429b050440f9"}],"lookups":[0,4593862683949524819,4589570948739990465,4592419361563782668,0,0,4582172824844043733,0,4581038663765150679,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"7e725af722b965e67775b5aefa3abc1c5a3dc0e282ea954be8bb6e33d04ea96d","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"7ef861def96b8913e16e445ca073e28855f4bc610f1b564c27564aabc53bb118"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"fa21e150e37c95e47418760bbfa6558cf0ab5abf0341ae7f4a95b555a295aab1"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"711d12bee09f23ce44d52e09e4569ca4e9cc89617c92c08d078cd31f24352b23"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"2a1fab69bc94bd47a3c29769c78ebc5577371aef27b4320396b042bf9a5e4703"}],"lookups":[0,4593862684491802387,4589570948875192782,4592419362359926316,0,0,4582172823952117752,0,4581038662516818819,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -118,11 +118,11 @@ {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"97c293b7f305196bea2d654891754563a78786db72ca063387638cdac3bf6f1d","probs":"98e53ea129aa00127491f7c4feb4f11f46ca30a304505815d1b6c7ec0db9c75d","shape":[4,17],"samples":[0,7,3,0,1,16,4,0,0,6,5,0,5,4,7,0,16,1,3,0,2,1,3,0,15,1,15,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"7ef861def96b8913e16e445ca073e28855f4bc610f1b564c27564aabc53bb118"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"afffc1b562eec6ba40de105bd0e3b0456dcca420b7f29180c037c8f502711a68"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"295fcc902e08d98f52ce9a144ecce62cc9b0568b99c89966807011b4a0b27f2e"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593862684491802387,4589570948875192782,4592419362359926316,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"571911e0e028948a23a3eac3e92ba7d044459c7205295e2f17bfcd24992f5184","shape":[4,17],"samples":[0,8,3,0,1,15,3,0,0,7,5,0,6,4,7,0,16,1,3,0,2,1,3,0,15,1,16,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"d8c74dc09b9be6a9a9edeb52fd2a96acbe1b4d336a782216871d3255e48be099"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"294f62819b2d0a38096f2c6d773a0abe40da5f6f4d79098182ef219346032fec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"f2fe5c2a5b9f0509a818cf72b9af9eaefae5eaf5264dcc67b2082192263f6741"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593073810764825107,4589485785735843476,4591802373085730816,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"59ec6035f4669d2aa016677ff13e657eb8e0f0b0f3da73702f8f91dce44c9843","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0],"next_rng":4594500682135173736,"converted":[{"ids":"18d8d609947c6b82b9607704ae40d3317038e709238514de750b5c7411ba4c20","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"5eb6da0e0e522104c6d50b0748e6893762f7f2c00a7163a46ccbb535bfd61a0d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35be322d094f9d154a8aba4733b8497f180353bd7ae7b0a15f90b586b549f28b","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"18f2f19d4d9f60bfffe4e89551324625fd4af67f35c20becd53ee2f39e4e150b","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5"}],"lookups":[0,4592419361563782668,0,4593862683949524819,0,0,4592419361563782668,0,4593862683949524819,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"151e66cd21203ed0798e6531377d12141a7e3bad4ed71a0ab63d14a92fdfd161","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"d8137d1f3e00281898a2a6579511112bd8e6bfe46e1b4bdcd8705827a9168615"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"d8137d1f3e00281898a2a6579511112bd8e6bfe46e1b4bdcd8705827a9168615"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"d8137d1f3e00281898a2a6579511112bd8e6bfe46e1b4bdcd8705827a9168615"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"d8137d1f3e00281898a2a6579511112bd8e6bfe46e1b4bdcd8705827a9168615"}],"lookups":[0,4592419362359926316,0,4593862684491802387,0,0,4592419362359926316,0,4593862684491802387,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -136,11 +136,11 @@ {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"de178206f39d468fb8aab5192f98cc684e234e33635b1ecf65d817fb06586fae","shape":[4,17],"samples":[0,14,7,11,1,15,7,5,0,13,10,10,9,11,12,9,16,0,5,7,2,0,7,10,15,0,13,11,14,12,9,4],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"51030b66a79f37a2306575302f6297f61cbaf6547d5a752b867eb1e6adb2bdf6"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"44d0a45799ff03f80d37dd5befde8fe89b5fc4c7d260f86e0b20e57500b7c591"},{"ids":"5371eaf2ff30065284f929a26be06c99892fcec9511cce23d2ae252403711bac","probs":"ee4f0ad4bc8a10060a89990cbdd691ab7961adff40afa76492562b641ed2d216"}],"lookups":[0,4592421128387115568,0,4593861858064867347,0,0,4581039736763554420,4585310134418132206,4582171492887323038,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"adc92548a1bada537e98a4288675413154f4f91dc5f58e0578b232409e822997","shape":[4,17],"samples":[0,14,7,11,1,15,7,5,0,13,10,10,9,11,12,9,16,0,5,7,2,0,7,10,15,0,13,11,14,12,9,4],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"334dfc601023e826631dcbd3790b42be7a005199e3bb3069bb158a707eb94767"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"517a356011e5c92c388af848d283ed3542d82cb89d88aca5eaea0f4372cc2b59"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"7b2115d79951ea9559ab1f0fa597f041b7b9d1d3f25deaa38ce5b07a7812b16a"},{"ids":"5371eaf2ff30065284f929a26be06c99892fcec9511cce23d2ae252403711bac","probs":"78bb445d71c4491476f3ed00bd8d9ecc82e8300f7c52ac4553c29fb9ce25b8ae"}],"lookups":[0,4592421128332663692,0,4593861858182478162,0,0,4581039736107940648,4585310134751824464,4582171492673295624,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -154,11 +154,11 @@ {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2bc5ba91b46b1bff6393ca967c058bd076d5b9b7644d48fe3a033239cdd55b75","probs":"5328cdcff7bd4a220c638030b645862eb5532a1492227e9b0ecc93bc63de5b2d","shape":[4,17],"samples":[0,14,7,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,5,0,2,0,7,0,15,0,13,0,14,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"334dfc601023e826631dcbd3790b42be7a005199e3bb3069bb158a707eb94767"},{"ids":"4be6e004b3d60e79b6100515b35748cca10d6342d1b59593830c0893069932a6","probs":"c1f92f131e69d81c421f342cc9dce3b9fdb0c3c19dda954f4d4a74454a9d0ec3"},{"ids":"a5ef6390a7a39e7f8b3f0d1e188384f3b875bdfdd015f04df4660dbd12104092","probs":"7b2115d79951ea9559ab1f0fa597f041b7b9d1d3f25deaa38ce5b07a7812b16a"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4592421128332663692,0,4593861858182478162,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"e297c4efc8a30bf54f0bd8a8b7d5b3fbc5a6b6a47cfd158bd1057d643012fb57","shape":[4,17],"samples":[0,13,6,0,1,15,7,0,0,13,10,0,9,11,12,0,16,0,4,0,2,0,6,0,15,0,16,0,13,12,9,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"555ce66f9b44f6886101f7b0123376fc148516990e066a3218f4c44d10fe2b40"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"57735855a05d7ec58a730dc0c44167178c94763aeb350a39bcfe5cd2bacfc966"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"eae8fe35a207e6f7834b62e92dd927f654a9809149069076e7d4dae99f5612e9"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4591803769947986173,4577194850198599864,4593072546326521755,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"86486498d999df0429bc5f8c81bdd4958610a50581a7b632ddd67208b6f2fa3c","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0,2,0,13,0],"next_rng":4594500682135173736,"converted":[{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"b0bd73e6922c0d2496dbcb99eac08eb5870090e59f6e06b1eb477d540002a5cd","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"e320b4f10b181e6b18f1049d94b2e69e1ab28efade6a6fe3102a4b51ce9e381b","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"32d2f569dbae313859d98f7c6699283e0ddaeca79fefd214739d453c7ecf077e"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"272403a1d2e88511f7957ebcbf051821928364cb9ce39368d23cf0f803b496d7"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"f26fad41fd012798d114266241e28c2fce27877aff5d28fa7dcfc65f1b120c5a"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"4c3324bd995f01d3a1306fcf4db724c1bc6a9903f9c16be59686e085a31af96e"}],"lookups":[0,4594550445809888962,4581650091654118176,0,0,0,4589189476676976414,0,4591292463022636546,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"abe40f5b132133f0ceb6fee408f02d3b1fc5307684df2106a439ff773b86ee46","shape":[4,17],"samples":[0,11,3,14,4,13,3,2,0,10,4,10,8,6,10,9,15,3,2,5,6,1,3,10,14,2,16,16,12,8,4,1],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"ea01f3d13212341a57a472b86da329afeededf0046440b2e97499bfcae165dd3"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"81a400f2cafd7e65ed36884e0606eb15690d9a185e2e4a0615de117a2ab8d949"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"573ccdec925191950915e2bd372e72a9d8e99bbc52c6619ff19cbde169000c39"},{"ids":"c4215d7853b535078b682e2f515e049cfac44559414d88e32cd62fbbc3a17e75","probs":"db256cddfaa461b89122368dd87376c9f615e556d8fdf20a16f4bd541d9bb9b9"}],"lookups":[0,4594550446128884374,4581650092299161675,0,0,0,4589189476945724830,0,4591292462429940115,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -172,11 +172,11 @@ {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"9ee23e9c635e66eccbaa2a4b992586e9721d47aa91337131fb973d0f4a6e5fa6","probs":"d43f5f671592b7d980e40b8ce6c26f1e8a105b37503b6c558f8bcb37f42176d2","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,6,1,3,0,14,2,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","probs":"9e670b7733403bcbc7b970334f5f6162262f90a25f8c706089b9e3e20c46774a"},{"ids":"1eb75e0537fd277c95769cc2641e06d2c61e2af9784d5530239be2ed8990edf8","probs":"62a2156ea606b14aa90c9e605a9b7282c69a54e53c26902c77616a84aa6319fe"},{"ids":"d95415f5def419f346156ad13749594913564f0e9e8bb055eda0b748e989f1d5","probs":"2e3c2be80cebc006eaabe84b8eb67ab0dc0c18e796a89698db36a7e50db95d90"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4594550446128884374,4581650092299161675,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"f4f514cea3979e9c0db33926b59cd9349a9935e566078e79bd4a51bea90cbfe2","shape":[4,17],"samples":[0,11,3,0,4,13,3,0,0,10,4,0,8,6,10,0,15,3,2,0,5,1,3,0,14,1,16,0,12,8,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"1921ae23d1ea9f831f017eb13363444fd0bab327edc1ea17031f95276f3f2a05"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"3a8b093d59e963f9e3f518f48b12ff974ad02f702c78064a911a7393774b8489"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"0af483ca7efad7b66a8929a348b1f82d06b277a03cd7ab3fae3e874c7a890809"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593940409358815240,4582699939386534176,4577577180921039568,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"0470297c3c38e54aaa909c1d5fbe16ed73ace5bdd079ba340d7c630b7c5bbf29","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0,8,6,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"23d7f42b1cdc1f0d492ebd756ed0fe8003995dda554d99418d47a81813650207","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"f0a0278e4372459cca6159cd5e71cfee638302a7b9ca9b05c34181ac0a65ac5d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"8bc0cea109f3bcb3726745cdc5f16a2e3bfb0c33fdd7a6e48fbf3f17b23de6f4","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"e28186b602c0dbccc8f1affa0ab01c240009e1c0e638cfe1022d93aa8dbc2cda"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"391ca548dd564665102f8179396a0b9375f91e97e49678805bf44d58d6c4fcdf"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"524e8eae18be36b30358f762e1d6e4f222df2a45fb708ab6768faa7856a9b3a4"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"77b0c0a41e59304e2b508e7a1f1777e720d96226f082a1966b074e821581b46e"}],"lookups":[0,4593861858064867347,4589570831941606662,4592421128387115568,0,0,4582171492887323038,0,4581039736763554420,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"ecee7d0e6fe8af7160b816cb975a56d005f810d83a09e13531de177f8d4a14f9","shape":[4,17],"samples":[0,7,3,11,1,16,4,5,0,6,5,9,5,4,7,8,16,1,3,6,2,1,3,9,15,1,15,13,14,5,4,5],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"850de36f941deb901fdc603d8524d7e58ef1afa27c1768d34743a3a735f1fed9"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"1e2bc4321c129a94529843bb0652584ae0d98d7aa546b7bb84343c082534c94c"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"c3647b01eb175ae44afa686af7a1a575b71598cc2ba9d59b010443722f52f784"},{"ids":"5c3a48bc81fc23ad0557ed5efe4d693e1642d7261e845bc9d76a3c0c8a5535da","probs":"ab1580611946242d321d5dabd7335d8e6983970940365da502475779b65411b7"}],"lookups":[0,4593861858182478162,4589570831684407863,4592421128332663692,0,0,4582171492673295624,0,4581039736107940648,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -190,11 +190,11 @@ {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"97c293b7f305196bea2d654891754563a78786db72ca063387638cdac3bf6f1d","probs":"060c91d3f25cee5d20db87a857064463425dd61040805405dcaece44d3a9cc3a","shape":[4,17],"samples":[0,7,3,0,1,16,4,0,0,6,5,0,5,4,7,0,16,1,3,0,2,1,3,0,15,1,15,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","probs":"58320f7ff4b20356ef12134f8f330b3b78b869f9223e23289997789a2b412feb"},{"ids":"f066ecf90bc2650055e006a0c8ada96b19b4cb32665f5876c56d0f5f6483dade","probs":"315378ecafdb0a255893816607e3267fdd979a2bd64925d986de125a3cb75ba4"},{"ids":"a67be73569d3f8da8764677e4b9e6858feff780f8a8da61f2f424895266dd676","probs":"c3647b01eb175ae44afa686af7a1a575b71598cc2ba9d59b010443722f52f784"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593861858182478162,4589570831684407864,4592421128332663693,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"53061119ab2c64c16c68da0d5e2dc1764404ccea956975db551a5137feb9d3cc","probs":"86cf5f40ac4c8de4984276bcb051a51f1a5ef3fd11a02f6d1b176b8b3334eab8","shape":[4,17],"samples":[0,8,3,0,1,15,3,0,0,7,5,0,6,4,7,0,16,1,3,0,2,1,3,0,15,1,16,0,14,5,4,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"44595be53caf9c3ccaa8292b5ef2901417721d59325a52f3b300c935f97c51df"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"3f75565d9c5a42938acb32c3dd1b69573a736e82145888f4e427fb8082a4eaa5"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"8703713276316a162951b34db1970d2803f745abf2c0c4c0c66e2c62fedff689"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4593072546326521754,4589485689477557738,4591803769947986172,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"59ec6035f4669d2aa016677ff13e657eb8e0f0b0f3da73702f8f91dce44c9843","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0,14,16,3,0],"next_rng":4594500682135173736,"converted":[{"ids":"18d8d609947c6b82b9607704ae40d3317038e709238514de750b5c7411ba4c20","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"5eb6da0e0e522104c6d50b0748e6893762f7f2c00a7163a46ccbb535bfd61a0d","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35be322d094f9d154a8aba4733b8497f180353bd7ae7b0a15f90b586b549f28b","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"85959ba83db7351851943d5df205e8e7162929a6bd827e4eafa14edcb870c11c","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa"}],"lookups":[0,4592421128387115568,0,4593861858064867347,0,0,4592421128387115568,0,4593861858064867347,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"798b6c0af26d0b282f9d83c66121451928a622283e5560161137a0c0f502a6a0","shape":[4,17],"samples":[0,14,1,15,1,15,1,1,0,13,8,13,9,9,13,12,16,0,1,2,2,0,1,14,15,0,16,16,14,11,2,1],"next_rng":4594500682135173736,"converted":[{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"702c77acd8f084cbc4a204e16788d89e4b8d632787978e28cf3636a1b67f1dfa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"702c77acd8f084cbc4a204e16788d89e4b8d632787978e28cf3636a1b67f1dfa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"702c77acd8f084cbc4a204e16788d89e4b8d632787978e28cf3636a1b67f1dfa"},{"ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","probs":"702c77acd8f084cbc4a204e16788d89e4b8d632787978e28cf3636a1b67f1dfa"}],"lookups":[0,4592421128332663692,0,4593861858182478162,0,0,4592421128332663692,0,4593861858182478162,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} @@ -208,11 +208,11 @@ {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"c5719598f73839e42b98f6f62625dab86d98fcda522dcedef935d9a681f37e58","shape":[4,17],"samples":[1,11,3,14,3,14,3,3,1,10,7,11,8,7,11,9,16,1,1,5,4,0,2,11,14,0,16,15,11,9,5,2],"next_rng":4594500682135173736,"converted":[{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"},{"ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","probs":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"}],"lookups":[0,4588638185040256542,4588638185040256542,4588638185040256542,0,0,4588638185040256542,4588638185040256542,4588638185040256542,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]]],"host_calls":0} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"8d6c13665bc3f3453f9f84ac1b01c37513eb70f39aa6cd36537327d4a46a04e7","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"85d193e40c1a92dbe98bcb81389cd2cea4967fab504be1572d3cf2880511872e","probs":"3b7b606ec6c143b991b9ce7f6ddf9c1b9db0a8d1ce2e3f12d3fc60fb75082f82","shape":[4,17],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":4} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,17],[4,17],[4,17]],[[4,17]]],"host_calls":1} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,17],[4,17]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"f1aedf6e661f514b6be4274a6c0b4e08615aca14ae616caf16cf7ca790ad0c22","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"1b8ddc44bb6cbe474bf672c8ce18b7c6d7d4af09706b31ca5710a85049bcaa64"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"1cf6e46fc4364485a17486c4c1e5f61a10d551565df0ee42b675cd36391f8c81"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"739f72b2c947c50564b6991be61f0a21da5d4f590b5264729d4b99d749dc7600"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"eeac6af43640cc5f9982518e874602ab33c9314f098168216060fd666b1d2b02","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"c872ae34151ece25761d96d11ebd426b7b99f2b473b2abcbc693c6ad1fae850b"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"9c5c9d28299051ee38a73fc7e9847ddb1bebf1e8cc48f3cd3b8f6df91cebc449"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"020a12b2672dcf82755e52520077d3020d37be69fd75e2276ca1577ca31f5e71"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -226,11 +226,11 @@ {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"96e2a15c4c31695d23488d9832f8f89a5827e0399f0a70960c0aebd03442467d","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"9c5c9d28299051ee38a73fc7e9847ddb1bebf1e8cc48f3cd3b8f6df91cebc449"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"cbe4360fced32ae0550451cc6a4507637d792e7712ddf52d1f4d726a98f96e93","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4f8ebba9c632ea450176dced2233760ad88ac53f4a9651c1b3c5b6c10f95c09f"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"85eb68d5f9a77cdd2ed10379534a96bc1b03d14690fb66b6d55de25140863794"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"4f5a8db94e6e80175d7c040867915897b0e055e80d003aab04c452eb15f7ad6a"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"96436992b6e1962d11eeee31093e4bc65345bf3f7a123a8ad90144f340cd78f7","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0],"next_rng":4594500682135173736,"converted":[{"ids":"24441e546a6e411de671d62f3576c65aa5cf934aa39abceebb27857bf6c80f40","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35e3a6176b50da27fcb868bf840f0e76290bd9bf55c40545e67bac66353d0674","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"f78e7265215b49f1cba204a09df258dd014f29fbfd403dd0057ed3bdd2e84039","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"171fcbd9aa028dac7c1af33ed8fc137a26b072c26c66c667ec72040dccce1663"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"aab56aa1c56079b593df2ac3bba08c1a0e85010927a6b1737d298b8205fa94f9"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"3c7c2d2f36c6b0a959e0746a3e40be9a7397a085ab1788f6688d15a6cf8f4809"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"07594de9049b868eba6cf99db000d375f71bbcbe20c9f2372130756587c2fee5"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"426e75d301c4cdce89f2357e5a8ec39786922bd35a02dbc8327872a09b84b29f","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"9c5c9d28299051ee38a73fc7e9847ddb1bebf1e8cc48f3cd3b8f6df91cebc449"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"48f82b7f7e439760e03a4c7239928836e8f0416f5240262104e0c0cc68f29d25"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"020a12b2672dcf82755e52520077d3020d37be69fd75e2276ca1577ca31f5e71"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -244,11 +244,11 @@ {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"e1a8563422bd706b0dfa69b62252d4429c0bfb0f3e940594f29dcde4d00f9f99","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"9c5c9d28299051ee38a73fc7e9847ddb1bebf1e8cc48f3cd3b8f6df91cebc449"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"48f82b7f7e439760e03a4c7239928836e8f0416f5240262104e0c0cc68f29d25"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"f49f454d4f1a1091a298f5ac985a8a7aa9941db1fde8d0520d82a6e7256820a2","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"46e10a7bfb9c4023b330a8b51135912d66977d04854f883bdaddead3bef66c69"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"4f5a8db94e6e80175d7c040867915897b0e055e80d003aab04c452eb15f7ad6a"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"fa1e61537c9de1a89b84d1ff75027060503a341d01333d7c1621b21d7afe1fb4"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"fb567f77ff99d00cb1c588fa3fd1f9f8c27208137dc5ff8e5e74f19dc14d8b1a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0],"next_rng":4594500682135173736,"converted":[{"ids":"4e8e14f0ac28d4a6840065d73ba438653d810ecc41ec9b7509615e009a5f3da4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"c69a9157638e69fb692d827383c3f27e586e0c98989cffdf8bd4c982ad837a4c","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"6c9d638b59133ef2279be41643de53e89352b239ce4a933d4223dd6162e91340","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"306f072291a52868ad2c19d0234cdada211f851aa1555b0ea63ee3eff017ac9d"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"b5596b9a975a16d8edf0bf667b8858fff0351d9dd00a8ca496a311f39d283c10"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"6ff34432db0fb740a4eb9f156497d6d2c1bef758c7e3a2d96b65b44a99dafb5c"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"621f6cee908dba05f814a1f9370b1d245944b6958a3c6e620bb62c632add08c5","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"c872ae34151ece25761d96d11ebd426b7b99f2b473b2abcbc693c6ad1fae850b"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"113eb8904f1072332978d09d96239457fb4de21538748f71d4e394cf9f8cdd63"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"092b5b95e962046f68e047669e6d44cc483bfc62cc78f7179c11ef986b32d086"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"113eb8904f1072332978d09d96239457fb4de21538748f71d4e394cf9f8cdd63"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -262,11 +262,11 @@ {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"272e4ed57d0a18e8e44ed2bb90d7b70387528848ceab4d635d85a2aaede4ceb7","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"092b5b95e962046f68e047669e6d44cc483bfc62cc78f7179c11ef986b32d086"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"113eb8904f1072332978d09d96239457fb4de21538748f71d4e394cf9f8cdd63"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"41ecfdb7387fd45bbbcf8c9af8ca168edd783fb09a7f25ffa523d4cb1ef8e18d","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"4f8ebba9c632ea450176dced2233760ad88ac53f4a9651c1b3c5b6c10f95c09f"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"dca366f3ca989383df142b87c935ac3223762545c6c55152f987b958246364a5"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"086d90077eaf200fc785252e134f41956b6f675c25174d6e674e70e957b60778"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"2c3b363ac61f9dd25bbc13e0a13662b85ce38bf5f9bc9364efed84cae3df231f","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0],"next_rng":4594500682135173736,"converted":[{"ids":"9955b5881aaa5ec377b4dd1807ab572abf8f7e9aa2afe3024027b1142cdbc567","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"63e7700301c6f6ec50e64c42a35cb70bd2b80ec8a8b215df16a0d613c98ffcc2","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"69a09126689952b095ff6aaa91b2bbd9c2c7bd220ddb5c62ecf1f4e42f61b7fc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"f77d801bfe8997b52fa614cb4a5b62227627abc0bcd7f2d657c12ac66b7f1a46","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"7ad26460579d706be3273cf2cb6b3c42bf9294f86b5bca8c2bfe1659d9433b16","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -280,11 +280,11 @@ {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"8112a6b758ab83d75b9902e5cd2d9dceb4dc17e221c50fedd183d27d389b56d0","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"1478618db81a73c4f2da83a8da91315e77b849d03b009e36c257a42c65e93982"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"fce8be466b297e1167e01c3419b7bf77f4f50f8508ad463ebadb10073369d841"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"fd747b902cc7e16a0c38dea783c00dc3b59e9f7911f673bb5b7e127a09965156"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"417530bb1ca242a9454c9d6b91748ff5d9d87ac789c0d7c17470887a170033a2","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"9c5c9d28299051ee38a73fc7e9847ddb1bebf1e8cc48f3cd3b8f6df91cebc449"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -298,11 +298,11 @@ {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"a63bbd4e89cd5b4f6ab73347fab8cae0deef86b110440fd6ebe571444774f27f","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"020a12b2672dcf82755e52520077d3020d37be69fd75e2276ca1577ca31f5e71"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"b8bd470a1960249dc264614324efa1011a406e660d820538855c7b79b9e74396","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"a363871ee93ad035c0e924f6a3377e9bed1b665efb6a3818b298c7cdc19f97a0"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"278df4eff26d9cf16119df9955ce505ca3310d9fcda7f3bed045d02663126326"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"57fb30871fa7c1ac553c01e755ed3fa3f12076423a30dbfe18daa14b37d46861"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"96436992b6e1962d11eeee31093e4bc65345bf3f7a123a8ad90144f340cd78f7","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0],"next_rng":4594500682135173736,"converted":[{"ids":"24441e546a6e411de671d62f3576c65aa5cf934aa39abceebb27857bf6c80f40","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35e3a6176b50da27fcb868bf840f0e76290bd9bf55c40545e67bac66353d0674","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"a0ed929c6055f0e6571e1cbda838b09a79f0fab5b05dd79f78e72476f8f1392d","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"f2854d89845622fc43ec17a5b29897ae10307ed7e29230893cd383aa93f096e8"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"edb667f9a8e0c81be7e0504bf36dcd39573651c67cf3eed507a835369f6f65c8"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"55f3f8aefc0b4a3d51536c05457c70c25372010199ee40f456851c63ca9252b1"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"29eb801ed522e85753ff47c125b486f928a6d58f1ba6eacc5df0877952682e1b"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"128c1260dc7c89147945f4fc7af793fe9f402f955ed4bd939f6792c16836e4b5","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"020a12b2672dcf82755e52520077d3020d37be69fd75e2276ca1577ca31f5e71"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -316,11 +316,11 @@ {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"72bd2bb4c15371c66ac5ec69d86cda7b534ef2f14c6b7bdc2dbcdc50a2d61e27","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"54b2feb89399fb81b6483ec64a27112bb964604d84979344e6da6b06dc4f2261"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"c9ce2f5310230e045a56ea0d67c8a7765fbdfe18930c77b354b6e896f30743c3"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"f830d1648b61bf2527a253675230aedc2cabb25f004b2aadc1253dd4e2d6d15d"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"610a0b52774d11cafe9efea6c3eb7afd73bce4d1d23f7caab107daf027f446d5","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"58712a9e9689cc3ee129f45145927443837bcafb12fe2796f7eb25de8136b9a1"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"4f5a8db94e6e80175d7c040867915897b0e055e80d003aab04c452eb15f7ad6a"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"278df4eff26d9cf16119df9955ce505ca3310d9fcda7f3bed045d02663126326"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"fb567f77ff99d00cb1c588fa3fd1f9f8c27208137dc5ff8e5e74f19dc14d8b1a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0],"next_rng":4594500682135173736,"converted":[{"ids":"4e8e14f0ac28d4a6840065d73ba438653d810ecc41ec9b7509615e009a5f3da4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"c69a9157638e69fb692d827383c3f27e586e0c98989cffdf8bd4c982ad837a4c","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"323498ac39b29ce7e3a42600e32e9ba1f051408d7d6b36b936412beebeb41c26","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"56fbd432c04b7e3ec9c8c54c21d6d3a675b33fa54b8fdadef6072b235fbe820d"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"6af4c40833be4febc095363c2481ef1e2ec03777a42969706bb854e5994a9f01"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"2445f1950210ca9bc238a65cb68f2940649ccd4bcb6d715d139a80f15cfffadf"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"ea618a7756325a6b4c2d45e021bab430728a0c11e7e10a5b59fa5eda49e5f8db","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"113eb8904f1072332978d09d96239457fb4de21538748f71d4e394cf9f8cdd63"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"092b5b95e962046f68e047669e6d44cc483bfc62cc78f7179c11ef986b32d086"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"6e5fcb53bddf598d57b5f2321b656c5f48ec3f9ba43de7763b9d3b1ea62f0487"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -334,11 +334,11 @@ {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"a2fc8044991649c992045b980968a855082386e566105f006e4143c915b24b22","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"3a6761e1bf6303f8c16b1d46695fd3cd0306ab53ae2bfef2bbc08fcfc2577b34"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"6e5fcb53bddf598d57b5f2321b656c5f48ec3f9ba43de7763b9d3b1ea62f0487"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"092b5b95e962046f68e047669e6d44cc483bfc62cc78f7179c11ef986b32d086"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"9ea480e3fb45b49157a1607fea5c4bb8129f0b71d03c8fff1fe57d67a0e06b0a","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"4e2d39618d09068d3fd491d211b98f24f5b59db2fcd95ecd47178a50d3af8301"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"456bb940661e76a46138a55873fdf6533348bae890843bcee78ba91e4051dc6f"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"bd3a2ae1e9039a76943c2deddd12c58f22d15ac31eea027cc1eb6141859c902b"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"2c3b363ac61f9dd25bbc13e0a13662b85ce38bf5f9bc9364efed84cae3df231f","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0],"next_rng":4594500682135173736,"converted":[{"ids":"9955b5881aaa5ec377b4dd1807ab572abf8f7e9aa2afe3024027b1142cdbc567","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"63e7700301c6f6ec50e64c42a35cb70bd2b80ec8a8b215df16a0d613c98ffcc2","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"69a09126689952b095ff6aaa91b2bbd9c2c7bd220ddb5c62ecf1f4e42f61b7fc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"97353e29319d04266343ec0ca09560b06906dfbb4f7deb215c27a6fd145ec163","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"416eca248852e521588dc835130779771366827e31c6241f7faf72f17b40ff24","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"26b77a1bbbb66ffd73082fa8d208fef47ffd7c7b3fd21ae2714abe5c10c25c91"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -352,11 +352,11 @@ {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"9ec22948e0d164d84dc881e11a601efe30bb455a2f3c215db5087d1ea5a18c03","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"c92ebf40ec4a465bd03a7aa42e44323f8fe2327e6420728aa00582ec5da53df3"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"00af519c7603872bdddfbafcea3210a1facee41604930f5e4ea5431242827438"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"507a2a4e815c3d5b57dfc265f1efd51dd275634cc7a25e803a21ab4010fc443f"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4ec240d08b44d24f906a088696a77dfb255cd9fade941b723139cba64ae74fe9","probs":"0010301a790310d7a0b3c5a46fb70cab376da1a7394620428fd6b025dd1afcea","shape":[4,20],"samples":[244,2315,410,3116,501,3086,531,546,244,2058,1045,2345,1272,1287,2330,1831,3842,138,274,803,758,2,410,2345,3071,2,3872,3630,2300,1544,788,289],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"7cee387479e002bbd706869e4b3fb3c74afaf5df31156322b693c5e3c091145a"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"71c306cc4fff0e7730c2c04e7a60599f09a191213e17350039bc0a508cee4329"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"0ff4e916e3d7af7b8ed747e8990c5a3b399f70bf8df1fa2c54f4918561082def"},{"ids":"f3b58f5c7b4fef64ba9b29039dccebb636a2e59440fb6058d4a5c605507194e2","probs":"71c306cc4fff0e7730c2c04e7a60599f09a191213e17350039bc0a508cee4329"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -370,11 +370,11 @@ {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"46b10f8448a0fdfa1aad935c99101a80921be2457f2c565737003117ff09c483","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"f750508003b1431101ddd6a313e84d34ab944b1eee5df56f74f65dbdce43efc6"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"0ff4e916e3d7af7b8ed747e8990c5a3b399f70bf8df1fa2c54f4918561082def"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"1912a40741c56e39a8c96fdc500fa49bd08f31e4fe686cdc119e2c6c70c0dc8c"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"1fbb47ba000d237b19b5a9f944637b389f984dddaa5326bc79b569a1e0e6baab","probs":"827a6829411e06dd9a499b7d0e456954664f2d374eca3c5beb1ab89b919aeb9a","shape":[4,20],"samples":[244,2315,410,0,501,3086,531,0,244,2058,1045,0,1272,1287,2330,0,3842,138,274,0,758,2,410,0,3071,2,3872,0,2300,1544,788,0],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"f493c3f6f64e28ebc7a748073193b0e9f98a0af7d3e4a7a767e868f2c7ea8d6e"},{"ids":"06e7df145adc20a98d9615c992a3a2f3f72d8d13bb0e7e10d9f6fc5632c40573","probs":"4a3f410edbf6059e53bb356b2376acf8b2b902b09fe2b5e5fb3a96f83a4f0c91"},{"ids":"ccc9d1118b7d914f1b2edf56f63001581de3494bae69320dbceb5582b3140b57","probs":"4a3f410edbf6059e53bb356b2376acf8b2b902b09fe2b5e5fb3a96f83a4f0c91"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"96436992b6e1962d11eeee31093e4bc65345bf3f7a123a8ad90144f340cd78f7","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0,244,2,17,0],"next_rng":4594500682135173736,"converted":[{"ids":"24441e546a6e411de671d62f3576c65aa5cf934aa39abceebb27857bf6c80f40","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"d86e8112f3c4c4442126f8e9f44f16867da487f29052bf91b810457db34209a4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"35e3a6176b50da27fcb868bf840f0e76290bd9bf55c40545e67bac66353d0674","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"cd9893c4b376833dce5aec31fdf330bc26b4ba764a01f523865c3ffedb5704b8","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"7376de767a0a675256c7a0ce70af821ed0dd2fa0fc8c902a25035f506c3d10e4"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"949dfc31dca692b23532e409317347f241b8e6e378e848652f1e0cebc06404c2"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"b5e7a559d416e62e33c37ebe94a98af9b29fdebc362133c796c026e03cb71829"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"4dca9bd36b11e8bcf2c36034ad2155a5e74366885df5d7b187cf19ee2a0bcfe7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"a0f3085d11c093a5e20912b5819a19e87e61ac9bca2c249ba558332ca4b4acd2","probs":"f7ec8c512be98102c73d53ac94c059c1533b431f29f6fa338cbefbd9fd149bfb","shape":[4,20],"samples":[250,2321,348,3122,507,3092,537,552,250,2064,1051,2351,1278,1293,2336,1837,3848,76,280,809,764,8,348,2351,3077,8,3878,3636,2306,1550,794,295],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"84399b7b97a41c7eb7e542d3b195a933a4328180e8053edcce25faf5d77e10c0"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"1912a40741c56e39a8c96fdc500fa49bd08f31e4fe686cdc119e2c6c70c0dc8c"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"11b39980a4e976f855f7615e5823f2cfc37e1fe0e7bf799b5549b61b2b819988"},{"ids":"86385e14f61ee09a9619d587a4da36d9e969416a2af5613903b894746bd26e79","probs":"0ff4e916e3d7af7b8ed747e8990c5a3b399f70bf8df1fa2c54f4918561082def"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -388,11 +388,11 @@ {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"43d70b6929ea70c710f66e03dc8676075b9c368379bc8c6bda512d945422cf3c","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"f750508003b1431101ddd6a313e84d34ab944b1eee5df56f74f65dbdce43efc6"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"0ff4e916e3d7af7b8ed747e8990c5a3b399f70bf8df1fa2c54f4918561082def"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"1912a40741c56e39a8c96fdc500fa49bd08f31e4fe686cdc119e2c6c70c0dc8c"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"05a87ef75d0d70a67978965daa1ddcc18aee9c1d0d79c698af08e2426e035868","probs":"827a6829411e06dd9a499b7d0e456954664f2d374eca3c5beb1ab89b919aeb9a","shape":[4,20],"samples":[250,2321,348,0,507,3092,537,0,250,2064,1051,0,1278,1293,2336,0,3848,76,280,0,764,8,348,0,3077,8,3878,0,2306,1550,794,0],"next_rng":4594500682135173736,"converted":[{"ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","probs":"f493c3f6f64e28ebc7a748073193b0e9f98a0af7d3e4a7a767e868f2c7ea8d6e"},{"ids":"83b961ed426f5d57233580d97456b23f0641b36151792e20268391ff549db553","probs":"4a3f410edbf6059e53bb356b2376acf8b2b902b09fe2b5e5fb3a96f83a4f0c91"},{"ids":"1aa62f1da39a53009a22d1ecfa75473851be951e672e67fad81d32777ba0dac9","probs":"4a3f410edbf6059e53bb356b2376acf8b2b902b09fe2b5e5fb3a96f83a4f0c91"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"fb567f77ff99d00cb1c588fa3fd1f9f8c27208137dc5ff8e5e74f19dc14d8b1a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0,250,8,23,0],"next_rng":4594500682135173736,"converted":[{"ids":"4e8e14f0ac28d4a6840065d73ba438653d810ecc41ec9b7509615e009a5f3da4","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"6cc16abd70eefb90dc0ba0d14fb088630873b2c6ad943f7442356735984c35a3","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"c69a9157638e69fb692d827383c3f27e586e0c98989cffdf8bd4c982ad837a4c","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"6e624ea3e6427731a6d14573bd3c5bd34ff7ed7cf21f5f583a5e25dcd0eed950","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"a6f35f0435769eadd2d08ec44f33be1c5e693c11e93f9853babd99b8556b2f15"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"6fcff1bd1c44889518550c313c2ea7e541051ec54eb1f8c34c6b8b3971dd4c7d"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"eac6d340d36281529fe3fee6724394962d30c3b6252924365b1477854af5efbe"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2b3d50ffe0e508f279164f185b5a86eca5b1c632e213ba273e00d4701c9e19c0","probs":"df3a71baebb341cc2d4098a93dfbfc04ee166b098806c5b8e0c9d8f2113a8571","shape":[4,20],"samples":[254,2552,481,3293,511,3323,602,587,254,2295,1252,2522,1282,1524,2537,2008,3852,239,345,844,768,103,481,2522,3081,103,4079,3807,2310,1781,859,330],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"7cee387479e002bbd706869e4b3fb3c74afaf5df31156322b693c5e3c091145a"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"b578fd483f9c8acad639792fc8d3daf3a0a697e97e6d9821d48b90d6b5db0c62"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"b578fd483f9c8acad639792fc8d3daf3a0a697e97e6d9821d48b90d6b5db0c62"},{"ids":"a3ebc489816acc020bfc0d97312da1449ce19d1f6185e405c6dc28eb95cdb783","probs":"05569eeec90b7faf41cbc336f4b5d98c3f65ac09ac060267499fbb47e61370de"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -406,11 +406,11 @@ {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"63dbb15e50aabc8fc94fb0a575c12919bc4b2f937db4fdede247c4005a2a4a2f","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"f750508003b1431101ddd6a313e84d34ab944b1eee5df56f74f65dbdce43efc6"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"b578fd483f9c8acad639792fc8d3daf3a0a697e97e6d9821d48b90d6b5db0c62"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"ba56deb99805c38102ccf84ead9c342372e35764369d9d1c081bee341b1f86a6"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"daa4f3bebb6e1a09dcf67c93f849d05097521913b62c09f8d75638a68ec356be","probs":"3be9db3729d7962c5d0fe513bae12f053f7c5164c3f0bb1ac90ed35ae1dc79d6","shape":[4,20],"samples":[254,2552,481,0,511,3323,602,0,254,2295,1252,0,1282,1524,2537,0,3852,239,345,0,768,103,481,0,3081,103,4079,0,2310,1781,859,0],"next_rng":4594500682135173736,"converted":[{"ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","probs":"f493c3f6f64e28ebc7a748073193b0e9f98a0af7d3e4a7a767e868f2c7ea8d6e"},{"ids":"481c1419ba34a4e50d7f59e2f1a2bd442c7b4de021523d3a5d793c26300334a3","probs":"59f68aeeea856dc27b7b5347b9bb8a4e0f56d2d1ba107fff446f0e9ad5c89f8f"},{"ids":"b9bbedf2fd4130756b32cbecad3d09f6cf693a41e0b976333a9d7d4d636dd20c","probs":"b00a536faeb0fed9fd681297eddf4e4eeb9bb6436615e5355883f531c2d12d80"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"2c3b363ac61f9dd25bbc13e0a13662b85ce38bf5f9bc9364efed84cae3df231f","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0,254,239,224,0],"next_rng":4594500682135173736,"converted":[{"ids":"9955b5881aaa5ec377b4dd1807ab572abf8f7e9aa2afe3024027b1142cdbc567","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"63e7700301c6f6ec50e64c42a35cb70bd2b80ec8a8b215df16a0d613c98ffcc2","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"69a09126689952b095ff6aaa91b2bbd9c2c7bd220ddb5c62ecf1f4e42f61b7fc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"51615d90f33ed6a0bcc33b8231d86af89dcb22d9b435ba24a5ba90b57c4b2da5","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"fbff677202dc30d30873925decdd32b33c694bd5f95ff5f6650f695ea598c053","probs":"c917bfe30734a699d1ccdf07fe486792f651ac77d875a8d09fb4bbe19915029e","shape":[4,20],"samples":[244,2300,501,3071,501,3071,637,637,244,2043,1151,2300,1272,1272,2300,1786,3842,244,380,894,758,123,501,2300,3071,123,3842,3585,2300,1529,894,380],"next_rng":4594500682135173736,"converted":[{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"5a290fa99d49ba0f8912032d6197965daf6a77e8e792028f239dc3e3097b0914"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"5a290fa99d49ba0f8912032d6197965daf6a77e8e792028f239dc3e3097b0914"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"5a290fa99d49ba0f8912032d6197965daf6a77e8e792028f239dc3e3097b0914"},{"ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","probs":"5a290fa99d49ba0f8912032d6197965daf6a77e8e792028f239dc3e3097b0914"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} @@ -424,11 +424,11 @@ {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,20]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"a78d22842364d7318e4cea74f5f9004fdd1beb089d5cfb7a4bdc12452a08e953","shape":[4,129],"samples":[1,20,5,24,5,25,6,6,2,18,13,19,14,13,19,16,29,2,3,9,8,0,5,20,24,0,29,27,20,16,10,3],"next_rng":4594500682135173736,"converted":[{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"},{"ids":"394a42f05d4ef71e6c3270cc4fb38075f42683eb24255ab033cbf89ecccf5143","probs":"7167e0f927f7f81d8901d74d1437547d71ad0f644532f700c81bbc439b0aedfe"}],"lookups":[0,4584964660638322961,4584964660638322961,0,0,0,4584964660638322961,4584964660638322961,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"448c8f2bd6fbb536b4d177151dd0542f07e88163cdc33410fb357edeab25be15","shape":[4,129],"samples":[2,28,7,33,7,34,8,8,3,25,18,27,19,18,26,23,40,3,4,13,11,0,7,28,33,1,40,37,28,22,13,4],"next_rng":4594500682135173736,"converted":[{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"},{"ids":"dc56578ae9f1cb6e535727e944b42eb0e38d5939e7b04dc6bccf64e0983b3d68","probs":"7033e4671ce68ccdc5517d645dd25ba35d132708c7899cdcac8e12db9ec86431"}],"lookups":[0,4582687230582855930,4582687230582855930,0,0,0,4582687230582855930,4582687230582855930,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,4097],[4,129]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,20]]],"host_calls":0} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":4097},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":4} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,4097]]],"host_calls":1} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,4097],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"4036d0cb797c9e2660a3cd681c29d9fc627f35df302d681988fd6f097b81d3a5","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -442,11 +442,11 @@ {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"cdbd08a8b75183e2029b022c009ce1b820ac2b3cb88013d808d21a138340567e","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"802fb66bc88e339f5419aefdbdd30ac3a0cfd3ea5e3acb7f0a06b75dd566ae5b","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"41c0aff54d4c330fbd7f6d4beab8fe7ae0ca72611106864efa76c28a169add67","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[244,1728,385,0,501,2242,642,0,244,1728,1156,0,1272,1214,1670,0,2557,186,385,0,758,186,385,0,2300,186,2441,0,1786,1471,899,0],"next_rng":4594500682135173736,"converted":[{"ids":"e2979c7ec4257cf20b1dfa2e6777fd1249181019fb2cd1b64ed1b8e3bc1bb2a2","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"af4e361722965807d8e18f379a924bf5827781105cb6ce35775c34e4017573c9","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -460,11 +460,11 @@ {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"802fb66bc88e339f5419aefdbdd30ac3a0cfd3ea5e3acb7f0a06b75dd566ae5b","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"b40cdb9ba0bdac38a9b45596a41c5cb9bef999c06613e93f0a9718c814acc27c","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"c31e7fb76db9e4adb090939ca506c3b971521072e18c654f71a83889623d8970","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[250,1734,391,0,507,2248,648,0,250,1734,1162,0,1278,1220,1676,0,2563,192,391,0,764,192,391,0,2306,192,2447,0,1792,1477,905,0],"next_rng":4594500682135173736,"converted":[{"ids":"b9461047e8c0fe773d620c5166c6810d985053bb95e6b4ed1def0d79a98bd9cc","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"a464405e8948cd30006284dd9797071688d694503eac70cb5338cd131072944c","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"91fc11d4f887cf60b316a31132003c6f4c02370c13c7a3fd83581deb737ab473","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"4036d0cb797c9e2660a3cd681c29d9fc627f35df302d681988fd6f097b81d3a5","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -478,11 +478,11 @@ {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"cdbd08a8b75183e2029b022c009ce1b820ac2b3cb88013d808d21a138340567e","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"b40cdb9ba0bdac38a9b45596a41c5cb9bef999c06613e93f0a9718c814acc27c","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"ad3ec4f5826e7cd0da332bdbadbef4a139aed408c3f3dcf16ad808e67a5e196a","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[70,1670,443,0,327,2184,700,0,70,1670,1214,0,1098,1156,1728,0,2383,128,443,0,584,128,443,0,2126,128,2499,0,1612,1413,957,0],"next_rng":4594500682135173736,"converted":[{"ids":"a987510f85f3bd4a35ff87959191912b4460ed0875ed2afd9d06b356439896d3","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"834aac64b112bd3c0162257d03bda346628bf7aec76bb639258c1a2ab566f860","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -496,11 +496,11 @@ {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"f8f082c98f23f6534c78886ffa466ae87e1d01708a6242aec413fbe075244d0c","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -514,11 +514,11 @@ {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"b40cdb9ba0bdac38a9b45596a41c5cb9bef999c06613e93f0a9718c814acc27c","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"802fb66bc88e339f5419aefdbdd30ac3a0cfd3ea5e3acb7f0a06b75dd566ae5b","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"41c0aff54d4c330fbd7f6d4beab8fe7ae0ca72611106864efa76c28a169add67","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[244,1728,385,0,501,2242,642,0,244,1728,1156,0,1272,1214,1670,0,2557,186,385,0,758,186,385,0,2300,186,2441,0,1786,1471,899,0],"next_rng":4594500682135173736,"converted":[{"ids":"e2979c7ec4257cf20b1dfa2e6777fd1249181019fb2cd1b64ed1b8e3bc1bb2a2","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"b93cef9f430d8c85e267ce8eb9b4b3271fd05272d0ecb7d6e964518a7c478309","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -532,11 +532,11 @@ {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"cdbd08a8b75183e2029b022c009ce1b820ac2b3cb88013d808d21a138340567e","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"7eda92c3b826bb21f7e162e14a4d2d87089562df1b290301990cfa346ae82c8c","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"c31e7fb76db9e4adb090939ca506c3b971521072e18c654f71a83889623d8970","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[250,1734,391,0,507,2248,648,0,250,1734,1162,0,1278,1220,1676,0,2563,192,391,0,764,192,391,0,2306,192,2447,0,1792,1477,905,0],"next_rng":4594500682135173736,"converted":[{"ids":"b9461047e8c0fe773d620c5166c6810d985053bb95e6b4ed1def0d79a98bd9cc","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"a464405e8948cd30006284dd9797071688d694503eac70cb5338cd131072944c","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"91fc11d4f887cf60b316a31132003c6f4c02370c13c7a3fd83581deb737ab473","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"f8f082c98f23f6534c78886ffa466ae87e1d01708a6242aec413fbe075244d0c","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -550,11 +550,11 @@ {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"b40cdb9ba0bdac38a9b45596a41c5cb9bef999c06613e93f0a9718c814acc27c","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"802fb66bc88e339f5419aefdbdd30ac3a0cfd3ea5e3acb7f0a06b75dd566ae5b","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"ad3ec4f5826e7cd0da332bdbadbef4a139aed408c3f3dcf16ad808e67a5e196a","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[70,1670,443,0,327,2184,700,0,70,1670,1214,0,1098,1156,1728,0,2383,128,443,0,584,128,443,0,2126,128,2499,0,1612,1413,957,0],"next_rng":4594500682135173736,"converted":[{"ids":"a987510f85f3bd4a35ff87959191912b4460ed0875ed2afd9d06b356439896d3","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"f777476942eaec3929f93ff594529b4c4038a5ae591b4f5109a0b06c3f136488","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -568,11 +568,11 @@ {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"4bd3ef54c101331affcf7f380408ddfce232ed6ce67f13583b736c363da6748e","probs":"1ffc5943c97e8bac0a37b3ab8fbfea6dba29b252efa29d60ae62c883eb3740c1","shape":[4,20],"samples":[501,3527,899,4182,1015,4298,1156,1098,501,3270,2184,3411,2557,2499,3469,2897,5127,443,642,1612,1529,186,899,3411,4356,186,5011,4696,3585,2756,1670,584],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -586,11 +586,11 @@ {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"cdbd08a8b75183e2029b022c009ce1b820ac2b3cb88013d808d21a138340567e","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"40264148d7811772fcc1034dad035c34f4d62f8d9593f0a16e566902eeb383fd","probs":"4036f4d2e6fb5633d467b865ab5c51bb8d6d81de0c855d8a505c77ba3f6a429a","shape":[4,20],"samples":[501,3527,899,0,1015,4298,1156,0,501,3270,2184,0,2557,2499,3469,0,5127,443,642,0,1529,186,899,0,4356,186,5011,0,3585,2756,1670,0],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"41c0aff54d4c330fbd7f6d4beab8fe7ae0ca72611106864efa76c28a169add67","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[244,1728,385,0,501,2242,642,0,244,1728,1156,0,1272,1214,1670,0,2557,186,385,0,758,186,385,0,2300,186,2441,0,1786,1471,899,0],"next_rng":4594500682135173736,"converted":[{"ids":"e2979c7ec4257cf20b1dfa2e6777fd1249181019fb2cd1b64ed1b8e3bc1bb2a2","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"2a472068bdd28d144bba35cb0658fae187877672d91799b970ce09e97a393f82","probs":"15a7d8e2c2265b7af04a64444e5b3c46502ce121d39914e5cdaf2546048647cb","shape":[4,20],"samples":[507,3533,905,4188,1021,4304,1162,1104,507,3276,2190,3417,2563,2505,3475,2903,5133,449,648,1618,1535,192,905,3417,4362,192,5017,4702,3591,2762,1676,590],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"53264da6975bf1b1bd3493b8499edd94d106a5806b52182544a23abbd0ea5b3b","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -604,11 +604,11 @@ {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"4036f4d2e6fb5633d467b865ab5c51bb8d6d81de0c855d8a505c77ba3f6a429a","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"83c14976f327d15d6cb0ac5bcd230599860ef3f9593cc7d8dc4b20dab7f08322","probs":"4ba1e536fc037ca81cbe4503c92580125234c030fea578ff9a633c34972b9e2b","shape":[4,20],"samples":[507,3533,905,0,1021,4304,1162,0,507,3276,2190,0,2563,2505,3475,0,5133,449,648,0,1535,192,905,0,4362,192,5017,0,3591,2762,1676,0],"next_rng":4594500682135173736,"converted":[{"ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"4658011d06aae396987b799f40add2ad841f76acdb0d9b16c4b9cd25293af057","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c37427b605e2b71409566ca138fdde00a4ab2333890aa5806ec9fa03a1768db1","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"c31e7fb76db9e4adb090939ca506c3b971521072e18c654f71a83889623d8970","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[250,1734,391,0,507,2248,648,0,250,1734,1162,0,1278,1220,1676,0,2563,192,391,0,764,192,391,0,2306,192,2447,0,1792,1477,905,0],"next_rng":4594500682135173736,"converted":[{"ids":"b9461047e8c0fe773d620c5166c6810d985053bb95e6b4ed1def0d79a98bd9cc","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"a464405e8948cd30006284dd9797071688d694503eac70cb5338cd131072944c","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"91fc11d4f887cf60b316a31132003c6f4c02370c13c7a3fd83581deb737ab473","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"c8c6079109625d5aa2cf7b658435d879c1d3f9877ca0b9bec4c089caf0957ae7","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[327,3469,957,4356,841,4240,1214,1272,327,3212,2242,3585,2383,2441,3527,3071,4953,385,700,1786,1355,128,957,3585,4182,128,5069,4870,3411,2698,1728,758],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -622,11 +622,11 @@ {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"4ba1e536fc037ca81cbe4503c92580125234c030fea578ff9a633c34972b9e2b","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"155552a49194cccb18209fc1e8a2ac5bf55fb438c3872f6e89e6ea432999c709","probs":"4036f4d2e6fb5633d467b865ab5c51bb8d6d81de0c855d8a505c77ba3f6a429a","shape":[4,20],"samples":[327,3469,957,0,841,4240,1214,0,327,3212,2242,0,2383,2441,3527,0,4953,385,700,0,1355,128,957,0,4182,128,5069,0,3411,2698,1728,0],"next_rng":4594500682135173736,"converted":[{"ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"fbebfb1389f4ae4c8fb434814d77779bf7396509e629f40717c4c2345e53bc14","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"a3e91afee0190b93a2d0947db36c475422cb529e2114c2fee681d3e1f901556d","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,20],[4,20]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"ad3ec4f5826e7cd0da332bdbadbef4a139aed408c3f3dcf16ad808e67a5e196a","probs":"cba4cebb192b3d4670c469b4af461e1959426dceda0dcb96433b8688429c869c","shape":[4,129],"samples":[70,1670,443,0,327,2184,700,0,70,1670,1214,0,1098,1156,1728,0,2383,128,443,0,584,128,443,0,2126,128,2499,0,1612,1413,957,0],"next_rng":4594500682135173736,"converted":[{"ids":"a987510f85f3bd4a35ff87959191912b4460ed0875ed2afd9d06b356439896d3","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"46df218629973d53afbcfbaf30cd19f3e42395673ccfcc17dc057dca44afd9f0","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"5a680082350a7f7479873cb34c874e568679373b8312944daf61f0e6a8823805","probs":"aec75911cfd21467e2b1c9f8bb3fc0dc65c630ff5f47af89c9410c1e04ad6804"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,0,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]],[[4,248320]]],"host_calls":4} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,20],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"ids":"3663ec811de8680451b1c0890d3a644d0d379dd9ed643064e382e996b3c72143","probs":"4108868d43e5370954cee8f2a08fae96c416d32cab50a43bfec4b7e942f55b35","shape":[4,20],"samples":[501,3585,1015,4356,1015,4356,1272,1272,501,3328,2300,3585,2557,2557,3585,3071,5127,501,758,1786,1529,244,1015,3585,4356,244,5127,4870,3585,2814,1786,758],"next_rng":4594500682135173736,"converted":[{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"},{"ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","probs":"c9283deca428a6896c34f2ac22f10a53e195b19151ae8da59ef88f8374a1f3d2"}],"lookups":[0,0,0,0,0,0,0,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} @@ -640,11 +640,11 @@ {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"ids":"e4092d171a71840f91471954d9af15cafdd11268a69659c8cbbcaba9d99f3dcf","probs":"e5b0820ca69b8c0fbd414357fe0dba851ede7206fe7abc24fde5d1cf9d104bd0","shape":[4,20],"samples":[1,13,3,16,3,16,4,4,1,12,8,13,9,9,13,11,19,1,2,6,5,0,3,13,16,0,19,18,13,10,6,2],"next_rng":4594500682135173736,"converted":[{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"},{"ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","probs":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7"}],"lookups":[0,4587366580439587226,4587366580439587226,0,0,0,4587366580439587226,4587366580439587226,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,20]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,129],[4,129]]],"host_calls":0} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"ids":"1c4a7f2bb1965137df60f494e76ec9058df35b98dac18f3bbcadef393ac909ad","probs":"2724625326b09c32cd065e6649789fa232a8babda36ae950cb152b3b05199c7f","shape":[4,129],"samples":[8,88,23,106,24,108,27,26,9,79,57,85,61,58,84,72,126,11,14,41,34,2,22,88,106,3,127,117,89,70,43,15],"next_rng":4594500682135173736,"converted":[{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"},{"ids":"0629241135d0e678fc19132006a62ea71a02eb106572a57948443a57e33e6e37","probs":"b41051c2608de86fc65b00b57d7a3157250fe88a8e216914ea894b6e8da2b92a"}],"lookups":[0,4575587398158387184,4575587398158387184,0,0,0,4575587398158387184,4575587398158387184,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,248320],[4,129]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.6,"top_p":0.95,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"ids":"7a270d11ebe5713aa049a0849f8aeb146380f8a28999ce63e1e874fbdd40b269","probs":"82d07f93da1ac3b2bd053100b4a520f676e92a69a150bc70009a07f147e4c051","shape":[4,20],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"serial","result":{"error":true},"evals":[[[4,80],[4,80]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":0.7,"top_p":1.0,"k":20,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,20]]],"host_calls":0} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"ids":"e84eaa9ef115c72823d150900cfef3aad82b7d1eb5e3f8a61f4f5e60040df78a","probs":"1926bd58edd28b8bba68ada71beb28fed99602358eeb345880a99a96f528a384","shape":[4,129],"samples":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next_rng":4594500682135173736,"converted":[{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":248320},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":4} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"serial","result":{"error":true},"evals":[[[4,516],[4,516],[4,516]],[[4,248320]]],"host_calls":1} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"mixed","temperature":1e-07,"top_p":0.01,"k":129,"route":"bound","result":{"error":true},"evals":[[[4,248320],[4,129]]],"host_calls":0} {"constructor":"padded","result":{"ids":"d19cb0301829c582bfa812a479252e4c1d47c1cf8901c5d99bee46cb7c799354","probs":"237e50d7b35702ffacd8720bef36c57320c1c84e0722479d315e2654caabab40","shape":[2,4],"samples":[3,3,0,3,0,3,0,3,3,3,0,3,0,3,0,3,7,3,3,3,0,3,0,3,7,3,7,3,7,3,0,3],"next_rng":4594500682135173736,"converted":[{"ids":"9fc3c9ea36bdd223994f1c4e05a469cb79ffd52aaf02ea97d7c8cfbb80962cec","probs":"3e6005cd4c7df91078c2d119468de3740398c4a849e647ff95f776ddcc9c541a"},{"ids":"0fec49e5cb80c80f848a00237963650b3d777cd7a75e6fadc16db41e7b6b92e1","probs":"ecf29fdb23d55a7613c1cdbdac8b54a853e86b59614d7d92983996f051986379"}],"lookups":[0,4602678819172646912,4595172819793696085,0,0,0,0,4599676419421066581,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17}} {"constructor":"negative","result":{"ids":"8a813d53c6ae983e366160c0ded43103f5639df9d8c1017bb09344e77c00a891","probs":"b8ebbab313c330871feb1cf2ba690e7ecd621c75009ccbb7c6731980b81df5c0","shape":[2,3],"samples":[null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0,null,0],"next_rng":4606978881747947146,"converted":[{"ids":"c571327cb01ac1de6972713cbf6cc1fc3c2cab8b581ee0bc3fe6d8b56963fd5b","probs":"79280b32ba689bc8ee93f85a95dccc001a2535762bdf15ca3a5371771feb55f7"},{"ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","probs":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"}],"lookups":[0,4607182418800017408,0,0,0,0,4607182418800017408,0,0,0,null,null,null,null,null,null,null,null,null,null],"vocab":17}} diff --git a/tests/fixtures/mtplx-sampler-entry.jsonl b/tests/fixtures/mtplx-sampler-entry.jsonl index b23a776..c02d762 100644 --- a/tests/fixtures/mtplx-sampler-entry.jsonl +++ b/tests/fixtures/mtplx-sampler-entry.jsonl @@ -1,1079 +1,1079 @@ -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"8ee5c66f018bbcf13185b35e194afe47609b51e96c0cbc345d7617d9ec617992","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"aef22f50dc33ae36b911ed3b89693ea439bb8b5d78825e11f18609935b4ada23","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"d8442f8d2d10fe0bf14c4d6ebe665136915cbdd7add6b7ed3941ff56b8aa34f8","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":1,"kind":"dense","probabilities":"b6dd730287b3ea00c929722cc7ed3d247a2cb3a24b1a74386cdaa29d90f48bc7","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"a740ace43b9782dbc09cb5fd10279547c35eeeb3ba508ef250a0440486f3631e","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"6acaaa890fb810e32a639843bf74902c6c2b20f1f38aab5dd39100d0cd8e8eec","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"7c694567d6bcbe65629863a01842a9d72ee74054f484aa892a975feecd13d63d","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"e20036377a2e9f1d3a76f119fd7fa3ab9b3cc29c037a7a913d5f415d4f60453b","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"417cb816f08ac08f8333aeed7d63a3d929a15bb6485fdae92dc4bab1a3192d11","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"323197cb27b7a332b1c4a0e546f5befc050c85cbec3503c59c0ae12565b0e360","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"512a7de1757d7f555a18d21e787ae4301ae4ed65f7383aa7b0afc70a6d8f884a","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"16b7c7ae97296329a41f4b297534007452fd63bd3a2839757102092140cd4a5d","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"b8d133de73cc18d8adad769d6d9a66717b3d7e182b8f965c5299ddec5fcac4cf","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"8ee5c66f018bbcf13185b35e194afe47609b51e96c0cbc345d7617d9ec617992","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"aef22f50dc33ae36b911ed3b89693ea439bb8b5d78825e11f18609935b4ada23","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"d8442f8d2d10fe0bf14c4d6ebe665136915cbdd7add6b7ed3941ff56b8aa34f8","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"732a4a0c48a7ff9b42124bbde0ab2f7605844c3925cc4b604665fbf8360ef0a6","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":1,"kind":"dense","probabilities":"b6dd730287b3ea00c929722cc7ed3d247a2cb3a24b1a74386cdaa29d90f48bc7","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"a740ace43b9782dbc09cb5fd10279547c35eeeb3ba508ef250a0440486f3631e","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"6acaaa890fb810e32a639843bf74902c6c2b20f1f38aab5dd39100d0cd8e8eec","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"c4344d0a99b33a1608b729eebb0bb813be31fa6c723d638717110064783028d5","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"7c694567d6bcbe65629863a01842a9d72ee74054f484aa892a975feecd13d63d","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"e20036377a2e9f1d3a76f119fd7fa3ab9b3cc29c037a7a913d5f415d4f60453b","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"417cb816f08ac08f8333aeed7d63a3d929a15bb6485fdae92dc4bab1a3192d11","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"323197cb27b7a332b1c4a0e546f5befc050c85cbec3503c59c0ae12565b0e360","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"512a7de1757d7f555a18d21e787ae4301ae4ed65f7383aa7b0afc70a6d8f884a","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"16b7c7ae97296329a41f4b297534007452fd63bd3a2839757102092140cd4a5d","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,5]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":7,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,5]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":7,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":5,"kind":"sparse","probabilities":"051642a71d515ed947133dbfe91e8f487a9acc538b7ec8886af9ed7b8591916c","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"051642a71d515ed947133dbfe91e8f487a9acc538b7ec8886af9ed7b8591916c","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"051642a71d515ed947133dbfe91e8f487a9acc538b7ec8886af9ed7b8591916c","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"d67b29dce687ef5a16c7a3fb625a9e3f39d9d41e9a02b3ee6d9939a30a85296c","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"5d5ca49b2f72a6adcaa14386d9973f9630c05a6f4ba649bfb95245e884551826","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"226631099c90bad91473d7030b53d15288c0d46df608cc4e3abfc9526db608e8","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"ac52a252b56419e4fa299522673e01abbeb0de263ce90f58ee1db4441721d69a","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"ac52a252b56419e4fa299522673e01abbeb0de263ce90f58ee1db4441721d69a","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"ac52a252b56419e4fa299522673e01abbeb0de263ce90f58ee1db4441721d69a","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":5,"kind":"dense","probabilities":"24194d1237d84e496ec96964ca991523e5eaa979cfe0877813292b2d2566e5a2","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"1729c2de58363b4db0335b86c1b367ee6835440d17cbf7455a22ae9032ef8599","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"a37d5f9ff40d52a84f5e5e53f939d5731ca5750ae2006191c987aef586df5a4b","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"eed0d2aaedb359b87036e9327740fc79c1280b9dfbcc67daae3c01f854293d5c","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"eed0d2aaedb359b87036e9327740fc79c1280b9dfbcc67daae3c01f854293d5c","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"eed0d2aaedb359b87036e9327740fc79c1280b9dfbcc67daae3c01f854293d5c","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":4,"kind":"dense","probabilities":"923406f243c2542479f6a65d703113ddb89f920188069c6d07b158939343c2b1","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"334420a34d9d78bfcc7bc7e39968aa233f608d51cc858952268197f86f91c525","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"e3dbe96459247c00865ce3c1c87ec5adfedaa12ba3337de2f388f52a4b4e0f78","trace":["eval"]}],"counts":[[8,2],[4,1],[6,1],[14,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"323197cb27b7a332b1c4a0e546f5befc050c85cbec3503c59c0ae12565b0e360","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"512a7de1757d7f555a18d21e787ae4301ae4ed65f7383aa7b0afc70a6d8f884a","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"16b7c7ae97296329a41f4b297534007452fd63bd3a2839757102092140cd4a5d","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"7a52d80798e1548175db4067892d32b961484d92cfef94852bf3a2a318e799da","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"7a52d80798e1548175db4067892d32b961484d92cfef94852bf3a2a318e799da","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"7a52d80798e1548175db4067892d32b961484d92cfef94852bf3a2a318e799da","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"47299b52899830b4d5381a953b0a65d78b7176fa737282f972c2571de174a91b","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":3,"kind":"sparse","probabilities":"7a598e8ebecace8c7a3844175bb0dccb5163ff0846c879f67187e625c40b1e8c","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"cd8d92e772e3ffcdcc7e193cc37befd475ce0ebe0312d139b8a835fefa1b37d2","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"89163f9df92ceec1c8a4716cb89af648ebbb62bddb97f39169e00c88472aded7","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"89163f9df92ceec1c8a4716cb89af648ebbb62bddb97f39169e00c88472aded7","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"89163f9df92ceec1c8a4716cb89af648ebbb62bddb97f39169e00c88472aded7","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"c979ece6219a380b906bfd7c7e9d9ed6b99faab1a8e6e5e4b1952f841c49301b","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"41dac1518aa69ae099515f5ddfff52d8e48a934bbe82e768dc8359e93d03dd58","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"8fa5ee259622ae3a6f16a1c7189a15eb21864c0a510a7afa848fef5e914b6be3","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":2,"kind":"dense","probabilities":"fbf05b14c59f8e223c8700bb681ccd1be43d5827e3ea24efdf1885b7bfeaee02","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"fbf05b14c59f8e223c8700bb681ccd1be43d5827e3ea24efdf1885b7bfeaee02","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"fbf05b14c59f8e223c8700bb681ccd1be43d5827e3ea24efdf1885b7bfeaee02","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"19f9aff5371de7f69605256cc67dbedfcc85831af5c891d266bcb8d7067e427e","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"889699aced0f43304de4c152c13675acc9e803137d45f32db7136edd4d56d310","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"aca5d4e398fdfc01c410bb8a1f68c8985c18f862de5eb0a31b5cb52f5fae4a41","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"323197cb27b7a332b1c4a0e546f5befc050c85cbec3503c59c0ae12565b0e360","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"512a7de1757d7f555a18d21e787ae4301ae4ed65f7383aa7b0afc70a6d8f884a","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"16b7c7ae97296329a41f4b297534007452fd63bd3a2839757102092140cd4a5d","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"b5f04183cd47fd9eece5b900e8e946f21df2d95091c113500092313efa4df026","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"358ce79755da2b8f8f9b07cd371d3607291921fc7d819af6f036c68ecdb5e879","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"da55cc33bbe88c830e729d924aedaa04504f171813e247508d5f32740c2d1733","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"323197cb27b7a332b1c4a0e546f5befc050c85cbec3503c59c0ae12565b0e360","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"512a7de1757d7f555a18d21e787ae4301ae4ed65f7383aa7b0afc70a6d8f884a","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"16b7c7ae97296329a41f4b297534007452fd63bd3a2839757102092140cd4a5d","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"44597fe85757dea79a2095c53bb06ac88057fafaeec057268cf9b97bf927b0c8","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"fae0362e4dec6c2d3e4fc9a075c662ec02eb4ea1101be13bb5e5e48b0c69e207","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"c34e126562a68af43341a1bce22b42aee318bb50f4b14e25ae9ea04d3a17ce87","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"c1cc39389cb5244e59f878bc006c4ae680a7d5780a6b6d790c609b00115e6847","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"8cee1877cac51f14c5b8c7488373be6ec78fe07e900ffc610a5f5da231658bf9","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea3bfac890becdad95433c859c03c665b85e993069c2528f402413deb0dcd60d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"71a5ad9796d95e22bf3322c0ba829c7adc7c201d6291297ff2fec155c8c3701f","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"1e7cd38b2a7f7dcb011fc952d1784d3e787e55139a4991c1d5c0d34fd97dcee4","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ba60c6ecf9659726afcf07a748f3a61f457262917d1d5975106e48f5208df89c","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"0e957a67b94ed8bb6dc64d92309e7926e7ce6315f6aa15f054a2bc40f8fa626c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"98bd862eea209850a7d47eefaa7b505a9f7318378e6090d66abc8169f5a2b1b8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"682c7a6d5291575393b4ac7e1e20af04b779e6d104864027d767fc6006e43f65","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"16c49290f33a3320167d1f315b6fdd356249073b39cf19a813f72c79973cccc5","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"44597fe85757dea79a2095c53bb06ac88057fafaeec057268cf9b97bf927b0c8","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"fae0362e4dec6c2d3e4fc9a075c662ec02eb4ea1101be13bb5e5e48b0c69e207","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"c34e126562a68af43341a1bce22b42aee318bb50f4b14e25ae9ea04d3a17ce87","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"f380d85397768af3fdd1ca5dd703db82470417bb70828012961d21c3e8178086","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"c1cc39389cb5244e59f878bc006c4ae680a7d5780a6b6d790c609b00115e6847","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"8cee1877cac51f14c5b8c7488373be6ec78fe07e900ffc610a5f5da231658bf9","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea3bfac890becdad95433c859c03c665b85e993069c2528f402413deb0dcd60d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"724e7e8fc81ebe61790855cf0566bc963b8ed176f676a8c7aeff8e95348a9530","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"71a5ad9796d95e22bf3322c0ba829c7adc7c201d6291297ff2fec155c8c3701f","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"1e7cd38b2a7f7dcb011fc952d1784d3e787e55139a4991c1d5c0d34fd97dcee4","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ba60c6ecf9659726afcf07a748f3a61f457262917d1d5975106e48f5208df89c","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"0e957a67b94ed8bb6dc64d92309e7926e7ce6315f6aa15f054a2bc40f8fa626c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"98bd862eea209850a7d47eefaa7b505a9f7318378e6090d66abc8169f5a2b1b8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"682c7a6d5291575393b4ac7e1e20af04b779e6d104864027d767fc6006e43f65","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,5]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":7,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,5]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":7,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":5,"kind":"sparse","probabilities":"87f1c51aaec780bff5ea0e02c429f8303bc19192d90ee0fe5c076ae2f3fea134","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"87f1c51aaec780bff5ea0e02c429f8303bc19192d90ee0fe5c076ae2f3fea134","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"87f1c51aaec780bff5ea0e02c429f8303bc19192d90ee0fe5c076ae2f3fea134","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"cb2c4ff873fbc61e1e9ac68b2b7d99c94349a5defd9cbafdcf83353f0ff98a42","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"b7e2cfa994b042d0d6054bfe3995678850d4acd90f505644d1440435cfc95f22","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"4a81be3780d6c23e329f66d9f3edb0e4458d1fc3bbd153cc4891dbeaa116ac2a","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"40e873665530c7a3c61a73158c134f12f0db4a51d3d72c6ffc9bb81e848582ba","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"40e873665530c7a3c61a73158c134f12f0db4a51d3d72c6ffc9bb81e848582ba","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"40e873665530c7a3c61a73158c134f12f0db4a51d3d72c6ffc9bb81e848582ba","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":5,"kind":"dense","probabilities":"7ac5692d211f00f2280ed60c4bbe00edbb2a1c30a27e31cb7d32fb2d2118d670","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"315a0c7b9cacade55867a9a14faed5625825147bec49b09785e8016f1fadd7e1","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"ccaea8d5f9c952990161607e78eecefd0ab90336acb0a1a90ec3d0b0b6f51a5a","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"a499d6740e269a582035282d9f7da45c7d744293c60effb8da435db21f809cd9","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"a499d6740e269a582035282d9f7da45c7d744293c60effb8da435db21f809cd9","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"a499d6740e269a582035282d9f7da45c7d744293c60effb8da435db21f809cd9","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":4,"kind":"dense","probabilities":"71d21d07b7715aaad7fa82b6fc26c88b84efaf2a530b0d0830414f667c81930c","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"a46b9161928d0984b161d137c00fbe3fe8ec33c86acf04e734cfd12630e922e9","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"6b4c3dd4c8db2e46339e01093eea004c92094de63cde98014e9b605636aa2da8","trace":["eval"]}],"counts":[[8,2],[4,1],[6,1],[14,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"0e957a67b94ed8bb6dc64d92309e7926e7ce6315f6aa15f054a2bc40f8fa626c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"98bd862eea209850a7d47eefaa7b505a9f7318378e6090d66abc8169f5a2b1b8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"682c7a6d5291575393b4ac7e1e20af04b779e6d104864027d767fc6006e43f65","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"c07c78d685415be98481539286fd87008d6481a59abda1498e36d94ae7e9ef6d","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"c07c78d685415be98481539286fd87008d6481a59abda1498e36d94ae7e9ef6d","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"c07c78d685415be98481539286fd87008d6481a59abda1498e36d94ae7e9ef6d","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"783021e813e67abea636f56ea29e8ca24ead29f1c8ffb02cfc9734ac7aceb5a8","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":3,"kind":"sparse","probabilities":"0a8baab0d644321296c4420193cafe51c576a8204e2b225139e84d006d08ed7a","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"5c71ca0101feb892ee8a67e4d3f8a5d4d1e8dd65f1d88a5f976001b795e870b5","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"191632c656998078c67ecde0f0a3509f26826f9d2e524b2b8165010ff59b3165","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"191632c656998078c67ecde0f0a3509f26826f9d2e524b2b8165010ff59b3165","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"191632c656998078c67ecde0f0a3509f26826f9d2e524b2b8165010ff59b3165","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"2b382e3863a1dd7c2b2423578f4330eb82d7cc62610ae436ff7dab6bf1712cd2","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"eee3efd4e62a3b62497dfd40ee0e6f696108409c3f34e76a676aafd83cdba2b7","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"b991ceef4e97413e1cca8b8a218b175fe6880b33069f98c4a77c087cf18083aa","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":2,"kind":"dense","probabilities":"8a4f0d7637e46f86f71903a3cda6ade8a76b6e032a24243be9fc337d4a5a0cbd","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"8a4f0d7637e46f86f71903a3cda6ade8a76b6e032a24243be9fc337d4a5a0cbd","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"8a4f0d7637e46f86f71903a3cda6ade8a76b6e032a24243be9fc337d4a5a0cbd","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"a67f17a02cf0d6a50d39c518fd841d9eaa695ef6dda05e89d8d2c2ab3acf1a8c","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"d60baec450991ac2553120c86e0dc38f57d10423c6a9f7fe0089ff7d6994d333","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"1f9281c9ccc4d405d9f0116d7f93850408c5e5cd6a221c9c246ee3ed8c91edf3","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"0e957a67b94ed8bb6dc64d92309e7926e7ce6315f6aa15f054a2bc40f8fa626c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"98bd862eea209850a7d47eefaa7b505a9f7318378e6090d66abc8169f5a2b1b8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"682c7a6d5291575393b4ac7e1e20af04b779e6d104864027d767fc6006e43f65","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"ba7bcee12d42f21f927cac6b661f3535a65fd7b75c45962e1788aec09c364c4c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"315685a59ccd23c578d566d083258efcbf5e41d5e03ba52caa97729da0a92530","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"1e5419761c43ee5acd011bdf93bac5b218c1744955fc70ce1ab82d6851370aa7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"ee7b0f99ccc9091cf4215ae0faf2ccd8838815d6142790cf4e742ade545682a2","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"c123d6765d79d399edfe960857c418557067c61523f302e944ac56b616d7aa1d","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"3ed6440e46d4d2967bdc4dcf84fc944ddfeaa746fb7c1e5357a9c61707ab78ab","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"db051ec0f9a0f117cb64413292c2c52764d5180fb68cf72d3f9330bfc8b579e1","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"32c6568bc592ce24d58748d77ac2a381470f559143315655f4626e529d3f54a6","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"d909ca1ffa5e56e65e7745ea1a376813c8730200f5b5a067e3112ea9e3474d8e","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"0e957a67b94ed8bb6dc64d92309e7926e7ce6315f6aa15f054a2bc40f8fa626c","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"98bd862eea209850a7d47eefaa7b505a9f7318378e6090d66abc8169f5a2b1b8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"682c7a6d5291575393b4ac7e1e20af04b779e6d104864027d767fc6006e43f65","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"479b5b7b4c1f5422d45d6152582705c47e191ae70664737e3f50ec5f376c457f","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"6e563798e2b29f1cfb673564046d271e8f1b7c2cfa0d4a778217ca399fd41a0f","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"17d37e87be67bcce68b496bc58bf4e7cdd5575548c7465fa55008bd6ee9d5983","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"f2acc660754d6f1fbb0d5677b1b6744cfef81081c8840e23d617cc428d8e94c5","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"bac96fd6a08b265dcaa69aab8d6c82e677cea2c9bcd55da992b5be1f6d24b625","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea1516e28ff8ae16d571b297a17842dfe97c878b275eeaec70e37045a748dbd4","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"54e2bc558b4211b09cfdc39a0415c2b404a9c89520984246b0bf5fe93f57366c","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"183612c287468f5cf677b6fadf3adf6c308f2dec65640777f8c795d3f15a4aad","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"c7641d581397a52c706690e4e3ef351bffff1159f1586c4450c020e3b4c7a433","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"24599cc0162aabac98c3b67b6b6708b25651d01bd6f1e6d813427884d5aad0f7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":16,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":16,"kind":"none","trace":["argmax","eval"]},{"token":1,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[2,1],[16,1],[1,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"c03d4aff327c8021562648b1708ecd997a6a3f2d7b8a0d6ad8a76420adbb1faa","ids":"d4f0a2a94528a346d65d38a4676477d17532ee3b1e04a42398ddd8549e882314","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"479b5b7b4c1f5422d45d6152582705c47e191ae70664737e3f50ec5f376c457f","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"6e563798e2b29f1cfb673564046d271e8f1b7c2cfa0d4a778217ca399fd41a0f","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"17d37e87be67bcce68b496bc58bf4e7cdd5575548c7465fa55008bd6ee9d5983","ids":"065dfe51f3e18e084aba7081cad6cb2d7e93f80aed2f9d61219239263ae23a2d","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea332a2580464adc9b80545377a8ce798ea26efe8de9c3f4e52285c0ce7bfe40","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"f2acc660754d6f1fbb0d5677b1b6744cfef81081c8840e23d617cc428d8e94c5","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"bac96fd6a08b265dcaa69aab8d6c82e677cea2c9bcd55da992b5be1f6d24b625","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"ea1516e28ff8ae16d571b297a17842dfe97c878b275eeaec70e37045a748dbd4","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"f3f8bc928cd7904cff1620659bf7ef27f7f97b10938012b1d2b59d8c92407a47","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"54e2bc558b4211b09cfdc39a0415c2b404a9c89520984246b0bf5fe93f57366c","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"183612c287468f5cf677b6fadf3adf6c308f2dec65640777f8c795d3f15a4aad","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"c7641d581397a52c706690e4e3ef351bffff1159f1586c4450c020e3b4c7a433","trace":["eval"]}],"counts":[[8,2],[2,2],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"24599cc0162aabac98c3b67b6b6708b25651d01bd6f1e6d813427884d5aad0f7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]},{"token":8,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,5]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":7,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]},{"token":8,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,5]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":7,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[15,1],[7,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":5,"kind":"sparse","probabilities":"32d2f569dbae313859d98f7c6699283e0ddaeca79fefd214739d453c7ecf077e","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"32d2f569dbae313859d98f7c6699283e0ddaeca79fefd214739d453c7ecf077e","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"32d2f569dbae313859d98f7c6699283e0ddaeca79fefd214739d453c7ecf077e","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"f804da0fcce1bb14f61fcca77967634a05952eb24efa205a0022a260d3ee200d","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":6,"kind":"sparse","probabilities":"055946fa41a01dcb2983f3d78649dd27741741fd8d66ee57a6375ec0b34d031e","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]},{"token":14,"kind":"sparse","probabilities":"a8ac59fa3b28b4abda15b5657ddc3b37dd8fddc490af1fe08651877bdcbdc2bc","ids":"de36edc66d43f5afa547b51d750fc58e316f727cd21c301f226de905964e3788","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"823945917a2f6f5accad38d02a4a098cd1c6ba33fef0b313dd74ae813e62d747","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"823945917a2f6f5accad38d02a4a098cd1c6ba33fef0b313dd74ae813e62d747","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"823945917a2f6f5accad38d02a4a098cd1c6ba33fef0b313dd74ae813e62d747","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":5,"kind":"dense","probabilities":"ee3ff2538ab36f4343f3df281351ebc297f8e37768b51f402e9bce2ed18f1313","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"5dfaef27090026bd47783f8cdee12b079132fc0c0bc407b1bdc6141b13aee28f","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"72d0e515a8554d714ed5412414c6477fa49d6dd4b317a87a6d560eacdc7ce3af","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":5,"kind":"dense","probabilities":"d1c459a8f6fe86b25f1db29f707b3c314adc222741a7044f0b3b14a1cba3e4c1","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"d1c459a8f6fe86b25f1db29f707b3c314adc222741a7044f0b3b14a1cba3e4c1","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"d1c459a8f6fe86b25f1db29f707b3c314adc222741a7044f0b3b14a1cba3e4c1","trace":["eval"]}],"counts":[[8,2],[5,1],[6,1],[14,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":4,"kind":"dense","probabilities":"258b633501e2ad8549ea252b1fba9531e0a8243b497c45e9e374b02eb416ba98","trace":["eval"]},{"token":6,"kind":"dense","probabilities":"c76c83537d48da3be2264ed55d46a5fb814f34ad4e46b423eb5e44cf8a604c2a","trace":["eval"]},{"token":14,"kind":"dense","probabilities":"462ddac2034a8ff9f9ad145c63f07ac5bcbc6fc57f35fae502c5f209f3da2de9","trace":["eval"]}],"counts":[[8,2],[4,1],[6,1],[14,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"24599cc0162aabac98c3b67b6b6708b25651d01bd6f1e6d813427884d5aad0f7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":14,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["eval","argmax"]},{"token":15,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":14,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":14,"kind":"none","trace":["argmax","eval"]},{"token":15,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[14,1],[15,1],[0,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1,"kind":"sparse","probabilities":"e28186b602c0dbccc8f1affa0ab01c240009e1c0e638cfe1022d93aa8dbc2cda","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":2,"kind":"sparse","probabilities":"e28186b602c0dbccc8f1affa0ab01c240009e1c0e638cfe1022d93aa8dbc2cda","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"e28186b602c0dbccc8f1affa0ab01c240009e1c0e638cfe1022d93aa8dbc2cda","ids":"9cf6a8ce18d4921ceb377ac3f946e7ca488e4627c312090afbd2904806f18fd2","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":2,"kind":"sparse","probabilities":"11c9e772361fe10f9531a0ffa76466a5122b9021615c8323893910c414385f13","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":3,"kind":"sparse","probabilities":"b0a0c9ce720f33a448df22ba87cd36122e37a2786207bfaab6f15b0ec8d3b6a3","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]},{"token":15,"kind":"sparse","probabilities":"a5afa3b1e056ab7a5cfca6008c75db7412ca6b56f70296ef71ee9292754fba17","ids":"d71c1f81388f84640a9ff2f59e70d8c02f506411aeffc3fd1d4fa425db40dbb3","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":1,"kind":"dense","probabilities":"48073c45f00b8795b7d5e4412b613afeca65a99610cd764948d25ea7eb695a05","trace":["eval"]},{"token":2,"kind":"dense","probabilities":"48073c45f00b8795b7d5e4412b613afeca65a99610cd764948d25ea7eb695a05","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"48073c45f00b8795b7d5e4412b613afeca65a99610cd764948d25ea7eb695a05","trace":["eval"]}],"counts":[[8,2],[1,1],[2,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"e9f7d10723e257c03792c2ca2adb351e14d7b9ca1cfdc2be88d061e6bdcb8ead","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"df629b72ea511b94515e6bddadc9cb07f3568f19a854c280a1ab0a0d2827c29c","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"0ba5527443deadc31cb0bae7f265b0b5d91dbdcb89918dffc41934204de5946b","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":2,"kind":"dense","probabilities":"233feeb854f2e2b2a9d3cbcee31d2bb207e3ea790fc0417c430fd355bb5750ce","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"233feeb854f2e2b2a9d3cbcee31d2bb207e3ea790fc0417c430fd355bb5750ce","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"233feeb854f2e2b2a9d3cbcee31d2bb207e3ea790fc0417c430fd355bb5750ce","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":2,"kind":"dense","probabilities":"f7a525aaee73ac33bde56cd7b796f88cb31ec62353651026c2f9b62c3b99a823","trace":["eval"]},{"token":3,"kind":"dense","probabilities":"e05146e61bc794b768e21eada9c1d122f4eeb2548aad900d21ad818602df906e","trace":["eval"]},{"token":15,"kind":"dense","probabilities":"58395ecdddc2808e03e12e15dced27086ff1119efb63e3ba54760eebf8c12711","trace":["eval"]}],"counts":[[8,2],[2,1],[3,1],[15,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"24599cc0162aabac98c3b67b6b6708b25651d01bd6f1e6d813427884d5aad0f7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"e8a576627816295aaea31dc098c037a9b95805ff983f1ec05ba875012fa99da8","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"ee7b0f99ccc9091cf4215ae0faf2ccd8838815d6142790cf4e742ade545682a2","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"c123d6765d79d399edfe960857c418557067c61523f302e944ac56b616d7aa1d","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"3ed6440e46d4d2967bdc4dcf84fc944ddfeaa746fb7c1e5357a9c61707ab78ab","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"db051ec0f9a0f117cb64413292c2c52764d5180fb68cf72d3f9330bfc8b579e1","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"32c6568bc592ce24d58748d77ac2a381470f559143315655f4626e529d3f54a6","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"d909ca1ffa5e56e65e7745ea1a376813c8730200f5b5a067e3112ea9e3474d8e","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[8,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":3,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","ids":"bb25b5201ac6c37409bb181321e5f74ef84fc6dd59cc690d9298e927304684f8","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":3,"kind":"sparse","probabilities":"d1e5022d715d06cdda2294d0ef591a505d1aa4e28f32e1ca890166bcca424860","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":5,"kind":"sparse","probabilities":"c0371c9337035b01364e09ef34fe08041cd161d787003ff25153ab3a47172e0e","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]},{"token":13,"kind":"sparse","probabilities":"24599cc0162aabac98c3b67b6b6708b25651d01bd6f1e6d813427884d5aad0f7","ids":"2d7826fa7f08f1cf44c8a557dd00123a9bbdbe4e62c28c24bace9714b23522a2","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"c404790c6b4c40b3f09243f9c62f6ab2b4fa2de19ce5716eff56f34605aa0dce","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"9393fc8e2a69cb33902f5fd9aaa835196da3ca2d8941613045a423068fa04ea8","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"54b9a96795f2c42f4edc00d832738d918e456ff48b03db32fba001fe31428e85","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":3,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":3,"kind":"dense","probabilities":"458645c12ac90a5ca1554dd8680572d0c588f0ed38ced7c63f1b05727dc08e53","trace":["eval"]},{"token":5,"kind":"dense","probabilities":"fc9d0b59cbbf9d582f4e1ce80b91f8e0f4e1b2882c700f7d2975f0683a9f740e","trace":["eval"]},{"token":13,"kind":"dense","probabilities":"cb06f1771a5506c0e5f8e12c593f460b4de317aae859c73ed7c0b9d1c9f75f9a","trace":["eval"]}],"counts":[[8,2],[3,1],[5,1],[13,1]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[8,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[8,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} +{"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} {"vocab":17,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[8,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"da7d0e2c6421901e86bcf0fa444ceac603d40a98fa910331a1dc690312ecdb70","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"44a4f312ad010ea4056e1ef3b4f3919761b5f3d9c9bfa2ff9a354360d55116dd","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"5724df5f997f67018b709740564d936784c8b161517225df34f9313bc994dac4","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"ad87c5f6fd70b1306e339ca5ae23521e6c8fae947a2c1b6191a8c1e4db41049d","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"b797f74f92e1a4a7cd253e08ae7774f985f77e63435858283a00d0efba32e7c2","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"cd0ecd485895e0d2bb784bd369fa7a5a748002da874cd80c915bd77959650024","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"58aee3b04f7086deb49f0cb26a0df5c5e74e1ade991489ada736fbe94e83e263","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"f37444a69a69e842bfe29827e7ae2e4dc6e4bb1bd4cbcc4580ca52be036e05b3","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"06e72884d06e02f9f3e450e6c348ef7b3ae6ae7e15dc56a0a8220787fc6e6626","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"da7d0e2c6421901e86bcf0fa444ceac603d40a98fa910331a1dc690312ecdb70","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"44a4f312ad010ea4056e1ef3b4f3919761b5f3d9c9bfa2ff9a354360d55116dd","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"5724df5f997f67018b709740564d936784c8b161517225df34f9313bc994dac4","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"d66634ff790d5ee146d73480d80b003cb61e1a8170d67aec3afa816b88bb2ecf","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"ad87c5f6fd70b1306e339ca5ae23521e6c8fae947a2c1b6191a8c1e4db41049d","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"b797f74f92e1a4a7cd253e08ae7774f985f77e63435858283a00d0efba32e7c2","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"cd0ecd485895e0d2bb784bd369fa7a5a748002da874cd80c915bd77959650024","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"419460c569ba360630d0336cb76e6ed417f59f0bad63d4b0c947c4b37bad8d4e","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"58aee3b04f7086deb49f0cb26a0df5c5e74e1ade991489ada736fbe94e83e263","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"f37444a69a69e842bfe29827e7ae2e4dc6e4bb1bd4cbcc4580ca52be036e05b3","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"06e72884d06e02f9f3e450e6c348ef7b3ae6ae7e15dc56a0a8220787fc6e6626","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":575,"kind":"sparse","probabilities":"171fcbd9aa028dac7c1af33ed8fc137a26b072c26c66c667ec72040dccce1663","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":832,"kind":"sparse","probabilities":"171fcbd9aa028dac7c1af33ed8fc137a26b072c26c66c667ec72040dccce1663","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"171fcbd9aa028dac7c1af33ed8fc137a26b072c26c66c667ec72040dccce1663","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]}],"counts":[[2048,2],[575,1],[832,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":575,"kind":"sparse","probabilities":"0527c9f39f13c3f9240a4a94eef64b179917fb2ca447fe73ce8ea16d5c9fea25","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":1021,"kind":"sparse","probabilities":"9e1b0d0a468b49e46813a2f0c95cbfe521c34c14e588063a6d139cfec68d0eb0","ids":"cb856277a45c0bea75bef56441ad5ee069279a05c8f45de7a01ff5a43dc3fc43","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"b703348f7f34731e4c7e834cc4185a3048749b6fb66d3e9cd8fbc1fd9f06c971","ids":"697e4763cabb116b3872177b8bce39d3a6eef2d97c9e5f0ec68ef4c3748ffaac","trace":["eval"]}],"counts":[[2048,2],[575,1],[1021,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"5a32055ae3adff96e2fb7d06289a04802e54de61d227baac0e1991529bcae523","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"5a32055ae3adff96e2fb7d06289a04802e54de61d227baac0e1991529bcae523","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"5a32055ae3adff96e2fb7d06289a04802e54de61d227baac0e1991529bcae523","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"5793870bcb21f1dcc52039ce934ad8e4afecb8293d945cb200cb0d09ac9ec89e","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"bb73f8a83243e4a435918401cb2b4fb25f45803572bcf8de153f9f27197f9d6d","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"f0b92a84932b8750cd271467d2356d7c00c9a7bf9f207441147ff6ddbcfbdaae","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"a69467aaf32b5b57fdd67ca4cbc36ebb31204f214126bc2702e867933a0beb82","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"a69467aaf32b5b57fdd67ca4cbc36ebb31204f214126bc2702e867933a0beb82","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"a69467aaf32b5b57fdd67ca4cbc36ebb31204f214126bc2702e867933a0beb82","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"d885a82725d1936baa4cd2dd8e2fcbc8d5180d60b0455ca54fec219b3c1a6026","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"f0833aaca40bfb29f8c7651e454f174d1ffac00f2de156ef3e5f87ee67119b92","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"6ecd447bfca2610fdd95e65f422b7fba964678f70e4b878b09e0d514d2499b4c","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":511,"kind":"none","trace":["eval","argmax"]},{"token":768,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":511,"kind":"none","trace":["argmax","eval"]},{"token":768,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":632,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":889,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"dc97bdd31cdf66de5560377201c42c3456537b0211e50a237c8a2291d68e9834","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]}],"counts":[[2048,2],[632,1],[889,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":632,"kind":"sparse","probabilities":"916cc022d12a1f42959f8184e669716ae2c08b859c43b52db5113b8ca6aacb53","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":1025,"kind":"sparse","probabilities":"05fa04218b443a460fe2d07f160b617b866923f5ceacb37f89f98c28c5a19750","ids":"8e877d7427cb5ce4aa06e5852fd71476c0737a43d9ab8d938f031807082fa2c1","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"4eda87234254209536e57b3c6ab9c80f6f5be597f272ce6545fba66c07beeaf8","ids":"65bd972d17cf565dc0551530fc0f94e0eaf735e04e4eaf74c824e9ad7e1a6055","trace":["eval"]}],"counts":[[2048,2],[632,1],[1025,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"3a99f2099ca06be4797a4aecc0675e1d87b2ccd95f851a610f3dafe470efee5e","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"3a99f2099ca06be4797a4aecc0675e1d87b2ccd95f851a610f3dafe470efee5e","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"3a99f2099ca06be4797a4aecc0675e1d87b2ccd95f851a610f3dafe470efee5e","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3267,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"3594736d6ce90a7368f866828d91aa46f8d9d46e3344d1f7a856f09d1bf13220","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"0f680b23b28d752ef1d3d2dc4c7a2445753efc4b38c7b4955b2e469c2a1f4366","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"e32fc8ee8f10e6ab0971d2177f7d16a3a8ff16883007f6226c18adbefe72d141","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"7bb4832fd75cfc6d7fbea996d6a1964d6e2c9718a7bfd650dd53d7ef58962331","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"7bb4832fd75cfc6d7fbea996d6a1964d6e2c9718a7bfd650dd53d7ef58962331","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"7bb4832fd75cfc6d7fbea996d6a1964d6e2c9718a7bfd650dd53d7ef58962331","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"27569aab4d7b46dafc9aba437e2eadb8e37589f0fdb2d0260c4fd2ae5c54f893","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"e6f1f98142c9d501286ddfb70b56e21968e35dadca0d97f931bc783140cde905","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"ac210105d04dd5634656f57d3e8e40fd909db50395a83996b7bed58048c9a0db","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"83980304450b9970c5bf1e9600e6331732eafa3d81c24bddf6b17695e26c635a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"e41dba81c54a5816f1893013e9b68e4c0cf6daedce3697640588329f8eb1274b","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"ed0ecb17aae4e14f30d73d4390672c06a1bc45b29a5d5b996f99d4af72344a58","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"2b973a12e2417f1672bed7b31b8a5d4946ad7827f447359e38d71bdeca4c05a2","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"413b0be71809a549cf911aeccf6a54bd0b38d24baf4399b3dcf42b0c6cf66452","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"a0b3a62ecdfb80fc908324cafc4a6e175eecbfe6614107ba478866116be11605","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"bf15b4ea545d106d590f0b259c9ef1ebdfea706c236a59595bbb2c7f2b4ecf21","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"55d90c3a928c0be4ec826f0ad8dd74e359be06bc99292bdab579ce32942d5a1c","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"0e91f7d1de8dddbc59310792b5a28ccdff65a5445a906876be45ef361129e656","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"83980304450b9970c5bf1e9600e6331732eafa3d81c24bddf6b17695e26c635a","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"e41dba81c54a5816f1893013e9b68e4c0cf6daedce3697640588329f8eb1274b","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"ed0ecb17aae4e14f30d73d4390672c06a1bc45b29a5d5b996f99d4af72344a58","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"a89be024ed62a2917ef40c262822b0bea448a2238b64e801ce121468bc651f9b","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"2b973a12e2417f1672bed7b31b8a5d4946ad7827f447359e38d71bdeca4c05a2","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"413b0be71809a549cf911aeccf6a54bd0b38d24baf4399b3dcf42b0c6cf66452","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"a0b3a62ecdfb80fc908324cafc4a6e175eecbfe6614107ba478866116be11605","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"c9e47f1005176ff52944ac7b26dc11c662c3674838fe3256720e0a9e5f2755c8","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"bf15b4ea545d106d590f0b259c9ef1ebdfea706c236a59595bbb2c7f2b4ecf21","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"55d90c3a928c0be4ec826f0ad8dd74e359be06bc99292bdab579ce32942d5a1c","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"0e91f7d1de8dddbc59310792b5a28ccdff65a5445a906876be45ef361129e656","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":575,"kind":"sparse","probabilities":"f2854d89845622fc43ec17a5b29897ae10307ed7e29230893cd383aa93f096e8","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":832,"kind":"sparse","probabilities":"f2854d89845622fc43ec17a5b29897ae10307ed7e29230893cd383aa93f096e8","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"f2854d89845622fc43ec17a5b29897ae10307ed7e29230893cd383aa93f096e8","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]}],"counts":[[2048,2],[575,1],[832,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":575,"kind":"sparse","probabilities":"d919cd92805919b924917665eb31088d72e73781469b5a0a6443addbf043c26f","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":1021,"kind":"sparse","probabilities":"16ae5d7087b3d9b4b8f6527fe132f5f7c8da6fcfeff6ecda96194871d7170950","ids":"cb856277a45c0bea75bef56441ad5ee069279a05c8f45de7a01ff5a43dc3fc43","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"52205983855c725eea477c35f794424f41020999d15f4e43676e2a1ae2769682","ids":"697e4763cabb116b3872177b8bce39d3a6eef2d97c9e5f0ec68ef4c3748ffaac","trace":["eval"]}],"counts":[[2048,2],[575,1],[1021,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"b23f78c3200444bae3b0e5bc6fc1a673b00863b3966fac0bfb85aec98770d415","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"b23f78c3200444bae3b0e5bc6fc1a673b00863b3966fac0bfb85aec98770d415","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"b23f78c3200444bae3b0e5bc6fc1a673b00863b3966fac0bfb85aec98770d415","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"96a574d996d4fa43ffe0220b7bda92975665828318e228a7ca75bd25fc77e396","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"72f35b638c047be359bedeb0cb2ea17d6a01f56a7f52e9933ffefc821af53102","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"1423443cea469fc83fe672f9e17f134e257328ccc2b52294218e293569dafac9","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"e2d6cd1c9d170425ee2c3706712652ab36e6ba928008b980d6dc4e6ed66bb587","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"e2d6cd1c9d170425ee2c3706712652ab36e6ba928008b980d6dc4e6ed66bb587","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"e2d6cd1c9d170425ee2c3706712652ab36e6ba928008b980d6dc4e6ed66bb587","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"2d47b73cbe92c7e4fa6976479f406dd12b4f2ab67ed5380aeb9b291bcfa9b23b","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"15e76851c3e639556ba206c93cb890f8ea41bd0c9442af937fcad4c6f3bb2a72","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"3cc3693d3ffc12e718f59d9db35adf896b9f7360488b58eb108d4107be9a6ad1","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":511,"kind":"none","trace":["eval","argmax"]},{"token":768,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":511,"kind":"none","trace":["argmax","eval"]},{"token":768,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":632,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":889,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"24d58800d59970c18c0bd4458298207891993ca562af6431950f673c4251e18a","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]}],"counts":[[2048,2],[632,1],[889,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":632,"kind":"sparse","probabilities":"0ee2457838d67c964c6d6ef82e74fbdc63d3d36d8b43eaf68eeb0d1d42c73693","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":1025,"kind":"sparse","probabilities":"3183aeffacdf7653936eae4d6c33e2dd911cb6bd368acd91228410c4277df96a","ids":"8e877d7427cb5ce4aa06e5852fd71476c0737a43d9ab8d938f031807082fa2c1","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"27b38d1b028f8548de97cb608a6b93b32c65f62ea51f2d6e51074a3843aa35a6","ids":"65bd972d17cf565dc0551530fc0f94e0eaf735e04e4eaf74c824e9ad7e1a6055","trace":["eval"]}],"counts":[[2048,2],[632,1],[1025,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"b98aa911f65ddfbfbaf947ae9499db3b08418820425f017abb0185cb2486a292","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"b98aa911f65ddfbfbaf947ae9499db3b08418820425f017abb0185cb2486a292","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"b98aa911f65ddfbfbaf947ae9499db3b08418820425f017abb0185cb2486a292","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3267,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"e5236c9b64a08568b20822c2f506c3ab18ece7f21ef76b8808733be46bf83aa3","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"0d240c5d68abd9f82bb4a8659da8d95afcd6f9069734646f5335903a5881b791","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"82afb4f0845db6dbb40ad37370144b95f309a16f64d50c89affef3858b41dca5","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"b0f8cfac7852cfee38fdd0df8fadf86602b86efac82d5a821c7a273c50dfb1b7","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"b0f8cfac7852cfee38fdd0df8fadf86602b86efac82d5a821c7a273c50dfb1b7","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"b0f8cfac7852cfee38fdd0df8fadf86602b86efac82d5a821c7a273c50dfb1b7","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"2b68b183b2b6c1435c5bb148b21598f9c8a9097f341c514417b5e7d24c30319a","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"edc669a2539e8c8e38980c9d39fac6c710909ae50d072548e9930d9c2c764173","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"7cc592edb444ed1ae5ca82d69b1f00e23bf81fefb0babe9b4e24210ac3c9d523","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"0ab62664f019b0235f757353841464d4706743cd8f2eb84778c7dfa0d47b65d2","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"cab1d3c9fcff8046a15898f31bb77fd6692b0399b9cce606970a9d26a44010d8","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"0ee5f7fc21b50415130afbf0f1e175fe8c9db49694b234fe085e93a5d792ebe6","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"0f2442a6fae47bbe090da62eafeb0d7cc10bc2ddfa266fa97fce56fa48aeb6dd","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"e5648213270d6d22dd873dbdf6621956f356d5993cc2ece6a565d533c961f6b3","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"c829590faa97fc1e420f7e2a0ca8ecac148d2faa7dfd649750642d552681d62d","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"b7304a72aa6c03beaf8504aaa0e054647759854beec876457f3bed9b7fa78163","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"3fa9eebe59670dd7512b8e4e7b6476552beee38a2712a98bbbfd5857fe97ffcb","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"0326c6ff2eb1547d86aacd0a2412d8e05263aea9b9212f01c6f1fcf9af9d6ac3","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"471c4071ec6872287af3d5f73af2f9638102290fa0c7e717b9ac5eb3e4069c91","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"bf40ddcf971b225e836c0e05482e1ba6ee3a25d4f0cc1f9e45a6f16bb891d699","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"517e64cd81ee7e375712c4268e0901c44f058ae013b8172825fbc364df4430d2","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":637,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":894,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]}],"counts":[[2048,2],[637,1],[894,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":637,"kind":"sparse","probabilities":"0f2442a6fae47bbe090da62eafeb0d7cc10bc2ddfa266fa97fce56fa48aeb6dd","ids":"7fad64ce889bc93c2da45d83eff0b6518c6b0df7f5f4b54469730ae306520658","trace":["eval"]},{"token":1015,"kind":"sparse","probabilities":"e5648213270d6d22dd873dbdf6621956f356d5993cc2ece6a565d533c961f6b3","ids":"7110e2a883556b72ba3773d733ce7b3bee2e748016b1246b37263256f184cd6f","trace":["eval"]},{"token":2814,"kind":"sparse","probabilities":"c829590faa97fc1e420f7e2a0ca8ecac148d2faa7dfd649750642d552681d62d","ids":"5b5a58e67ef95e85f927019fc82b231ea896a77b48ca805fe6c698d1ae992d40","trace":["eval"]}],"counts":[[2048,2],[637,1],[1015,1],[2814,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":924,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"cdd683c12bf7dfb5d77f1f45bb6bf073b3902541c6eac133e566803fdbaa32df","trace":["eval"]}],"counts":[[2048,2],[924,1],[1296,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"b7304a72aa6c03beaf8504aaa0e054647759854beec876457f3bed9b7fa78163","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"3fa9eebe59670dd7512b8e4e7b6476552beee38a2712a98bbbfd5857fe97ffcb","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"0326c6ff2eb1547d86aacd0a2412d8e05263aea9b9212f01c6f1fcf9af9d6ac3","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":928,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"88a051d74f8d6c9a8d9a61012f1bc86c75314f88553f1975b55ae686d0b9ba77","trace":["eval"]}],"counts":[[2048,2],[928,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":929,"kind":"dense","probabilities":"471c4071ec6872287af3d5f73af2f9638102290fa0c7e717b9ac5eb3e4069c91","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"bf40ddcf971b225e836c0e05482e1ba6ee3a25d4f0cc1f9e45a6f16bb891d699","trace":["eval"]},{"token":3264,"kind":"dense","probabilities":"517e64cd81ee7e375712c4268e0901c44f058ae013b8172825fbc364df4430d2","trace":["eval"]}],"counts":[[2048,2],[929,1],[1297,1],[3264,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":575,"kind":"sparse","probabilities":"7376de767a0a675256c7a0ce70af821ed0dd2fa0fc8c902a25035f506c3d10e4","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":832,"kind":"sparse","probabilities":"7376de767a0a675256c7a0ce70af821ed0dd2fa0fc8c902a25035f506c3d10e4","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"7376de767a0a675256c7a0ce70af821ed0dd2fa0fc8c902a25035f506c3d10e4","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]}],"counts":[[2048,2],[575,1],[832,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":575,"kind":"sparse","probabilities":"b89d3c7f14da559bdd2750410b3d60f60704bb898fa20454fd932c1444b9e45f","ids":"6a92af0fd36f1d43c81bfe388246ddd0071e3525684883b1f8dc5c0d7b36f8e0","trace":["eval"]},{"token":1021,"kind":"sparse","probabilities":"d9cf2e272392708985a353636ebb99136c7f6f3c37a5b926fab22bd96c6fe892","ids":"cb856277a45c0bea75bef56441ad5ee069279a05c8f45de7a01ff5a43dc3fc43","trace":["eval"]},{"token":2820,"kind":"sparse","probabilities":"069960fe7ecd3526d23d757135b875660ee3dcbae9d3efaf8a124f7d724077c4","ids":"697e4763cabb116b3872177b8bce39d3a6eef2d97c9e5f0ec68ef4c3748ffaac","trace":["eval"]}],"counts":[[2048,2],[575,1],[1021,1],[2820,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"e5331e74c059223ac06c73ccf2c817d88ee1e702a8adb27c037210e7935219c9","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"e5331e74c059223ac06c73ccf2c817d88ee1e702a8adb27c037210e7935219c9","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"e5331e74c059223ac06c73ccf2c817d88ee1e702a8adb27c037210e7935219c9","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"4a255a0f6261445bacb78ba1b65d771b44d1fdf302b0d8120a926d30f35fc696","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"8bbdb0c3fb3d57f020b9b5e6f3927f29db4be65be844ee77edd5064d090d9452","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"6f2a28d85a24cd7ff03f9ce23bf7822782a836217bb4de8fcfdc3cb97ecafcbd","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":930,"kind":"dense","probabilities":"40d522a4810a775076a8cecac54249de6ec926004ce603b67c0a4f17affaa3e0","trace":["eval"]},{"token":1296,"kind":"dense","probabilities":"40d522a4810a775076a8cecac54249de6ec926004ce603b67c0a4f17affaa3e0","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"40d522a4810a775076a8cecac54249de6ec926004ce603b67c0a4f17affaa3e0","trace":["eval"]}],"counts":[[2048,2],[930,1],[1296,1],[3265,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":930,"kind":"dense","probabilities":"b84e925da0de56164dcfa59add41f5cbcf035831fc99e316e268a0e176aebccf","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"eb738b1ff737af0139f726ba318a326338844b7d84380d3acd5620539db3a35d","trace":["eval"]},{"token":3265,"kind":"dense","probabilities":"81876724b969518e3a9a1a51868097738bd9d4d272966da843a5e4a6cd942487","trace":["eval"]}],"counts":[[2048,2],[930,1],[1297,1],[3265,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":254,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["eval","argmax"]},{"token":511,"kind":"none","trace":["eval","argmax"]},{"token":768,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":254,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":254,"kind":"none","trace":["argmax","eval"]},{"token":511,"kind":"none","trace":["argmax","eval"]},{"token":768,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[254,1],[511,1],[768,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":632,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":889,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"4cc71cc4537dc609e35703ae619f9a3ec2c3475dd4c990a1fdcd09f0fff11fc5","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]}],"counts":[[2048,2],[632,1],[889,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":632,"kind":"sparse","probabilities":"8aad384b3d96d6eec690783f25efd71a325753c82bfffef398c11e924837462e","ids":"adc3e2dbda41e1c546b8b1748c2a3972d3d676fdb50068d1d50610eac16991bc","trace":["eval"]},{"token":1025,"kind":"sparse","probabilities":"45d432f323d949c39a9fff3b6a4365fcc7141624ff0c908cada71aa721fe64ce","ids":"8e877d7427cb5ce4aa06e5852fd71476c0737a43d9ab8d938f031807082fa2c1","trace":["eval"]},{"token":2824,"kind":"sparse","probabilities":"f98c086a188a207dfe356fefa6c5cb19f5b0f962b91a38a6290e936ba02bc5f5","ids":"65bd972d17cf565dc0551530fc0f94e0eaf735e04e4eaf74c824e9ad7e1a6055","trace":["eval"]}],"counts":[[2048,2],[632,1],[1025,1],[2824,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"77a7e287e8a9f94ebb585533a20a0fd0673b43c1a61fcec38da88c5e47e0830c","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"77a7e287e8a9f94ebb585533a20a0fd0673b43c1a61fcec38da88c5e47e0830c","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"77a7e287e8a9f94ebb585533a20a0fd0673b43c1a61fcec38da88c5e47e0830c","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3267,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"a90312a8c8afe314c0946d9be6309f36aeb184c7ceceadc8046df075c2aff29a","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"14f00388a7fb3450bf75654902f3e1108909e689c2078f1fc594b18e88e5628b","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"e02c78b105dadc092d033fca1b5f6728f3df80ed2c9d74fc22daadca7c8efbf1","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":936,"kind":"dense","probabilities":"e16b332f3a5183145436f8a88832524ee0b426534139517efcc35030142269d1","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"e16b332f3a5183145436f8a88832524ee0b426534139517efcc35030142269d1","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"e16b332f3a5183145436f8a88832524ee0b426534139517efcc35030142269d1","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":936,"kind":"dense","probabilities":"2d38fd36dc402e651283c5198d6f7a7eb69609612942ee349df7064e440e6049","trace":["eval"]},{"token":1299,"kind":"dense","probabilities":"81d7aff1f318c92599709402f8f63f3893828a20381ef41b0915687a3c4a05be","trace":["eval"]},{"token":3268,"kind":"dense","probabilities":"2951085a70191265e631d2ee45640c8d562deec09ca22182557c00d36032c6b7","trace":["eval"]}],"counts":[[2048,2],[936,1],[1299,1],[3268,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"0ab62664f019b0235f757353841464d4706743cd8f2eb84778c7dfa0d47b65d2","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"cab1d3c9fcff8046a15898f31bb77fd6692b0399b9cce606970a9d26a44010d8","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"0ee5f7fc21b50415130afbf0f1e175fe8c9db49694b234fe085e93a5d792ebe6","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[2048,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[2048,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[2048,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":885,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":1233,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]},{"token":3104,"kind":"dense","probabilities":"cdfabc6a8bd23dc3d412bf3d0bef9a042e62b28e10b073d5798cc64a2e1559df","trace":["eval"]}],"counts":[[2048,2],[885,1],[1233,1],[3104,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":885,"kind":"dense","probabilities":"6c70886bb302a91980585c234d2929baf43b76e6a4fc45efdd6a2e805d3de3d2","trace":["eval"]},{"token":1234,"kind":"dense","probabilities":"079c21a133c0b6290b22160672f4577ccf94beb1927f3cc55f9f6248b42f55ee","trace":["eval"]},{"token":3106,"kind":"dense","probabilities":"f704488e93c8be183a1900799b0dea6191915f0a8fa0af43d218e1b516680548","trace":["eval"]}],"counts":[[2048,2],[885,1],[1234,1],[3106,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":931,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]},{"token":3266,"kind":"dense","probabilities":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3266,1]],"next_rng":4604266380111679709} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":931,"kind":"dense","probabilities":"6d3ac12f0299740cbd17cb32243a5c6990f327919d3e263f6db9f434ab59e773","trace":["eval"]},{"token":1297,"kind":"dense","probabilities":"1b856aea5839164b8f1218a2d3e53776db2b0b20d3e1386d5fcc7c2e321b3ff9","trace":["eval"]},{"token":3267,"kind":"dense","probabilities":"12d3d5a76d4270d5a923c1949de44624326f52b60eb94ea12aece5d8a2bf54ed","trace":["eval"]}],"counts":[[2048,2],[931,1],[1297,1],[3267,1]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[2048,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[2048,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} +{"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} {"vocab":4097,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[2048,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"1397f01137a5e66c47e1f50caa1d04d35ce0ce075cb6cf90efa41e0a0610a93e","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"723b682954adbb0c6fe4762219a84aa4342b5ed1d667d39176bd63a5122be48d","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"d3ad8d1625df0cf4c53b0be6f6dd138ff25182881a89c2c2d699dc72e5d47230","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"ac770568469db33d09ae659f4a5cbe30d6b852751187a4ea7f194a5a2b42d22d","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"a458286c891636859c42234adcf4320699a4240327ce07f0f9fc26bd2bc925eb","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"540a332a834d7a0c13e97f9b79d26f34e2de4b38116c08a20c0187ef38068ee4","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"c4d0773756c2cdb9f8c87bb81c3155d5666eef24b8e0b90c37818872f20ba24a","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"1397f01137a5e66c47e1f50caa1d04d35ce0ce075cb6cf90efa41e0a0610a93e","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"723b682954adbb0c6fe4762219a84aa4342b5ed1d667d39176bd63a5122be48d","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"d3ad8d1625df0cf4c53b0be6f6dd138ff25182881a89c2c2d699dc72e5d47230","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"8df884eca07c6667466cae6b8334c444f9bcc1012a1186bd15ddd78990fa9896","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"ac770568469db33d09ae659f4a5cbe30d6b852751187a4ea7f194a5a2b42d22d","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"a458286c891636859c42234adcf4320699a4240327ce07f0f9fc26bd2bc925eb","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"540a332a834d7a0c13e97f9b79d26f34e2de4b38116c08a20c0187ef38068ee4","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":1792,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":4105,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[1792,1],[4105,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":2049,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8f6e535883abcc2d05d58b4305d79748fb57e4c6ff53e41fa66f235f6a71d792","trace":["eval","eval"]},{"token":4619,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8c02134cc809f02d840cd5951c912abdddca5128bf636a8a596e45666421749c","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[2049,1],[4619,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"3b81d3e38ea0088eb2b32ff52ccae31f36a90a14fe1e98534c563e433363ea79","trace":["eval"]},{"token":78633,"kind":"dense","probabilities":"3b81d3e38ea0088eb2b32ff52ccae31f36a90a14fe1e98534c563e433363ea79","trace":["eval"]},{"token":197956,"kind":"dense","probabilities":"3b81d3e38ea0088eb2b32ff52ccae31f36a90a14fe1e98534c563e433363ea79","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78633,1],[197956,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56432,"kind":"dense","probabilities":"461d515503b34c98d174d7388560fbcc1a9758981cbc84678bfd4b70d5d01c18","trace":["eval"]},{"token":78633,"kind":"dense","probabilities":"28ce1609d78e38f0475e68a0f13446fa1cf4e0d494166dc2347e649424d51bed","trace":["eval"]},{"token":197956,"kind":"dense","probabilities":"0ffd32efc4e641a8a52f292de3d8e8412c730bd6b1ff7df8ceecf967397adf58","trace":["eval"]}],"counts":[[124160,2],[56432,1],[78633,1],[197956,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56449,"kind":"dense","probabilities":"22dd6fb48435619488905683dc67d4a6b3fd9e43a81d50111575a875bfb19d67","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"22dd6fb48435619488905683dc67d4a6b3fd9e43a81d50111575a875bfb19d67","trace":["eval"]},{"token":198000,"kind":"dense","probabilities":"22dd6fb48435619488905683dc67d4a6b3fd9e43a81d50111575a875bfb19d67","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198000,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56449,"kind":"dense","probabilities":"d44556cd4dabbcd4fb6d99cd66d6e65b864d94f79ded4c64d46a3c4a1e3caa6e","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"f8f6c6223e881672d39626f4f59add14a599eb3660a98b35faf445a0f5fc7bab","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"e557cbea2819fabc6d574e7c935034fe0e1cf9739887f23b600064cb1e2b08df","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198001,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":327,"kind":"none","trace":["eval","argmax"]},{"token":584,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":327,"kind":"none","trace":["argmax","eval"]},{"token":584,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1612,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":3925,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1612,1],[3925,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1869,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"64edd9f7d14f012ccdfeb99612a51f96357710a2817dd2ab8dba4de23683caff","trace":["eval","eval"]},{"token":4439,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c1328fcaef690b2d32f54d4283ccf0661624cfbba8f719a029f2e52273bb9834","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1869,1],[4439,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"2c9acf44c1a67ae740a26af1f8621791880e0451e96055feee9fbabfe8959f63","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"2c9acf44c1a67ae740a26af1f8621791880e0451e96055feee9fbabfe8959f63","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"2c9acf44c1a67ae740a26af1f8621791880e0451e96055feee9fbabfe8959f63","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"1b856d43e78487caae46d6ad2a118bad333ffc171eacee65f7e2e8b5a4c3233e","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"4ff94c58ad478b6f69f41ef3ca763c2d6beaaddeeecd61fcac33a9d407fd25a7","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"44a6b4fd68a484069af0a03be33466bc46ae25303a41d5d6d1a150712da65fea","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"98c9902aaacd73c1339f29bc320d3c705c2411fd45eafbf62a49a08dd5f672fe","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"98c9902aaacd73c1339f29bc320d3c705c2411fd45eafbf62a49a08dd5f672fe","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"98c9902aaacd73c1339f29bc320d3c705c2411fd45eafbf62a49a08dd5f672fe","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"e48fbaba3ecf13afe44321996b61f438ce8ec381e078ff105693444ccd1a39d7","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"87ee322e1cccf76a7302d1bdc8ac8d65cc45603e58abcfa8bf5d89efa9873988","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"2cf721baa681009167f45df274cf93741b2d440be254879745f7fcab3b1102e0","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"bfloat16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"a533c007720c63e1f1c7c3f47ffefbe5845484fcdeefaeda5f1feb7e4ef2af43","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"251ce8e8c82a5adc9e547b830ab4364dd81f2321d0930afd9d64562b32fae926","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"21a47cb17aef16a6aeffd0ecfb4ab5a34cd5acfcbb2ab0a5b1879852da70ea1d","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"a8cee6df95009d59d94111a812d2f4b3513afc7320f8512fcc78df901d0a9469","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"abffa85c9778504c1e216e7fa97484b0cc1fb6c47a6d2d703ee8b016dd87f3ab","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"da8f9bbbac9e15957c0235d9df31f6d8d793ea88a996967d40128092b76b5cda","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"04d8fdae91e419a93a7c796740dba1478d227079a2328e30e9eaaa78e32568e2","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"a533c007720c63e1f1c7c3f47ffefbe5845484fcdeefaeda5f1feb7e4ef2af43","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"251ce8e8c82a5adc9e547b830ab4364dd81f2321d0930afd9d64562b32fae926","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"21a47cb17aef16a6aeffd0ecfb4ab5a34cd5acfcbb2ab0a5b1879852da70ea1d","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"a17ee24c2d266d60577aba2b1387e8077db1b7aa8e4eb701d027586ffee722ae","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"a8cee6df95009d59d94111a812d2f4b3513afc7320f8512fcc78df901d0a9469","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"abffa85c9778504c1e216e7fa97484b0cc1fb6c47a6d2d703ee8b016dd87f3ab","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"da8f9bbbac9e15957c0235d9df31f6d8d793ea88a996967d40128092b76b5cda","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":1792,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":4105,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[1792,1],[4105,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":2049,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8f6e535883abcc2d05d58b4305d79748fb57e4c6ff53e41fa66f235f6a71d792","trace":["eval","eval"]},{"token":4619,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8c02134cc809f02d840cd5951c912abdddca5128bf636a8a596e45666421749c","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[2049,1],[4619,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"442b125598334ad7b3ae7951433e580f2115b9c09d8e3ba7a8dd5ad639c85653","trace":["eval"]},{"token":78634,"kind":"dense","probabilities":"442b125598334ad7b3ae7951433e580f2115b9c09d8e3ba7a8dd5ad639c85653","trace":["eval"]},{"token":197955,"kind":"dense","probabilities":"442b125598334ad7b3ae7951433e580f2115b9c09d8e3ba7a8dd5ad639c85653","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78634,1],[197955,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"6376118823635de9e648cbc805731d4a2b8eeac6a330781233cfc589555751fe","trace":["eval"]},{"token":78634,"kind":"dense","probabilities":"568a8f86f185eb2d3fba6b7c34fc86a199d3d856d0a9b36a60e2fe5153d98c2c","trace":["eval"]},{"token":197956,"kind":"dense","probabilities":"bd3fdb472b77e2be1480165df6691c1c485609ab98cce8570d5a742ff7a2803d","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78634,1],[197956,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56449,"kind":"dense","probabilities":"ee4c638ce0d5aa742a882c3669b48544d1db672355b8559c671534fa357ed3a7","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"ee4c638ce0d5aa742a882c3669b48544d1db672355b8559c671534fa357ed3a7","trace":["eval"]},{"token":198000,"kind":"dense","probabilities":"ee4c638ce0d5aa742a882c3669b48544d1db672355b8559c671534fa357ed3a7","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198000,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56449,"kind":"dense","probabilities":"af4161cd1db054265dff1aa87e7814f3268bb0f2f765373a2ec90008cff57f4f","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"5191f3ce27fb768df1d62e2f06b12d6a83ea1a05db5df7ad7160a7dca2074191","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"9bdec6c900650eb9f9425c905e0b026d6335e4493746ce10bd7fb5803138311a","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198001,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":327,"kind":"none","trace":["eval","argmax"]},{"token":584,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":327,"kind":"none","trace":["argmax","eval"]},{"token":584,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1612,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":3925,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1612,1],[3925,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1869,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"64edd9f7d14f012ccdfeb99612a51f96357710a2817dd2ab8dba4de23683caff","trace":["eval","eval"]},{"token":4439,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c1328fcaef690b2d32f54d4283ccf0661624cfbba8f719a029f2e52273bb9834","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1869,1],[4439,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"c42628aa7eb4bacb58019195293571b677d1982dc1f7530dba76194722614c32","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"c42628aa7eb4bacb58019195293571b677d1982dc1f7530dba76194722614c32","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"c42628aa7eb4bacb58019195293571b677d1982dc1f7530dba76194722614c32","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"18eaab0e235bc6c35e1754e2bd2e09638316bb2e18b3b15976fd3bb09e36d124","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"ae0e9b4050ff46e432570e059615be18b2d3a1486d7e5b643e2c29de045962ea","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"0d1c6e0ff18cea2f49d0c852c85f838e9f7f6a91c4b67af6a137767152d6d014","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"e3ae6ef0648d9869329efb7c24c2fa9db05783af1e13ce241a4a2a4b30504c5b","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e3ae6ef0648d9869329efb7c24c2fa9db05783af1e13ce241a4a2a4b30504c5b","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"e3ae6ef0648d9869329efb7c24c2fa9db05783af1e13ce241a4a2a4b30504c5b","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"7ae4024c0b3cbe5064b7ee6a2193f6539fa9ec59309859c54c6f4c8e9001a089","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"b8a1ed57e0b293fc0c565ec88081c17e82b33cf99f8e9a8d8dc4e3c8f5a59f23","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"e79c04e8ad72c76d480f504b5c80e56815ef411633a51de27a9a3c1ff9b18b7c","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"99fc6d2f7eafdddc6eb52e9bf60635e3ec2305961b82a286beaca078c8002941","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"74cb647e0b829c4e7f176920af5309a4a8d722b199706825f32ffc460e4ffeb1","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"3dc80b814c8143d5050dcaa020a80e4e15e080602827c3776c09e0c476a84e17","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float16","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"4a4c0d9e26dade8d1a18bcd580a94f1edd43882f62423180d7d860ad43b65c10","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"77ade723c0f2c4d6042585f2ffc3fdeea580335acf4d436985e644d442ccac49","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"1347e572949797ff718de3b0db239a74919526472f7751d5c89bab4600949f67","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"ba3b5c907c53ab18627d12dadfb23e9339bcbd5019d1707245fba12719482d19","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"1a7f75ac16f9db3df7c867a7f52cb97fd61e1f45290803a69300001f9daed44a","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"07b1f72d88ea26d719c009002fa9ab36b0ca10cbc2d066b3178e6bb1c4448fff","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"plain","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":244,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["eval","argmax"]},{"token":501,"kind":"none","trace":["eval","argmax"]},{"token":758,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":244,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":244,"kind":"none","trace":["argmax","eval"]},{"token":501,"kind":"none","trace":["argmax","eval"]},{"token":758,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[244,1],[501,1],[758,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":1786,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":4099,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[1786,1],[4099,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1272,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c2f1876c9c8d2c52bc94fc3c74439e37a0c0801187aa5f9c2349832c8f4ab927","trace":["eval","eval"]},{"token":2043,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"9e2d739c38f3b8456359ffc2e591f490b54c13639e150323b0f3c7e70fd3dcc6","trace":["eval","eval"]},{"token":4613,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e599de043e21bec2ca1bd0d0174a582ceafebc99893bc9eaa3fae6c725b6dfe8","trace":["eval","eval"]}],"counts":[[124160,2],[1272,1],[2043,1],[4613,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"39fb8f20e228f56fb723404d105664c09c6bc8f4c7b59ed3c885e769535dbd45","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"4a4c0d9e26dade8d1a18bcd580a94f1edd43882f62423180d7d860ad43b65c10","trace":["eval"]},{"token":78629,"kind":"dense","probabilities":"77ade723c0f2c4d6042585f2ffc3fdeea580335acf4d436985e644d442ccac49","trace":["eval"]},{"token":197952,"kind":"dense","probabilities":"1347e572949797ff718de3b0db239a74919526472f7751d5c89bab4600949f67","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78629,1],[197952,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]},{"token":198004,"kind":"dense","probabilities":"dfa60a7ca9bb97805b7e9f88395a59d4b59a9f860399577b13053ecf067b2264","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78656,1],[198004,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"ba3b5c907c53ab18627d12dadfb23e9339bcbd5019d1707245fba12719482d19","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"1a7f75ac16f9db3df7c867a7f52cb97fd61e1f45290803a69300001f9daed44a","trace":["eval"]},{"token":198005,"kind":"dense","probabilities":"07b1f72d88ea26d719c009002fa9ab36b0ca10cbc2d066b3178e6bb1c4448fff","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198005,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]},{"token":1,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[1,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"rank3","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":250,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["eval","argmax"]},{"token":507,"kind":"none","trace":["eval","argmax"]},{"token":764,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":250,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":250,"kind":"none","trace":["argmax","eval"]},{"token":507,"kind":"none","trace":["argmax","eval"]},{"token":764,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[250,1],[507,1],[764,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":1792,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":4105,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[1792,1],[4105,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1278,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"688f42355215626051404e56590fa8370e807af086cf55a7172391081dc147cd","trace":["eval","eval"]},{"token":2049,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8f6e535883abcc2d05d58b4305d79748fb57e4c6ff53e41fa66f235f6a71d792","trace":["eval","eval"]},{"token":4619,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"8c02134cc809f02d840cd5951c912abdddca5128bf636a8a596e45666421749c","trace":["eval","eval"]}],"counts":[[124160,2],[1278,1],[2049,1],[4619,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"15d703bd141437d4d79c9e3546eb93f0a1e9c9ca98277f9e47f515769cef130c","trace":["eval"]},{"token":78634,"kind":"dense","probabilities":"15d703bd141437d4d79c9e3546eb93f0a1e9c9ca98277f9e47f515769cef130c","trace":["eval"]},{"token":197955,"kind":"dense","probabilities":"15d703bd141437d4d79c9e3546eb93f0a1e9c9ca98277f9e47f515769cef130c","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78634,1],[197955,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"56a355bb570e4e12eab2ca3611411dd1bff866258de55c586ffe1b1e5c63a3e7","trace":["eval"]},{"token":78634,"kind":"dense","probabilities":"da86c1231fe7cb3144bb47d0c7e85e1cdb2465d2327afc9329f3d3f34c634982","trace":["eval"]},{"token":197956,"kind":"dense","probabilities":"b8c6177b660620bef99b7fd448672253a8ffd664c1d92515d36beb1663f602c5","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78634,1],[197956,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56449,"kind":"dense","probabilities":"fd8fb4ade5febfbcc8ceba6e597d4dca7bec47d2fc7ed369f860f2202f58df9a","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"fd8fb4ade5febfbcc8ceba6e597d4dca7bec47d2fc7ed369f860f2202f58df9a","trace":["eval"]},{"token":198000,"kind":"dense","probabilities":"fd8fb4ade5febfbcc8ceba6e597d4dca7bec47d2fc7ed369f860f2202f58df9a","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198000,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56449,"kind":"dense","probabilities":"f125cf2bcbf95f763c2d90e1252c67dadf60dd5f0622ff7ebe9080bbb8eb19a8","trace":["eval"]},{"token":78656,"kind":"dense","probabilities":"a37eb28e259967a2f810a8f04e6423b8fbfe54ca9f40e1dc4b0042d4ff967f93","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"98d2a9e7102241b4e9386a219af3cb38d31b0a5f2a485170f4276f0ee3625f64","trace":["eval"]}],"counts":[[124160,2],[56449,1],[78656,1],[198001,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"strided","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":70,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["eval","argmax"]},{"token":327,"kind":"none","trace":["eval","argmax"]},{"token":584,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":70,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":70,"kind":"none","trace":["argmax","eval"]},{"token":327,"kind":"none","trace":["argmax","eval"]},{"token":584,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[70,1],[327,1],[584,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1612,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":3925,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1612,1],[3925,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":1098,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"bb018d1c3acfbb2c9123db20d3d8e707d1132e237a63225ebb2f0d2d126a54c8","trace":["eval","eval"]},{"token":1869,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"64edd9f7d14f012ccdfeb99612a51f96357710a2817dd2ab8dba4de23683caff","trace":["eval","eval"]},{"token":4439,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"c1328fcaef690b2d32f54d4283ccf0661624cfbba8f719a029f2e52273bb9834","trace":["eval","eval"]}],"counts":[[124160,2],[1098,1],[1869,1],[4439,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":56433,"kind":"dense","probabilities":"671ee0bd02a4e6ee18f0ebf9b9eca7ed2e702cf30de5c1f0f7bc2d79fb64bbbb","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"671ee0bd02a4e6ee18f0ebf9b9eca7ed2e702cf30de5c1f0f7bc2d79fb64bbbb","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"671ee0bd02a4e6ee18f0ebf9b9eca7ed2e702cf30de5c1f0f7bc2d79fb64bbbb","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":56433,"kind":"dense","probabilities":"7c8b061253145eec6b308636606b46f0f4825f5315286caefb0711a5677d1a03","trace":["eval"]},{"token":78637,"kind":"dense","probabilities":"6a3dfd7ac2a0554cd07cbfcefd1c0f059d5d00513fcf9b406fabac49cd5bdc93","trace":["eval"]},{"token":197960,"kind":"dense","probabilities":"8bd1a46eeb7569f440cd4b6b349f4883ead2bd2cc11134fe5a55aefffa438b6a","trace":["eval"]}],"counts":[[124160,2],[56433,1],[78637,1],[197960,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56450,"kind":"dense","probabilities":"6a586d8d7317f1103c019acf0785047ba24b0595edca79f1a298f1f3cf7d9aef","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6a586d8d7317f1103c019acf0785047ba24b0595edca79f1a298f1f3cf7d9aef","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"6a586d8d7317f1103c019acf0785047ba24b0595edca79f1a298f1f3cf7d9aef","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56450,"kind":"dense","probabilities":"5ce065c0a5a97b193819631264c026a4525a9f6298baff952bc1c69d6ee855df","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"d4ee2c6850ce90cc2c54cf5a9e7145ccd79dd822fb62881395cc1cb8403398ce","trace":["eval"]},{"token":198006,"kind":"dense","probabilities":"6640699245f42af6785407acbf9f20887deca6ffe446909e51b3695cbe1ca970","trace":["eval"]}],"counts":[[124160,2],[56450,1],[78657,1],[198006,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]},{"error":true,"trace":["eval","eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"reverse","mode":"nonfinite","profile":"dense_all","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"pattern","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"99fc6d2f7eafdddc6eb52e9bf60635e3ec2305961b82a286beaca078c8002941","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"74cb647e0b829c4e7f176920af5309a4a8d722b199706825f32ffc460e4ffeb1","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"3dc80b814c8143d5050dcaa020a80e4e15e080602827c3776c09e0c476a84e17","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":2,"kind":"none","trace":["eval","argmax"]},{"token":3,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":0,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["argmax","eval"]},{"token":2,"kind":"none","trace":["argmax","eval"]},{"token":3,"kind":"none","trace":["argmax","eval"]}],"counts":[[124160,2],[0,1],[2,1],[3,1]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":false,"steps":[{"token":4,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":6,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]},{"token":15,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"f5c4cb24f4c9b43e624e0a83cb11934f932dbd5db24eee67fed696354ac88a61","trace":["eval","eval"]}],"counts":[[124160,2],[4,1],[6,1],[15,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"sparse","penalties":true,"steps":[{"token":5,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"a695bf9c1f563564ba4d133650cf362f372ea8f8f50290c9e526423ebc89e0a7","trace":["eval","eval"]},{"token":8,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"dc2d743eb8cc7156d770757e0801dea1a86868322607972e897973bfe5d724fd","trace":["eval","eval"]},{"token":18,"kind":"sparse","probabilities":"dab41ff849bcb42483789223c1aa01f11435a7fd9de13f6e9f0697420e1768f7","ids":"e229914d33347e8d96bbb5bb9e6bd48514fcd0f2291f51b9fb87d2891ef24652","trace":["eval","eval"]}],"counts":[[124160,2],[5,1],[8,1],[18,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":false,"steps":[{"token":53629,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":74724,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]},{"token":188102,"kind":"dense","probabilities":"4c61bb7e78834cd4caa927e1b63092759f5d8173145e08ca78212d5a716b390f","trace":["eval"]}],"counts":[[124160,2],[53629,1],[74724,1],[188102,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_top_p","penalties":true,"steps":[{"token":53630,"kind":"dense","probabilities":"aaebba77e4bfb676bd88cb006c0fd069f15049d37bbb7346162f3adb6f3383d6","trace":["eval"]},{"token":74726,"kind":"dense","probabilities":"826a7b7c85c15078e32c149dae3bab3149e60a471b6ae2852f81d26ac0dc6f53","trace":["eval"]},{"token":188104,"kind":"dense","probabilities":"ec5dee801b446b782eadd94401d8f535097b19f5dc42aeeca3cfbdc1eb41eedf","trace":["eval"]}],"counts":[[124160,2],[53630,1],[74726,1],[188104,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":false,"steps":[{"token":56452,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]},{"token":198001,"kind":"dense","probabilities":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198001,1]],"next_rng":4604266380111679709} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"equal","profile":"dense_all","penalties":true,"steps":[{"token":56452,"kind":"dense","probabilities":"5c58c0069b527fc03ec502455db588032ee432e3319787324b333d2219ad5c76","trace":["eval"]},{"token":78657,"kind":"dense","probabilities":"e13e3f65ddb79b891d4968f3812a68bdc5dcc954b215ce5f872e3fccb623df74","trace":["eval"]},{"token":198002,"kind":"dense","probabilities":"5b5e124250fa7ba7fa8b249ab9fb1aa4d3abdffb3a02aa2c1bf8ae9b73912334","trace":["eval"]}],"counts":[[124160,2],[56452,1],[78657,1],[198002,1]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]},{"token":0,"kind":"none","trace":["eval","argmax"]}],"counts":[[124160,2],[0,3]],"next_rng":4597358663699103712} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} -{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]},{"token":0,"kind":"sparse","probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc","trace":["eval","eval"]}],"counts":[[124160,2],[0,3]],"next_rng":4604266380111679709} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":false,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"greedy","penalties":true,"steps":[{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]},{"error":true,"trace":["argmax","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":false,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} +{"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"sparse","penalties":true,"steps":[{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]},{"error":true,"trace":["eval","eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_top_p","penalties":true,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} {"vocab":248320,"dtype":"float32","layout":"broadcast","mode":"nonfinite","profile":"dense_all","penalties":false,"steps":[{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]},{"error":true,"trace":["eval"]}],"counts":[[124160,2]],"next_rng":4597358663699103712} diff --git a/tests/fixtures/mtplx-sampler-fallback.jsonl b/tests/fixtures/mtplx-sampler-fallback.jsonl index 9677cb6..f7b9555 100644 --- a/tests/fixtures/mtplx-sampler-fallback.jsonl +++ b/tests/fixtures/mtplx-sampler-fallback.jsonl @@ -28,12 +28,12 @@ {"kind":"dense","vocab":17,"mode":"equal","top_p":1.0,"top_k":0,"temperature":0.6,"sha256":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"} {"kind":"dense","vocab":17,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"} {"kind":"dense","vocab":17,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.6,"sha256":"2f75407dafefd0c94d4086fe91d44d2a691b92bf9cdaa3b97d64c43afd203eec"} -{"kind":"sparse","vocab":17,"mode":"nonfinite","top_p":0.95,"ids":[[0],[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16],[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16],[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16]],"probabilities":[[4607182418800017408],[4583470125244317986,4584274903162039981,4584913498231553259,4585403052336341145,4585943033054120046,4586538637394287817,4587195590428162504,4587920214047044866,4588719477018087891,4589384546141931126,4589870747603590315,4590407031337863395,4590998554749504208,4591651008255767288,4592370668642664377,4593164457921865947],[4583470125244317986,4584274903162039981,4584913498231553259,4585403052336341145,4585943033054120046,4586538637394287817,4587195590428162504,4587920214047044866,4588719477018087891,4589384546141931126,4589870747603590315,4590407031337863395,4590998554749504208,4591651008255767288,4592370668642664377,4593164457921865947],[4583470125244317986,4584274903162039981,4584913498231553259,4585403052336341145,4585943033054120046,4586538637394287817,4587195590428162504,4587920214047044866,4588719477018087891,4589384546141931126,4589870747603590315,4590407031337863395,4590998554749504208,4591651008255767288,4592370668642664377,4593164457921865947]]} +{"kind":"sparse","vocab":17,"mode":"nonfinite","top_p":0.95,"error":true} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.0,"sha256":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.0,"sha256":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.6,"error":true} -{"kind":"sparse","vocab":17,"mode":"nonfinite","top_p":1.0,"ids":[[0],[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16],[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16],[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16]],"probabilities":[[4607182418800017408],[4582570607829064589,4583282728395344946,4584068201681994787,4584799502097317607,4585277314231602385,4585804343898336961,4586385660985805440,4587026857054827540,4587734100187265086,4588514193629108745,4589271330846132655,4589745870388253985,4590269290700165157,4590846625759409239,4591483430587723924,4592185829300413485,4592960580260849490],[4582570607829064589,4583282728395344946,4584068201681994787,4584799502097317607,4585277314231602385,4585804343898336961,4586385660985805440,4587026857054827540,4587734100187265086,4588514193629108745,4589271330846132655,4589745870388253985,4590269290700165157,4590846625759409239,4591483430587723924,4592185829300413485,4592960580260849490],[4582570607829064589,4583282728395344946,4584068201681994787,4584799502097317607,4585277314231602385,4585804343898336961,4586385660985805440,4587026857054827540,4587734100187265086,4588514193629108745,4589271330846132655,4589745870388253985,4590269290700165157,4590846625759409239,4591483430587723924,4592185829300413485,4592960580260849490]]} +{"kind":"sparse","vocab":17,"mode":"nonfinite","top_p":1.0,"error":true} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.0,"sha256":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":17,"mode":"nonfinite","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"} @@ -78,12 +78,12 @@ {"kind":"dense","vocab":4097,"mode":"equal","top_p":1.0,"top_k":0,"temperature":0.6,"sha256":"aae2b7d568054610c2c33a2a7bf52a3ef42462797fcd2f39f808664aa720b7ad"} {"kind":"dense","vocab":4097,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"} {"kind":"dense","vocab":4097,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.6,"sha256":"4d8d58c44fe3d255e96f413286bd7688f51a6f13b8f4b100ab6adb8af3f6dc3f"} -{"kind":"sparse","vocab":4097,"mode":"nonfinite","top_p":0.95,"ids":[[0],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096]],"probabilities":[[4607182418800017408],[4587338767903852705,4587341688419326307,4587344608934799908,4587347531969407040,4587350455004014172,4587353380557754835,4587356309470340206,4587359236703503223,4587362165616088595,4587365095368385143,4587368025960392868,4587370958231822947,4587373891342964203,4587376829492372521,4587379761763802600,4587382701592633273,4587385639742041591,4587388579570872263,4587391519399702935,4587394461747667138],[4587338767903852705,4587341688419326307,4587344608934799908,4587347531969407040,4587350455004014172,4587353380557754835,4587356309470340206,4587359236703503223,4587362165616088595,4587365095368385143,4587368025960392868,4587370958231822947,4587373891342964203,4587376829492372521,4587379761763802600,4587382701592633273,4587385639742041591,4587388579570872263,4587391519399702935,4587394461747667138],[4587338767903852705,4587341688419326307,4587344608934799908,4587347531969407040,4587350455004014172,4587353380557754835,4587356309470340206,4587359236703503223,4587362165616088595,4587365095368385143,4587368025960392868,4587370958231822947,4587373891342964203,4587376829492372521,4587379761763802600,4587382701592633273,4587385639742041591,4587388579570872263,4587391519399702935,4587394461747667138]]} +{"kind":"sparse","vocab":4097,"mode":"nonfinite","top_p":0.95,"error":true} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.0,"sha256":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.0,"sha256":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.6,"error":true} -{"kind":"sparse","vocab":4097,"mode":"nonfinite","top_p":1.0,"ids":[[0],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096],[4077,4078,4079,4080,4081,4082,4083,4084,4085,4086,4087,4088,4089,4090,4091,4092,4093,4094,4095,4096]],"probabilities":[[4607182418800017408],[4587338766723896628,4587341687746433435,4587344609101288761,4587347532501346487,4587350456233993217,4587353382013507009,4587356308125880511,4587359236286787089,4587362164780824304,4587365095325061967,4587368026202701413,4587370959132210035,4587373892395391809,4587376827712112845,4587379763362778620,4587382701068655105,4587385639108748138,4587388579205724687,4587391519637189814,4587394462127212627],[4587338766723896628,4587341687746433435,4587344609101288761,4587347532501346487,4587350456233993217,4587353382013507009,4587356308125880511,4587359236286787089,4587362164780824304,4587365095325061967,4587368026202701413,4587370959132210035,4587373892395391809,4587376827712112845,4587379763362778620,4587382701068655105,4587385639108748138,4587388579205724687,4587391519637189814,4587394462127212627],[4587338766723896628,4587341687746433435,4587344609101288761,4587347532501346487,4587350456233993217,4587353382013507009,4587356308125880511,4587359236286787089,4587362164780824304,4587365095325061967,4587368026202701413,4587370959132210035,4587373892395391809,4587376827712112845,4587379763362778620,4587382701068655105,4587385639108748138,4587388579205724687,4587391519637189814,4587394462127212627]]} +{"kind":"sparse","vocab":4097,"mode":"nonfinite","top_p":1.0,"error":true} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.0,"sha256":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":4097,"mode":"nonfinite","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"} @@ -128,12 +128,12 @@ {"kind":"dense","vocab":248320,"mode":"equal","top_p":1.0,"top_k":0,"temperature":0.6,"sha256":"6f46aac0b33fcf6d92ebe44511db79afdcb03ca323cddbbd03c07636fe78be61"} {"kind":"dense","vocab":248320,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"} {"kind":"dense","vocab":248320,"mode":"equal","top_p":1.0,"top_k":20,"temperature":0.6,"sha256":"dd72f182a8194dbc8d2be121876463ad662c9b3537bd77ad0b5ec9a995109615"} -{"kind":"sparse","vocab":248320,"mode":"nonfinite","top_p":0.95,"ids":[[0],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319]],"probabilities":[[4607182418800017408],[4587366122787014302,4587366170310645966,4587366218626338158,4587366266149969822,4587366315257722542,4587366363573414733,4587366411097046397,4587366459412738589,4587366506936370253,4587366555252062445,4587366602775694109,4587366651883446828,4587366700199139020,4587366747722770684,4587366796038462876,4587366843562094540,4587366891877786731,4587366946529963145,4587366995637715864,4587367043161347528],[4587366122787014302,4587366170310645966,4587366218626338158,4587366266149969822,4587366315257722542,4587366363573414733,4587366411097046397,4587366459412738589,4587366506936370253,4587366555252062445,4587366602775694109,4587366651883446828,4587366700199139020,4587366747722770684,4587366796038462876,4587366843562094540,4587366891877786731,4587366946529963145,4587366995637715864,4587367043161347528],[4587366122787014302,4587366170310645966,4587366218626338158,4587366266149969822,4587366315257722542,4587366363573414733,4587366411097046397,4587366459412738589,4587366506936370253,4587366555252062445,4587366602775694109,4587366651883446828,4587366700199139020,4587366747722770684,4587366796038462876,4587366843562094540,4587366891877786731,4587366946529963145,4587366995637715864,4587367043161347528]]} +{"kind":"sparse","vocab":248320,"mode":"nonfinite","top_p":0.95,"error":true} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.0,"sha256":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":0.95,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.0,"sha256":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":0.95,"top_k":20,"temperature":0.6,"error":true} -{"kind":"sparse","vocab":248320,"mode":"nonfinite","top_p":1.0,"ids":[[0],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319],[248300,248301,248302,248303,248304,248305,248306,248307,248308,248309,248310,248311,248312,248313,248314,248315,248316,248317,248318,248319]],"probabilities":[[4607182418800017408],[4587366121016187173,4587366169116914460,4587366218076913066,4587366266178288305,4587366314279984656,4587366363240969637,4587366411343313955,4587366459445979390,4587366507548965947,4587366556511264182,4587366604614898721,4587366652718854388,4587366700823131184,4587366749786742709,4587366798750686938,4587366845996913438,4587366894961511411,4587366943067405357,4587366992032662920,4587367039280156679],[4587366121016187173,4587366169116914460,4587366218076913066,4587366266178288305,4587366314279984656,4587366363240969637,4587366411343313955,4587366459445979390,4587366507548965947,4587366556511264182,4587366604614898721,4587366652718854388,4587366700823131184,4587366749786742709,4587366798750686938,4587366845996913438,4587366894961511411,4587366943067405357,4587366992032662920,4587367039280156679],[4587366121016187173,4587366169116914460,4587366218076913066,4587366266178288305,4587366314279984656,4587366363240969637,4587366411343313955,4587366459445979390,4587366507548965947,4587366556511264182,4587366604614898721,4587366652718854388,4587366700823131184,4587366749786742709,4587366798750686938,4587366845996913438,4587366894961511411,4587366943067405357,4587366992032662920,4587367039280156679]]} +{"kind":"sparse","vocab":248320,"mode":"nonfinite","top_p":1.0,"error":true} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.0,"sha256":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":1.0,"top_k":0,"temperature":0.6,"error":true} {"kind":"dense","vocab":248320,"mode":"nonfinite","top_p":1.0,"top_k":20,"temperature":0.0,"sha256":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"} diff --git a/tests/fixtures/mtplx-sampler-mixed.jsonl b/tests/fixtures/mtplx-sampler-mixed.jsonl index ecc4f20..bf5060a 100644 --- a/tests/fixtures/mtplx-sampler-mixed.jsonl +++ b/tests/fixtures/mtplx-sampler-mixed.jsonl @@ -7,17 +7,17 @@ {"vocab":1,"mode":"same","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":1,"mode":"same","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":true,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":1,"mode":"disjoint","kinds":"dd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"disjoint","kinds":"ds","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} +{"vocab": 1, "mode": "disjoint", "kinds": "ds", "construction_error": true} {"vocab":1,"mode":"disjoint","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"disjoint","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":true,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} +{"vocab": 1, "mode": "disjoint", "kinds": "ss", "construction_error": true} {"vocab":1,"mode":"nonfinite","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"nonfinite","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"nonfinite","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"nonfinite","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":true,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} +{"vocab": 1, "mode": "nonfinite", "kinds": "ds", "construction_error": true} +{"vocab": 1, "mode": "nonfinite", "kinds": "sd", "construction_error": true} +{"vocab": 1, "mode": "nonfinite", "kinds": "ss", "construction_error": true} {"vocab":1,"mode":"zero","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":1,"mode":"zero","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"zero","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":1,"mode":"zero","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":true,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408],[true,0,4607182418800017408]],"next_verify":4594500682135173736} +{"vocab": 1, "mode": "zero", "kinds": "sd", "construction_error": true} +{"vocab": 1, "mode": "zero", "kinds": "ss", "construction_error": true} {"vocab":17,"mode":"reverse","kinds":"dd","sampled":{"tokens":[4,5,14,12,7,5,10,3,12,16,5,16,12,2,7,15,12,5,13,4,1,3,5,7,5,14,3,3,2,10,14,10],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"68d4bf336aea675e5e28b71c59e87684ebd64f905e71e86a590d9dfefb8d606c"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4598175219545276417],[false,5,4585130310279789464],[true,16,4607182418800017408],[true,6,4604180019048437078],[true,13,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,10,4601392076421969630],[false,3,4594710912139606805],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4602678819172646914],[true,5,4607182418800017408],[true,12,4607182418800017408],[false,16,4598175219545276417],[true,9,4585130310279789464],[true,16,4607182418800017408],[false,14,4604180019048437078],[false,5,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,16,4601392076421969630],[true,11,4594710912139606805],[true,1,4607182418800017408]],"next_verify":4601557188279288624} {"vocab":17,"mode":"reverse","kinds":"ds","sampled":{"tokens":[4,5,14,12,7,5,10,3,12,16,5,16,12,2,7,15,12,5,13,4,1,3,5,7,5,14,3,3,2,10,14,10],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"68d4bf336aea675e5e28b71c59e87684ebd64f905e71e86a590d9dfefb8d606c"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4598175219545276417],[false,5,4585130310279789464],[true,16,4607182418800017408],[true,6,4604180019048437078],[true,13,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,10,4601392076421969630],[false,3,4594710912139606805],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4602678819172646914],[true,5,4607182418800017408],[true,12,4607182418800017408],[false,16,4598175219545276417],[true,9,4585130310279789464],[true,16,4607182418800017408],[false,14,4604180019048437078],[false,5,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,16,4601392076421969630],[true,11,4594710912139606805],[true,1,4607182418800017408]],"next_verify":4601557188279288624} {"vocab":17,"mode":"reverse","kinds":"sd","sampled":{"tokens":[4,5,14,12,7,5,10,3,12,16,5,16,12,2,7,15,12,5,13,4,1,3,5,7,5,14,3,3,2,10,14,10],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"68d4bf336aea675e5e28b71c59e87684ebd64f905e71e86a590d9dfefb8d606c"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4598175219545276417],[false,5,4585130310279789464],[true,16,4607182418800017408],[true,6,4604180019048437078],[true,13,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,10,4601392076421969630],[false,3,4594710912139606805],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4602678819172646914],[true,5,4607182418800017408],[true,12,4607182418800017408],[false,16,4598175219545276417],[true,9,4585130310279789464],[true,16,4607182418800017408],[false,14,4604180019048437078],[false,5,4599154262942530872],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,4592670820000712479],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,16,4601392076421969630],[true,11,4594710912139606805],[true,1,4607182418800017408]],"next_verify":4601557188279288624} @@ -36,8 +36,8 @@ {"vocab":17,"mode":"nonfinite","kinds":"ss","sampled":{"tokens":[4,5,14,12,7,5,10,3,12,16,5,16,12,2,7,15,12,5,13,4,2,3,6,7,5,14,3,3,2,10,15,10],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"67457fab781d99c8c492c7c4b1e18f0f75a7912065373eb47abee5b3facfbab7","ids":"0d242953c1c1ccca8826a893fc6c51b877e2137d856615aa8ef19fbd0b004672"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4598175219545276416],[false,5,4585130310279789462],[true,16,4607182418800017408],[true,6,4604180019048437076],[true,13,4599154262942530871],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,0],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,10,4601392076421969629],[false,3,4594710912139606803],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4602678819172646912],[true,5,4607182418800017408],[true,12,4607182418800017408],[false,16,4598175219545276416],[true,9,4585130310279789462],[true,16,4607182418800017408],[false,14,4604180019048437076],[false,5,4599154262942530871],[true,3,4607182418800017408],[true,10,4607182418800017408],[false,12,0],[true,7,4607182418800017408],[true,14,4607182418800017408],[false,16,4601392076421969629],[true,11,4594710912139606803],[true,1,4607182418800017408]],"next_verify":4601557188279288624} {"vocab":17,"mode":"zero","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,6,4607182418800017408],[true,13,4607182418800017408],[true,3,4607182418800017408],[true,10,4607182418800017408],[true,0,4607182418800017408],[true,7,4607182418800017408],[true,14,4607182418800017408],[true,4,4607182418800017408],[true,11,4607182418800017408],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4607182418800017408],[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,6,4607182418800017408],[true,13,4607182418800017408],[true,3,4607182418800017408],[true,10,4607182418800017408],[true,0,4607182418800017408],[true,7,4607182418800017408],[true,14,4607182418800017408],[true,4,4607182418800017408],[true,11,4607182418800017408],[true,1,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":17,"mode":"zero","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,6,4607182418800017408],[true,13,4607182418800017408],[true,3,4607182418800017408],[true,10,4607182418800017408],[true,0,4607182418800017408],[true,7,4607182418800017408],[true,14,4607182418800017408],[true,4,4607182418800017408],[true,11,4607182418800017408],[true,1,4607182418800017408],[true,8,4607182418800017408],[true,15,4607182418800017408],[true,5,4607182418800017408],[true,12,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,6,4607182418800017408],[true,13,4607182418800017408],[true,3,4607182418800017408],[true,10,4607182418800017408],[true,0,4607182418800017408],[true,7,4607182418800017408],[true,14,4607182418800017408],[true,4,4607182418800017408],[true,11,4607182418800017408],[true,1,4607182418800017408]],"next_verify":4594500682135173736} -{"vocab":17,"mode":"zero","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"d5ae40407fdc5f612f7a29be2a4cfd02896ce0bc69b2cb448d70928cd8589dfe"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[true,0,4607182418800017408],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[true,0,4607182418800017408],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4593803838413721144} -{"vocab":17,"mode":"zero","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[true,0,4607182418800017408],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[true,0,4607182418800017408],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4593803838413721144} +{"vocab": 17, "mode": "zero", "kinds": "sd", "construction_error": true} +{"vocab": 17, "mode": "zero", "kinds": "ss", "construction_error": true} {"vocab":129,"mode":"reverse","kinds":"dd","sampled":{"tokens":[28,40,101,86,49,43,77,23,86,120,32,120,85,12,56,112,89,42,94,27,10,19,44,58,34,105,25,16,12,77,109,77],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"016fb306008bf67e7715558607ff212feeb4eb60395bcced17ec45f5d9137180"},"decisions":[[true,5,4607182418800017408],[true,12,4606773000652074634],[true,19,4603512819103641448],[true,26,4607182418800017408],[true,33,4607182418800017408],[false,26,4591215111030249285],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4604064542134914756],[true,68,4607182418800017408],[true,75,4607182418800017408],[false,57,4596373779694328216],[true,89,4607182418800017408],[true,96,4607182418800017408],[false,13,4604660403008689931],[true,110,4601477859272014780],[true,117,4607182418800017408],[true,124,4599676419421066581],[true,2,4607182418800017408],[false,87,4591215111030249285],[true,16,4607182418800017408],[true,23,4607182418800017408],[false,116,4604064542134914756],[true,37,4607182418800017408],[true,44,4607182418800017408],[false,15,4596373779694328216],[true,58,4607182418800017408],[true,65,4607182418800017408],[true,72,4604660403008689931],[true,79,4601477859272014780],[true,86,4607182418800017408],[false,119,4599676419421066581]],"next_verify":4587559244767229904} {"vocab":129,"mode":"reverse","kinds":"ds","sampled":{"tokens":[28,40,101,86,49,43,77,23,86,120,32,120,85,12,56,112,89,42,94,27,10,19,44,58,34,105,25,16,12,77,109,77],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"95fb6b0d021fee5af43a64377f31a0c9de0be74e84675713dce47256fd1eb898"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[false,108,4594288198107389753],[false,23,4578601153151023370],[true,47,4597808320356477103],[true,54,4607182418800017408],[true,61,4607182418800017408],[true,68,4607182418800017408],[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,23,4607182418800017408],[true,30,4607182418800017408],[true,37,4607182418800017408],[true,44,4607182418800017408],[true,51,4607182418800017408],[true,58,4607182418800017408],[true,65,4607182418800017408],[true,72,4607182418800017408],[true,79,4607182418800017408],[true,86,4607182418800017408],[true,93,4607182418800017408]],"next_verify":4603745791242046308} {"vocab":129,"mode":"reverse","kinds":"sd","sampled":{"tokens":[47,67,107,94,74,67,87,47,94,121,47,121,94,26,80,114,94,67,101,47,20,47,67,80,53,107,47,33,26,87,114,87],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"dda7c63540eded4df14712cef1adc729b5bb3a01844f8c60f91d5b44c28d898e"},"decisions":[[false,94,0],[false,107,0],[false,107,0],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4603853864037681221],[true,47,4607182418800017408],[false,94,0],[false,80,0],[false,80,0],[false,26,0],[false,67,0],[false,6,0],[false,94,0],[false,6,0],[false,114,0],[false,80,0],[false,26,0],[false,67,0],[false,67,0],[false,87,0],[false,6,0],[false,74,0],[false,74,0],[false,74,0],[false,67,0],[false,87,0],[false,6,0],[false,53,0],[false,67,0],[false,94,0],[false,53,0]],"next_verify":4581739469254677216} @@ -56,8 +56,8 @@ {"vocab":129,"mode":"nonfinite","kinds":"ss","sampled":{"tokens":[47,67,107,94,74,67,87,47,94,121,53,121,94,26,80,114,94,67,101,47,26,47,67,80,67,107,47,33,26,87,114,87],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"58d85c3e8d65305be21fcd4e719739135cf579f2d8fd00cfc4aead2cbcd6ee9e","ids":"fe68f66b5f04994e7a5737e3c722fa01015bad70e4131ed9bbd40e88531e9f6a"},"decisions":[[false,80,0],[false,87,0],[false,107,0],[true,26,4607182418800017408],[true,33,4607050926840094181],[true,40,4591119480513941483],[true,47,4607182418800017408],[false,80,0],[false,67,0],[false,80,0],[false,6,0],[false,47,0],[false,6,0],[false,80,0],[false,6,0],[false,128,0],[false,80,0],[false,6,0],[false,47,0],[false,47,0],[false,80,0],[false,6,0],[false,67,0],[false,67,0],[false,47,0],[false,47,0],[false,80,0],[false,6,0],[false,26,0],[false,47,0],[false,80,0],[false,26,0]],"next_verify":4581739469254677216} {"vocab":129,"mode":"zero","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4607182418800017408],null,[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,2,4607182418800017408],[true,9,4607182418800017408],[true,16,4607182418800017408],[true,23,4607182418800017408],[true,30,4607182418800017408],null,[true,44,4607182418800017408],[true,51,4607182418800017408],[true,58,4607182418800017408],[true,65,4607182418800017408],[true,72,4607182418800017408],[true,79,4607182418800017408],[true,86,4607182418800017408],[true,93,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":129,"mode":"zero","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[null,null,null,[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"next_verify":4594500682135173736} -{"vocab":129,"mode":"zero","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"859d151a3f6998b0733367528721fe9269dc5d88b0a9131b0151c5d91c2413d5"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} -{"vocab":129,"mode":"zero","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} +{"vocab": 129, "mode": "zero", "kinds": "sd", "construction_error": true} +{"vocab": 129, "mode": "zero", "kinds": "ss", "construction_error": true} {"vocab":4097,"mode":"reverse","kinds":"dd","sampled":{"tokens":[931,1297,3266,2770,1601,1363,2451,763,2755,3858,1017,3887,2733,391,1810,3632,2857,1338,3006,902,334,655,1392,1905,1091,3341,791,530,375,2452,3500,2465],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"43316ff9414c1bc6eca29a6a66421cf4ea5564987376ea1776e8b0e6d670f479"},"decisions":[[true,5,4607182418800017408],[true,12,4606773000652074634],[true,19,4603512819103641447],[true,26,4607182418800017408],[true,33,4607182418800017407],[false,855,4591215111030249284],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4604064542134914756],[true,68,4607182418800017408],[true,75,4607182418800017408],[false,1867,4596373779694328216],[true,89,4607182418800017408],[true,96,4607182418800017408],[false,367,4604660403008689930],[true,110,4601477859272014779],[true,117,4607182418800017408],[true,124,4599676419421066580],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4605305918955279701],[false,109,4602368226094897222],[true,159,4607182418800017408],[false,2848,4602678819172646910],[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4606007566723312060],[true,194,4603000504860316233],[true,201,4607182418800017408],[true,208,4604608933298662837],[false,1752,0],[true,222,4607182418800017408]],"next_verify":4606672374948657776} {"vocab":4097,"mode":"reverse","kinds":"ds","sampled":{"tokens":[931,1297,3266,2770,1601,1363,2451,763,2755,3858,1017,3887,2733,391,1810,3632,2857,1338,3006,902,334,655,1392,1905,1091,3341,791,530,375,2452,3500,2465],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"36b4e4006ce128f1cd7066e294caef8cc5dd64653b971efdc8519afa2185fec0"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4607182418800017408],[true,68,4607182418800017408],[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4607182418800017408],[true,152,4607182418800017408],[true,159,4607182418800017408],[true,166,4607182418800017408],[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4607182418800017408],[true,194,4607182418800017408],[true,201,4607182418800017408],[true,208,4607182418800017408],[false,483,0],[true,222,4607182418800017408]],"next_verify":4599226383852258898} {"vocab":4097,"mode":"reverse","kinds":"sd","sampled":{"tokens":[1077,1509,3449,2586,1724,1509,2155,862,2586,3880,1077,3880,2586,646,1940,3880,2802,1509,2802,1077,646,862,1509,1940,1077,3449,1077,862,646,2155,3664,2155],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"5c282d0279ff03540c0b125e68d58982536e3aa4f4a829f54fc959cdc32d9d92"},"decisions":[[false,2802,0],[false,3449,0],[false,3664,0],[false,1077,0],[false,2155,0],[false,2586,0],[false,1940,0],[false,2155,0],[false,646,0],[false,1509,0],[false,431,0],[false,2802,0],[false,431,0],[false,3880,0],[false,2155,0],[false,862,0],[false,1509,0],[false,1509,0],[false,2371,0],[false,431,0],[false,1940,0],[false,1940,0],[false,1724,0],[false,1724,0],[false,2155,0],[false,431,0],[false,1077,0],[false,1724,0],[false,2802,0],[false,1293,0],[false,1724,0],[false,1509,0]],"next_verify":4606376319297213697} @@ -76,8 +76,8 @@ {"vocab":4097,"mode":"nonfinite","kinds":"ss","sampled":{"tokens":[1077,1509,3449,2586,1724,1509,2155,1077,2586,3880,1077,3880,2586,862,1940,3880,2802,1509,2802,1077,646,862,1509,1940,1293,3449,1077,862,862,2155,3664,2155],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"9b46e3847ae5ae724db330b627925abde37f548c0d7077fb222666562ec8089e","ids":"765b82390f7e7e1daaed43fcd137dfd9f1004fe4ef45ec7c12a9c28ccd6da253"},"decisions":[[false,3664,0],[false,3880,0],[false,3880,0],[false,1077,0],[false,2371,0],[false,3664,0],[false,2155,0],[false,2371,0],[false,646,0],[false,1940,0],[false,646,0],[false,3664,0],[false,646,0],[false,4096,0],[false,2371,0],[false,862,0],[false,1940,0],[false,1940,0],[false,2586,0],[false,646,0],[false,2155,0],[false,2155,0],[false,1940,0],[false,1940,0],[false,2371,0],[false,646,0],[false,1940,0],[false,1940,0],[false,3664,0],[false,1940,0],[false,1940,0],[false,1940,0]],"next_verify":4606376319297213697} {"vocab":4097,"mode":"zero","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4607182418800017408],null,[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4607182418800017408],[true,152,4607182418800017408],[true,159,4607182418800017408],[true,166,4607182418800017408],[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4607182418800017408],[true,194,4607182418800017408],[true,201,4607182418800017408],[true,208,4607182418800017408],[true,215,4607182418800017408],[true,222,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":4097,"mode":"zero","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,[true,215,4607182418800017408],null],"next_verify":4594500682135173736} -{"vocab":4097,"mode":"zero","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"b4a11e26a2208a02277a02d7a15fbf135fa00d16bddb5e7b70010c709433f9a9"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} -{"vocab":4097,"mode":"zero","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} +{"vocab": 4097, "mode": "zero", "kinds": "sd", "construction_error": true} +{"vocab": 4097, "mode": "zero", "kinds": "ss", "construction_error": true} {"vocab":248320,"mode":"reverse","kinds":"dd","sampled":{"tokens":[56452,78657,198002,167928,97119,82643,148570,46370,167058,233869,61644,235625,165688,23813,109716,220130,173191,81070,182248,54664,20261,39705,84453,115516,66158,202572,47998,32150,22761,148635,212249,149394],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"dd197241a2b10ca226037362a6b85290b24a99a3265921865eb4b54aff241285"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4605760229444005673],[false,47911,4601928219234751830],[false,51992,4596622254156527970],[true,40,4599676419421066581],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4606682018841420685],[false,118221,4602874627852097803],[false,161847,4598175219545276416],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4603497655468532456],[true,117,4599009219476270953],[true,124,4607182418800017408],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4607182418800017408],[true,152,4604180019048437078],[false,226852,4599907373248111223],[true,166,4607182418800017408],[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4607182418800017408],[true,194,4604930618986332161],[true,201,4600877379321698714],[false,74044,4595172819793696085],[false,156805,0],[true,222,4607182418800017408]],"next_verify":4587559244767229904} {"vocab":248320,"mode":"reverse","kinds":"ds","sampled":{"tokens":[56452,78657,198002,167928,97119,82643,148570,46370,167058,233869,61644,235625,165688,23813,109716,220130,173191,81070,182248,54664,20261,39705,84453,115516,66158,202572,47998,32150,22761,148635,212249,149394],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"50af936e58541d1fcf87f8e046583d29daa4752a3efe554131e0f2b6b562cc61"},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4607182418800017408],[true,68,4607182418800017408],[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4607182418800017408],[true,152,4607182418800017408],[true,159,4607182418800017408],[true,166,4607182418800017408],[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4607182418800017408],[true,194,4607182418800017408],[true,201,4607182418800017408],[true,208,4607182418800017408],[false,29451,0],[true,222,4607182418800017408]],"next_verify":4599226383852258898} {"vocab":248320,"mode":"reverse","kinds":"sd","sampled":{"tokens":[26138,65347,209110,143763,91485,65347,143763,26138,143763,235249,39208,235249,143763,13069,104555,222180,156833,65347,169902,26138,13069,26138,78416,104555,52277,209110,26138,26138,13069,143763,222180,143763],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"16470dc8389c537891e99a0e055a99e53d1a85c5c453abcfcd0e230d83d76341"},"decisions":[[false,156833,0],[false,209110,0],[false,222180,0],[false,26138,0],[false,143763,0],[false,143763,0],[false,104555,0],[false,117624,0],[false,13069,0],[false,65347,0],[false,13069,0],[false,156833,0],[false,13069,0],[false,222180,0],[false,117624,0],[false,13069,0],[false,65347,0],[false,65347,0],[false,143763,0],[false,13069,0],[false,104555,0],[false,104555,0],[false,78416,0],[false,78416,0],[false,117624,0],[false,13069,0],[false,52277,0],[false,78416,0],[false,156833,0],[false,52277,0],[false,91485,0],[false,65347,0]],"next_verify":4606376319297213697} @@ -96,5 +96,5 @@ {"vocab":248320,"mode":"nonfinite","kinds":"ss","sampled":{"tokens":[39208,65347,209110,143763,91485,78416,143763,26138,143763,235249,39208,235249,143763,13069,104555,222180,156833,65347,169902,39208,13069,26138,78416,104555,65347,209110,26138,26138,13069,143763,222180,143763],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"b4bed38f61f0aacd81dabb052355f74eec58367f88019e0d3acba868c4dcea67","ids":"1853c0d6cb4ca804b7ff3c57bfbc6da9717bb6eeb2bfc7e8dca13cd918dc8ae3"},"decisions":[[false,143763,0],[false,222180,0],[false,222180,0],[false,13069,0],[false,117624,0],[false,143763,0],[false,52277,0],[false,104555,0],[false,13069,0],[false,26138,0],[false,13069,0],[false,143763,0],[false,13069,0],[false,222180,0],[false,104555,0],[false,13069,0],[false,26138,0],[false,26138,0],[false,143763,0],[false,13069,0],[false,26138,0],[false,52277,0],[false,26138,0],[false,26138,0],[false,104555,0],[false,13069,0],[false,26138,0],[false,26138,0],[false,143763,0],[false,26138,0],[false,26138,0],[false,26138,0]],"next_verify":4606376319297213697} {"vocab":248320,"mode":"zero","kinds":"dd","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[[true,5,4607182418800017408],[true,12,4607182418800017408],[true,19,4607182418800017408],[true,26,4607182418800017408],[true,33,4607182418800017408],[true,40,4607182418800017408],[true,47,4607182418800017408],[true,54,4607182418800017408],[true,61,4607182418800017408],[true,68,4607182418800017408],[true,75,4607182418800017408],[true,82,4607182418800017408],[true,89,4607182418800017408],[true,96,4607182418800017408],[true,103,4607182418800017408],[true,110,4607182418800017408],[true,117,4607182418800017408],[true,124,4607182418800017408],[true,131,4607182418800017408],[true,138,4607182418800017408],[true,145,4607182418800017408],[true,152,4607182418800017408],[true,159,4607182418800017408],null,[true,173,4607182418800017408],[true,180,4607182418800017408],[true,187,4607182418800017408],[true,194,4607182418800017408],[true,201,4607182418800017408],[true,208,4607182418800017408],[true,215,4607182418800017408],[true,222,4607182418800017408]],"next_verify":4594500682135173736} {"vocab":248320,"mode":"zero","kinds":"ds","sampled":{"error":true,"next":4597358663699103712},"residual":{"error":true},"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"next_verify":4594500682135173736} -{"vocab":248320,"mode":"zero","kinds":"sd","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"d","borrowed":false,"probabilities":"a781d9dc26dcafd56743703f36a26ed788d7941813aba3686dc5ecd68927c969"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} -{"vocab":248320,"mode":"zero","kinds":"ss","sampled":{"tokens":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"next":4606569824417127725},"residual":{"kind":"s","borrowed":false,"probabilities":"6c3c396ed6b5c36dcae172271f462051b1266b851e92df3deea8ac65478fd712","ids":"af5570f5a1810b7af78caf4bc70a660f0df51e42baf91d4de5b2328de0e83dfc"},"decisions":[[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0],[false,0,0]],"next_verify":4606376319297213697} +{"vocab": 248320, "mode": "zero", "kinds": "sd", "construction_error": true} +{"vocab": 248320, "mode": "zero", "kinds": "ss", "construction_error": true} diff --git a/tools/issue105-reference.py b/tools/issue105-reference.py new file mode 100644 index 0000000..48fc81d --- /dev/null +++ b/tools/issue105-reference.py @@ -0,0 +1,36 @@ +"""Model-free #105 receipt from the pinned MTPLX/MLX oracle, never production.""" +import json +import subprocess +from pathlib import Path + +import mlx.core as mx +import numpy as np +from mtplx import generation +from mtplx.sampling import NonFiniteLogitsError, SamplerConfig + +reference = Path(generation.__file__).resolve().parent.parent +assert subprocess.check_output(["git", "-C", str(reference), "rev-parse", "HEAD"], text=True).strip() == "9882703f3105363ddc37eca9f97aa09a1d387112" +assert mx.__version__ == "0.32.2" +rows = { + "nan": np.full(64, np.nan, np.float32), + "positive_inf": np.array([np.inf] + [0.] * 63, np.float32), + "all_negative_inf": np.full(64, -np.inf, np.float32), + "valid_mask": np.array([-np.inf, 2., -np.inf, 1.] + [-np.inf] * 60, np.float32), +} +for name, values in rows.items(): + row = mx.array(values) + for temperature in (0., .6, 1.): + config = SamplerConfig(temperature=temperature, top_p=.95, top_k=20) + try: + token, _ = generation._sample_from_logits(row, config, np.random.default_rng(0)) + result = {"token": token} + except NonFiniteLogitsError as error: + result = {"error": str(error), "nan": error.nan_count, "inf": error.inf_count, "vocab": error.vocab_size} + print(json.dumps(dict(case="ordinary", row=name, temperature=temperature, **result)), flush=True) + config = SamplerConfig(temperature=1., top_p=.95, top_k=20) + token = int(generation._mx_lazy_sample(row, config, mx.random.key(7)).item()) + print(json.dumps(dict(case="lazy", row=name, token=token)), flush=True) + # The specialized MTP greedy helper still lacks the ordinary guard at this + # revision. Keep the conflict with #105 visible; never label this parity. + token, _ = generation._greedy_draft_token_and_top_values(row.reshape(1,1,-1), topk=2) + print(json.dumps(dict(case="mtp_greedy_specialized", row=name, token=token)), flush=True) diff --git a/tools/mtplx-kernel-fixtures.py b/tools/mtplx-kernel-fixtures.py index a2b858c..6adc0a7 100644 --- a/tools/mtplx-kernel-fixtures.py +++ b/tools/mtplx-kernel-fixtures.py @@ -1396,7 +1396,7 @@ def ple_connected_fixtures(): def batched_sampler_fixtures(): """Both actual batch routes, their whole-batch fallback and public methods.""" from mtplx import fast_sampling as fs - from mtplx.sampling import SamplerConfig + from mtplx.sampling import SamplerConfig, NonFiniteLogitsError assert mx.__version__ == "0.32.2" and np.__version__ == "2.4.4" def digest(values, dtype): return hashlib.sha256(np.asarray(values, dtype=dtype).tobytes()).hexdigest() @@ -1407,13 +1407,13 @@ def batched_sampler_fixtures(): samples = [] for i in range(32): try: samples.append(batch.sample(i % len(batch.token_ids), rng)) - except ValueError: samples.append(None) + except (ValueError,NonFiniteLogitsError): samples.append(None) converted = [] for row in range(len(batch.token_ids)): try: p = batch.to_distribution(row) converted.append(dict(ids=digest(p.token_ids, '