slobodanmargetic988/weeyuga-benchmarks-public
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
98c3d4fa5b3fe2593fde6d8ee677f347b3205ff9
weeyuga-benchmarks-public/runs/79afe366-1055-4e45-adf6-593864a530e8/run.jsonl
slobodanmargetic988 a18db6a3da B3 staging seed — 21 runs + catalogue v1.0-draft + methodology + README 
Initial population of the weeyuga-benchmarks-public archive (PRIVATE
staging visibility — flips public after Miljan + Stevan security audit
sign-off per Sloba's 17:34Z dispatch).

Contents:
- README.md       — public-facing intro (warns staging state, schema overview, citation pattern, license split)
- LICENSE         — CC-BY-4.0 default (auto-init from Gitea)
- catalogue.json  — schema_version=1.0-draft (locked once Tomas ratifies); 21 benchmarks indexed, 13 complete + 8 meta-only
- methodology.md  — mirror of WeeyugaWeb docs/BENCHMARKS/HARNESS.md (canonical methodology)
- runs/<id>/run.jsonl|run.log|run.md|metadata.json — packaged copies of every run in WeeyugaWeb docs/BENCHMARKS/runs/*

Run set covers:
- Mission 1 (2026-04-28/29): pavilion-weeyuga-v1 + reconstructed v3 (96 calls, 16 models routed via weeyuga :11435)
- Predator trio (2026-05-04): granite-4.1-8B + gemma-4-E4B-it + qwen3.5-9B
- Predator qwen rerun (2026-05-04): qwen3.5-9B think500/nothink + qwen3-14B feasibility
- A3B campaign (2026-05-04/05): pavilion-a3b + predator-a3b NGL matrix + ctx sweep + NGL+ctx 2D + NGL=6 deep dive
- VPS50 CPU matrix + gemma-e4b CPU lane (2026-05-04/05)

Visibility GATE: this repo stays private until Miljan G1-G4 audit and
Stevan G3 credential audit both green. After sign-off, single API call
flips visibility=public, anonymous read on, push-protection requires
auth, issues moderate by default.

No raw IPs, no SSH user@host strings, no /Users/ paths, no whisper
transcripts in any of these files. Hardware names (pavilion, predator,
vps50) are intentional and fine to share.

Builder: WeeyugaWeb/scripts/benchmarks/build_catalogue.py (deterministic,
idempotent, ~5s wall on 21 runs).
Publish flow: WeeyugaWeb/scripts/benchmarks/publish_bench_run.py
(builds packaged dirs, regenerates catalogue, optional --push to mirror
into this repo, optional --deploy stub for cicd rsync).

Owner: mac/benchmark-tester-ben (Ben).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-05 19:46:01 +02:00

47 lines
20 KiB
JSON
Raw Blame History

{"type": "meta", "benchmark_run_id": "79afe366-1055-4e45-adf6-593864a530e8", "harness_version": "predator-a3b-ngl6-ctx-1", "started_at_utc": "2026-05-05T09:44:34Z", "host": "Slobodans-MacBook-Air.local", "node": "predator", "engine": "llamacpp", "purpose": "Sloba 2026-05-05: NGL=6 large-context rerun with new max_tokens methodology. 'no need to run small context just do 64 96 131'.", "cells": [{"key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536}, {"key": "ngl6-ctx96k", "ngl": 6, "ctx": 65536}, {"key": "ngl6-ctx131k", "ngl": 6, "ctx": 65536}], "gguf": "Qwen3-30B-A3B-UD-IQ2_M.gguf", "max_tokens_per_prompt": {"hello": 512, "P-MEDIUM": 1024, "P-HARD": 2048}}
{"type": "vram_snapshot", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "3039, 2991, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "14325,14300,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 114.59 \u00b1 4.05 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.01 \u00b1 0.25 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 38170, "prompt_tokens": 9, "completion_tokens": 198, "tokens_per_sec": 5.187319884726224, "finish_reason": "stop", "reasoning_chars": 834, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 15973, "prompt_tokens": 9, "completion_tokens": 94, "tokens_per_sec": 5.884930820760032, "finish_reason": "stop", "reasoning_chars": 346, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 13824, "prompt_tokens": 9, "completion_tokens": 82, "tokens_per_sec": 5.931712962962963, "finish_reason": "stop", "reasoning_chars": 300, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 22431, "prompt_tokens": 9, "completion_tokens": 116, "tokens_per_sec": 5.171414560206856, "finish_reason": "stop", "reasoning_chars": 449, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 81140, "prompt_tokens": 22, "completion_tokens": 437, "tokens_per_sec": 5.385753019472516, "finish_reason": "stop", "reasoning_chars": 1693, "content_chars": 498, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 70839, "prompt_tokens": 22, "completion_tokens": 392, "tokens_per_sec": 5.533674953062579, "finish_reason": "stop", "reasoning_chars": 1555, "content_chars": 385, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 60354, "prompt_tokens": 22, "completion_tokens": 335, "tokens_per_sec": 5.550584882526428, "finish_reason": "stop", "reasoning_chars": 1201, "content_chars": 455, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 75591, "prompt_tokens": 22, "completion_tokens": 416, "tokens_per_sec": 5.5033006574856795, "finish_reason": "stop", "reasoning_chars": 1486, "content_chars": 473, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 147513, "prompt_tokens": 30, "completion_tokens": 747, "tokens_per_sec": 5.063960464501434, "finish_reason": "stop", "reasoning_chars": 1206, "content_chars": 2019, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 157591, "prompt_tokens": 30, "completion_tokens": 828, "tokens_per_sec": 5.254107150789068, "finish_reason": "stop", "reasoning_chars": 1237, "content_chars": 2268, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 146270, "prompt_tokens": 30, "completion_tokens": 771, "tokens_per_sec": 5.271074041156765, "finish_reason": "stop", "reasoning_chars": 1032, "content_chars": 2223, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 146218, "prompt_tokens": 30, "completion_tokens": 777, "tokens_per_sec": 5.313983230518815, "finish_reason": "stop", "reasoning_chars": 1031, "content_chars": 2225, "error": null}
{"type": "vram_snapshot", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "3526, 2504, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "17037,11588,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 115.02 \u00b1 3.48 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.00 \u00b1 0.26 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 16242, "prompt_tokens": 9, "completion_tokens": 86, "tokens_per_sec": 5.294914419406477, "finish_reason": "stop", "reasoning_chars": 290, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 18234, "prompt_tokens": 9, "completion_tokens": 103, "tokens_per_sec": 5.6487879785017, "finish_reason": "stop", "reasoning_chars": 377, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 19231, "prompt_tokens": 9, "completion_tokens": 105, "tokens_per_sec": 5.45993448078623, "finish_reason": "stop", "reasoning_chars": 384, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 16843, "prompt_tokens": 9, "completion_tokens": 100, "tokens_per_sec": 5.937184587068812, "finish_reason": "stop", "reasoning_chars": 367, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 110870, "prompt_tokens": 22, "completion_tokens": 585, "tokens_per_sec": 5.276449896274916, "finish_reason": "stop", "reasoning_chars": 2434, "content_chars": 447, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 110774, "prompt_tokens": 22, "completion_tokens": 595, "tokens_per_sec": 5.3712965136223305, "finish_reason": "stop", "reasoning_chars": 2056, "content_chars": 871, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 112101, "prompt_tokens": 22, "completion_tokens": 603, "tokens_per_sec": 5.379077795916182, "finish_reason": "stop", "reasoning_chars": 2125, "content_chars": 810, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 66119, "prompt_tokens": 22, "completion_tokens": 369, "tokens_per_sec": 5.580846655273068, "finish_reason": "stop", "reasoning_chars": 1364, "content_chars": 421, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 151424, "prompt_tokens": 30, "completion_tokens": 787, "tokens_per_sec": 5.197326711749788, "finish_reason": "stop", "reasoning_chars": 2143, "content_chars": 1193, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 152836, "prompt_tokens": 30, "completion_tokens": 799, "tokens_per_sec": 5.227825904891517, "finish_reason": "stop", "reasoning_chars": 1256, "content_chars": 2176, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 88383, "prompt_tokens": 30, "completion_tokens": 491, "tokens_per_sec": 5.555366982338232, "finish_reason": "stop", "reasoning_chars": 1180, "content_chars": 1027, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 151338, "prompt_tokens": 30, "completion_tokens": 791, "tokens_per_sec": 5.226711070583726, "finish_reason": "stop", "reasoning_chars": 1215, "content_chars": 2102, "error": null}
{"type": "vram_snapshot", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "3997, 2033, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "19867,8758,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 113.80 \u00b1 3.44 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 4.96 \u00b1 0.46 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 34389, "prompt_tokens": 9, "completion_tokens": 153, "tokens_per_sec": 4.449097095001308, "finish_reason": "stop", "reasoning_chars": 595, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 18091, "prompt_tokens": 9, "completion_tokens": 85, "tokens_per_sec": 4.698468851915317, "finish_reason": "stop", "reasoning_chars": 235, "content_chars": 113, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 40404, "prompt_tokens": 9, "completion_tokens": 197, "tokens_per_sec": 4.875754875754875, "finish_reason": "stop", "reasoning_chars": 796, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 43729, "prompt_tokens": 9, "completion_tokens": 215, "tokens_per_sec": 4.9166457042237415, "finish_reason": "stop", "reasoning_chars": 859, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 120915, "prompt_tokens": 22, "completion_tokens": 595, "tokens_per_sec": 4.920812140760038, "finish_reason": "stop", "reasoning_chars": 1981, "content_chars": 893, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 73236, "prompt_tokens": 22, "completion_tokens": 349, "tokens_per_sec": 4.765415915669889, "finish_reason": "stop", "reasoning_chars": 1233, "content_chars": 463, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 104076, "prompt_tokens": 22, "completion_tokens": 502, "tokens_per_sec": 4.82339828586802, "finish_reason": "stop", "reasoning_chars": 1965, "content_chars": 455, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 96577, "prompt_tokens": 22, "completion_tokens": 462, "tokens_per_sec": 4.783747683195792, "finish_reason": "stop", "reasoning_chars": 1771, "content_chars": 513, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 167278, "prompt_tokens": 30, "completion_tokens": 786, "tokens_per_sec": 4.698764930235895, "finish_reason": "stop", "reasoning_chars": 1176, "content_chars": 2193, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 145866, "prompt_tokens": 30, "completion_tokens": 692, "tokens_per_sec": 4.744080183181824, "finish_reason": "stop", "reasoning_chars": 2123, "content_chars": 790, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 99791, "prompt_tokens": 30, "completion_tokens": 492, "tokens_per_sec": 4.93030433606237, "finish_reason": "stop", "reasoning_chars": 1133, "content_chars": 946, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 156630, "prompt_tokens": 30, "completion_tokens": 758, "tokens_per_sec": 4.839430505011811, "finish_reason": "stop", "reasoning_chars": 1138, "content_chars": 2102, "error": null}
Reference in New Issue View Git Blame Copy Permalink