slobodanmargetic988/weeyuga-benchmarks-public
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

B3 staging seed — 21 runs + catalogue v1.0-draft + methodology + README

Browse Source 
Initial population of the weeyuga-benchmarks-public archive (PRIVATE
staging visibility — flips public after Miljan + Stevan security audit
sign-off per Sloba's 17:34Z dispatch).

Contents:
- README.md       — public-facing intro (warns staging state, schema overview, citation pattern, license split)
- LICENSE         — CC-BY-4.0 default (auto-init from Gitea)
- catalogue.json  — schema_version=1.0-draft (locked once Tomas ratifies); 21 benchmarks indexed, 13 complete + 8 meta-only
- methodology.md  — mirror of WeeyugaWeb docs/BENCHMARKS/HARNESS.md (canonical methodology)
- runs/<id>/run.jsonl|run.log|run.md|metadata.json — packaged copies of every run in WeeyugaWeb docs/BENCHMARKS/runs/*

Run set covers:
- Mission 1 (2026-04-28/29): pavilion-weeyuga-v1 + reconstructed v3 (96 calls, 16 models routed via weeyuga :11435)
- Predator trio (2026-05-04): granite-4.1-8B + gemma-4-E4B-it + qwen3.5-9B
- Predator qwen rerun (2026-05-04): qwen3.5-9B think500/nothink + qwen3-14B feasibility
- A3B campaign (2026-05-04/05): pavilion-a3b + predator-a3b NGL matrix + ctx sweep + NGL+ctx 2D + NGL=6 deep dive
- VPS50 CPU matrix + gemma-e4b CPU lane (2026-05-04/05)

Visibility GATE: this repo stays private until Miljan G1-G4 audit and
Stevan G3 credential audit both green. After sign-off, single API call
flips visibility=public, anonymous read on, push-protection requires
auth, issues moderate by default.

No raw IPs, no SSH user@host strings, no /Users/ paths, no whisper
transcripts in any of these files. Hardware names (pavilion, predator,
vps50) are intentional and fine to share.

Builder: WeeyugaWeb/scripts/benchmarks/build_catalogue.py (deterministic,
idempotent, ~5s wall on 21 runs).
Publish flow: WeeyugaWeb/scripts/benchmarks/publish_bench_run.py
(builds packaged dirs, regenerates catalogue, optional --push to mirror
into this repo, optional --deploy stub for cicd rsync).

Owner: mac/benchmark-tester-ben (Ben).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Slobodan Margetic
2026-05-05 19:46:01 +02:00
parent 5c726cf585
commit a18db6a3da
70 changed files with 16023 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

849
runs/79afe366-1055-4e45-adf6-593864a530e8/metadata.json Normal file
View File

@@ -0,0 +1,849 @@
{
"id": "79afe366-1055-4e45-adf6-593864a530e8",
"title": "predator-a3b-ngl6-ctx-1 \u2014 qwen3 on predator",
"date": "2026-05-05",
"hardware": "predator",
"engine": "llamacpp",
"harness": "predator-a3b-ngl6-ctx-1",
"model_family": "qwen3",
"model_sizes": [
"qwen3:30b-a3b-iq2m"
],
"task_kind": null,
"headline": "45 calls across 3 cell(s); ~5.2 tok/s mean; p50 84.8s",
"summary_md_path": null,
"raw_jsonl_path": "runs/79afe366-1055-4e45-adf6-593864a530e8.jsonl",
"log_path": "runs/79afe366-1055-4e45-adf6-593864a530e8.log",
"synthesis_doc": "A3B_AND_CPU_OVERNIGHT_2026-05-05.md",
"cells": [
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 81326.17,
"duration_ms_p50": 73215.0,
"tokens_per_sec_mean": 5.42,
"tokens_per_sec_max": 5.93
},
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 84532.92,
"duration_ms_p50": 99578.5,
"tokens_per_sec_mean": 5.43,
"tokens_per_sec_max": 5.94
},
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 91748.5,
"duration_ms_p50": 98184.0,
"tokens_per_sec_mean": 4.79,
"tokens_per_sec_max": 4.93
}
],
"n_calls_total": 45,
"n_errors_total": 0,
"started_at": "2026-05-05T09:44:34Z",
"tags": [
"a3b",
"ctx",
"iq2",
"ngl",
"predator",
"qwen3"
],
"status": "complete",
"visibility": "draft",
"cells_full": [
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 81326.17,
"duration_ms_p50": 73215.0,
"tokens_per_sec_mean": 5.42,
"tokens_per_sec_max": 5.93,
"calls": [
{
"type": "vram_snapshot",
"model_key": "ngl6-ctx64k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"raw": "3039, 2991, 6144"
},
{
"type": "ram_snapshot",
"model_key": "ngl6-ctx64k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"raw": "14325,14300,28625"
},
{
"type": "llama_bench",
"model_key": "ngl6-ctx64k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 114.59 \u00b1 4.05 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.01 \u00b1 0.25 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "hello",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 38170,
"prompt_tokens": 9,
"completion_tokens": 198,
"tokens_per_sec": 5.187319884726224,
"finish_reason": "stop",
"reasoning_chars": 834,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "hello",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 15973,
"prompt_tokens": 9,
"completion_tokens": 94,
"tokens_per_sec": 5.884930820760032,
"finish_reason": "stop",
"reasoning_chars": 346,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "hello",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 13824,
"prompt_tokens": 9,
"completion_tokens": 82,
"tokens_per_sec": 5.931712962962963,
"finish_reason": "stop",
"reasoning_chars": 300,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "hello",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 22431,
"prompt_tokens": 9,
"completion_tokens": 116,
"tokens_per_sec": 5.171414560206856,
"finish_reason": "stop",
"reasoning_chars": 449,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-MEDIUM",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 81140,
"prompt_tokens": 22,
"completion_tokens": 437,
"tokens_per_sec": 5.385753019472516,
"finish_reason": "stop",
"reasoning_chars": 1693,
"content_chars": 498,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-MEDIUM",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 70839,
"prompt_tokens": 22,
"completion_tokens": 392,
"tokens_per_sec": 5.533674953062579,
"finish_reason": "stop",
"reasoning_chars": 1555,
"content_chars": 385,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-MEDIUM",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 60354,
"prompt_tokens": 22,
"completion_tokens": 335,
"tokens_per_sec": 5.550584882526428,
"finish_reason": "stop",
"reasoning_chars": 1201,
"content_chars": 455,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-MEDIUM",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 75591,
"prompt_tokens": 22,
"completion_tokens": 416,
"tokens_per_sec": 5.5033006574856795,
"finish_reason": "stop",
"reasoning_chars": 1486,
"content_chars": 473,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-HARD",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 147513,
"prompt_tokens": 30,
"completion_tokens": 747,
"tokens_per_sec": 5.063960464501434,
"finish_reason": "stop",
"reasoning_chars": 1206,
"content_chars": 2019,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-HARD",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 157591,
"prompt_tokens": 30,
"completion_tokens": 828,
"tokens_per_sec": 5.254107150789068,
"finish_reason": "stop",
"reasoning_chars": 1237,
"content_chars": 2268,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-HARD",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 146270,
"prompt_tokens": 30,
"completion_tokens": 771,
"tokens_per_sec": 5.271074041156765,
"finish_reason": "stop",
"reasoning_chars": 1032,
"content_chars": 2223,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k",
"model_key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536,
"prompt_id": "P-HARD",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 146218,
"prompt_tokens": 30,
"completion_tokens": 777,
"tokens_per_sec": 5.313983230518815,
"finish_reason": "stop",
"reasoning_chars": 1031,
"content_chars": 2225,
"error": null
}
]
},
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 84532.92,
"duration_ms_p50": 99578.5,
"tokens_per_sec_mean": 5.43,
"tokens_per_sec_max": 5.94,
"calls": [
{
"type": "vram_snapshot",
"model_key": "ngl6-ctx96k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"raw": "3526, 2504, 6144"
},
{
"type": "ram_snapshot",
"model_key": "ngl6-ctx96k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"raw": "17037,11588,28625"
},
{
"type": "llama_bench",
"model_key": "ngl6-ctx96k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 115.02 \u00b1 3.48 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.00 \u00b1 0.26 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "hello",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 16242,
"prompt_tokens": 9,
"completion_tokens": 86,
"tokens_per_sec": 5.294914419406477,
"finish_reason": "stop",
"reasoning_chars": 290,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "hello",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 18234,
"prompt_tokens": 9,
"completion_tokens": 103,
"tokens_per_sec": 5.6487879785017,
"finish_reason": "stop",
"reasoning_chars": 377,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "hello",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 19231,
"prompt_tokens": 9,
"completion_tokens": 105,
"tokens_per_sec": 5.45993448078623,
"finish_reason": "stop",
"reasoning_chars": 384,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "hello",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 16843,
"prompt_tokens": 9,
"completion_tokens": 100,
"tokens_per_sec": 5.937184587068812,
"finish_reason": "stop",
"reasoning_chars": 367,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-MEDIUM",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 110870,
"prompt_tokens": 22,
"completion_tokens": 585,
"tokens_per_sec": 5.276449896274916,
"finish_reason": "stop",
"reasoning_chars": 2434,
"content_chars": 447,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-MEDIUM",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 110774,
"prompt_tokens": 22,
"completion_tokens": 595,
"tokens_per_sec": 5.3712965136223305,
"finish_reason": "stop",
"reasoning_chars": 2056,
"content_chars": 871,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-MEDIUM",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 112101,
"prompt_tokens": 22,
"completion_tokens": 603,
"tokens_per_sec": 5.379077795916182,
"finish_reason": "stop",
"reasoning_chars": 2125,
"content_chars": 810,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-MEDIUM",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 66119,
"prompt_tokens": 22,
"completion_tokens": 369,
"tokens_per_sec": 5.580846655273068,
"finish_reason": "stop",
"reasoning_chars": 1364,
"content_chars": 421,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-HARD",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 151424,
"prompt_tokens": 30,
"completion_tokens": 787,
"tokens_per_sec": 5.197326711749788,
"finish_reason": "stop",
"reasoning_chars": 2143,
"content_chars": 1193,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-HARD",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 152836,
"prompt_tokens": 30,
"completion_tokens": 799,
"tokens_per_sec": 5.227825904891517,
"finish_reason": "stop",
"reasoning_chars": 1256,
"content_chars": 2176,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-HARD",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 88383,
"prompt_tokens": 30,
"completion_tokens": 491,
"tokens_per_sec": 5.555366982338232,
"finish_reason": "stop",
"reasoning_chars": 1180,
"content_chars": 1027,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k",
"model_key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 98304,
"prompt_id": "P-HARD",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 151338,
"prompt_tokens": 30,
"completion_tokens": 791,
"tokens_per_sec": 5.226711070583726,
"finish_reason": "stop",
"reasoning_chars": 1215,
"content_chars": 2102,
"error": null
}
]
},
{
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"n_calls": 15,
"n_errors": 0,
"duration_ms_mean": 91748.5,
"duration_ms_p50": 98184.0,
"tokens_per_sec_mean": 4.79,
"tokens_per_sec_max": 4.93,
"calls": [
{
"type": "vram_snapshot",
"model_key": "ngl6-ctx131k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"raw": "3997, 2033, 6144"
},
{
"type": "ram_snapshot",
"model_key": "ngl6-ctx131k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"raw": "19867,8758,28625"
},
{
"type": "llama_bench",
"model_key": "ngl6-ctx131k",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 113.80 \u00b1 3.44 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 4.96 \u00b1 0.46 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "hello",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 34389,
"prompt_tokens": 9,
"completion_tokens": 153,
"tokens_per_sec": 4.449097095001308,
"finish_reason": "stop",
"reasoning_chars": 595,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "hello",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 18091,
"prompt_tokens": 9,
"completion_tokens": 85,
"tokens_per_sec": 4.698468851915317,
"finish_reason": "stop",
"reasoning_chars": 235,
"content_chars": 113,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "hello",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 40404,
"prompt_tokens": 9,
"completion_tokens": 197,
"tokens_per_sec": 4.875754875754875,
"finish_reason": "stop",
"reasoning_chars": 796,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "hello",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 43729,
"prompt_tokens": 9,
"completion_tokens": 215,
"tokens_per_sec": 4.9166457042237415,
"finish_reason": "stop",
"reasoning_chars": 859,
"content_chars": 37,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-MEDIUM",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 120915,
"prompt_tokens": 22,
"completion_tokens": 595,
"tokens_per_sec": 4.920812140760038,
"finish_reason": "stop",
"reasoning_chars": 1981,
"content_chars": 893,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-MEDIUM",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 73236,
"prompt_tokens": 22,
"completion_tokens": 349,
"tokens_per_sec": 4.765415915669889,
"finish_reason": "stop",
"reasoning_chars": 1233,
"content_chars": 463,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-MEDIUM",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 104076,
"prompt_tokens": 22,
"completion_tokens": 502,
"tokens_per_sec": 4.82339828586802,
"finish_reason": "stop",
"reasoning_chars": 1965,
"content_chars": 455,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-MEDIUM",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 96577,
"prompt_tokens": 22,
"completion_tokens": 462,
"tokens_per_sec": 4.783747683195792,
"finish_reason": "stop",
"reasoning_chars": 1771,
"content_chars": 513,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-HARD",
"run_idx": 0,
"phase": "cold",
"total_duration_ms": 167278,
"prompt_tokens": 30,
"completion_tokens": 786,
"tokens_per_sec": 4.698764930235895,
"finish_reason": "stop",
"reasoning_chars": 1176,
"content_chars": 2193,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-HARD",
"run_idx": 1,
"phase": "warm",
"total_duration_ms": 145866,
"prompt_tokens": 30,
"completion_tokens": 692,
"tokens_per_sec": 4.744080183181824,
"finish_reason": "stop",
"reasoning_chars": 2123,
"content_chars": 790,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-HARD",
"run_idx": 2,
"phase": "warm",
"total_duration_ms": 99791,
"prompt_tokens": 30,
"completion_tokens": 492,
"tokens_per_sec": 4.93030433606237,
"finish_reason": "stop",
"reasoning_chars": 1133,
"content_chars": 946,
"error": null
},
{
"type": "call",
"cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k",
"model_key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 131072,
"prompt_id": "P-HARD",
"run_idx": 3,
"phase": "warm",
"total_duration_ms": 156630,
"prompt_tokens": 30,
"completion_tokens": 758,
"tokens_per_sec": 4.839430505011811,
"finish_reason": "stop",
"reasoning_chars": 1138,
"content_chars": 2102,
"error": null
}
]
}
],
"meta_record": {
"type": "meta",
"benchmark_run_id": "79afe366-1055-4e45-adf6-593864a530e8",
"harness_version": "predator-a3b-ngl6-ctx-1",
"started_at_utc": "2026-05-05T09:44:34Z",
"host": "Slobodans-MacBook-Air.local",
"node": "predator",
"engine": "llamacpp",
"purpose": "Sloba 2026-05-05: NGL=6 large-context rerun with new max_tokens methodology. 'no need to run small context just do 64 96 131'.",
"cells": [
{
"key": "ngl6-ctx64k",
"ngl": 6,
"ctx": 65536
},
{
"key": "ngl6-ctx96k",
"ngl": 6,
"ctx": 65536
},
{
"key": "ngl6-ctx131k",
"ngl": 6,
"ctx": 65536
}
],
"gguf": "Qwen3-30B-A3B-UD-IQ2_M.gguf",
"max_tokens_per_prompt": {
"hello": 512,
"P-MEDIUM": 1024,
"P-HARD": 2048
}
},
"packaged_at": "2026-05-05T17:43:34Z"
}

46
runs/79afe366-1055-4e45-adf6-593864a530e8/run.jsonl Normal file
View File

@@ -0,0 +1,46 @@
{"type": "meta", "benchmark_run_id": "79afe366-1055-4e45-adf6-593864a530e8", "harness_version": "predator-a3b-ngl6-ctx-1", "started_at_utc": "2026-05-05T09:44:34Z", "host": "Slobodans-MacBook-Air.local", "node": "predator", "engine": "llamacpp", "purpose": "Sloba 2026-05-05: NGL=6 large-context rerun with new max_tokens methodology. 'no need to run small context just do 64 96 131'.", "cells": [{"key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536}, {"key": "ngl6-ctx96k", "ngl": 6, "ctx": 65536}, {"key": "ngl6-ctx131k", "ngl": 6, "ctx": 65536}], "gguf": "Qwen3-30B-A3B-UD-IQ2_M.gguf", "max_tokens_per_prompt": {"hello": 512, "P-MEDIUM": 1024, "P-HARD": 2048}}
{"type": "vram_snapshot", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "3039, 2991, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "14325,14300,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx64k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "ngl": 6, "ctx": 65536, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 114.59 \u00b1 4.05 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.01 \u00b1 0.25 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 38170, "prompt_tokens": 9, "completion_tokens": 198, "tokens_per_sec": 5.187319884726224, "finish_reason": "stop", "reasoning_chars": 834, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 15973, "prompt_tokens": 9, "completion_tokens": 94, "tokens_per_sec": 5.884930820760032, "finish_reason": "stop", "reasoning_chars": 346, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 13824, "prompt_tokens": 9, "completion_tokens": 82, "tokens_per_sec": 5.931712962962963, "finish_reason": "stop", "reasoning_chars": 300, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 22431, "prompt_tokens": 9, "completion_tokens": 116, "tokens_per_sec": 5.171414560206856, "finish_reason": "stop", "reasoning_chars": 449, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 81140, "prompt_tokens": 22, "completion_tokens": 437, "tokens_per_sec": 5.385753019472516, "finish_reason": "stop", "reasoning_chars": 1693, "content_chars": 498, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 70839, "prompt_tokens": 22, "completion_tokens": 392, "tokens_per_sec": 5.533674953062579, "finish_reason": "stop", "reasoning_chars": 1555, "content_chars": 385, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 60354, "prompt_tokens": 22, "completion_tokens": 335, "tokens_per_sec": 5.550584882526428, "finish_reason": "stop", "reasoning_chars": 1201, "content_chars": 455, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 75591, "prompt_tokens": 22, "completion_tokens": 416, "tokens_per_sec": 5.5033006574856795, "finish_reason": "stop", "reasoning_chars": 1486, "content_chars": 473, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 147513, "prompt_tokens": 30, "completion_tokens": 747, "tokens_per_sec": 5.063960464501434, "finish_reason": "stop", "reasoning_chars": 1206, "content_chars": 2019, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 157591, "prompt_tokens": 30, "completion_tokens": 828, "tokens_per_sec": 5.254107150789068, "finish_reason": "stop", "reasoning_chars": 1237, "content_chars": 2268, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 146270, "prompt_tokens": 30, "completion_tokens": 771, "tokens_per_sec": 5.271074041156765, "finish_reason": "stop", "reasoning_chars": 1032, "content_chars": 2223, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx64k", "model_key": "ngl6-ctx64k", "ngl": 6, "ctx": 65536, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 146218, "prompt_tokens": 30, "completion_tokens": 777, "tokens_per_sec": 5.313983230518815, "finish_reason": "stop", "reasoning_chars": 1031, "content_chars": 2225, "error": null}
{"type": "vram_snapshot", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "3526, 2504, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "17037,11588,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx96k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "ngl": 6, "ctx": 98304, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 115.02 \u00b1 3.48 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 6.00 \u00b1 0.26 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 16242, "prompt_tokens": 9, "completion_tokens": 86, "tokens_per_sec": 5.294914419406477, "finish_reason": "stop", "reasoning_chars": 290, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 18234, "prompt_tokens": 9, "completion_tokens": 103, "tokens_per_sec": 5.6487879785017, "finish_reason": "stop", "reasoning_chars": 377, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 19231, "prompt_tokens": 9, "completion_tokens": 105, "tokens_per_sec": 5.45993448078623, "finish_reason": "stop", "reasoning_chars": 384, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 16843, "prompt_tokens": 9, "completion_tokens": 100, "tokens_per_sec": 5.937184587068812, "finish_reason": "stop", "reasoning_chars": 367, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 110870, "prompt_tokens": 22, "completion_tokens": 585, "tokens_per_sec": 5.276449896274916, "finish_reason": "stop", "reasoning_chars": 2434, "content_chars": 447, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 110774, "prompt_tokens": 22, "completion_tokens": 595, "tokens_per_sec": 5.3712965136223305, "finish_reason": "stop", "reasoning_chars": 2056, "content_chars": 871, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 112101, "prompt_tokens": 22, "completion_tokens": 603, "tokens_per_sec": 5.379077795916182, "finish_reason": "stop", "reasoning_chars": 2125, "content_chars": 810, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 66119, "prompt_tokens": 22, "completion_tokens": 369, "tokens_per_sec": 5.580846655273068, "finish_reason": "stop", "reasoning_chars": 1364, "content_chars": 421, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 151424, "prompt_tokens": 30, "completion_tokens": 787, "tokens_per_sec": 5.197326711749788, "finish_reason": "stop", "reasoning_chars": 2143, "content_chars": 1193, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 152836, "prompt_tokens": 30, "completion_tokens": 799, "tokens_per_sec": 5.227825904891517, "finish_reason": "stop", "reasoning_chars": 1256, "content_chars": 2176, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 88383, "prompt_tokens": 30, "completion_tokens": 491, "tokens_per_sec": 5.555366982338232, "finish_reason": "stop", "reasoning_chars": 1180, "content_chars": 1027, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx96k", "model_key": "ngl6-ctx96k", "ngl": 6, "ctx": 98304, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 151338, "prompt_tokens": 30, "completion_tokens": 791, "tokens_per_sec": 5.226711070583726, "finish_reason": "stop", "reasoning_chars": 1215, "content_chars": 2102, "error": null}
{"type": "vram_snapshot", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "3997, 2033, 6144"}
{"type": "ram_snapshot", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "19867,8758,28625"}
{"type": "llama_bench", "model_key": "ngl6-ctx131k", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "ngl": 6, "ctx": 131072, "raw": "llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):\r\nAt line:1 char:1\r\n+ & 'D:\\WeeyugaTools\\llama.cpp\\llama-bench.exe' -m 'D:\\WeeyugaModels\\ll ...\r\n+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\r\n + CategoryInfo : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException\r\n + FullyQualifiedErrorId : NativeCommandError\r\n \r\n Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB\r\nload_backend: loaded CUDA backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cuda.dll\r\nload_backend: loaded RPC backend from D:\\WeeyugaTools\\llama.cpp\\ggml-rpc.dll\r\nload_backend: loaded CPU backend from D:\\WeeyugaTools\\llama.cpp\\ggml-cpu-haswell.dll\r\n| model | size | params | backend | ngl | test | t/s |\r\n| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | pp256 | 113.80 \u00b1 3.44 |\r\n| qwen3moe 30B.A3B IQ2_M - 2.7 bpw | 10.11 GiB | 30.53 B | CUDA | 6 | tg64 | 4.96 \u00b1 0.46 |\r\n\r\nbuild: 665abc609 (8951)\r\n\r"}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 0, "phase": "cold", "total_duration_ms": 34389, "prompt_tokens": 9, "completion_tokens": 153, "tokens_per_sec": 4.449097095001308, "finish_reason": "stop", "reasoning_chars": 595, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 1, "phase": "warm", "total_duration_ms": 18091, "prompt_tokens": 9, "completion_tokens": 85, "tokens_per_sec": 4.698468851915317, "finish_reason": "stop", "reasoning_chars": 235, "content_chars": 113, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 2, "phase": "warm", "total_duration_ms": 40404, "prompt_tokens": 9, "completion_tokens": 197, "tokens_per_sec": 4.875754875754875, "finish_reason": "stop", "reasoning_chars": 796, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "hello", "run_idx": 3, "phase": "warm", "total_duration_ms": 43729, "prompt_tokens": 9, "completion_tokens": 215, "tokens_per_sec": 4.9166457042237415, "finish_reason": "stop", "reasoning_chars": 859, "content_chars": 37, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 0, "phase": "cold", "total_duration_ms": 120915, "prompt_tokens": 22, "completion_tokens": 595, "tokens_per_sec": 4.920812140760038, "finish_reason": "stop", "reasoning_chars": 1981, "content_chars": 893, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 1, "phase": "warm", "total_duration_ms": 73236, "prompt_tokens": 22, "completion_tokens": 349, "tokens_per_sec": 4.765415915669889, "finish_reason": "stop", "reasoning_chars": 1233, "content_chars": 463, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 2, "phase": "warm", "total_duration_ms": 104076, "prompt_tokens": 22, "completion_tokens": 502, "tokens_per_sec": 4.82339828586802, "finish_reason": "stop", "reasoning_chars": 1965, "content_chars": 455, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-MEDIUM", "run_idx": 3, "phase": "warm", "total_duration_ms": 96577, "prompt_tokens": 22, "completion_tokens": 462, "tokens_per_sec": 4.783747683195792, "finish_reason": "stop", "reasoning_chars": 1771, "content_chars": 513, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 0, "phase": "cold", "total_duration_ms": 167278, "prompt_tokens": 30, "completion_tokens": 786, "tokens_per_sec": 4.698764930235895, "finish_reason": "stop", "reasoning_chars": 1176, "content_chars": 2193, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 1, "phase": "warm", "total_duration_ms": 145866, "prompt_tokens": 30, "completion_tokens": 692, "tokens_per_sec": 4.744080183181824, "finish_reason": "stop", "reasoning_chars": 2123, "content_chars": 790, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 2, "phase": "warm", "total_duration_ms": 99791, "prompt_tokens": 30, "completion_tokens": 492, "tokens_per_sec": 4.93030433606237, "finish_reason": "stop", "reasoning_chars": 1133, "content_chars": 946, "error": null}
{"type": "call", "cell_id": "predator:llamacpp:qwen3:30b-a3b-iq2m-think500-ngl6-ctx131k", "model_key": "ngl6-ctx131k", "ngl": 6, "ctx": 131072, "prompt_id": "P-HARD", "run_idx": 3, "phase": "warm", "total_duration_ms": 156630, "prompt_tokens": 30, "completion_tokens": 758, "tokens_per_sec": 4.839430505011811, "finish_reason": "stop", "reasoning_chars": 1138, "content_chars": 2102, "error": null}

63
runs/79afe366-1055-4e45-adf6-593864a530e8/run.log Normal file
View File

@@ -0,0 +1,63 @@
[09:44:24Z] === predator-a3b-ngl6-ctx run_id=79afe366-1055-4e45-adf6-593864a530e8 ===
[09:44:24Z] Plan: NGL=6 × ctx={64k, 96k, 131k}
[09:44:24Z] Creating run-mirror dir on Predator: D:\WeeyugaBench\runs\79afe366-1055-4e45-adf6-593864a530e8
[09:44:34Z] >>> CELL: ngl6-ctx64k (NGL=6 ctx=65536)
[09:44:34Z] Stopping llama-server on Predator...
[09:44:41Z] Starting llama-server (key=ngl6-ctx64k, NGL=6, ctx=65536)...
[09:44:48Z] Waiting for llama-server (key=ngl6-ctx64k, up to 15 min)...
[09:45:12Z] llama-server up after 17s
[09:45:16Z] Running llama-bench for ngl6-ctx64k (NGL=6)...
[09:46:31Z] Running prompts for ngl6-ctx64k (cold + 3 warm; max_tokens 512/1024/2048)...
[09:46:31Z] prompt=hello cold (max_tokens=512)
[09:47:09Z] prompt=hello warm 1
[09:47:25Z] prompt=hello warm 2
[09:47:39Z] prompt=hello warm 3
[09:48:01Z] prompt=P-MEDIUM cold (max_tokens=1024)
[09:49:23Z] prompt=P-MEDIUM warm 1
[09:50:34Z] prompt=P-MEDIUM warm 2
[09:51:34Z] prompt=P-MEDIUM warm 3
[09:52:50Z] prompt=P-HARD cold (max_tokens=2048)
[09:55:17Z] prompt=P-HARD warm 1
[09:57:55Z] prompt=P-HARD warm 2
[10:00:21Z] prompt=P-HARD warm 3
[10:02:48Z] >>> CELL: ngl6-ctx96k (NGL=6 ctx=98304)
[10:02:48Z] Stopping llama-server on Predator...
[10:02:52Z] Starting llama-server (key=ngl6-ctx96k, NGL=6, ctx=98304)...
[10:02:55Z] Waiting for llama-server (key=ngl6-ctx96k, up to 15 min)...
[10:03:02Z] llama-server up after 7s
[10:03:05Z] Running llama-bench for ngl6-ctx96k (NGL=6)...
[10:04:19Z] Running prompts for ngl6-ctx96k (cold + 3 warm; max_tokens 512/1024/2048)...
[10:04:19Z] prompt=hello cold (max_tokens=512)
[10:04:36Z] prompt=hello warm 1
[10:04:54Z] prompt=hello warm 2
[10:05:13Z] prompt=hello warm 3
[10:05:30Z] prompt=P-MEDIUM cold (max_tokens=1024)
[10:07:21Z] prompt=P-MEDIUM warm 1
[10:09:12Z] prompt=P-MEDIUM warm 2
[10:11:04Z] prompt=P-MEDIUM warm 3
[10:12:10Z] prompt=P-HARD cold (max_tokens=2048)
[10:14:42Z] prompt=P-HARD warm 1
[10:17:15Z] prompt=P-HARD warm 2
[10:18:43Z] prompt=P-HARD warm 3
[10:21:15Z] >>> CELL: ngl6-ctx131k (NGL=6 ctx=131072)
[10:21:15Z] Stopping llama-server on Predator...
[10:21:19Z] Starting llama-server (key=ngl6-ctx131k, NGL=6, ctx=131072)...
[10:21:22Z] Waiting for llama-server (key=ngl6-ctx131k, up to 15 min)...
[10:21:30Z] llama-server up after 7s
[10:21:32Z] Running llama-bench for ngl6-ctx131k (NGL=6)...
[10:23:00Z] Running prompts for ngl6-ctx131k (cold + 3 warm; max_tokens 512/1024/2048)...
[10:23:00Z] prompt=hello cold (max_tokens=512)
[10:23:34Z] prompt=hello warm 1
[10:23:52Z] prompt=hello warm 2
[10:24:33Z] prompt=hello warm 3
[10:25:17Z] prompt=P-MEDIUM cold (max_tokens=1024)
[10:27:18Z] prompt=P-MEDIUM warm 1
[10:28:31Z] prompt=P-MEDIUM warm 2
[10:30:15Z] prompt=P-MEDIUM warm 3
[10:31:52Z] prompt=P-HARD cold (max_tokens=2048)
[10:34:39Z] prompt=P-HARD warm 1
[10:37:05Z] prompt=P-HARD warm 2
[10:38:45Z] prompt=P-HARD warm 3
[10:41:22Z] Stopping llama-server on Predator...
[10:41:26Z] === bench complete ===
[10:41:26Z] Mirroring run-dir to Predator...