type: meta

node: predator

engine: llamacpp

purpose: Sloba 2026-05-05: NGL=12 and NGL=24 × ctx sweep up to 131k. Find the actual context ceiling at the two NGL sweet spots from the prior bench.

methodology_notes: Sloba 2026-05-05: 'max tokens should be bigger than reasoning budget'. Prior bench had hello max_tokens=256 < reasoning_budget=500 → content_chars=0. Bumped to 512/1024/2048 so reasoning + answer both fit.


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |           pp256 |        126.21 ± 2.67 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |            tg64 |          6.32 ± 0.94 |

build: 665abc609 (8951)


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |           pp256 |        126.69 ± 4.44 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |            tg64 |          6.01 ± 0.94 |

build: 665abc609 (8951)


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |           pp256 |        26.49 ± 11.80 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  12 |            tg64 |          4.94 ± 0.78 |

build: 665abc609 (8951)


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |           pp256 |         48.01 ± 0.46 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |            tg64 |          6.50 ± 0.03 |

build: 665abc609 (8951)


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |           pp256 |         27.92 ± 3.61 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |            tg64 |          5.63 ± 0.39 |

build: 665abc609 (8951)


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 6143 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 6143 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1060, compute capability 6.1, VMM: yes, VRAM: 6143 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |           pp256 |         15.72 ± 3.11 |
| qwen3moe 30B.A3B IQ2_M - 2.7 bpw |  10.11 GiB |    30.53 B | CUDA       |  24 |            tg64 |          5.22 ± 0.53 |

build: 665abc609 (8951)