type: meta

node: pavilion

engine: llamacpp

purpose: Sloba 2026-05-04: Qwen3-30B-A3B (MoE) on weaker Pavilion hardware (GTX 1050 4GB / 16GB RAM) for cross-machine A3B comparison

note: 30B total / 3B active MoE; 9.9GB IQ2_XXS; partial CPU offload heavy


raw:
llama-bench.exe : ggml_cuda_init: found 1 CUDA devices (Total VRAM: 4095 MiB):
At line:1 char:1
+ & 'D:\WeeyugaTools\llama.cpp\llama-bench.exe' -m 'D:\WeeyugaModels\ll ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (ggml_cuda_init:...RAM: 4095 MiB)::String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError

  Device 0: NVIDIA GeForce GTX 1050, compute capability 6.1, VMM: yes, VRAM: 4095 MiB
load_backend: loaded CUDA backend from D:\WeeyugaTools\llama.cpp\ggml-cuda.dll
load_backend: loaded RPC backend from D:\WeeyugaTools\llama.cpp\ggml-rpc.dll
load_backend: loaded CPU backend from D:\WeeyugaTools\llama.cpp\ggml-cpu-haswell.dll
| model                          |       size |     params | backend    | ngl |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |
| qwen3moe 30B.A3B IQ2_XXS - 2.0625 bpw |   9.65 GiB |    30.53 B | CUDA       |  12 |           pp256 |          6.27 ± 2.87 |
| qwen3moe 30B.A3B IQ2_XXS - 2.0625 bpw |   9.65 GiB |    30.53 B | CUDA       |  12 |            tg64 |          4.90 ± 0.67 |

build: 665abc609 (8951)