benchmarks: build ggml with the tinyBLAS GEMM path (GGML_LLAMAFILE) llama.cpp enables by default - #46
Open
codspeed-hq[bot] wants to merge 1 commit into
CodSpeed HQ / CodSpeed Performance Analysis
failed
Jul 30, 2026 in 0s
1 benchmark regressed
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 4 improved benchmarks
❌ 1 regressed benchmark
✅ 23 untouched benchmarks
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | WallTime | prompt_layer[f32] |
247.1 ms | 296.6 ms | -16.69% |
| ⚡ | Simulation | ffn_swiglu |
1,067.7 ms | 776.8 ms | +37.46% |
| ⚡ | Simulation | mul_mat[f32] |
346.1 ms | 258.7 ms | +33.81% |
| ⚡ | WallTime | lm_head[f16] |
60.6 ms | 52.5 ms | +15.26% |
| ⚡ | Simulation | mul_mat[q4_0] |
102 ms | 90 ms | +13.24% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing codspeed-optim-build-the-benchmarked-ggml-with-the-tinyblas-gemm-1785422569683 (d862814) with master (46819c9)
Loading