Skip to content

benchmarks: build ggml with the tinyBLAS GEMM path (GGML_LLAMAFILE) llama.cpp enables by default - #46

Open
codspeed-hq[bot] wants to merge 1 commit into
masterfrom
codspeed-optim-build-the-benchmarked-ggml-with-the-tinyblas-gemm-1785422569683
Open

benchmarks: build ggml with the tinyBLAS GEMM path (GGML_LLAMAFILE) llama.cpp enables by default#46
codspeed-hq[bot] wants to merge 1 commit into
masterfrom
codspeed-optim-build-the-benchmarked-ggml-with-the-tinyblas-gemm-1785422569683

benchmarks: enable GGML_LLAMAFILE by default to match llama.cpp

d862814
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis failed Jul 30, 2026 in 0s

1 benchmark regressed

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 1 regressed benchmark
✅ 23 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime prompt_layer[f32] 247.1 ms 296.6 ms -16.69%
Simulation ffn_swiglu 1,067.7 ms 776.8 ms +37.46%
Simulation mul_mat[f32] 346.1 ms 258.7 ms +33.81%
WallTime lm_head[f16] 60.6 ms 52.5 ms +15.26%
Simulation mul_mat[q4_0] 102 ms 90 ms +13.24%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing codspeed-optim-build-the-benchmarked-ggml-with-the-tinyblas-gemm-1785422569683 (d862814) with master (46819c9)

Open in CodSpeed