Skip to content

Automate RowFn benchmark comparisons - #9351

Closed
connortsui20 wants to merge 1 commit into
ct/row-fn-tensor-productsfrom
ct/row-fn-benchmark-tools
Closed

Automate RowFn benchmark comparisons#9351
connortsui20 wants to merge 1 commit into
ct/row-fn-tensor-productsfrom
ct/row-fn-benchmark-tools

Automate RowFn benchmark comparisons

d9c3394
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis failed Aug 20, 2026 in 0s

1 benchmark regressed

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 91 improved benchmarks
❌ 1 regressed benchmark
✅ 1885 untouched benchmarks
🆕 19 new benchmarks
⏩ 478 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime words_gather_scalar[65536] 8.3 µs 9.4 µs -11.85%
⚡ Simulation or_chain[1024] 2.4 ms 1.5 ms +61.83%
⚡ Simulation or_chain[16] 2.3 ms 1.4 ms +60.63%
⚡ Simulation add_i64_nullable 320.4 µs 199.5 µs +60.6%
⚡ Simulation mul_i32_nullable 233.3 µs 148.4 µs +57.24%
⚡ Simulation mul_u8_nonnull 102.2 µs 65.1 µs +57.04%
⚡ Simulation case_when_nary_10_conditions[1000] 606.6 µs 393.5 µs +54.14%
⚡ Simulation int_gt[16] 157.6 µs 111.5 µs +41.31%
⚡ Simulation int_gt[1024] 164.9 µs 118.4 µs +39.34%
⚡ Simulation case_when_nary_equality_lookup[1000] 424.1 µs 306 µs +38.58%
⚡ Simulation mul_i32_constant 130 µs 94.9 µs +36.91%
⚡ Simulation or_chain[8192] 3.7 ms 2.7 ms +36.8%
⚡ Simulation baseline_lt[4, 1024] 131.2 µs 97.5 µs +34.51%
⚡ Simulation case_when_nary_10_conditions[10000] 984.4 µs 734.5 µs +34.01%
⚡ Simulation int_gt[8192] 225.6 µs 169.5 µs +33.1%
⚡ Simulation case_when_nary_early_dominant[1000] 295.5 µs 224.5 µs +31.64%
⚡ Simulation baseline_eq[4, 1024] 127.4 µs 96.9 µs +31.52%
⚡ Simulation case_when_nary_3_conditions[1000] 297.5 µs 227.1 µs +30.98%
⚡ Simulation baseline_lt[16, 1024] 128.7 µs 98.7 µs +30.41%
⚡ Simulation baseline_eq[16, 1024] 128.6 µs 98.8 µs +30.09%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ct/row-fn-benchmark-tools (d9c3394) with ct/row-fn-tensor-products (c1382ba)2

Open in CodSpeed

Footnotes

  1. 478 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on ct/row-fn-tensor-products (7152a1c) during the generation of this report, so 597702a was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

View more details on CodSpeed HQ