Skip to content

perf(gqh): GQH matvec for gfx1201 — greedy 28.7 tok/s, MTP n-max=2 50.3 tok/s - #1

Open
DeanoC wants to merge 2 commits into
feat/gqh-qtypesfrom
perf/gqh-multicol
Open

perf(gqh): GQH matvec for gfx1201 — greedy 28.7 tok/s, MTP n-max=2 50.3 tok/s#1
DeanoC wants to merge 2 commits into
feat/gqh-qtypesfrom
perf/gqh-multicol

perf(gqh): optimize the multi-column matvec for MTP verify batches (n…

f8dd7c3
Select commit
Loading
Failed to load commit list.

There are no checks for this commit