Skip to content

Batch vLLM reranker scoring across queries - #2439

Open
jioffe502 wants to merge 1 commit into
NVIDIA:mainfrom
jioffe502:jioffe502/reranker-score-batching
Open

Batch vLLM reranker scoring across queries#2439
jioffe502 wants to merge 1 commit into
NVIDIA:mainfrom
jioffe502:jioffe502/reranker-score-batching

perf(rerank): batch vLLM pair scoring across queries

2472d00
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar