-
Notifications
You must be signed in to change notification settings - Fork 335
Pull requests: huggingface/evaluate
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix: stop ASR generation_kwargs leaking across compute calls
#799
opened Aug 17, 2026 by
tonycoder-hub
Loading…
fix: treat sentiment-analysis and text-classification as the same evaluator task
#798
opened Aug 17, 2026 by
tonycoder-hub
Loading…
fix: score HONEST sentence completions with the sentence scorer
#797
opened Aug 17, 2026 by
tonycoder-hub
Loading…
Fix text2text generation_kwargs leaking across compute calls
#796
opened Aug 17, 2026 by
tonycoder-hub
Loading…
Fix McNemar ZeroDivisionError when models have no discordant pairs
#795
opened Aug 17, 2026 by
tonycoder-hub
Loading…
fix: list the same stripped strings that text_duplicates counts
#794
opened Aug 17, 2026 by
tonycoder-hub
Loading…
2 tasks done
fix: compute radar_plot axis padding from the original range
#793
opened Aug 17, 2026 by
tonycoder-hub
Loading…
2 tasks done
docs: stop listing BLEURT checkpoint as a compute() argument
#792
opened Aug 17, 2026 by
tonycoder-hub
Loading…
fix: evaluate-cli import error with huggingface-hub 1.0.0
#791
opened Aug 17, 2026 by
tonycoder-hub
Loading…
Fix BERTScore OverflowError when the tokenizer has no model_max_length
#790
opened Aug 17, 2026 by
tonycoder-hub
Loading…
fix(perplexity): use all_special_tokens for GPT-2 tokenizer compatibility
#789
opened Aug 16, 2026 by
akaashsa
Loading…
Fix typo and document normalize values in confusion_matrix README
#788
opened Aug 9, 2026 by
RudrenduPaul
Loading…
Use per-dimension mean (axis=0) in mahalanobis metric
#786
opened Aug 6, 2026 by
uttam12331
Loading…
Add Expected Calibration Error (ECE) metric using netcal
#785
opened Jul 31, 2026 by
itsfernn
Loading…
Add financial_llm_faithfulness metric for regulated financial AI evaluation
#783
opened Jul 25, 2026 by
priyanka25aug
Loading…
1 of 5 tasks
Add Retrieval-Conditioned Confidence Metric (RCCS) for RAG evaluation
#782
opened Jul 13, 2026 by
AIMindCrafter
Loading…
feat(module): add EvaluationModuleError to public API and wrap _compute exceptions
#779
opened Jul 8, 2026 by
rityagodala
Loading…
Add behavioral_drift: fine-tuning output integrity metric beyond loss curves
#778
opened Jul 8, 2026 by
YuhaoLin2005
Loading…
Fix evaluator task validation for text2text-generation, summarization, and translation
#775
opened Jul 5, 2026 by
zanvari
Loading…
export EvaluationModuleError and wrap _compute failures
#774
opened Jul 4, 2026 by
RavSinghChandan
Loading…
Previous Next
ProTip!
Exclude everything labeled
bug with -label:bug.