Functions — github.com/huggingface/evaluate

CodeHub MCPcopy Create free account

hub / github.com/huggingface/evaluate / functions

Functions785 in github.com/huggingface/evaluate

⨍ Functions 785◇ Types & classes 150↳ Endpoints 6

Method_download_and_prepare

(self, dl_manager)

metrics/bleurt/bleurt.py:98

Method_download_and_prepare

(self, dl_manager)

metrics/frugalscore/frugalscore.py:73

Method_download_and_prepare

(self, dl_manager)

metrics/meteor/meteor.py:119

Method_download_and_prepare

(self, dl_manager)

metrics/comet/comet.py:152

Method_get_modification_time

src/evaluate/loading.py:540

Function_http_ci_user_agent

(*args, **kwargs)

tests/conftest.py:34

templates/{{ cookiecutter.module_slug }}/{{ cookiecutter.module_slug }}.py:64

measurements/word_count/word_count.py:49

measurements/regard/regard.py:120

measurements/toxicity/toxicity.py:111

measurements/perplexity/perplexity.py:90

measurements/word_length/word_length.py:68

measurements/honest/honest.py:116

measurements/label_distribution/label_distribution.py:73

measurements/text_duplicates/text_duplicates.py:64

metrics/wiki_split/wiki_split.py:325

metrics/roc_auc/roc_auc.py:147

metrics/sari/sari.py:262

metrics/bleurt/bleurt.py:81

metrics/trec_eval/trec_eval.py:74

metrics/confusion_matrix/confusion_matrix.py:64

metrics/xtreme_s/xtreme_s.py:250

metrics/rl_reliability/rl_reliability.py:88

metrics/seqeval/seqeval.py:104

metrics/cuad/cuad.py:73

metrics/pearsonr/pearsonr.py:88

metrics/frugalscore/frugalscore.py:59

metrics/r_squared/r_squared.py:69

metrics/wer/wer.py:79

metrics/indic_glue/indic_glue.py:107

metrics/mse/mse.py:90

metrics/cer/cer.py:122

metrics/coval/coval.py:274

metrics/matthews_correlation/matthews_correlation.py:103

metrics/nist_mt/nist_mt.py:89

metrics/spearmanr/spearmanr.py:101

metrics/mape/mape.py:86

metrics/xnli/xnli.py:71

metrics/recall/recall.py:97

metrics/smape/smape.py:128

metrics/google_bleu/google_bleu.py:129

metrics/squad_v2/squad_v2.py:92

metrics/ter/ter.py:155

metrics/mean_iou/mean_iou.py:278

metrics/mase/mase.py:96

metrics/mahalanobis/mahalanobis.py:62

metrics/meteor/meteor.py:93

metrics/competition_math/competition_math.py:70

metrics/character/character.py:96

metrics/perplexity/perplexity.py:89

metrics/accuracy/accuracy.py:82

metrics/bertscore/bertscore.py:102

metrics/f1/f1.py:107

metrics/mauve/mauve.py:96

metrics/comet/comet.py:129

metrics/poseval/poseval.py:85

metrics/sacrebleu/sacrebleu.py:107

metrics/precision/precision.py:107

metrics/code_eval/code_eval.py:136

metrics/exact_match/exact_match.py:88

metrics/chrf/chrf.py:128

metrics/charcut_mt/charcut_mt.py:69

metrics/mae/mae.py:86

metrics/rouge/rouge.py:95

metrics/super_glue/super_glue.py:149

metrics/brier_score/brier_score.py:89

metrics/bleu/bleu.py:89

metrics/glue/glue.py:107

metrics/squad/squad.py:70

comparisons/mcnemar/mcnemar.py:65

comparisons/exact_match/exact_match.py:49

comparisons/wilcoxon/wilcoxon.py:58

tests/test_metric.py:17

tests/test_metric.py:74

tests/test_metric.py:571

tests/test_metric.py:620

src/evaluate/module.py:63

Function_reset_library_root_logger

src/evaluate/utils/logging.py:73

Function_resumable_file_manager

src/evaluate/utils/file_utils.py:530

( func, func_args: Optional[tuple] = None, func_kwargs: Optional[dict] = None, exceptions: Typ

src/evaluate/utils/file_utils.py:248

Add one prediction and reference for each evaluation module's stack. Args: predictions (`list/array/tensor`, *optional*):

src/evaluate/module.py:895

Methodadd_batch

Add a batch of predictions and references for each evaluation module's stack. Args: predictions (`list/array/tensor`, *optional*)

src/evaluate/module.py:920

Functionadd_end_docstrings

src/evaluate/utils/file_utils.py:583

Functionadd_start_docstrings

src/evaluate/utils/file_utils.py:575

Methodargs_metric

src/evaluate/evaluator/base.py:140

Functionarrow_file

(tmp_path_factory, dataset)

tests/conftest.py:95

Functionarrow_path

(tmp_path_factory)

tests/conftest.py:237

Functionbert_cos_score_idf

(model, refs, *args, **kwargs)

tests/test_metric_common.py:190

Methodbuild_args_metric

(metric, key, **kwargs)

src/evaluate/evaluator/base.py:139

Functionbz2_csv_path

(csv_path, tmp_path_factory)

tests/conftest.py:267

Functionbz2_file

(tmp_path_factory)

tests/conftest.py:131

Functioncheck_correctness

Evaluates the functional correctness of a completion by running the test suite provided in the problem. :param completion_id: an optiona

metrics/code_eval/execute.py:28

Functioncheck_gold_parse_annotation

metrics/coval/coval.py:258

Methodchecked_fct

tests/test_metric.py:522

src/evaluate/module.py:109

Methodcodebase_urls

src/evaluate/module.py:129

Methodcollate_fn

tests/test_trainer_evaluator_parity.py:136

Functioncompute

src/evaluate/utils/gradio.py:109

Compute each evaluation module. Usage of positional arguments is not allowed to prevent mistakes. Args: predictions (`li

src/evaluate/module.py:944

( self, model_or_pipeline: Union[ str, "Pipeline", Callable, "PreTrainedModel", "T

src/evaluate/evaluator/text2text_generation.py:172

← previous next →401–500 of 785, ranked by callers