Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/ML-GSAI/LLaDA
/ functions
Functions
3,438 in github.com/ML-GSAI/LLaDA
⨍
Functions
3,438
◇
Types & classes
889
↳
Endpoints
19
↓ 2 callers
Method
is_change
Check if there is change in the response in the form of *change me*.
opencompass/opencompass/datasets/IFEval/instructions.py:709
↓ 2 callers
Function
is_equiv
(str1, str2, verbose=False)
opencompass/opencompass/datasets/medbench/math_equivalence.py:147
↓ 2 callers
Method
is_interval
(self, epr)
opencompass/opencompass/datasets/OlympiadBench.py:375
↓ 2 callers
Function
is_section_row
(row: List[str])
opencompass/opencompass/summarizers/multi_model.py:43
↓ 2 callers
Method
judge
(self, expression1, expression2, precision=1e-8)
opencompass/opencompass/datasets/OlympiadBench.py:326
↓ 2 callers
Function
launch
Launch a single task. Args: task (BaseTask): Task to launch. tokens (SyncManager.Semaphore): Multiprocessing semaphore
opencompass/opencompass/runners/local_api.py:95
↓ 2 callers
Method
load
(path: str, name: str, local_mode: bool = False)
opencompass/opencompass/datasets/ceval.py:18
↓ 2 callers
Method
load
(path: str)
opencompass/opencompass/datasets/triviaqa.py:20
↓ 2 callers
Method
load
(path)
opencompass/opencompass/datasets/piqa.py:35
↓ 2 callers
Method
load
(path)
opencompass/opencompass/datasets/winogrande.py:18
↓ 2 callers
Method
load
(path: str, name: str)
opencompass/opencompass/datasets/arc.py:17
↓ 2 callers
Method
load
(path: str, name: str, **kwargs)
opencompass/opencompass/datasets/mmlu.py:18
↓ 2 callers
Method
load
(path)
opencompass/opencompass/datasets/siqa.py:35
↓ 2 callers
Method
load
Load dataset. Args: path(str): Data path of the dataset. libs(Optional[Union[str, list]]): All the libraries to be
opencompass/opencompass/datasets/ds1000.py:89
↓ 2 callers
Method
load
(path: str, index: str)
opencompass/opencompass/datasets/lawbench/lawbench.py:21
↓ 2 callers
Method
load
(path: str, dataset_splits: List[str] = [ 'CNMO', 'CCEE',
opencompass/opencompass/datasets/livemathbench/livemathbench.py:31
↓ 2 callers
Method
load
( path: str, dataset: str = 'squad', max_seq_length: int = 4096, tokenizer_mod
opencompass/opencompass/datasets/ruler/ruler_qa.py:22
↓ 2 callers
Method
load_contamination_annotations
(path, split='val')
opencompass/opencompass/datasets/ceval.py:46
↓ 2 callers
Method
load_contamination_annotations
(path, split='val')
opencompass/opencompass/datasets/mmlu.py:64
↓ 2 callers
Function
load_dataset
(dataset_name, setting_name, parent_path, prompt_path=None,
opencompass/opencompass/datasets/medbench/dataset_loader.py:228
↓ 2 callers
Function
load_datasets
(source, conf)
opencompass/tests/dataset/test_ms_datasets.py:94
↓ 2 callers
Function
load_datasets
(source, conf)
opencompass/tests/dataset/test_local_datasets.py:94
↓ 2 callers
Function
load_datasets_conf
(source)
opencompass/tests/dataset/test_ms_datasets.py:88
↓ 2 callers
Method
load_single
(src_path, tgt_path, src_lang, tgt_lang)
opencompass/opencompass/datasets/flores.py:17
↓ 2 callers
Function
load_yaml
Load a YAML file.
opencompass/opencompass/datasets/korbench/korbench_utils.py:10
↓ 2 callers
Function
load_yaml
Load a YAML file.
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:10
↓ 2 callers
Function
lower
(text)
opencompass/opencompass/datasets/longbench/evaluators.py:28
↓ 2 callers
Function
main
()
opencompass/opencompass/cli/main.py:247
↓ 2 callers
Method
make_circular_dataset
(dataset, circular_patterns, option_keys, answer_key, answer_key_switch_method)
opencompass/opencompass/datasets/circular.py:90
↓ 2 callers
Function
make_code_execution_prompt
(code, input, cot)
opencompass/opencompass/datasets/livecodebench/prompts.py:73
↓ 2 callers
Function
master_convert
The only function needed to convert a LaTeX string into a SymPy expression. Args: s (str): The input LaTeX string. It should be a val
opencompass/opencompass/datasets/phybench/latex_pre_process.py:504
↓ 2 callers
Method
merge
(self, summarizer: 'MultiModelSummarizer')
opencompass/opencompass/summarizers/multi_model.py:274
↓ 2 callers
Method
metric_max_over_ground_truths
(self, metric_fn, prediction, ground_truths)
opencompass/opencompass/datasets/tydiqa.py:61
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/opencompass/summarizers/default.py:22
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/opencompass/summarizers/subjective/common_summarizer.py:20
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/opencompass/summarizers/subjective/compass_arena.py:20
↓ 2 callers
Function
normalize
Lower text and remove punctuation, articles and extra whitespace.
opencompass/opencompass/datasets/drop_simple_eval.py:18
↓ 2 callers
Function
normalize_answer
Lower text and remove punctuation, articles and extra whitespace.
opencompass/opencompass/datasets/longbench/evaluators.py:15
↓ 2 callers
Function
normalize_zh_answer
Lower text and remove punctuation, extra whitespace.
opencompass/opencompass/datasets/longbench/evaluators.py:34
↓ 2 callers
Function
number_it
(num)
opencompass/opencompass/datasets/TheoremQA/number_utils.py:50
↓ 2 callers
Function
pad_array_with_value
(array, target_shape, pad_value)
opencompass/opencompass/datasets/arc_prize_public_evaluation.py:185
↓ 2 callers
Function
parse_dataset_cfg
(dataset_cfg: ConfigDict)
opencompass/tools/prompt_viewer.py:44
↓ 2 callers
Method
parse_formula
(self, formula_str: str)
opencompass/opencompass/datasets/srbench.py:98
↓ 2 callers
Function
parse_math_answer
(setting_name, raw_string)
opencompass/opencompass/datasets/agieval/post_process.py:92
↓ 2 callers
Function
parse_qa_multiple_answer
(string)
opencompass/opencompass/datasets/medbench/post_process.py:170
↓ 2 callers
Function
parse_require_file
(fpath)
opencompass/setup.py:74
↓ 2 callers
Method
parse_xml_to_dict
(self, xml_string)
opencompass/opencompass/datasets/NPHardEval/p_BSP.py:84
↓ 2 callers
Function
patch_fileio
(global_vars=None)
opencompass/opencompass/utils/fileio.py:180
↓ 2 callers
Function
post_process
Input a string like below: xxx[[5]]xxx, and extract the score
opencompass/opencompass/datasets/subjective/commonbench.py:11
↓ 2 callers
Method
predict_win_rate
Predict win rates between all models using their ELO ratings. Args: ratings_df (pd.DataFrame): DataFrame containing model ratings
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:950
↓ 2 callers
Function
preprocess_for_bt
In BT we only need the unique (matchup,outcome) sets along with the weights of how often they occur.
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:63
↓ 2 callers
Function
preprocess_for_style
( df, apply_ratio: List[int] = None, style_variables: List[str] = STYLE_CONTROL_VARIABLES_V1,
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:87
↓ 2 callers
Function
print_prompts
(model_cfg, dataset_cfg, count=1)
opencompass/tools/prompt_viewer.py:51
↓ 2 callers
Function
process_edits
(edits, args)
opencompass/opencompass/datasets/lawbench/utils/compare_m2_for_evaluation.py:165
↓ 2 callers
Function
process_hdf5_datagroup
(group)
opencompass/opencompass/datasets/scicode.py:88
↓ 2 callers
Function
process_hdf5_sparse_matrix
(group)
opencompass/opencompass/datasets/scicode.py:68
↓ 2 callers
Function
process_symbol_in_dict
(dict)
opencompass/opencompass/datasets/scicode.py:176
↓ 2 callers
Function
publish_image_to_local
(image_base64: str)
opencompass/opencompass/lagent/actions/ipython_interpreter.py:278
↓ 2 callers
Function
read_jsonl
(path)
opencompass/opencompass/datasets/agieval/utils.py:5
↓ 2 callers
Function
read_jsonl
(path)
opencompass/opencompass/datasets/medbench/utils.py:5
↓ 2 callers
Method
read_jsonl
Read a JSONL file and return its contents as a list of dictionaries. Args: file_path: Path to the JSONL file Returns:
opencompass/opencompass/utils/fileio.py:54
↓ 2 callers
Method
readline
(self, *args, **kwargs)
opencompass/opencompass/datasets/mbpp.py:222
↓ 2 callers
Method
register_module
( self, name: Optional[Union[str, List[str]]] = None, force: bool = True,
opencompass/opencompass/registry.py:10
↓ 2 callers
Function
remove_articles
(text)
opencompass/opencompass/datasets/lveval/evaluators.py:150
↓ 2 callers
Function
remove_commas_and_spaces
(s)
opencompass/opencompass/datasets/korbench/korbench_utils.py:393
↓ 2 callers
Function
remove_commas_and_spaces
(s)
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:393
↓ 2 callers
Function
remove_few_shot_prefix
(string: str)
opencompass/opencompass/datasets/agieval/post_process.py:17
↓ 2 callers
Function
remove_few_shot_prefix
(string: str)
opencompass/opencompass/datasets/medbench/post_process.py:17
↓ 2 callers
Function
remove_invisible_chars
Remove invisible characters.
opencompass/opencompass/datasets/mathbench.py:238
↓ 2 callers
Function
remove_overall_brace
Remove the overall {xxx} brace.
opencompass/opencompass/datasets/phybench/latex_pre_process.py:200
↓ 2 callers
Function
remove_punc
(text)
opencompass/opencompass/datasets/longbench/evaluators.py:24
↓ 2 callers
Function
removesuffix
(s, suffix)
opencompass/opencompass/datasets/PMMEval/mifeval_utils/detectable_format_checker.py:12
↓ 2 callers
Function
reset_std
Reset stdout and stderr, also change logger stream handler.
opencompass/opencompass/runners/local_api.py:77
↓ 2 callers
Function
rule5_normalize_content
(content)
opencompass/opencompass/datasets/korbench/korbench_utils.py:380
↓ 2 callers
Function
rule5_normalize_content
(content)
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:380
↓ 2 callers
Method
rule5_normalize_content
Normalizes content for rule 5. Args: content (str): The content to normalize. Returns: list: Sorted list of
opencompass/opencompass/openicl/icl_evaluator/icl_korbench_evaluator.py:246
↓ 2 callers
Method
run
(self, cur_model=None, cur_model_abbr=None)
opencompass/opencompass/tasks/openicl_infer.py:64
↓ 2 callers
Method
run_judge_pair
(self, prompt_template, system_prompt, question, answer_a, answer_b, reference)
opencompass/opencompass/datasets/leval/evaluators.py:30
↓ 2 callers
Method
save
(self, idx, **kwargs)
opencompass/opencompass/datasets/livemathbench/livemathbench.py:304
↓ 2 callers
Method
save_multiround_results
(self, origin_prompt: list, prediction: str,
opencompass/opencompass/openicl/icl_inferencer/icl_agent_inferencer.py:41
↓ 2 callers
Method
save_multiround_results
(self, origin_prompt: list, prediction: str,
opencompass/opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:149
↓ 2 callers
Method
save_results
(self, origin_prompt: list, prediction: str, id
opencompass/opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:135
↓ 2 callers
Function
save_results_to_plots
(txt_results_save_path, mean=False)
opencompass/opencompass/summarizers/needlebench.py:206
↓ 2 callers
Method
score
( self, predictions, judgements: Optional[List] = None, references: Optional[L
opencompass/opencompass/openicl/icl_evaluator/lm_evaluator.py:163
↓ 2 callers
Method
set_history
(self, history)
opencompass/opencompass/models/lagent.py:42
↓ 2 callers
Function
simplify_edits
(sent, max_answer_num)
opencompass/opencompass/datasets/lawbench/utils/compare_m2_for_evaluation.py:135
↓ 2 callers
Method
split_by_comma
(self, expr: str)
opencompass/opencompass/datasets/OlympiadBench.py:297
↓ 2 callers
Function
split_or_expression
(expression)
opencompass/opencompass/datasets/korbench/korbench_utils.py:422
↓ 2 callers
Function
split_or_expression
(expression)
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:422
↓ 2 callers
Method
strip_changes
Strips off the changes.
opencompass/opencompass/datasets/IFEval/instructions.py:714
↓ 2 callers
Function
strip_string
(string)
opencompass/opencompass/datasets/math_intern.py:257
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/opencompass/datasets/apps.py:767
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/opencompass/datasets/taco.py:717
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/opencompass/datasets/livecodebench/testing_util.py:650
↓ 2 callers
Function
sum_lengths
(sentences)
opencompass/opencompass/datasets/babilong/babilong_utils.py:111
↓ 2 callers
Function
swallow_io
()
opencompass/opencompass/datasets/mbpp.py:194
↓ 2 callers
Method
sympy_sub_pi
(self, expression_sympy)
opencompass/opencompass/datasets/OlympiadBench.py:378
↓ 2 callers
Function
sympy_to_tree
Convert a SymPy expression into a tree structure. This function takes a SymPy expression and recursively converts it into a tree represen
opencompass/opencompass/datasets/phybench/EED.py:146
↓ 2 callers
Function
time_limit
(seconds: float)
opencompass/opencompass/datasets/mbpp.py:203
↓ 2 callers
Method
to_dict
(self)
opencompass/opencompass/datasets/agieval/constructions.py:61
← previous
next →
401–500 of 3,438, ranked by callers