MCPcopy Create free account

hub / github.com/ML-GSAI/LLaDA / functions

Functions3,438 in github.com/ML-GSAI/LLaDA

↓ 1 callersFunctionexact_match_score
(predicted_text, original_text)
opencompass/opencompass/datasets/benbench.py:46
↓ 1 callersMethodexecute_code
Orchestrates compilation and execution.
opencompass/opencompass/datasets/codecompass/executor.py:116
↓ 1 callersFunctionexists
(path)
opencompass/opencompass/utils/fileio.py:226
↓ 1 callersFunctionexp_frac
(s)
opencompass/opencompass/datasets/phybench/latex_pre_process.py:215
↓ 1 callersFunctionextract_all_responses_from_json
(response_json)
opencompass/opencompass/datasets/korbench/korbench_utils.py:319
↓ 1 callersFunctionextract_all_responses_from_json
(response_json)
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:319
↓ 1 callersFunctionextract_answer
Extract answer from toolbench format.
opencompass/opencompass/openicl/icl_evaluator/icl_agent_evaluator.py:36
↓ 1 callersFunctionextract_answer
(answer, calid)
opencompass/opencompass/datasets/MedCalc_Bench.py:73
↓ 1 callersFunctionextract_answer
(response_text: str)
opencompass/opencompass/datasets/math.py:134
↓ 1 callersFunctionextract_answer
(model_response, item, prompt_style, type)
opencompass/opencompass/datasets/calm/evaluation/labeling/Natural.py:13
↓ 1 callersFunctionextract_answer
(js)
opencompass/opencompass/datasets/agieval/utils.py:27
↓ 1 callersFunctionextract_answer
(js)
opencompass/opencompass/datasets/medbench/utils.py:27
↓ 1 callersMethodextract_answer
(cls, pred: str, extract_last_num=False)
opencompass/opencompass/datasets/math_intern.py:137
↓ 1 callersFunctionextract_archive
(from_path, to_path=None, remove_finished=False)
opencompass/opencompass/utils/fileio.py:480
↓ 1 callersFunctionextract_boxed_answer
(pred_str, strip_double_curly_brace=False)
opencompass/opencompass/datasets/math_intern.py:51
↓ 1 callersFunctionextract_boxed_answer
(text)
opencompass/opencompass/datasets/gaokao_math.py:66
↓ 1 callersFunctionextract_boxed_latex
提取 \\boxed{...} 中的表达式(支持嵌套括号)。
opencompass/opencompass/datasets/phybench/box_extract.py:1
↓ 1 callersFunctionextract_bracket_content
(s: str, bracket_position: int)
opencompass/opencompass/datasets/phybench/latex_pre_process.py:35
↓ 1 callersFunctionextract_choice
r"""{ "answer": "A|B|C|D" }
opencompass/opencompass/datasets/PMMEval/mlogiqa.py:27
↓ 1 callersFunctionextract_choice
r"""{ "answer": "A|B|C|D" }
opencompass/opencompass/datasets/PMMEval/mhellaswag.py:27
↓ 1 callersFunctionextract_choice
r"""{ "answer": "A|B|C|D" }
opencompass/opencompass/datasets/PMMEval/xnli.py:28
↓ 1 callersFunctionextract_choice
r"""{ "answer": "A|B|C|D" }
opencompass/opencompass/datasets/PMMEval/mmmlu.py:27
↓ 1 callersFunctionextract_choice_fuzzy
(gen)
opencompass/opencompass/datasets/PMMEval/mlogiqa.py:60
↓ 1 callersFunctionextract_choice_fuzzy
(gen, lang)
opencompass/opencompass/datasets/PMMEval/mhellaswag.py:59
↓ 1 callersFunctionextract_choice_fuzzy
(gen, lang)
opencompass/opencompass/datasets/PMMEval/xnli.py:60
↓ 1 callersFunctionextract_choice_fuzzy
(gen)
opencompass/opencompass/datasets/PMMEval/mmmlu.py:59
↓ 1 callersMethodextract_code
(command: str)
opencompass/opencompass/lagent/actions/python_interpreter.py:88
↓ 1 callersFunctionextract_code_execution
(model_output: str, cot: bool = False)
opencompass/opencompass/datasets/livecodebench/extract_utils.py:43
↓ 1 callersFunctionextract_code_generation
(model_output: str, model_type: str = 'chat')
opencompass/opencompass/datasets/livecodebench/extract_utils.py:6
↓ 1 callersFunctionextract_code_generation
(model_output: str, entrypoint: Optional[str] = None)
opencompass/opencompass/datasets/bigcodebench/extractor.py:182
↓ 1 callersFunctionextract_code_generation_v2
(model_output: str, model_type: str = 'chat')
opencompass/opencompass/datasets/livecodebench/extract_utils.py:22
↓ 1 callersFunctionextract_command
extract the command name from a bracket.
opencompass/opencompass/datasets/phybench/latex_pre_process.py:79
↓ 1 callersFunctionextract_cpp_code
Extract Cpp Code.
opencompass/opencompass/datasets/codecompass/utils.py:1
↓ 1 callersFunctionextract_dicts
(data)
opencompass/opencompass/openicl/icl_evaluator/lm_evaluator.py:18
↓ 1 callersFunctionextract_first_numeric_score
extract the first numeric score from the score text Args: score_text (str): the text containing the score Returns:
opencompass/opencompass/datasets/eese/utils.py:6
↓ 1 callersFunctionextract_json
(text)
opencompass/opencompass/datasets/korbench/korbench_utils.py:305
↓ 1 callersFunctionextract_judge_label
(text)
opencompass/opencompass/datasets/livemathbench/utils.py:4
↓ 1 callersFunctionextract_last_equal_content
Extract the content after the last occurrence of specific mathematical comparison or assignment operators. :param strip_whitespace: If True,
opencompass/opencompass/datasets/phybench/latex_pre_process.py:334
↓ 1 callersMethodextract_matching_bracket
(cls, target_str: str)
opencompass/opencompass/datasets/math_intern.py:116
↓ 1 callersFunctionextract_missing_rating
(text, search_type)
opencompass/opencompass/summarizers/subjective/alignmentbench.py:53
↓ 1 callersFunctionextract_missing_rating
(text, search_type)
opencompass/opencompass/datasets/subjective/alignbench.py:154
↓ 1 callersFunctionextract_prediction
(output, options=None, option_inds='ABCDEFGH')
opencompass/opencompass/datasets/tabmwp.py:106
↓ 1 callersFunctionextract_predictions_from_json
(input_folder)
opencompass/tools/convert_alignmentbench.py:10
↓ 1 callersFunctionextract_prob
(model_response, prompt_style, type)
opencompass/opencompass/datasets/calm/evaluation/labeling/Probability.py:14
↓ 1 callersMethodextract_python_script
(self, response: str)
opencompass/opencompass/datasets/scicode.py:235
↓ 1 callersMethodextract_rate
This function is designed for calculating the extraction rate. Args: results (dict): The result dict, include the information
opencompass/opencompass/tasks/openicl_eval.py:333
↓ 1 callersFunctionextract_rating
(text)
opencompass/opencompass/summarizers/subjective/alignmentbench.py:89
↓ 1 callersFunctionextract_rating
(text)
opencompass/opencompass/datasets/subjective/alignbench.py:172
↓ 1 callersFunctionextract_rating_plus
(text)
opencompass/opencompass/summarizers/subjective/alignmentbench.py:71
↓ 1 callersFunctionextract_score
(text)
opencompass/opencompass/datasets/subjective/alignbench.py:212
↓ 1 callersFunctionextract_target_code_or_empty
(code: str, entrypoint: Optional[str] = None)
opencompass/opencompass/datasets/bigcodebench/extractor.py:114
↓ 1 callersFunctionextract_test_output_code
(model_output: str)
opencompass/opencompass/datasets/livecodebench/extract_utils.py:64
↓ 1 callersFunctionextract_theoremqa_answer
(pred: str, answer_flag: bool = True)
opencompass/opencompass/datasets/TheoremQA/utils.py:19
↓ 1 callersMethodextract_toxicity_attributes
Given a response from PerspectiveAPI, return scores in dict. Args: text: Text to perform evaluation. Returns:
opencompass/opencompass/openicl/icl_evaluator/icl_toxic_evaluator.py:79
↓ 1 callersMethodextract_winner
(self, s, lan)
opencompass/opencompass/openicl/icl_evaluator/icl_judge_evaluator.py:264
↓ 1 callersFunctionfast_map_dpp
fast implementation of the greedy algorithm reference: https://github.com/laming-chen/fast-map-dpp/blob/master/dpp_test.py paper: Fast Greedy
opencompass/opencompass/openicl/icl_retriever/icl_dpp_retriever.py:103
↓ 1 callersFunctionfill_eval_cfg
(cfg, args)
opencompass/opencompass/utils/run.py:389
↓ 1 callersFunctionfill_infer_cfg
(cfg, args)
opencompass/opencompass/utils/run.py:361
↓ 1 callersMethodfind_FinishAction
(self, text)
opencompass/opencompass/datasets/teval/evaluators/reason_retrieve_understand_evaluator.py:168
↓ 1 callersMethodfind_a_dot_b_structure
(self, text)
opencompass/opencompass/datasets/teval/evaluators/reason_retrieve_understand_evaluator.py:163
↓ 1 callersFunctionfirst_option_postprocess
Find first valid option for text.
opencompass/opencompass/datasets/mathbench.py:154
↓ 1 callersFunctionfirst_pre_process
Perform the first stage of LaTeX string preprocessing. if not brackets_balanced(s): raise ValueError("The input string has unbalanced bra
opencompass/opencompass/datasets/phybench/latex_pre_process.py:364
↓ 1 callersFunctionfirsttime_process
(args)
opencompass/opencompass/datasets/lawbench/utils/parallel_to_m2.py:84
↓ 1 callersFunctionfit_bt
(matchups, outcomes, weights, n_models, alpha, tol=1e-6)
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:260
↓ 1 callersFunctionfit_contextual_bt
( matchups, features, outcomes, models, idxs=None, alpha=math.
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:411
↓ 1 callersFunctionfit_vectorized_elo
Fit multiple sets of Elo ratings on different samples of the data at the same time.
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:172
↓ 1 callersFunctionfix_a_slash_b
(string)
opencompass/opencompass/datasets/math_intern.py:217
↓ 1 callersFunctionfix_fracs
(string)
opencompass/opencompass/datasets/math_intern.py:185
↓ 1 callersFunctionfix_sqrt
(string)
opencompass/opencompass/datasets/math_intern.py:242
↓ 1 callersFunctionflatten_data
(data)
opencompass/opencompass/summarizers/subjective/subjective.py:13
↓ 1 callersMethodflip_dict_levels
Flips the two levels of a nested dictionary so that dict[lvl1][lvl2] becomes dict[lvl2][lvl1]. Args: original_dict (dict)
opencompass/opencompass/summarizers/subjective/compass_arena_bradley_terry.py:931
↓ 1 callersFunctionformat_chat_history
Format chat history for the LLaDA model Args: history: List of [user_message, assistant_message] pairs Returns:
app.py:42
↓ 1 callersMethodformat_details
This function is responsible for formatting prediction details. Args: predictions (list): The prediction list. refere
opencompass/opencompass/tasks/openicl_eval.py:352
↓ 1 callersFunctionformat_testcase_func_name_input
Use the form of "assert func_name(input) == ".
opencompass/opencompass/datasets/livecodebench/prompts.py:137
↓ 1 callersFunctionforward_process
(batch, prompt_index, mask_id)
get_log_likelihood.py:7
↓ 1 callersFunctionfuzzy_match
(s1: str, s2: str)
opencompass/opencompass/datasets/drop_simple_eval.py:28
↓ 1 callersMethodgcpCheck
(self, dimacs_str, answer_str)
opencompass/opencompass/datasets/NPHardEval/hard_GCP.py:117
↓ 1 callersMethodgcp_decision_check
Check if the given GCP instance is feasible with k_colors. :param dimacs_str: The DIMACS format string of the GCP instance. :param an
opencompass/opencompass/datasets/NPHardEval/cmp_GCP_D.py:147
↓ 1 callersMethodgcp_greedy_solution
Provides a greedy solution to the GCP problem. :param adjacency_list: A dictionary of the adjacency list. :return: A tuple of (num_co
opencompass/opencompass/datasets/NPHardEval/cmp_GCP_D.py:132
↓ 1 callersFunctiongen_packages_items
()
opencompass/setup.py:82
↓ 1 callersFunctiongenerate
Args: model: Mask predictor. prompt: A tensor of shape (1, l). steps: Sampling steps, less than or equal to gen_lengt
visualization/generate.py:42
↓ 1 callersMethodgenerate
Generate results given a list of inputs. Args: inputs (List[str]): A list of strings. max_out_len (int): The maximum
opencompass/opencompass/models/base.py:53
↓ 1 callersMethodgenerate
(self, inputs: List[str], max_out_len: int, min_out_len: Op
opencompass/opencompass/models/huggingface_above_v4_33.py:542
↓ 1 callersMethodgenerate
Generate results given a list of inputs. Args: inputs (List[PromptType]): A list of strings or PromptDicts. The P
opencompass/opencompass/models/xunfei_api.py:101
↓ 1 callersFunctiongenerate_balanced_list
(length)
opencompass/opencompass/datasets/judge/judgerbenchv2.py:97
↓ 1 callersMethodgenerate_header
生成请求头参数. :param content_type: :param accept: :return:
opencompass/opencompass/models/yayi_api.py:130
↓ 1 callersMethodgenerate_input_field_prompt
Generate a prompt for the input field based on the provided :obj:`entry` data. Args: entry (:obj:`Dict`): A piece of data
opencompass/opencompass/openicl/icl_dataset_reader.py:99
↓ 1 callersMethodgenerate_output_field_prompt
Generate a prompt for the output field based on the provided :obj:`entry` data. Args: entry (:obj:`Dict`): A piece of dat
opencompass/opencompass/openicl/icl_dataset_reader.py:140
↓ 1 callersMethodgenerate_prompt_and_label_for_generate_task
Generate the prompt and the label info for one test example in generative evaluation with `prompt_template`. If `prompt_template` is n
opencompass/opencompass/openicl/icl_retriever/icl_base_retriever.py:210
↓ 1 callersFunctiongenerate_question_list
Generates a list of questions from the dataset based on the specified prompt style. Args: dataset_path (str): The path to the dataset
opencompass/opencompass/datasets/calm/data_processing/generate_questions.py:152
↓ 1 callersFunctiongenerate_random_string
生成随机串. :param length: 随机串长度,默认为 16 :return: 随机串
opencompass/opencompass/models/yayi_api.py:20
↓ 1 callersFunctiongenerate_response_with_visualization
Generate text with LLaDA model with visualization using the same sampling as in generate.py Args: messages: List of message dict
app.py:94
↓ 1 callersMethodgenerate_samples
返回在定义域内的样本点 (x0, x1)
opencompass/opencompass/datasets/srbench.py:149
↓ 1 callersMethodgenerate_signature
生成签名. :param method: :param accept: :param content_type: :param date: :param url_path: :return:
opencompass/opencompass/models/yayi_api.py:112
↓ 1 callersFunctiongenerate_step_visualization
Final visualization version (completely borderless)
visualization/visualization_zhihu.py:90
↓ 1 callersFunctiongenerate_step_visualization
Generate visualization for specific step
visualization/visualization_paper.py:83
↓ 1 callersFunctiongenerate_table
(data_list, title=None)
opencompass/docs/zh_cn/statis.py:86
↓ 1 callersFunctiongenerate_table
(data_list, title=None)
opencompass/docs/en/statis.py:88
↓ 1 callersFunctionget_accuracy
(judged_answers)
opencompass/opencompass/summarizers/subjective/charm.py:102
↓ 1 callersMethodget_action
(self, step)
opencompass/opencompass/datasets/ds1000_interpreter.py:42
← previousnext →901–1,000 of 3,438, ranked by callers