MCPcopy Create free account

hub / github.com/ML-GSAI/LLaDA / functions

Functions3,438 in github.com/ML-GSAI/LLaDA

⨍ Functions 3,438◇ Types & classes 889↳ Endpoints 19
↓ 1 callersFunctionget_answer
(problem)
opencompass/opencompass/datasets/tabmwp.py:43
↓ 1 callersFunctionget_answer_with_dollar_sign
(s)
opencompass/opencompass/datasets/agieval/post_process.py:137
↓ 1 callersFunctionget_answer_with_dollar_sign
(s)
opencompass/opencompass/datasets/medbench/post_process.py:137
↓ 1 callersFunctionget_answer_without_dollar_sign
(s)
opencompass/opencompass/datasets/agieval/post_process.py:147
↓ 1 callersFunctionget_answer_without_dollar_sign
(s)
opencompass/opencompass/datasets/medbench/post_process.py:147
↓ 1 callersMethodget_answers
(validated_answers)
opencompass/opencompass/datasets/drop.py:14
↓ 1 callersFunctionget_battles_from_judgment
(dataset, subdir_path, post_process, WEIGHT=3)
opencompass/opencompass/summarizers/subjective/arenahard.py:157
↓ 1 callersFunctionget_battles_from_judgment
(judged_answers, references, WEIGHT=3)
opencompass/opencompass/datasets/subjective/arena_hard.py:58
↓ 1 callersFunctionget_bootstrap_result
(battles, func_compute_elo, num_round)
opencompass/opencompass/summarizers/subjective/arenahard.py:64
↓ 1 callersFunctionget_bootstrap_result
(battles, func_compute_elo, num_round)
opencompass/opencompass/datasets/subjective/arena_hard.py:129
↓ 1 callersFunctionget_capability_results
(judged_answers, references, fout,
opencompass/opencompass/summarizers/subjective/alignmentbench.py:238
↓ 1 callersFunctionget_capability_results
( judged_answers, references, fout, fout_flag, model_abbr, judge_model_abbr, datas
opencompass/opencompass/summarizers/subjective/common_summarizer.py:40
↓ 1 callersFunctionget_capability_results
( judged_answers, references, fout, fout_flag, model_abbr, )
opencompass/opencompass/summarizers/subjective/wildbench.py:62
↓ 1 callersFunctionget_capability_results
(judged_answers, references, fout,
opencompass/opencompass/summarizers/subjective/multiround.py:52
↓ 1 callersFunctionget_capability_results
( judged_answers, references, fout, fout_flag, model, )
opencompass/opencompass/summarizers/subjective/all_obj.py:35
↓ 1 callersFunctionget_capability_results
( judged_answers, references, fout, fout_flag, model_abbr, )
opencompass/opencompass/summarizers/subjective/mtbench.py:54
↓ 1 callersFunctionget_capability_results
(judged_answers, references, categories=CATEGORIES)
opencompass/opencompass/datasets/subjective/alignbench.py:273
↓ 1 callersFunctionget_capability_results
(judged_answers, references)
opencompass/opencompass/datasets/subjective/commonbench.py:26
↓ 1 callersFunctionget_capability_results
( judged_answers, references, )
opencompass/opencompass/datasets/subjective/mtbench.py:233
↓ 1 callersMethodget_chat_list
(self, ice_idx_list: List[List[int]], retriever: BaseRetriever,
opencompass/opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:272
↓ 1 callersMethodget_cheapest_align_seq
回溯获得编辑距离最小的编辑序列
opencompass/opencompass/datasets/lawbench/utils/modules/alignment.py:311
↓ 1 callersFunctionget_check_prompt
(metadata)
opencompass/opencompass/datasets/livecodebench/prompts.py:173
↓ 1 callersFunctionget_choices
(problem)
opencompass/opencompass/datasets/tabmwp.py:47
↓ 1 callersFunctionget_circular_example
For given example, generate four circular examples.
opencompass/opencompass/datasets/needlebench/atc_choice.py:22
↓ 1 callersFunctionget_config_from_arg
Get the config object given args. Only a few argument combinations are accepted (priority from high to low) 1. args.config 2. args.models
opencompass/opencompass/utils/run.py:87
↓ 1 callersFunctionget_config_wrapper
()
opencompass/opencompass/datasets/korbench/korbench_utils.py:144
↓ 1 callersFunctionget_config_wrapper
()
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:144
↓ 1 callersFunctionget_current_time_gmt_format
获取当前时间的GMT 时间 :return:
opencompass/opencompass/models/yayi_api.py:58
↓ 1 callersFunctionget_current_timestamp
获取当前时间时间戳 :return:
opencompass/opencompass/models/yayi_api.py:42
↓ 1 callersMethodget_data
Get necessary data from problem path.
opencompass/opencompass/datasets/ds1000.py:52
↓ 1 callersFunctionget_data_path
(path, local_mode=False)
opencompass/opencompass/datasets/codecompass/CodeCompass.py:17
↓ 1 callersFunctionget_dataset_df
Preprocess babi text files.
opencompass/opencompass/datasets/babilong/babilong_utils.py:33
↓ 1 callersFunctionget_deps
(nodes: List[Tuple[str, Node]])
opencompass/opencompass/datasets/bigcodebench/extractor.py:49
↓ 1 callersFunctionget_dict_model_names
(nested_dict)
opencompass/opencompass/summarizers/needlebench.py:390
↓ 1 callersFunctionget_dimension_results
(judged_answers, references, fout, fout_flag, model)
opencompass/opencompass/summarizers/subjective/alignmentbench.py:203
↓ 1 callersMethodget_encoding_from_retriever_indices
( self, ice_idx_list: List[List[int]], retriever: BaseRetriever,
opencompass/opencompass/openicl/icl_inferencer/icl_sw_ce_loss_inferencer.py:191
↓ 1 callersMethodget_factor
(self, dataset: ConfigDict)
opencompass/opencompass/partitioners/size.py:164
↓ 1 callersMethodget_factor
(self, dataset: ConfigDict)
opencompass/opencompass/partitioners/sub_size.py:224
↓ 1 callersMethodget_facts
Get a list of LogicNodes from the tree. By default, you will get the explicit leaf nodes. :param include_cs: Include the commonsense
opencompass/opencompass/datasets/musr/tree.py:240
↓ 1 callersFunctionget_final_results
(judged_answers, references, output_dir, fout_flag, model, judgemodel)
opencompass/opencompass/summarizers/subjective/mtbench101.py:53
↓ 1 callersFunctionget_final_results
(judged_answers, references, origial_responses)
opencompass/opencompass/datasets/simpleqa.py:122
↓ 1 callersFunctionget_final_results
(parsed_judges: List[List[Dict]], references: List[List[str]], ori
opencompass/opencompass/datasets/sage/evaluation.py:58
↓ 1 callersFunctionget_final_results
(judged_answers, references)
opencompass/opencompass/datasets/subjective/mtbench101.py:349
↓ 1 callersFunctionget_final_results
(judged_answers, references, origial_responses)
opencompass/opencompass/datasets/livereasonbench/livereasonbench.py:127
↓ 1 callersFunctionget_first_brace_command
Find the first brace.
opencompass/opencompass/datasets/phybench/latex_pre_process.py:192
↓ 1 callersFunctionget_formatted_input
( context, question, examples, instruction, post_prompt, template=DEFAULT_TEMPLATE, )
opencompass/opencompass/datasets/babilong/prompts.py:17
↓ 1 callersFunctionget_function_dependency
(entrypoint: str, call_graph: Dict[str, str])
opencompass/opencompass/datasets/bigcodebench/extractor.py:66
↓ 1 callersMethodget_generation_prompt_list_and_label
( self, ice_idx_list: List[List[int]], retriever: BaseRetriever,
opencompass/opencompass/openicl/icl_inferencer/icl_inference_ppl_only_inferencer.py:185
↓ 1 callersMethodget_generation_prompt_list_from_retriever_indices
( self, ice_idx_list: List[List[int]], extra_prompt: dict, ret
opencompass/opencompass/openicl/icl_inferencer/icl_attack_inferencer.py:181
↓ 1 callersMethodget_generation_prompt_list_from_retriever_indices
( self, ice_idx_list: List[List[int]], retriever: BaseRetriever,
opencompass/opencompass/openicl/icl_inferencer/icl_mink_percent_inferencer.py:140
↓ 1 callersMethodget_generation_prompt_list_from_retriever_indices
( self, ice_idx_list: List[List[int]], retriever: BaseRetriever,
opencompass/opencompass/openicl/icl_inferencer/icl_ppl_only_inferencer.py:139
↓ 1 callersFunctionget_generic_question_template_answer_self_repair
(question: str, code, metadata)
opencompass/opencompass/datasets/livecodebench/prompts.py:170
↓ 1 callersFunctionget_generic_question_template_test_completion
(question_content, starter_code,
opencompass/opencompass/datasets/livecodebench/prompts.py:133
↓ 1 callersFunctionget_get_prompt_func
Returns the appropriate prompt generation function based on the given task. Args: task (str): The name of the task for which the prom
opencompass/opencompass/datasets/calm/data_processing/generate_questions.py:8
↓ 1 callersFunctionget_gt_label
(item)
opencompass/opencompass/datasets/calm/evaluation/labeling/AS.py:7
↓ 1 callersFunctionget_hash
(path)
opencompass/tools/update_dataset_suffix.py:67
↓ 1 callersMethodget_id
(self, data)
opencompass/opencompass/datasets/korbench/korbench_utils.py:121
↓ 1 callersMethodget_id
(self, data)
opencompass/opencompass/datasets/korbench/korbench_dataset_config/config_wrapper.py:26
↓ 1 callersMethodget_id
(self, data)
opencompass/opencompass/datasets/supergpqa/supergpqa_utils.py:121
↓ 1 callersMethodget_id
(self, data)
opencompass/opencompass/datasets/supergpqa/supergpqa_dataset_config/config_wrapper.py:26
↓ 1 callersFunctionget_item_error
Analyze errors in a single model response for a given task and prompt style. Args: model_response (str): The model's response to anal
opencompass/opencompass/datasets/calm/evaluation/errors.py:221
↓ 1 callersFunctionget_judgeanswer
Extract judgements (scores) Args: result (dict): result dict. filename (str): result path. post_process (function): The p
opencompass/opencompass/datasets/subjective/hellobench.py:224
↓ 1 callersFunctionget_judgeanswer_and_reference
(result, filename, post_process)
opencompass/opencompass/datasets/chinese_simpleqa.py:146
↓ 1 callersFunctionget_judgeanswer_and_reference_charm_mem
Extract judgements (scores), references and original judging prompts. Args: dataset (ConfigDict): Dataset config. subdir_path (st
opencompass/opencompass/summarizers/subjective/charm.py:39
↓ 1 callersFunctionget_judgeanswer_and_reference_update
Extract judgements (scores) and references. Args: dataset (ConfigDict): Dataset config. subdir_path (str): Model path in results
opencompass/opencompass/summarizers/subjective/utils.py:78
↓ 1 callersMethodget_kernel
(self, embed, candidates)
opencompass/opencompass/openicl/icl_retriever/icl_dpp_retriever.py:77
↓ 1 callersFunctionget_log_likelihood
Args: model: Mask predictor. prompt: A tensor of shape (l1). answer: A tensor of shape (l2). mc_num: Monte Carlo
get_log_likelihood.py:47
↓ 1 callersMethodget_logits
(self, inputs, prompt_index)
opencompass/opencompass/models/dllm.py:446
↓ 1 callersMethodget_loglikelihood
(self, prefix, target)
eval_llada.py:152
↓ 1 callersMethodget_loglikelihood
(self, inputs: List[str], conts: List[str])
opencompass/opencompass/models/vllm.py:144
↓ 1 callersMethodget_metrics
Calculate metric for scores of each sample. Args: scores (dict): Dict of calculated scores of metrics. Returns:
opencompass/opencompass/openicl/icl_evaluator/icl_toxic_evaluator.py:185
↓ 1 callersMethodget_mink_percent
https://swj0419.github.io/detect-pretrain.github.io/
opencompass/opencompass/models/dllm.py:329
↓ 1 callersFunctionget_multiline_input
(hint)
opencompass/opencompass/lagent/actions/ipython_interpreter.py:291
↓ 1 callersFunctionget_num_transfer_tokens
In the reverse process, the interval [0, 1] is uniformly discretized into steps intervals. Furthermore, because LLaDA employs a linear noise
generate.py:22
↓ 1 callersFunctionget_num_transfer_tokens
In the reverse process, the interval [0, 1] is uniformly discretized into steps intervals. Furthermore, because LLaDA employs a linear noise
app.py:74
↓ 1 callersFunctionget_num_transfer_tokens
In the reverse process, the interval [0, 1] is uniformly discretized into steps intervals. Furthermore, because LLaDA employs a linear nois
visualization/generate.py:20
↓ 1 callersFunctionget_number
(options)
opencompass/opencompass/datasets/needlebench/atc_choice.py:15
↓ 1 callersFunctionget_numerical_final_results
(judged_answers, references, origial_responses,
opencompass/opencompass/datasets/matbench/post_process.py:7
↓ 1 callersMethodget_output_dir
Get output dir from eval task. Notice: output dir should be in format xxx/data. All the needed files should be
opencompass/opencompass/datasets/cibench.py:516
↓ 1 callersMethodget_ppl
Get perplexity scores given a list of inputs. Args: inputs (List[str]): A list of strings. mask_length (Optional[List
opencompass/opencompass/models/dllm.py:407
↓ 1 callersMethodget_ppl
Get perplexity scores given a list of inputs. Args: inputs (List[str]): A list of strings. mask_length (Optional[List
opencompass/opencompass/models/base.py:68
↓ 1 callersMethodget_ppl
Get perplexity scores given a list of inputs. Args: inputs (List[str]): A list of strings. mask_length (Optional[List
opencompass/opencompass/models/huggingface_above_v4_33.py:593
↓ 1 callersMethodget_ppl
(self, inputs: List[str], mask_length: Optional[List[int]] = None)
opencompass/opencompass/models/vllm.py:119
↓ 1 callersMethodget_ppl_tokenwise
Get tokenwise perplexity scores given a list of inputs. Args: inputs (List[str]): A list of strings. mask_length (Opt
opencompass/opencompass/models/base.py:89
↓ 1 callersMethodget_ppl_tokenwise_from_template
Get token-wise perplexity given a list of templates. Args: templates (List[PromptType]): A list of templates. mask_le
opencompass/opencompass/models/base.py:176
↓ 1 callersFunctionget_prompt_hash
Get the hash of the prompt configuration. Args: dataset_cfg (ConfigDict or list[ConfigDict]): The dataset configuration.
opencompass/tools/update_dataset_suffix.py:16
↓ 1 callersMethodget_proposals
Get proposal prompts. Args: x (str): The input text to be solved. y (str): The partial output. Returns:
opencompass/opencompass/openicl/icl_inferencer/icl_tot_inferencer.py:196
↓ 1 callersFunctionget_question_text
(problem, option_inds='ABCDEFGH')
opencompass/opencompass/datasets/tabmwp.py:25
↓ 1 callersFunctionget_random_line_by_language
(counter, file_path, language)
opencompass/opencompass/datasets/needlebench/origin.py:15
↓ 1 callersFunctionget_random_line_by_language
(counter, file_path, language)
opencompass/opencompass/datasets/needlebench_v2/origin.py:16
↓ 1 callersFunctionget_random_needles
(counter, file_path, needle_count)
opencompass/opencompass/datasets/needlebench/multi.py:14
↓ 1 callersFunctionget_random_needles
(counter, file_path, num_needles, language)
opencompass/opencompass/datasets/needlebench_v2/multi.py:17
↓ 1 callersMethodget_raw_scores
Returns a dict with score
opencompass/opencompass/datasets/lawbench/utils/rc_f1.py:106
↓ 1 callersMethodget_raw_scores_human
Returns a dict with score
opencompass/opencompass/datasets/lawbench/utils/rc_f1.py:121
↓ 1 callersFunctionget_results
(judged_answers)
opencompass/opencompass/datasets/chinese_simpleqa.py:194
↓ 1 callersMethodget_sample
(self, sample_size)
opencompass/opencompass/datasets/babilong/babilong_utils.py:137
↓ 1 callersMethodget_sample_size
(self)
opencompass/opencompass/datasets/babilong/babilong_utils.py:287
↓ 1 callersMethodget_samples
Get samples from a partial output. Args: x (str): The input text to be solved. y (str): The partial output.
opencompass/opencompass/openicl/icl_inferencer/icl_tot_inferencer.py:215
↓ 1 callersMethodget_score
(self, time_str)
opencompass/opencompass/summarizers/subjective/compassbench.py:83
↓ 1 callersMethodget_score
(self, time_str)
opencompass/opencompass/summarizers/subjective/wildbench.py:167
← previousnext →1,001–1,100 of 3,438, ranked by callers