Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/InternScience/SciReason
/ functions
Functions
3,711 in github.com/InternScience/SciReason
⨍
Functions
3,711
◇
Types & classes
923
↳
Endpoints
23
↓ 1 callers
Method
_results_processor
(self, results)
opencompass/datasets/bigcodebench/bigcodebench.py:211
↓ 1 callers
Function
_retry_api
(fn, *args, **kwargs)
opencompass/datasets/ChemBenchQA/evaluator.py:73
↓ 1 callers
Method
_retry_api
(self, fn, *args, **kwargs)
opencompass/datasets/PEER/evaluator.py:255
↓ 1 callers
Method
_role2str
Convert a role prompt to a string, given an updated role_dict. Args: role_prompt (Dict): The role prompt to be converted.
opencompass/models/base.py:475
↓ 1 callers
Method
_run_split_on_punc
Splits punctuation on a piece of text.
opencompass/datasets/lawbench/utils/modules/tokenization.py:181
↓ 1 callers
Method
_run_strip_accents
Strips accents from a piece of text.
opencompass/datasets/lawbench/utils/modules/tokenization.py:170
↓ 1 callers
Method
_run_task
(self, cmd, log_path, poll_interval)
opencompass/runners/volc.py:207
↓ 1 callers
Method
_save_results
Save evaluation results to file.
opencompass/tasks/openicl_eval.py:325
↓ 1 callers
Method
_score
(self, model_cfg, dataset_cfg, eval_cfg, output_co
opencompass/tasks/subjective_eval.py:354
↓ 1 callers
Method
_score
(self)
opencompass/tasks/openicl_eval.py:87
↓ 1 callers
Method
_set_meta_template
(self, model)
opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:195
↓ 1 callers
Function
_set_model_kwargs_torch_dtype
(model_kwargs)
opencompass/models/huggingface_above_v4_33.py:127
↓ 1 callers
Function
_set_precision
Set precision (mostly to do with tensorfloat32) This allows user to go to fp32 Args: allow_tf32: if allowing Returns:
opencompass/datasets/unconditional_protein_generation/omegafold/pipeline.py:62
↓ 1 callers
Method
_sharded_compute
( self, pairwise_fasta: torch.Tensor, d: torch.Tensor, local_v
opencompass/datasets/unconditional_protein_generation/omegafold/embedders.py:298
↓ 1 callers
Method
_single_generate
Support for single prompt inference. Args: inputs (List[str]): A list of strings. max_out_len (int): The maximum leng
opencompass/models/huggingface.py:340
↓ 1 callers
Function
_single_simpleqa_postprocess
(judgement: str)
opencompass/datasets/simpleqa.py:166
↓ 1 callers
Method
_split_rounds
Split the prompt template into rounds, based on single round template. Return the index ranges of each round. Specifically, p
opencompass/models/base.py:396
↓ 1 callers
Method
_split_rounds
Split the prompt template into rounds, based on single round template. Return the index ranges of each round. Specifically, p
opencompass/models/base_api.py:323
↓ 1 callers
Method
_stop_at_stop_token
Produces the prefix of decoded_string that ends at the first occurrence of a stop_token. WARNING: the decoded_string *must not* inclu
opencompass/datasets/multipl_e.py:65
↓ 1 callers
Method
_stream_jsonl_all
(filename: str)
opencompass/datasets/humanevalx.py:42
↓ 1 callers
Method
_tensor_multiplication
Multiply everything by the tensor Args: other: Returns:
opencompass/datasets/unconditional_protein_generation/omegafold/utils/protein_utils/aaframe.py:616
↓ 1 callers
Method
_tokenize_chinese_chars
Adds whitespace around any CJK character.
opencompass/datasets/lawbench/utils/modules/tokenization.py:201
↓ 1 callers
Method
_trim_prediction
Trims the prediction string based on the length of the reference string. Args: prediction (str): The prediction string.
opencompass/datasets/needlebench/origin.py:216
↓ 1 callers
Function
action_ex
()
opencompass/datasets/musr/tree.py:679
↓ 1 callers
Function
add_brackets
(num)
opencompass/datasets/lawbench/utils/char_smi.py:363
↓ 1 callers
Function
add_spaces_to_ec_number
在EC号码中添加空格,格式从 2.7.10.2 变为 2 . 7 . 10 . 2
opencompass/datasets/opi/process_ec_numbers.py:5
↓ 1 callers
Function
annotate
:param line: :return:
opencompass/datasets/lawbench/utils/parallel_to_m2.py:50
↓ 1 callers
Function
annotate_with_time_out
:param line: :return:
opencompass/datasets/lawbench/utils/parallel_to_m2.py:19
↓ 1 callers
Function
answer_cleansing
( method: str, prediction: str, options: list, label: str, )
opencompass/datasets/medmcqa.py:79
↓ 1 callers
Function
answer_cleansing
( method: str, prediction: str, options: list, label: str, )
opencompass/datasets/Medbullets.py:89
↓ 1 callers
Function
answer_cleansing
( method: str, prediction: str, options: list, label: str, )
opencompass/datasets/MedXpertQA.py:59
↓ 1 callers
Function
answer_cleansing
( method: str, prediction: str, options: list, label: str, )
opencompass/datasets/nejmaibench.py:94
↓ 1 callers
Function
answer_cleansing
( method: str, prediction: str, options: list, label: str, )
opencompass/datasets/SciKnowEval.py:75
↓ 1 callers
Method
api_score
(self, predictions, references)
opencompass/datasets/truthfulqa.py:195
↓ 1 callers
Function
are_csc_matrix_close
(matrix1, matrix2)
opencompass/datasets/scicode.py:187
↓ 1 callers
Function
are_dicts_close
(dict1, dict2, atol=1e-8, rtol=1e-5)
opencompass/datasets/scicode.py:142
↓ 1 callers
Method
ask_gpt25
(self, question, answer, prediction)
opencompass/datasets/PEER/evaluator.py:270
↓ 1 callers
Method
ask_gpt25_batch
(self, questions, answers, predictions)
opencompass/datasets/PEER/evaluator.py:303
↓ 1 callers
Function
attention
Computes attention with q, k , v Args: query: positive tensor of shape (*_q, dim_qk) key: positive tensor of shape (*_k, dim_qk)
opencompass/datasets/unconditional_protein_generation/omegafold/modules.py:104
↓ 1 callers
Method
aug_with_original_data
Create original dataset and concat to the end.
opencompass/datasets/advglue.py:34
↓ 1 callers
Function
bar_inside_vec
(s)
opencompass/datasets/phybench/latex_pre_process.py:261
↓ 1 callers
Method
basic_score
(self, predictions, references)
opencompass/datasets/truthfulqa.py:126
↓ 1 callers
Method
batch_infer
(self, models: List[TurboMindAPIModel], inputs: List[str])
opencompass/datasets/omni_math.py:49
↓ 1 callers
Function
bbeh_freeform_postprocess
(text: str)
opencompass/datasets/bbeh.py:33
↓ 1 callers
Function
bbeh_mcq_postprocess
(text: str)
opencompass/datasets/bbeh.py:61
↓ 1 callers
Function
bbh_freeform_postprocess
(text: str)
opencompass/datasets/bbh.py:48
↓ 1 callers
Method
bertscore_match
Calculate the similarity between predicted plan and golden answer, A plan can be regarded a sequence of actions, and each act
opencompass/datasets/teval/evaluators/planning_evaluator.py:302
↓ 1 callers
Function
brackets_balanced
Check if the brackets in a LaTeX string are balanced Args: s(str): the input string Return: bool: True if the brackets ar
opencompass/datasets/phybench/latex_pre_process.py:7
↓ 1 callers
Method
bsp_check
Check if the binary search solution is valid. :param instance: The instance dictionary with array and target value. :param solution:
opencompass/datasets/NPHardEval/p_BSP.py:106
↓ 1 callers
Method
build_inferencer
Build LLM Inference.
opencompass/evaluator/generic_llm_evaluator.py:60
↓ 1 callers
Function
build_prompt
(item, nopt=4, multi_lang=True)
opencompass/datasets/subjective/corev2.py:249
↓ 1 callers
Function
build_prompt_en
(item, prompt, ics)
opencompass/datasets/subjective/corev2.py:222
↓ 1 callers
Function
build_tokenizer
(lang: str)
opencompass/datasets/PMMEval/flores.py:93
↓ 1 callers
Method
cal_ce
(self, input_texts: List[str], mask_length=None)
opencompass/openicl/icl_retriever/icl_mdl_retriever.py:145
↓ 1 callers
Function
calc_cls_task_scores
(list_structured_golden, list_structured_predict, list_label
opencompass/datasets/medbench/medbench.py:322
↓ 1 callers
Function
calc_info_extract_task_scores
(list_structured_predict, list_structured_golden)
opencompass/datasets/medbench/medbench.py:274
↓ 1 callers
Function
calc_scores_ctc
(dict_gt, dict_pred)
opencompass/datasets/medbench/medbench.py:425
↓ 1 callers
Function
calc_scores_nlg
(dict_gt, dict_pred)
opencompass/datasets/medbench/medbench.py:455
↓ 1 callers
Function
calculate_accuracy_
(predictions, references)
opencompass/datasets/Mol_Instructions/biotext.py:63
↓ 1 callers
Function
calculate_boolean_metrics
(pred_text_list, gold_text_list)
opencompass/datasets/LLM4Chem/utils/metrics.py:556
↓ 1 callers
Method
calculate_bpb
This function is used to calculate the BPB (Bits Per Byte) for the data. The correct BPB is obtained directly from the values in the '
opencompass/tasks/openicl_eval.py:413
↓ 1 callers
Function
calculate_f1_score
(true_entities, predicted_entities)
opencompass/datasets/Mol_Instructions/biotext.py:41
↓ 1 callers
Function
calculate_fingerprint_similarity
(pred_mol_list, gold_mols_list, morgan_r=2)
opencompass/datasets/LLM4Chem/utils/metrics.py:69
↓ 1 callers
Function
calculate_md5
(fpath: str, chunk_size: int = 1024 * 1024)
opencompass/utils/fileio.py:328
↓ 1 callers
Function
calculate_metrics
(judged_answers)
opencompass/datasets/chinese_simpleqa.py:162
↓ 1 callers
Function
calculate_number_metrics
(pred_text_list, gold_text_list)
opencompass/datasets/LLM4Chem/utils/metrics.py:516
↓ 1 callers
Function
calculate_single_element_match
(predictions, references)
opencompass/datasets/smolinstruct.py:161
↓ 1 callers
Function
calculate_single_element_match_for_list
(predictions, references)
opencompass/datasets/smolinstruct.py:113
↓ 1 callers
Function
calculate_text_metrics
(pred_text_list, gold_text_list, text_model='allenai/scibert_scivocab_uncased', text_trunc_length=512)
opencompass/datasets/LLM4Chem/utils/metrics.py:440
↓ 1 callers
Function
call_function
(name, arg)
opencompass/summarizers/subjective/corev2.py:40
↓ 1 callers
Function
call_method
(method, inputs)
opencompass/datasets/apps.py:773
↓ 1 callers
Function
call_method
(method, inputs)
opencompass/datasets/taco.py:723
↓ 1 callers
Function
call_method
(method, inputs)
opencompass/datasets/livecodebench/testing_util.py:656
↓ 1 callers
Function
canonicalize
(smiles, isomeric=False, canonical=True, kekulize=False)
opencompass/datasets/LLM4Chem/utils/smiles_canonicalization.py:9
↓ 1 callers
Method
category2dimensions
(self, category)
opencompass/datasets/subjective/alignbench.py:54
↓ 1 callers
Function
charm_memory_eval
(pred: str, ref: Union[str, List[str]])
opencompass/datasets/charm.py:52
↓ 1 callers
Function
chdir
(root)
opencompass/datasets/livecodebench/execute_utils.py:178
↓ 1 callers
Function
check
(a, b)
opencompass/datasets/math401.py:4
↓ 1 callers
Function
check_correctness
(answer: str, ground_truth, calid, upper_limit, lower_limit)
opencompass/datasets/MedCalc_Bench.py:14
↓ 1 callers
Method
check_correctness
Check correctness of code generation with a global timeout. The global timeout is to catch some extreme/rare cases not handled by the
opencompass/datasets/apps.py:167
↓ 1 callers
Method
check_correctness
Check correctness of code generation with a global timeout. The global timeout is to catch some extreme/rare cases not handled by the
opencompass/datasets/taco.py:116
↓ 1 callers
Function
check_http
()
opencompass/utils/network.py:74
↓ 1 callers
Function
check_internet
A tricky way to check internet.
opencompass/datasets/cibench.py:100
↓ 1 callers
Function
check_md5
(fpath, md5, **kwargs)
opencompass/utils/fileio.py:341
↓ 1 callers
Method
check_nums
(self, prediction, reference)
opencompass/datasets/game24.py:242
↓ 1 callers
Function
check_ping
()
opencompass/utils/network.py:84
↓ 1 callers
Function
check_position_bias
Check position bias for judgellm's judgement. Args: judged_answers: The successfully extracted judgement. references: The referen
opencompass/datasets/subjective/compass_arena.py:34
↓ 1 callers
Function
check_rating
(rating, all_dimensions)
opencompass/datasets/subjective/alignbench.py:190
↓ 1 callers
Method
check_real_valid
Exclude response without real answer.
opencompass/openicl/icl_evaluator/icl_agent_evaluator.py:98
↓ 1 callers
Function
check_socket
()
opencompass/utils/network.py:66
↓ 1 callers
Function
check_spell_error
(src_span: str, tgt_span: str, threshold: float = 0.8)
opencompass/datasets/lawbench/utils/modules/classifier.py:16
↓ 1 callers
Function
check_testcase_output
(testcase_str, expected_output)
opencompass/datasets/livecodebench/evaluator.py:430
↓ 1 callers
Function
check_url_accessibility
Check if a specific URL is accessible through optional proxy. Args: url: str, target URL to check timeout: float, timeout in seco
opencompass/utils/network.py:119
↓ 1 callers
Method
check_user_data_dir
(self, user_data_dir)
opencompass/datasets/cibench.py:264
↓ 1 callers
Function
clean_json_string
(json_str)
opencompass/datasets/korbench/korbench_utils.py:293
↓ 1 callers
Function
clean_json_string
(json_str)
opencompass/datasets/supergpqa/supergpqa_utils.py:293
↓ 1 callers
Function
clean_latex
(latex_expr)
opencompass/datasets/korbench/korbench_utils.py:326
↓ 1 callers
Function
clean_latex
(latex_expr)
opencompass/datasets/supergpqa/supergpqa_utils.py:326
↓ 1 callers
Method
clean_latex
Cleans LaTeX expressions for parsing. Args: latex_expr (str): The LaTeX expression to clean. Returns: str: T
opencompass/openicl/icl_evaluator/icl_korbench_evaluator.py:199
↓ 1 callers
Function
clean_prediction
(seq: str)
opencompass/datasets/unconditional_protein_generation/UPG.py:79
← previous
next →
801–900 of 3,711, ranked by callers