Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/InternScience/SciReason
/ functions
Functions
3,711 in github.com/InternScience/SciReason
⨍
Functions
3,711
◇
Types & classes
923
↳
Endpoints
23
↓ 2 callers
Method
make_circular_dataset
(dataset, circular_patterns, option_keys, answer_key, answer_key_switch_method)
opencompass/datasets/circular.py:90
↓ 2 callers
Function
make_code_execution_prompt
(code, input, cot)
opencompass/datasets/livecodebench/prompts.py:73
↓ 2 callers
Function
master_convert
The only function needed to convert a LaTeX string into a SymPy expression. Args: s (str): The input LaTeX string. It should be a val
opencompass/datasets/phybench/latex_pre_process.py:504
↓ 2 callers
Function
material_postprocessor
提取 <material> 标签内容
opencompass/datasets/composition_material.py:95
↓ 2 callers
Method
merge
(self, summarizer: 'MultiModelSummarizer')
opencompass/summarizers/multi_model.py:274
↓ 2 callers
Method
metric_max_over_ground_truths
(self, metric_fn, prediction, ground_truths)
opencompass/datasets/tydiqa.py:61
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/summarizers/default.py:22
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/summarizers/subjective/common_summarizer.py:20
↓ 2 callers
Function
model_abbr_from_cfg_used_in_summarizer
(model)
opencompass/summarizers/subjective/compass_arena.py:20
↓ 2 callers
Function
normalize_answer
Lower text and remove punctuation, articles and extra whitespace.
opencompass/datasets/longbench/evaluators.py:15
↓ 2 callers
Function
normalize_zh_answer
Lower text and remove punctuation, extra whitespace.
opencompass/datasets/longbench/evaluators.py:34
↓ 2 callers
Function
normalized_smith_waterman
Compute normalized Smith-Waterman score for protein sequences. Args: seq1, seq2 (str): Protein sequences (uppercase letters)
opencompass/datasets/Mol_Instructions/normalized_SW_score.py:7
↓ 2 callers
Function
number_it
(num)
opencompass/datasets/TheoremQA/number_utils.py:50
↓ 2 callers
Function
pad_array_with_value
(array, target_shape, pad_value)
opencompass/datasets/arc_prize_public_evaluation.py:185
↓ 2 callers
Function
parse_dataset_cfg
(dataset_cfg: ConfigDict)
tools/prompt_viewer.py:44
↓ 2 callers
Function
parse_math_answer
(setting_name, raw_string)
opencompass/datasets/agieval/post_process.py:92
↓ 2 callers
Function
parse_molecule
(molecular_formula)
opencompass/datasets/LLM4Chem/utils/metrics.py:270
↓ 2 callers
Function
parse_qa_multiple_answer
(string)
opencompass/datasets/medbench/post_process.py:170
↓ 2 callers
Function
parse_require_file
(fpath)
setup.py:74
↓ 2 callers
Method
parse_xml_to_dict
(self, xml_string)
opencompass/datasets/NPHardEval/p_BSP.py:84
↓ 2 callers
Function
patch_fileio
(global_vars=None)
opencompass/utils/fileio.py:180
↓ 2 callers
Method
position_in_frame
Get the frame-based position of the given global position Args: pos (): the global position of shape (*, 3) Ret
opencompass/datasets/unconditional_protein_generation/omegafold/utils/protein_utils/aaframe.py:902
↓ 2 callers
Function
post_process
Input a string like below: xxx[[5]]xxx, and extract the score
opencompass/datasets/subjective/commonbench.py:11
↓ 2 callers
Method
predict_win_rate
Predict win rates between all models using their ELO ratings. Args: ratings_df (pd.DataFrame): DataFrame containing model ratings
opencompass/summarizers/subjective/compass_arena_bradley_terry.py:950
↓ 2 callers
Function
preprocess_for_bt
In BT we only need the unique (matchup,outcome) sets along with the weights of how often they occur.
opencompass/summarizers/subjective/compass_arena_bradley_terry.py:63
↓ 2 callers
Function
preprocess_for_style
( df, apply_ratio: List[int] = None, style_variables: List[str] = STYLE_CONTROL_VARIABLES_V1,
opencompass/summarizers/subjective/compass_arena_bradley_terry.py:87
↓ 2 callers
Function
print_prompts
(model_cfg, dataset_cfg, count=1)
tools/prompt_viewer.py:51
↓ 2 callers
Function
process_edits
(edits, args)
opencompass/datasets/lawbench/utils/compare_m2_for_evaluation.py:165
↓ 2 callers
Function
process_hdf5_datagroup
(group)
opencompass/datasets/scicode.py:87
↓ 2 callers
Function
process_hdf5_sparse_matrix
(group)
opencompass/datasets/scicode.py:67
↓ 2 callers
Function
process_symbol_in_dict
(dict)
opencompass/datasets/scicode.py:175
↓ 2 callers
Function
publish_image_to_local
(image_base64: str)
opencompass/lagent/actions/ipython_interpreter.py:278
↓ 2 callers
Function
read_jsonl
(path)
opencompass/datasets/agieval/utils.py:5
↓ 2 callers
Function
read_jsonl
(path)
opencompass/datasets/medbench/utils.py:5
↓ 2 callers
Method
read_jsonl
Read a JSONL file and return its contents as a list of dictionaries. Args: file_path: Path to the JSONL file Returns:
opencompass/utils/fileio.py:54
↓ 2 callers
Method
readline
(self, *args, **kwargs)
opencompass/datasets/mbpp.py:222
↓ 2 callers
Method
register_module
( self, name: Optional[Union[str, List[str]]] = None, force: bool = True,
opencompass/registry.py:10
↓ 2 callers
Function
remove_articles
(text)
opencompass/datasets/lveval/evaluators.py:150
↓ 2 callers
Function
remove_commas_and_spaces
(s)
opencompass/datasets/korbench/korbench_utils.py:393
↓ 2 callers
Function
remove_commas_and_spaces
(s)
opencompass/datasets/supergpqa/supergpqa_utils.py:393
↓ 2 callers
Function
remove_few_shot_prefix
(string: str)
opencompass/datasets/agieval/post_process.py:17
↓ 2 callers
Function
remove_few_shot_prefix
(string: str)
opencompass/datasets/medbench/post_process.py:17
↓ 2 callers
Function
remove_invisible_chars
Remove invisible characters.
opencompass/datasets/mathbench.py:238
↓ 2 callers
Function
remove_overall_brace
Remove the overall {xxx} brace.
opencompass/datasets/phybench/latex_pre_process.py:200
↓ 2 callers
Function
remove_punc
(text)
opencompass/datasets/longbench/evaluators.py:24
↓ 2 callers
Function
removesuffix
(s, suffix)
opencompass/datasets/PMMEval/mifeval_utils/detectable_format_checker.py:12
↓ 2 callers
Function
reset_std
Reset stdout and stderr, also change logger stream handler.
opencompass/runners/local_api.py:77
↓ 2 callers
Function
rule5_normalize_content
(content)
opencompass/datasets/korbench/korbench_utils.py:380
↓ 2 callers
Function
rule5_normalize_content
(content)
opencompass/datasets/supergpqa/supergpqa_utils.py:380
↓ 2 callers
Method
rule5_normalize_content
Normalizes content for rule 5. Args: content (str): The content to normalize. Returns: list: Sorted list of
opencompass/openicl/icl_evaluator/icl_korbench_evaluator.py:246
↓ 2 callers
Method
run
(self, cur_model=None, cur_model_abbr=None)
opencompass/tasks/openicl_infer.py:64
↓ 2 callers
Method
run_judge_pair
(self, prompt_template, system_prompt, question, answer_a, answer_b, reference)
opencompass/datasets/leval/evaluators.py:30
↓ 2 callers
Method
save_multiround_results
(self, origin_prompt: list, prediction: str,
opencompass/openicl/icl_inferencer/icl_agent_inferencer.py:41
↓ 2 callers
Method
save_multiround_results
(self, origin_prompt: list, prediction: str,
opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:149
↓ 2 callers
Method
save_results
(self, origin_prompt: list, prediction: str, id
opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:135
↓ 2 callers
Method
score
( self, predictions, judgements: Optional[List] = None, references: Optional[L
opencompass/openicl/icl_evaluator/lm_evaluator.py:163
↓ 2 callers
Method
score
(self, predictions, references)
opencompass/datasets/Mol_Instructions/molecule.py:291
↓ 2 callers
Method
score
Calculates retrosynthesis prediction accuracy. Args: predictions (list): A flat list of predicted SMILES strings.
opencompass/datasets/LLM4Chem/retrosynthesis_evaluator.py:223
↓ 2 callers
Method
set_history
(self, history)
opencompass/models/lagent.py:42
↓ 2 callers
Function
simplify_edits
(sent, max_answer_num)
opencompass/datasets/lawbench/utils/compare_m2_for_evaluation.py:135
↓ 2 callers
Method
split_by_comma
(self, expr: str)
opencompass/datasets/OlympiadBench.py:297
↓ 2 callers
Function
split_or_expression
(expression)
opencompass/datasets/korbench/korbench_utils.py:422
↓ 2 callers
Function
split_or_expression
(expression)
opencompass/datasets/supergpqa/supergpqa_utils.py:422
↓ 2 callers
Method
strip_changes
Strips off the changes.
opencompass/datasets/IFEval/instructions.py:714
↓ 2 callers
Function
strip_string
(string)
opencompass/datasets/math_intern.py:257
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/datasets/apps.py:767
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/datasets/taco.py:717
↓ 2 callers
Function
stripped_string_compare
(s1, s2)
opencompass/datasets/livecodebench/testing_util.py:650
↓ 2 callers
Function
sum_lengths
(sentences)
opencompass/datasets/babilong/babilong_utils.py:111
↓ 2 callers
Function
swallow_io
()
opencompass/datasets/mbpp.py:194
↓ 2 callers
Method
sympy_sub_pi
(self, expression_sympy)
opencompass/datasets/OlympiadBench.py:378
↓ 2 callers
Function
sympy_to_tree
Convert a SymPy expression into a tree structure. This function takes a SymPy expression and recursively converts it into a tree represen
opencompass/datasets/phybench/EED.py:146
↓ 2 callers
Function
time_limit
(seconds: float)
opencompass/datasets/mbpp.py:203
↓ 2 callers
Method
to_angstrom
move to angstrom Args: in_place: if to use in_place operation Returns:
opencompass/datasets/unconditional_protein_generation/omegafold/utils/protein_utils/aaframe.py:168
↓ 2 callers
Method
to_dict
(self)
opencompass/datasets/agieval/constructions.py:61
↓ 2 callers
Method
to_dict
(self)
opencompass/datasets/medbench/constructions.py:21
↓ 2 callers
Method
to_dict
(self)
opencompass/datasets/medbench/constructions.py:61
↓ 2 callers
Method
trans_plus_minus_sign
(self, expr_list: list)
opencompass/datasets/OlympiadBench.py:315
↓ 2 callers
Function
vl_model_score
(model, pred_img, ori_prompt, judge_prompt)
opencompass/datasets/cibench.py:187
↓ 2 callers
Function
white_space_fix
(text)
opencompass/datasets/longbench/evaluators.py:21
↓ 2 callers
Function
wmt_postprocess
(text: str, lang: str)
opencompass/datasets/PMMEval/flores.py:18
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_inference_ppl_only_inferencer.py:230
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_chat_inferencer.py:131
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_mink_percent_inferencer.py:181
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_sw_ce_loss_inferencer.py:342
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_ppl_only_inferencer.py:180
↓ 2 callers
Method
write_to_json
Dump the result to a json file.
opencompass/openicl/icl_inferencer/icl_base_inferencer.py:170
↓ 1 callers
Function
CER_calculate_accuracy_
(predictions, references)
opencompass/datasets/Mol_Instructions/biotext.py:74
↓ 1 callers
Function
CER_calculate_f1_score
(true_entities, predicted_entities)
opencompass/datasets/Mol_Instructions/biotext.py:30
↓ 1 callers
Function
EED
Computes the similarity score and distance metrics between two LaTeX expressions. This function evaluates the equivalence of two mathematical
opencompass/datasets/phybench/EED.py:253
↓ 1 callers
Function
ReCoRD_postprocess
(text: str)
opencompass/datasets/record.py:77
↓ 1 callers
Function
Xsum_postprocess
(text: str)
opencompass/datasets/xsum.py:52
↓ 1 callers
Function
__extract_entities_pred
(pred, entity_types)
opencompass/datasets/lawbench/utils/comprehension_scores.py:71
↓ 1 callers
Function
__extract_entities_ref
(ref)
opencompass/datasets/lawbench/utils/comprehension_scores.py:54
↓ 1 callers
Function
__find_substring_starts
(s, target)
opencompass/datasets/lawbench/utils/comprehension_scores.py:11
↓ 1 callers
Method
__init__
(self)
opencompass/lagent/actions/python_interpreter.py:18
↓ 1 callers
Method
__init__
(self, use_system_role: bool = True, first_system_role: bool = True,
opencompass/lagent/agents/react.py:77
↓ 1 callers
Method
__init__
( self, model: BaseModel, max_out_len: int, stopping_criteria:
opencompass/openicl/icl_inferencer/icl_gen_inferencer.py:50
↓ 1 callers
Method
__init__
(self, data: List[Any])
opencompass/openicl/icl_retriever/icl_topk_retriever.py:149
↓ 1 callers
Method
__init__
(self, model='gpt-3.5-turbo-16k', temperature=0, **kwargs)
opencompass/openicl/icl_evaluator/icl_agent_evaluator.py:121
← previous
next →
501–600 of 3,711, ranked by callers