MCPcopy Create free account

hub / github.com/PERSONA-bench/PERSONA / functions

Functions235 in github.com/PERSONA-bench/PERSONA

⨍ Functions 235◇ Types & classes 2
↓ 1 callersFunctionbuild_dialogue_tree_with_hidden_score
(post_data_with_ids, node_id_to_hide_score_of)
demo/3.2PromptMaker.py:199
↓ 1 callersFunctionbuild_dialogue_tree_with_hidden_score
(post_data_with_ids, node_id_to_hide_score_of)
PromptMakers/3.2PromptMaker.py:199
↓ 1 callersFunctionbuild_dialogue_tree_with_hidden_score_for_few_shot
Prepares a full post dialogue tree for few-shot examples, hiding the score of a specific node. This is similar to the original build_dialogue
PromptMakers/3.1_RandPrompt.py:277
↓ 1 callersFunctionbuild_display_branch
(current_node_id_build, stop_at_child_id, current_path_to_excluded_child)
PromptMakers/3.3_RandPrompt.py:346
↓ 1 callersFunctionbuild_display_branch_up_to_parent
(node_id_current, id_of_reply_to_exclude_branch, exclusion_path)
demo/3.3PromptMaker.py:289
↓ 1 callersFunctionbuild_display_branch_up_to_parent
(node_id_current, id_of_reply_to_exclude_branch, exclusion_path)
PromptMakers/3.3PromptMaker.py:289
↓ 1 callersFunctionbuild_minimal_context_for_prediction
Creates a structure for post_data_store containing only the target reply (score hidden) and its direct parent.
PromptMakers/3.1_RandPrompt.py:211
↓ 1 callersFunctionbuild_post_context_excluding_node
(post_data_orig, node_to_remove_id)
demo/3.3PromptMaker.py:243
↓ 1 callersFunctionbuild_post_context_excluding_node
(post_data_orig, node_to_remove_id)
PromptMakers/3.3PromptMaker.py:243
↓ 1 callersFunctionbuild_post_context_excluding_node_id
(post_data_orig_hierarchical, node_id_to_remove)
PromptMakers/3.3_RandPrompt.py:276
↓ 1 callersFunctioncalculate_bleu_score
(reference, candidate)
LLMEvaluators/LogEvaluator/LogEval3.3.py:155
↓ 1 callersFunctioncalculate_meteor_score
(reference, candidate)
LLMEvaluators/LogEvaluator/LogEval3.3.py:168
↓ 1 callersFunctioncalculate_removed_percentage_in_tree
(tree_nodes_list)
demo/3.3PromptMaker.py:228
↓ 1 callersFunctioncalculate_removed_percentage_in_tree
(tree_nodes_list)
PromptMakers/3.3PromptMaker.py:228
↓ 1 callersFunctioncalculate_rouge_scores
(reference, candidate)
LLMEvaluators/LogEvaluator/LogEval3.3.py:141
↓ 1 callersFunctioncalculate_sbert_similarity
(text1, text2)
LLMEvaluators/LogEvaluator/LogEval3.3.py:128
↓ 1 callersFunctioncall_anthropic_vertex_with_retry
(client, model_id, prompt_text, max_gen_tokens, temperature, worker_logger_instance)
LLMEvaluators/3.3/Claude.py:204
↓ 1 callersFunctioncall_azure_openai_with_retry
(client, deployment_name, prompt_text, model_config, num_candidates, max_gen_tokens,
LLMEvaluators/3.3/GPT-4o-mini.py:243
↓ 1 callersFunctioncall_azure_openai_with_retry
(client, deployment_name, prompt_text, model_config, num_candidates, max_gen_tokens,
LLMEvaluators/3.3/GPT4.1_Random_Task.py:198
↓ 1 callersFunctioncall_azure_openai_with_retry
(client, deployment_name, prompt_text, model_config, num_candidates, max_gen_tokens,
LLMEvaluators/3.3/GPT4.1.py:241
↓ 1 callersFunctioncall_azure_openai_with_retry
(client, deployment_name, prompt_text, model_config, num_candidates, max_gen_tokens,
demo/GPT3.3.py:241
↓ 1 callersFunctioncall_google_vertex_with_retry
(client_sdk, model_id, prompt_text, num_candidates, max_gen_tokens, temperature)
LLMEvaluators/3.3/GPT-4o-mini.py:316
↓ 1 callersFunctioncall_google_vertex_with_retry
(client_sdk, model_id, prompt_text, num_candidates, max_gen_tokens, temperature, thread_logger)
LLMEvaluators/3.3/GPT4.1_Random_Task.py:268
↓ 1 callersFunctioncall_google_vertex_with_retry
(client_sdk, model_id, prompt_text, num_candidates, max_gen_tokens, temperature)
LLMEvaluators/3.3/GPT4.1.py:314
↓ 1 callersFunctioncall_google_vertex_with_retry
(client_sdk, model_id, prompt_text, num_candidates, max_gen_tokens, temperature)
demo/GPT3.3.py:314
↓ 1 callersFunctioncompute_classification_metrics
(input_path, output_csv_path)
LLMEvaluators/LogEvaluator/LogEval3.1.py:18
↓ 1 callersFunctioncompute_metrics
(input_path, output_csv_path)
LLMEvaluators/LogEvaluator/LogEval3.2.py:6
↓ 1 callersFunctioncount_qualifying_dialogue_trees
(all_nodes_in_post, post_author_name)
demo/3.3PromptMaker.py:151
↓ 1 callersFunctioncount_qualifying_dialogue_trees
(all_nodes_in_post, post_author_name)
PromptMakers/3.3_RandPrompt.py:182
↓ 1 callersFunctioncount_qualifying_dialogue_trees
(all_nodes_in_post, post_author_name)
PromptMakers/3.3PromptMaker.py:151
↓ 1 callersFunctionevaluate_model
Main function to evaluate a model against a dataset in a .jsonl file.
LLMEvaluators/3.1/GPT.py:157
↓ 1 callersFunctionevaluate_model
(model_to_evaluate_name, dataset_type_to_use, output_folder=OUTPUT_FOLDER)
LLMEvaluators/3.2/GPT.py:149
↓ 1 callersFunctionevaluate_model
Main function to evaluate a model against a dataset in a .jsonl file.
demo/GPT3.1.py:153
↓ 1 callersFunctionevaluate_model
(model_to_evaluate_name, dataset_type_to_use, output_folder=OUTPUT_FOLDER)
demo/GPT3.2.py:137
↓ 1 callersFunctionevaluate_model_multithreaded
Evaluates the specified model using multiple threads.
LLMEvaluators/3.1/Claude.py:289
↓ 1 callersFunctionevaluate_model_multithreaded
(model_name_to_eval, input_file_path, num_threads=NUM_THREADS, output_folder=OUTPUT_FOLDER)
LLMEvaluators/3.2/Claude.py:418
↓ 1 callersFunctionextract_prediction
(output_text)
LLMEvaluators/LogEvaluator/LogEval3.1.py:10
↓ 1 callersFunctionfind_author_replies_for_body_prediction
(flat_nodes_list, post_author_name)
demo/3.3PromptMaker.py:124
↓ 1 callersFunctionfind_author_replies_for_body_prediction
(flat_nodes_list, post_author_name)
PromptMakers/3.3PromptMaker.py:124
↓ 1 callersFunctionfind_author_replies_in_post_for_score_prediction
(flat_nodes_list, post_author_name)
demo/3.1PromptMaker.py:146
↓ 1 callersFunctionfind_author_replies_in_post_for_score_prediction
(flat_nodes_list, post_author_name)
demo/3.2PromptMaker.py:150
↓ 1 callersFunctionfind_author_replies_in_post_for_score_prediction
(flat_nodes_list, post_author_name)
PromptMakers/3.2_RandPrompt.py:140
↓ 1 callersFunctionfind_author_replies_in_post_for_score_prediction
(flat_nodes_list, post_author_name)
PromptMakers/3.1PromptMaker.py:146
↓ 1 callersFunctionfind_author_replies_in_post_for_score_prediction
(flat_nodes_list, post_author_name)
PromptMakers/3.2PromptMaker.py:150
↓ 1 callersFunctiongenerate_from_openai_chat_completion
( client: openai.AsyncOpenAI, limiter: aiolimiter.AsyncLimiter, queries: List[Dict[str
LLMEvaluators/3.1/LlamaAndDeepSeek_batch_eval.py:169
↓ 1 callersFunctiongenerate_from_openai_chat_completion
( client: openai.AsyncOpenAI, limiter: aiolimiter.AsyncLimiter, queries: List[Dict[str
LLMEvaluators/3.2/LlamaAndDeepSeek_batch_eval.py:169
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
demo/3.1PromptMaker.py:88
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
demo/3.2PromptMaker.py:92
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
demo/3.3PromptMaker.py:86
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
PromptMakers/3.2_RandPrompt.py:85
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
PromptMakers/3.1PromptMaker.py:88
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
PromptMakers/3.2PromptMaker.py:92
↓ 1 callersFunctiongenerate_unique_ids_for_post
(post_data, post_index_prefix)
PromptMakers/3.3PromptMaker.py:86
↓ 1 callersFunctionget_azure_gpt_prediction
Gets a numerical score prediction from a configured Azure GPT model with retry logic.
LLMEvaluators/3.2/GPT.py:101
↓ 1 callersFunctionget_azure_gpt_prediction
Gets a numerical score prediction from a configured Azure GPT model with retry logic.
demo/GPT3.2.py:89
↓ 1 callersFunctionget_context_post_summary_string
(post_obj, main_author_name_for_summary="the post author")
PromptMakers/3.2_RandPrompt.py:205
↓ 1 callersFunctionget_default_few_shot_details_refactored
(post_data_store_for_default)
demo/3.1PromptMaker.py:246
↓ 1 callersFunctionget_default_few_shot_details_refactored
(post_data_store_for_default)
demo/3.2PromptMaker.py:245
↓ 1 callersFunctionget_default_few_shot_details_refactored
(post_data_store_for_default)
PromptMakers/3.1PromptMaker.py:246
↓ 1 callersFunctionget_default_few_shot_details_refactored
(post_data_store_for_default)
PromptMakers/3.2PromptMaker.py:245
↓ 1 callersFunctionget_default_few_shot_for_body_prediction
()
demo/3.3PromptMaker.py:329
↓ 1 callersFunctionget_default_few_shot_for_body_prediction
()
PromptMakers/3.3_RandPrompt.py:435
↓ 1 callersFunctionget_default_few_shot_for_body_prediction
()
PromptMakers/3.3PromptMaker.py:329
↓ 1 callersFunctionget_default_few_shot_for_without_prompt_refactored
()
demo/3.2PromptMaker.py:334
↓ 1 callersFunctionget_default_few_shot_for_without_prompt_refactored
()
PromptMakers/3.2PromptMaker.py:334
↓ 1 callersFunctionget_model_prediction
Gets a prediction from the specified Azure OpenAI model.
LLMEvaluators/3.1/GPT.py:50
↓ 1 callersFunctionget_model_prediction
Gets a prediction from the specified Azure OpenAI model.
demo/GPT3.1.py:46
↓ 1 callersFunctionget_node_by_id
Helper to find a specific node (post or comment) by its ID in a structured post.
PromptMakers/3.1_RandPrompt.py:190
↓ 1 callersFunctionget_nodes_in_dialogue_tree
(all_post_nodes_flat, tlc_id_for_tree)
demo/3.3PromptMaker.py:203
↓ 1 callersFunctionget_nodes_in_dialogue_tree
(all_post_nodes_flat, tlc_id_for_tree)
PromptMakers/3.3PromptMaker.py:203
↓ 1 callersFunctionget_pseudo_random_few_shot_details
(context_provider_sample_details, post_data_store_for_fs_context)
PromptMakers/3.2_RandPrompt.py:231
↓ 1 callersFunctionget_tlc_id_for_target_reply
(target_reply_node, nodes_map, root_post_id)
demo/3.3PromptMaker.py:185
↓ 1 callersFunctionget_tlc_id_for_target_reply
(target_reply_node, nodes_map, root_post_id)
PromptMakers/3.3PromptMaker.py:185
↓ 1 callersFunctionget_truncated_dialogue_tree_for_body_fewshot
(full_post_flat_nodes, few_shot_reply_obj)
demo/3.3PromptMaker.py:268
↓ 1 callersFunctionget_truncated_dialogue_tree_for_body_fewshot
(full_post_flat_nodes_fs, few_shot_reply_obj_fs, post_author_name_fs)
PromptMakers/3.3_RandPrompt.py:314
↓ 1 callersFunctionget_truncated_dialogue_tree_for_body_fewshot
(full_post_flat_nodes, few_shot_reply_obj)
PromptMakers/3.3PromptMaker.py:268
↓ 1 callersFunctiongroup_posts_by_author
Group posts by their author. Args: post_list (list[dict]): with key 'author'。 Returns: dict[str, list[dict]]: {author:
Raw_Data_Process.py:6
↓ 1 callersFunctioninitialize_evaluation_resources
()
LLMEvaluators/LogEvaluator/LogEval3.3.py:90
↓ 1 callersFunctionload_queries_from_txt
Loads queries from a TXT file where each line is a JSON object.
LLMEvaluators/3.1/LlamaAndDeepSeek_batch_eval.py:680
↓ 1 callersFunctionload_queries_from_txt
Loads queries from a TXT file where each line is a JSON object.
LLMEvaluators/3.2/LlamaAndDeepSeek_batch_eval.py:680
↓ 1 callersFunctionlog_and_save_metrics
(domain_metrics_aggregated, overall_metrics_aggregated)
LLMEvaluators/LogEvaluator/LogEval3.3.py:371
↓ 1 callersFunctionlog_domain_metrics
(current_domain_stats, logger_instance_to_use, meteor_is_available_flag, active_model_count=1)
LLMEvaluators/3.3/Claude.py:278
↓ 1 callersFunctionlog_domain_metrics
(current_domain_stats, logger_instance, meteor_is_available_flag, num_models)
LLMEvaluators/3.3/GPT4.1_Random_Task.py:294
↓ 1 callersFunctionmain
()
LLMEvaluators/LogEvaluator/LogEval3.3.py:437
↓ 1 callersFunctionmain
()
LLMEvaluators/3.3/Claude.py:549
↓ 1 callersFunctionmain
()
LLMEvaluators/3.3/GPT-4o-mini.py:373
↓ 1 callersFunctionmain
()
LLMEvaluators/3.3/GPT4.1_Random_Task.py:997
↓ 1 callersFunctionmain
()
LLMEvaluators/3.3/GPT4.1.py:371
↓ 1 callersFunctionmain
()
LLMEvaluators/3.1/LlamaAndDeepSeek_batch_eval.py:707
↓ 1 callersFunctionmain
()
LLMEvaluators/3.2/LlamaAndDeepSeek_batch_eval.py:707
↓ 1 callersFunctionmain
()
demo/3.1PromptMaker.py:322
↓ 1 callersFunctionmain
()
demo/GPT3.3.py:371
↓ 1 callersFunctionmain
()
demo/3.2PromptMaker.py:370
↓ 1 callersFunctionmain
()
demo/3.3PromptMaker.py:356
↓ 1 callersFunctionmain
()
PromptMakers/3.3_RandPrompt.py:466
↓ 1 callersFunctionmain
()
PromptMakers/3.2_RandPrompt.py:306
↓ 1 callersFunctionmain
()
PromptMakers/3.1_RandPrompt.py:331
↓ 1 callersFunctionmain
()
PromptMakers/3.1PromptMaker.py:322
↓ 1 callersFunctionmain
()
PromptMakers/3.2PromptMaker.py:370
↓ 1 callersFunctionmain
()
PromptMakers/3.3PromptMaker.py:356
← previousnext →101–200 of 235, ranked by callers