MCPcopy Create free account

hub / github.com/HongyuanLuke/frequencylaw / functions

Functions35 in github.com/HongyuanLuke/frequencylaw

⨍ Functions 35◇ Types & classes 1
↓ 4 callersFunctionclean_and_tokenize
(text)
newfrequency.py:8
↓ 3 callersFunctioncalculate_weighted_score_new
(sentence, freq_dict)
MT-SFT/sort_frequency.py:109
↓ 3 callersFunctionclean_and_tokenize
(sentence, remove_stopwords=True)
MT-SFT/sort_frequency.py:22
↓ 2 callersFunctioncompare_numbers
(num1, num2)
judge.py:27
↓ 2 callersFunctiongeometric_mean
(frequencies)
MT-SFT/sort_frequency.py:100
↓ 2 callersFunctionload_and_normalize_corpus
:param file_path: :return: {word: prob}
newfrequency.py:13
↓ 2 callersFunctionprocess_questions
(question, token, system)
reply_mr.py:94
↓ 1 callersFunctionalign_and_merge
:param beta: (0.0~1.0) :param epsilon: :return: {word: prob}
newfrequency.py:35
↓ 1 callersFunctionclean_and_tokenize
(sentence)
frequency.py:22
↓ 1 callersFunctioncompare_and_write_results
(sen1_file, sen2_file, output_file)
issame.py:92
↓ 1 callersFunctioncompute_sentence_score
(sentence, prob_dict, epsilon=1e-8)
newfrequency.py:66
↓ 1 callersFunctioncompute_zipf_frequency
(sentence, word_frequencies)
frequency.py:28
↓ 1 callersFunctionextract_number_from_response
(response)
reply_mr.py:85
↓ 1 callersMethodgenerate
(self, query)
MT-SFT/runmodel.py:30
↓ 1 callersFunctionget_ngram_frequencies
(custom_path=None)
MT-SFT/sort_frequency.py:39
↓ 1 callersFunctionget_word_frequencies
()
frequency.py:15
↓ 1 callersFunctionmain
()
MT-SFT/sort_frequency.py:126
↓ 1 callersFunctionmake_requests_GPT
( system, user, model='gpt-4o-mini', max_tokens=1024, temperature=1.0, retries=10, presence_penalty=
reply_mt.py:12
↓ 1 callersFunctionmake_requests_GPT
( system, user, model='gpt-4o-mini', max_tokens=1024, temperature=1.0, retries=10, presence_penalty=
reply_mr.py:12
↓ 1 callersFunctionmake_requests_GPT
( system, user, model='gpt-4o-mini', max_tokens=1024, temperature=1.0, retries=10, presence_penalty=
issame.py:4
↓ 1 callersFunctionmake_requests_GPT
( system, user, model='gpt-4o-mini', max_tokens=1024, temperature=1.0, retries=10, presence_penalty=
rephrase.py:12
↓ 1 callersFunctionprocess_batch
()
MT-SFT/runmodel.py:57
↓ 1 callersFunctionprocess_file
()
reply_mt.py:116
↓ 1 callersFunctionprocess_file
()
reply_mr.py:112
↓ 1 callersFunctionprocess_file
()
rephrase.py:108
↓ 1 callersFunctionprocess_jsonl
(jsonl_file)
frequency.py:47
↓ 1 callersFunctionprocess_questions
(question,token, system)
reply_mt.py:86
↓ 1 callersFunctionprocess_questions
(question, token, system)
rephrase.py:86
↓ 1 callersFunctionprocess_sentences_from_file
(sen1, sen2, max_attempts)
issame.py:78
↓ 1 callersFunctionread_data_from_jsonl
(file_path)
reply_mt.py:108
↓ 1 callersFunctionread_data_from_jsonl
(file_path)
reply_mr.py:105
↓ 1 callersFunctionread_data_from_jsonl
(file_path)
judge.py:4
Method__init__
(self)
MT-SFT/runmodel.py:27
Functioncompute_zipf_frequency
(sentence, prob_dict, epsilon=1e-8)
newfrequency.py:90
Functionload_probabilities
file_path:your_combined_probs.txt
newfrequency.py:79