Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/TencentCloudADP/youtu-embedding
/ functions
Functions
191 in github.com/TencentCloudADP/youtu-embedding
⨍
Functions
191
◇
Types & classes
31
↓ 7 callers
Function
setLocaleCookie
(response: NextResponse, locale: string)
docs/middleware.ts:32
↓ 6 callers
Method
encode
(self, features)
training/CoDiEmb/train/model.py:133
↓ 6 callers
Method
pooling
(self, hidden_state: torch.Tensor, attention_mask: torch.Tensor = None, recast: bool = False)
training/CoDiEmb/train/model.py:233
↓ 4 callers
Function
buildDocsPath
(locale: string, rest: string[] = [])
docs/middleware.ts:39
↓ 3 callers
Method
_gather_tensor
(t: torch.Tensor)
training/CoDiEmb/train/loss.py:132
↓ 3 callers
Method
_prepare_texts
A centralized method to prepare texts by adding model-specific prefixes (instructions) and suffixes.
training/CoDiEmb/test/cmteb_dres_model.py:68
↓ 3 callers
Method
compute_similarity
(q_reps: torch.Tensor, p_reps: torch.Tensor)
training/CoDiEmb/train/loss.py:126
↓ 3 callers
Method
get_embedding
(self, sentences: List[str], instruction="", **kwargs)
training/CoDiEmb/test/cmteb_dres_model.py:85
↓ 2 callers
Method
__init__
Args: eps (float): A small epsilon value to ensure numerical stability and handle comparisons, e.g., to
training/CoDiEmb/train/loss.py:239
↓ 2 callers
Method
_dist_gather_tensor
(self, t: torch.Tensor)
training/CoDiEmb/train/loss.py:165
↓ 2 callers
Method
_dist_gather_tensor
(self, t: torch.Tensor)
training/CoDiEmb/train/loss.py:219
↓ 2 callers
Method
_dist_gather_tensor
(self, t: torch.Tensor)
training/CoDiEmb/train/loss.py:315
↓ 2 callers
Method
_do_it_first
(self, first)
training/CoDiEmb/train/utils.py:25
↓ 2 callers
Function
baseOptions
(locale: string)
docs/app/layout.config.tsx:13
↓ 2 callers
Function
build_instruction_prefix
(model_name: str, instruction: str = "")
training/CoDiEmb/test/eval_cmteb.py:62
↓ 2 callers
Method
build_query
Assemble instruction and text, and return both the full text and instruction length. Returns: (full_text: str, instruction_len: int)
training/CoDiEmb/train/data.py:140
↓ 2 callers
Method
create_text_mask
Create precise text_mask based on offset_mapping and instruction character lengths. 1 indicates text token, 0 indicates instruction/p
training/CoDiEmb/train/data.py:214
↓ 2 callers
Method
encode
(self, sentences_batch, instruction)
test_transformers_local.py:47
↓ 2 callers
Method
encode
(self, sentences_batch, instruction)
test_transformers_online_macos.py:46
↓ 2 callers
Method
encode
(self, sentences_batch, instruction)
test_transformers_online_cuda.py:38
↓ 2 callers
Method
encode
(self, sentences_batch, instruction)
usage/infer_llm_embedding.py:50
↓ 2 callers
Function
generateI18nUrl
(targetLocale: string, currentPathname: string)
docs/lib/i18n-utils.ts:4
↓ 2 callers
Function
openDemo
(title: string, url: string)
docs/components/home/LandingShowcase.tsx:99
↓ 2 callers
Function
process_dataset
(data_args, training_args, num_samples, ds_name_to_samples, task_data, tokenizer=None)
training/CoDiEmb/train/run.py:103
↓ 2 callers
Function
renderPage
(page: any)
docs/app/docs/[lang]/[[...slug]]/page.tsx:37
↓ 2 callers
Method
set_epoch
(self, epoch)
training/CoDiEmb/train/run.py:466
↓ 2 callers
Method
wait_for_everyone
(self)
training/CoDiEmb/train/utils.py:22
↓ 2 callers
Function
wrappeed_callable
()
training/CoDiEmb/train/utils.py:61
↓ 1 callers
Method
_get_average_ranks
(self, x: torch.Tensor)
training/CoDiEmb/train/loss.py:193
↓ 1 callers
Method
_loss_ir
( self, q_reps: torch.Tensor, p_reps: torch.Tensor )
training/CoDiEmb/train/loss.py:81
↓ 1 callers
Method
_loss_sts
( self, q_reps: torch.Tensor, p_reps: torch.Tensor, y: Optional[torch.Tensor]
training/CoDiEmb/train/loss.py:55
↓ 1 callers
Method
_print_debug_info
(self)
training/CoDiEmb/train/sampler.py:326
↓ 1 callers
Function
analyze_retrieval_results
读取指定文件夹中的所有 .json 文件,提取信息并计算总分和平均分。 :param folder_path: 存放 .json 文件的文件夹路径
training/CoDiEmb/test/result/get_ir_ndcg.py:5
↓ 1 callers
Function
analyze_sts_results
读取指定文件夹中的所有 STS 任务 .json 文件,提取 Spearman 相关系数,并计算总分和平均分。 此版本会优先查找 "validation" 字段,如果找不到,则会查找 "test" 字段。 :param folder_path: 存放 .json 文件的
training/CoDiEmb/test/result/get_sts_spearman.py:4
↓ 1 callers
Function
args_to_dtype
(args)
training/CoDiEmb/train/run.py:28
↓ 1 callers
Function
broadcast_object_list
(object_list)
training/CoDiEmb/train/utils.py:45
↓ 1 callers
Function
buildCategoryLinks
( articles: RawArticleCard[], lang: LanguageKey, )
docs/app/[lang]/(home)/page.tsx:211
↓ 1 callers
Method
build_passage
Assemble instruction and text, and return both the full text and instruction length. Returns: (full_text: str, instruction_len: int)
training/CoDiEmb/train/data.py:178
↓ 1 callers
Function
build_passage_instruction_prefix
(model_name: str, instruction: str = "")
training/CoDiEmb/test/eval_cmteb.py:79
↓ 1 callers
Method
compute_similarity
(self, queries, passages)
test_transformers_local.py:97
↓ 1 callers
Method
compute_similarity
(self, queries, passages)
test_transformers_online_macos.py:96
↓ 1 callers
Method
compute_similarity
(self, queries, passages)
test_transformers_online_cuda.py:86
↓ 1 callers
Method
compute_similarity
(self, queries, passages)
usage/infer_llm_embedding.py:98
↓ 1 callers
Method
compute_similarity_for_vectors
(self, q_reps, p_reps)
test_transformers_local.py:92
↓ 1 callers
Method
compute_similarity_for_vectors
(self, q_reps, p_reps)
test_transformers_online_macos.py:91
↓ 1 callers
Method
compute_similarity_for_vectors
(self, q_reps, p_reps)
test_transformers_online_cuda.py:81
↓ 1 callers
Method
compute_similarity_for_vectors
(self, q_reps, p_reps)
usage/infer_llm_embedding.py:93
↓ 1 callers
Method
display_results
Display similarity results in a detailed visual format
test_transformers_local.py:104
↓ 1 callers
Function
encode
(client, inputs, is_query=False)
usage/tencent_cloud_api.py:15
↓ 1 callers
Method
encode_passages
(self, passages)
test_transformers_local.py:87
↓ 1 callers
Method
encode_passages
(self, passages)
test_transformers_online_macos.py:86
↓ 1 callers
Method
encode_passages
(self, passages)
test_transformers_online_cuda.py:76
↓ 1 callers
Method
encode_passages
(self, passages)
usage/infer_llm_embedding.py:88
↓ 1 callers
Method
encode_queries
(self, queries)
test_transformers_local.py:82
↓ 1 callers
Method
encode_queries
(self, queries)
test_transformers_online_macos.py:81
↓ 1 callers
Method
encode_queries
(self, queries)
test_transformers_online_cuda.py:71
↓ 1 callers
Method
encode_queries
(self, queries)
usage/infer_llm_embedding.py:83
↓ 1 callers
Method
encode_with_multi_layer_loss
(self, features)
training/CoDiEmb/train/model.py:75
↓ 1 callers
Method
encode_wo_multi_layer_loss
(self, features)
training/CoDiEmb/train/model.py:107
↓ 1 callers
Function
filter_too_long_instructions
(tokenizer, dataset, query_max_len, passage_max_len)
training/CoDiEmb/train/run.py:36
↓ 1 callers
Function
formatBaseUrl
(url: string)
docs/app/sitemap.ts:12
↓ 1 callers
Function
formatCategoryLabel
(key: string, fallback: string)
docs/app/[lang]/(home)/page.tsx:132
↓ 1 callers
Function
formatRelativeUpdate
(timestamp: number, lang: LanguageKey)
docs/app/[lang]/(home)/page.tsx:137
↓ 1 callers
Function
getArticles
(lang: LanguageKey)
docs/app/[lang]/(home)/page.tsx:165
↓ 1 callers
Function
getAssetPath
(path: string)
docs/lib/utils.ts:11
↓ 1 callers
Function
getMDXComponents
(components?: MDXComponents)
docs/mdx-components.tsx:6
↓ 1 callers
Method
get_all_dataset_batches
(self, generator)
training/CoDiEmb/train/sampler.py:79
↓ 1 callers
Function
get_args
()
training/CoDiEmb/test/eval_cmteb.py:184
↓ 1 callers
Method
get_chunks
(self, global_idxs, ds_indices_per_dataset_chunks)
training/CoDiEmb/train/sampler.py:203
↓ 1 callers
Method
get_negatives
(self, data_item)
training/CoDiEmb/train/data.py:80
↓ 1 callers
Method
get_positives
(self, data_item)
training/CoDiEmb/train/data.py:62
↓ 1 callers
Function
get_tasks
(names: list[str] | None, languages: list[str] | None = None, benchmark: str | None = None)
evaluation/run_mteb.py:217
↓ 1 callers
Function
loadMermaid
()
docs/components/mdx/mermaid.tsx:21
↓ 1 callers
Function
load_ir_train_data
(data_args, training_args, num_samples, ds_name_to_samples, tokenizer=None)
training/CoDiEmb/train/run.py:164
↓ 1 callers
Function
load_model
(args)
training/CoDiEmb/test/eval_cmteb.py:93
↓ 1 callers
Function
load_sts_train_data
(data_args, training_args, num_samples, ds_name_to_samples, tokenizer=None)
training/CoDiEmb/train/run.py:179
↓ 1 callers
Function
load_train_data
(data_args, training_args, tokenizer=None)
training/CoDiEmb/train/run.py:194
↓ 1 callers
Function
main
()
test_transformers_local.py:151
↓ 1 callers
Function
main
()
training/CoDiEmb/test/eval_cmteb.py:198
↓ 1 callers
Function
main
()
training/CoDiEmb/test/result/get_sts_spearman.py:50
↓ 1 callers
Function
main
()
training/CoDiEmb/test/result/get_ir_ndcg.py:44
↓ 1 callers
Function
main
()
training/CoDiEmb/train/run.py:226
↓ 1 callers
Function
main
()
usage/infer_llm_embedding.py:106
↓ 1 callers
Function
main
()
evaluation/run_mteb.py:275
↓ 1 callers
Method
mean_pooling
(self, hidden_state, attention_mask)
test_transformers_local.py:40
↓ 1 callers
Method
mean_pooling
(self, hidden_state, attention_mask)
test_transformers_online_macos.py:39
↓ 1 callers
Method
mean_pooling
(self, hidden_state, attention_mask)
test_transformers_online_cuda.py:31
↓ 1 callers
Method
mean_pooling
(self, hidden_state, attention_mask)
training/CoDiEmb/test/cmteb_dres_model.py:177
↓ 1 callers
Method
mean_pooling
(self, hidden_state, attention_mask)
usage/infer_llm_embedding.py:43
↓ 1 callers
Function
normalizeLanguage
(lang: string)
docs/app/[lang]/(home)/page.tsx:90
↓ 1 callers
Function
normalize_dataset_features
(dataset)
training/CoDiEmb/train/run.py:55
↓ 1 callers
Function
one_by_one
()
training/CoDiEmb/train/utils.py:67
↓ 1 callers
Function
overlap
()
training/CoDiEmb/train/utils.py:82
↓ 1 callers
Method
process_passages
(self, passage_groups, task_types)
training/CoDiEmb/train/data.py:233
↓ 1 callers
Function
renderChart
()
docs/components/mdx/mermaid.tsx:29
↓ 1 callers
Function
resolveLocale
(request: NextRequest)
docs/middleware.ts:9
↓ 1 callers
Function
resolveMTime
(relativePath: string)
docs/app/[lang]/(home)/page.tsx:111
↓ 1 callers
Function
resolveRelativePath
(page: ReturnType<typeof source.getPages>[number])
docs/app/[lang]/(home)/page.tsx:104
↓ 1 callers
Function
run_eval
(model, tasks: list, args: EvalArguments, **kwargs)
evaluation/run_mteb.py:235
↓ 1 callers
Function
set_instruction
(model, task, args)
training/CoDiEmb/test/eval_cmteb.py:155
next →
1–100 of 191, ranked by callers