MCPcopy Create free account
hub / github.com/OSU-NLP-Group/In-Context-Reranking / mean_pooling

Function mean_pooling

experiments.py:47–50  ·  view source on GitHub ↗
(token_embeddings, mask)

Source from the content-addressed store, hash-verified

45if args.reranker == 'rankgpt':
46 from src.rank_gpt_reranker import RankGPTModel
47def mean_pooling(token_embeddings, mask):
48 token_embeddings = token_embeddings.masked_fill(~mask[..., None].bool(), 0.)
49 sentence_embeddings = token_embeddings.sum(dim=1) / mask.sum(dim=1)[..., None]
50 return sentence_embeddings
51
52NO_TITLE_DATASETS = ['fiqa']
53

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected