MCPcopy Create free account
hub / github.com/Mark12Ding/Dispider / preprocess_v1

Function preprocess_v1

dispider/conv_template.py:9–84  ·  view source on GitHub ↗
(
    sources,
    tokenizer: transformers.PreTrainedTokenizer,
    conv: Conversation,
    has_image: bool = False
)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls 3

tokenizer_image_tokenFunction · 0.85
append_messageMethod · 0.80
get_promptMethod · 0.80

Tested by

no test coverage detected