MCPcopy Create free account
hub / github.com/antirez/llama.cpp-deepseek-v4-flash / mtmd_tokenize

Function mtmd_tokenize

tools/mtmd/mtmd.cpp:998–1005  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

996};
997
998int32_t mtmd_tokenize(mtmd_context * ctx,
999 mtmd_input_chunks * output,
1000 const mtmd_input_text * text,
1001 const mtmd_bitmap ** bitmaps,
1002 size_t n_bitmaps) {
1003 mtmd_tokenizer tokenizer(ctx, text, bitmaps, n_bitmaps);
1004 return tokenizer.tokenize(output);
1005}
1006
1007int32_t mtmd_encode_chunk(mtmd_context * ctx, const mtmd_input_chunk * chunk) {
1008 if (chunk->type == MTMD_INPUT_CHUNK_TYPE_TEXT) {

Callers 2

eval_messageFunction · 0.85
process_mtmd_promptFunction · 0.85

Calls 1

tokenizeMethod · 0.45

Tested by

no test coverage detected