MCPcopy Create free account
hub / github.com/MiniMax-AI/VTP / _clean_lower

Function _clean_lower

vtp/tokenizers/text_tokenizer.py:124–126  ·  view source on GitHub ↗

Basic, remove whitespace, lower case.

(x)

Source from the content-addressed store, hash-verified

122
123
124def _clean_lower(x):
125 """Basic, remove whitespace, lower case."""
126 return whitespace_clean(basic_clean(x)).lower()
127
128
129def _clean_whitespace(x):

Callers

nothing calls this directly

Calls 2

whitespace_cleanFunction · 0.85
basic_cleanFunction · 0.85

Tested by

no test coverage detected