MCPcopy Create free account
hub / github.com/MiniMax-AI/VTP / whitespace_clean

Function whitespace_clean

vtp/tokenizers/text_tokenizer.py:117–121  ·  view source on GitHub ↗

Clean whitespace.

(text)

Source from the content-addressed store, hash-verified

115
116
117def whitespace_clean(text):
118 """Clean whitespace."""
119 text = " ".join(text.split())
120 text = text.strip()
121 return text
122
123
124def _clean_lower(x):

Callers 2

_clean_lowerFunction · 0.85
_clean_whitespaceFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected