Function _clean_whitespace

vtp/tokenizers/text_tokenizer.py:129–131 · view source on GitHub ↗

Basic, remove whitespace.

(x)

Source from the content-addressed store, hash-verified

127
128
129	def _clean_whitespace(x):
130	"""Basic, remove whitespace."""
131	return whitespace_clean(basic_clean(x))
132
133
134	def get_clean_fn(clean_type: str):

nothing calls this directly

whitespace_cleanFunction · 0.85

basic_cleanFunction · 0.85

no test coverage detected