Function test_text_only

tests/data/test_preprocessor.py:33–35 · view source on GitHub ↗

()

Source from the content-addressed store, hash-verified

31
32
33	def test_text_only():
34	_test_tokenization(["What time is it?", " 3"])
35	_test_tokenization(["a b", " res1 res2", " d e", " res5"])
36
37
38	def test_at_start():

nothing calls this directly

_test_tokenizationFunction · 0.85

no test coverage detected