Function tokenize

sdgsystem/utils.py:6–7 · view source on GitHub ↗

(text: str)

Source from the content-addressed store, hash-verified

4
5
6	def tokenize(text: str) -> List[str]:
7	return text.lower().split()
8
9	def check_dir(path: str):
10	directory = os.path.dirname(path)

_searchMethod · 0.85

splitMethod · 0.80

no test coverage detected