MCPcopy Create free account
hub / github.com/YunwenTechnology/QueryGeneration / __init__

Method __init__

tokenization/tokenization.py:175–181  ·  view source on GitHub ↗

Constructs a BasicTokenizer. Args: do_lower_case: Whether to lower case the input.

(self, do_lower_case=True)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected