Method
_TokenizeOneSentence
Tokenizes a single sentence.
(i, strs, token_ids_ta, target_ids_ta, paddings_ta)
Source from the content-addressed store, hash-verified
source not stored for this graph (policy: none)
Callers
nothing calls this directly
Tested by
no test coverage detected