MCPcopy Create free account
hub / github.com/LiteSSLHub/DisCo / tokenize

Method tokenize

src/pytorch_pretrained_bert/tokenization.py:92–97  ·  view source on GitHub ↗
(self, text)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

convert_examples_to_featuresFunction · 0.45
mainFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected