MCPcopy Create free account
hub / github.com/google-research/language / TokenizationError

Class TokenizationError

language/realm/featurization.py:551–552  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

549
550
551class TokenizationError(Exception):
552 pass
553
554
555def bert_format(input_seqs, max_seq_len, cls_id, sep_id):

Callers 1

_compute_token_boundariesMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…