MCPcopy Create free account
hub / github.com/google-research/language / span_tokenize

Method span_tokenize

language/fruit/rendering_utils.py:316–322  ·  view source on GitHub ↗
(
      self,
      text,
      *args,
      **kwargs,
  )

Source from the content-addressed store, hash-verified

314 """Abstract class for span tokenizers."""
315
316 def span_tokenize(
317 self,
318 text,
319 *args,
320 **kwargs,
321 ):
322 Ellipsis
323
324
325def iou_score(sent_a, sent_b):

Callers 2

Calls

no outgoing calls

Tested by

no test coverage detected