MCPcopy Create free account
hub / github.com/google-research/language / _ngrams

Function _ngrams

language/table_text_eval/table_text_eval.py:290–294  ·  view source on GitHub ↗

Yields all ngrams of given order in sequence.

(sequence, order)

Source from the content-addressed store, hash-verified

288
289
290def _ngrams(sequence, order):
291 """Yields all ngrams of given order in sequence."""
292 assert order >= 1
293 for n in range(order, len(sequence) + 1):
294 yield tuple(sequence[n - order: n])
295
296
297def _ngram_counts(sequence, order):

Callers 1

_ngram_countsFunction · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…