MCPcopy
hub / github.com/nltk/nltk / __init__

Method __init__

nltk/text.py:339–356  ·  view source on GitHub ↗

Create a Text object. :param tokens: The source text. :type tokens: sequence of str

(self, tokens, name=None)

Source from the content-addressed store, hash-verified

337 _COPY_TOKENS = True
338
339 def __init__(self, tokens, name=None):
340 """
341 Create a Text object.
342
343 :param tokens: The source text.
344 :type tokens: sequence of str
345 """
346 if self._COPY_TOKENS:
347 tokens = list(tokens)
348 self.tokens = tokens
349
350 if name:
351 self.name = name
352 elif "]" in tokens[:20]:
353 end = tokens[:20].index("]")
354 self.name = " ".join(str(tok) for tok in tokens[1:end])
355 else:
356 self.name = " ".join(str(tok) for tok in tokens[:8]) + "..."
357
358 # ////////////////////////////////////////////////////////////
359 # Support item & slice access

Callers 1

__init__Method · 0.45

Calls 2

indexMethod · 0.45
joinMethod · 0.45

Tested by

no test coverage detected