MCPcopy Create free account
hub / github.com/CasterWx/python-girlfriend-mood / tokenize

Method tokenize

jieba/__init__.py:455–486  ·  view source on GitHub ↗

Tokenize a sentence and yields tuples of (word, start, end) Parameter: - sentence: the str(unicode) to be segmented. - mode: "default" or "search", "search" is for finer segmentation. - HMM: whether to use the Hidden Markov Model.

(self, unicode_sentence, mode="default", HMM=True)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

__call__Method · 0.80

Calls 1

cutMethod · 0.95

Tested by

no test coverage detected