MCPcopy Create free account
hub / github.com/eshirazi/python-with-braces / tokenize

Function tokenize

Lib/tokenize.py:155–171  ·  view source on GitHub ↗

The tokenize() function accepts two parameters: one representing the input stream, and one providing an output mechanism for tokenize(). The first parameter, readline, must be a callable object which provides the same interface as the readline() method of built-in file objects.

(readline, tokeneater=printtoken)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

tokenize.pyFile · 0.70

Calls 1

tokenize_loopFunction · 0.70

Tested by

no test coverage detected