MCPcopy Create free account
hub / github.com/JFox/aws-lambda-lxml / tokenize

Function tokenize

3.6.4/py27/lxml/html/diff.py:516–538  ·  view source on GitHub ↗

Parse the given HTML and returns token objects (words with attached tags). This parses only the content of a page; anything in the head is ignored, and the and elements are themselves optional. The content is then parsed by lxml, which ensures the validity of the

(html, include_hrefs=True)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

tokenize_annotatedFunction · 0.70
htmldiffFunction · 0.70

Calls 3

parse_htmlFunction · 0.70
flatten_elFunction · 0.70
fixup_chunksFunction · 0.70

Tested by

no test coverage detected