MCPcopy Create free account
hub / github.com/openai/tiktoken / test_large_repeated

Function test_large_repeated

tests/test_encoding.py:52–57  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

50
51
52def test_large_repeated():
53 enc = tiktoken.get_encoding("o200k_base")
54
55 # Large inputs should be handled without raising.
56 tokens = enc.encode("x" * 1_000_000)
57 assert tokens
58
59
60def test_simple_regex():

Callers

nothing calls this directly

Calls 1

encodeMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…