MCPcopy Create free account
hub / github.com/AI-Hypercomputer/maxtext / TokenizerParameters

Class TokenizerParameters

src/MaxText/gcloud_stub.py:152–156  ·  view source on GitHub ↗

Stub tokenizer parameters object.

Source from the content-addressed store, hash-verified

150
151 # Tokenizer placeholders (unused in decoupled tests due to runtime guard).
152 class TokenizerParameters: # pragma: no cover - placeholder
153 """Stub tokenizer parameters object."""
154
155 def __init__(self, *a, **k): # pylint: disable=unused-argument
156 pass
157
158 class TokenizerType: # emulate enum descriptor access pattern
159 """Stub tokenizer type descriptor container."""

Callers 1

get_tokenizerMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected