Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/davisking/dlib
/ tokenizer_tester
Method
tokenizer_tester
dlib/test/tokenizer.cpp:414–418 ·
view source on GitHub ↗
Source
from the content-addressed store, hash-verified
412
{
413
public:
414
tokenizer_tester (
415
) :
416
tester (
"test_tokenizer"
,
417
"Runs tests on the tokenizer component."
)
418
{}
419
420
void perform_test (
421
)
Callers
nothing calls this directly
Calls
no outgoing calls
Tested by
no test coverage detected