MCPcopy Create free account
hub / github.com/LiteSSLHub/DisCo / __init__

Method __init__

src/data.py:335–347  ·  view source on GitHub ↗
(self,
                 data_filename,
                 tokenizer,
                 text_max_len: int,
                 max_text_ntokens_per_sent: int,
                 min_text_ntokens_per_sent: int,
                 )

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls 1

read_jsonlFunction · 0.90

Tested by

no test coverage detected