Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/OpenBitSys/BitDistiller
/ doc_to_text
Method
doc_to_text
test/general/lm_eval/tasks/mutual.py:52–53 ·
view source on GitHub ↗
(self, doc)
Source
from the content-addressed store, hash-verified
50
return
NotImplemented
51
52
def
doc_to_text(self, doc):
53
return
self.detokenize(doc[
"article"
])
54
55
def
should_decontaminate(self):
56
return
True
Callers
nothing calls this directly
Calls
1
detokenize
Method · 0.95
Tested by
no test coverage detected