MCPcopy Create free account
hub / github.com/OpenSparseLLMs/MoM / clean_cpp

Method clean_cpp

lm-eval-harness/lm_eval/decontamination/janitor.py:200–204  ·  view source on GitHub ↗
(self, dirty_string: str)

Source from the content-addressed store, hash-verified

198 )
199
200 def clean_cpp(self, dirty_string: str) -> List[str]:
201 contamination_indices = janitor_util.clean_ngram_with_indices(
202 dirty_string, self.delete_chars, self.ngram_n
203 )
204 return self._split_chunks(dirty_string, contamination_indices)
205
206 ##############
207 # Slow python

Callers 1

cleanMethod · 0.95

Calls 1

_split_chunksMethod · 0.95

Tested by

no test coverage detected