MCPcopy Create free account
hub / github.com/Yuan-Li-FNLP/R3-RAG / single_worker

Function single_worker

tool/FlashRAG/scripts/preprocess_wiki_old.py:153–161  ·  view source on GitHub ↗
(docs)

Source from the content-addressed store, hash-verified

151
152
153def single_worker(docs):
154 results = []
155 for item in tqdm(docs):
156 title, text = basic_process(item[0], item[1])
157 if title is None:
158 continue
159 title = f'"{title}"'
160 results.append((title, text))
161 return results
162
163
164if __name__ == "__main__":

Callers

nothing calls this directly

Calls 2

basic_processFunction · 0.70
appendMethod · 0.45

Tested by

no test coverage detected