MCPcopy Create free account
hub / github.com/Alibaba-NLP/ViDoRAG / parse_file

Method parse_file

search_engine.py:133–138  ·  view source on GitHub ↗
(file,node_dir)

Source from the content-addressed store, hash-verified

131 parsed_files.extend(nodes)
132 else:
133 def parse_file(file,node_dir):
134 input_file = os.path.join(node_dir, file)
135 suffix = input_file.split('.')[-1]
136 if suffix != 'node':
137 return []
138 return nodefile2node(input_file)
139 with ThreadPoolExecutor(max_workers=max_workers) as executor:
140 # results = list(tqdm(executor.map(parse_file, files, self.node_dir), total=len(files)))
141 results = list(tqdm(executor.map(parse_file, files, [self.node_dir]*len(files)), total=len(files)))

Callers

nothing calls this directly

Calls 1

nodefile2nodeFunction · 0.90

Tested by

no test coverage detected