MCPcopy Create free account
hub / github.com/activeloopai/deeplake / transfer_non_link_data

Function transfer_non_link_data

python/deeplake/__init__.py:253–259  ·  view source on GitHub ↗
(source, dest)

Source from the content-addressed store, hash-verified

251 ]
252
253 def transfer_non_link_data(source, dest):
254 dl = deeplake._deeplake._Prefetcher(source, raw_columns=set(get_raw_columns(source)))
255 for counter, batch in enumerate(progress_bar(dl), start=1):
256 dest.append(batch)
257 if counter % 100 == 0:
258 commit_data(dest)
259 commit_data(dest, "Final commit of non-link data")
260
261 def transfer_with_links(source, dest, links, column_names):
262 iterable_cols = [col for col in column_names if col not in links]

Callers 1

convertFunction · 0.85

Calls 5

setFunction · 0.85
get_raw_columnsFunction · 0.85
commit_dataFunction · 0.85
appendMethod · 0.80
progress_barFunction · 0.70

Tested by

no test coverage detected