MCPcopy
hub / github.com/LAION-AI/Open-Assistant / download_data

Function download_data

data/datasets/oa_dolly_15k/create_dataset.py:11–16  ·  view source on GitHub ↗
(url: str, destination: str)

Source from the content-addressed store, hash-verified

9
10
11def download_data(url: str, destination: str):
12 response = requests.get(url, stream=True)
13
14 with open(destination, "wb") as handle:
15 for data in response.iter_content():
16 handle.write(data)
17
18
19def build_dataset(data_file: str, include_context: bool = True) -> Dataset:

Callers 1

mainFunction · 0.85

Calls 1

getMethod · 0.45

Tested by

no test coverage detected