MCPcopy Create free account
hub / github.com/apache/impala / run_dataset_preload

Function run_dataset_preload

bin/load-data.py:216–225  ·  view source on GitHub ↗

Execute a preload script if present in dataset directory. E.g. to generate data before loading

(dataset)

Source from the content-addressed store, hash-verified

214 return is_success
215
216def run_dataset_preload(dataset):
217 """Execute a preload script if present in dataset directory. E.g. to generate data
218 before loading"""
219 dataset_preload_script = os.path.join(DATASET_DIR, dataset, "preload")
220 if os.path.exists(dataset_preload_script):
221 LOG.info("Running preload script for " + dataset)
222 if options.scale_factor != "" and int(options.scale_factor) > 1:
223 dataset_preload_script += " " + str(options.scale_factor)
224 exec_cmd(dataset_preload_script, error_msg="Error executing preload script for " + dataset,
225 exit_on_error=True)
226
227def generate_schema_statements(workload):
228 generate_cmd = GENERATE_SCHEMA_CMD % (options.exploration_strategy, workload,

Callers 1

mainFunction · 0.85

Calls 3

exec_cmdFunction · 0.70
joinMethod · 0.45
existsMethod · 0.45

Tested by

no test coverage detected