MCPcopy
hub / github.com/dlt-hub/dlt / write_progress

Method write_progress

dlt/common/storages/load_package.py:692–698  ·  view source on GitHub ↗

Writes buffered table→count pairs as a JSON progress file (atomic via rename).

(self, load_id: str, table_counts: Dict[str, int])

Source from the content-addressed store, hash-verified

690 self.storage.create_folder(self.get_progress_dir(load_id), exists_ok=True)
691
692 def write_progress(self, load_id: str, table_counts: Dict[str, int]) -> None:
693 """Writes buffered table→count pairs as a JSON progress file (atomic via rename)."""
694 if not table_counts:
695 return
696 progress_dir = self.get_progress_dir(load_id)
697 file_path = os.path.join(progress_dir, uniq_id() + ".progress.json")
698 self.storage.save(file_path, json.dumps(table_counts))
699
700 def collect_progress(self, load_id: str) -> Dict[str, int]:
701 """Reads and deletes all progress files, returning aggregated table→items_count."""

Callers 2

_flush_progressMethod · 0.80

Calls 5

get_progress_dirMethod · 0.95
uniq_idFunction · 0.90
joinMethod · 0.80
saveMethod · 0.80
dumpsMethod · 0.45

Tested by 1