MCPcopy Create free account
hub / github.com/modelscope/modelscope / to_hf_dataset

Method to_hf_dataset

modelscope/msdatasets/ms_dataset.py:649–651  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

647 prefetch=prefetch)
648
649 def to_hf_dataset(self) -> Dataset:
650 self._hf_ds.reset_format()
651 return self._hf_ds
652
653 def remap_columns(self, column_mapping: Dict[str, str]) -> Dataset:
654 """

Callers 14

build_dataset_from_fileFunction · 0.80
test_ms_csv_basicMethod · 0.80
test_finetune_msmarcoMethod · 0.80
test_finetune_dureaderMethod · 0.80
setUpMethod · 0.80
train_workerFunction · 0.80
test_finetune_msmarcoMethod · 0.80
test_finetune_dureaderMethod · 0.80
test_finetune_cluewscMethod · 0.80
setUpMethod · 0.80
test_trainer_save_best_ckptMethod · 0.80
test_trainer_with_continue_trainMethod · 0.80

Calls

no outgoing calls

Tested by 12

test_ms_csv_basicMethod · 0.64
test_finetune_msmarcoMethod · 0.64
test_finetune_dureaderMethod · 0.64
setUpMethod · 0.64
train_workerFunction · 0.64
test_finetune_msmarcoMethod · 0.64
test_finetune_dureaderMethod · 0.64
test_finetune_cluewscMethod · 0.64
setUpMethod · 0.64
test_trainer_save_best_ckptMethod · 0.64
test_trainer_with_continue_trainMethod · 0.64
setUpMethod · 0.64