MCPcopy Create free account
hub / github.com/modelscope/modelscope / build_preprocessor

Method build_preprocessor

modelscope/trainers/trainer.py:630–644  ·  view source on GitHub ↗

Build train and eval preprocessor. User can override this method to implement custom logits. Returns: The train preprocessor and eval preprocessor instance.

(self)

Source from the content-addressed store, hash-verified

628 return dataset.ds_instance
629
630 def build_preprocessor(self) -> Tuple[Preprocessor, Preprocessor]:
631 """Build train and eval preprocessor.
632
633 User can override this method to implement custom logits.
634
635 Returns: The train preprocessor and eval preprocessor instance.
636
637 """
638 train_preprocessor = Preprocessor.from_pretrained(
639 self.model_dir,
640 cfg_dict=self.cfg,
641 preprocessor_mode=ModeKeys.TRAIN)
642 eval_preprocessor = Preprocessor.from_pretrained(
643 self.model_dir, cfg_dict=self.cfg, preprocessor_mode=ModeKeys.EVAL)
644 return train_preprocessor, eval_preprocessor
645
646 def get_metrics(self) -> List[Union[str, Dict]]:
647 """Get the metric class types.

Callers 1

get_preprocessorsMethod · 0.95

Calls 1

from_pretrainedMethod · 0.45

Tested by

no test coverage detected