MCPcopy Index your code
hub / github.com/modelscope/modelscope / build_preprocessor

Function build_preprocessor

modelscope/preprocessors/builder.py:10–22  ·  view source on GitHub ↗

build preprocessor given model config dict Args: cfg (:obj:`ConfigDict`): config dict for model object. field_name (str, optional): application field name, refer to :obj:`Fields` for more details default_args (dict, optional): Default initialization argumen

(cfg: ConfigDict,
                       field_name: str = None,
                       default_args: dict = None)

Source from the content-addressed store, hash-verified

8
9
10def build_preprocessor(cfg: ConfigDict,
11 field_name: str = None,
12 default_args: dict = None):
13 """ build preprocessor given model config dict
14
15 Args:
16 cfg (:obj:`ConfigDict`): config dict for model object.
17 field_name (str, optional): application field name, refer to
18 :obj:`Fields` for more details
19 default_args (dict, optional): Default initialization arguments.
20 """
21 return build_from_cfg(
22 cfg, PREPROCESSORS, group_key=field_name, default_args=default_args)

Callers 13

to_custom_datasetMethod · 0.90
__init__Method · 0.90
__init__Method · 0.90
__init__Method · 0.90
test_tokenizeMethod · 0.90
from_pretrainedMethod · 0.85
__init__Method · 0.85

Calls 1

build_from_cfgFunction · 0.90

Used in the wild real call sites across dependent graphs

searching dependent graphs…