MCPcopy Index your code
hub / github.com/NVIDIA/TensorRT-LLM / PostprocWorkerConfig

Class PostprocWorkerConfig

tensorrt_llm/executor/postproc_worker.py:42–49  ·  view source on GitHub ↗

The config for the postprocess worker.

Source from the content-addressed store, hash-verified

40
41@dataclass
42class PostprocWorkerConfig:
43 ''' The config for the postprocess worker. '''
44 num_postprocess_workers: int = 0
45 postprocess_tokenizer_dir: Optional[str] = None
46
47 @property
48 def enabled(self) -> bool:
49 return self.num_postprocess_workers > 0
50
51
52class PostprocWorker:

Callers 8

_build_modelMethod · 0.85
_build_modelMethod · 0.85
__init__Method · 0.85
__init__Method · 0.85
createMethod · 0.85
__init__Method · 0.85
__init__Method · 0.85
worker_mainFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected