The config for the postprocess worker.
| 40 | |
| 41 | @dataclass |
| 42 | class PostprocWorkerConfig: |
| 43 | ''' The config for the postprocess worker. ''' |
| 44 | num_postprocess_workers: int = 0 |
| 45 | postprocess_tokenizer_dir: Optional[str] = None |
| 46 | |
| 47 | @property |
| 48 | def enabled(self) -> bool: |
| 49 | return self.num_postprocess_workers > 0 |
| 50 | |
| 51 | |
| 52 | class PostprocWorker: |
no outgoing calls
no test coverage detected