total number of tokens
(self)
| 271 | return self.EncodeAsIds(text, process_fn=process_fn) |
| 272 | |
| 273 | def __len__(self): |
| 274 | """total number of tokens""" |
| 275 | return self.num_tokens |
| 276 | |
| 277 | def get_command(self, name): |
| 278 | """get command token corresponding to `name`""" |
nothing calls this directly
no outgoing calls
no test coverage detected