* Creates a token based on the Buffer value provided * @abstract * @param {Buffer|Array} value * @returns {Token} Computed token
(value)
| 52 | * @returns {Token} Computed token |
| 53 | */ |
| 54 | hash(value) { |
| 55 | throw new Error('You must implement a hash function for the tokenizer'); |
| 56 | } |
| 57 | |
| 58 | /** |
| 59 | * Parses a token string and returns a representation of the token |
no outgoing calls
no test coverage detected