Set the options for this tokenizer. By default, this is 0.
| 114 | |
| 115 | // Set the options for this tokenizer. By default, this is 0. |
| 116 | void set_options(int options) { options_ = options; } |
| 117 | |
| 118 | // Set the characters to regard as quotes. By default, this is empty. When |
| 119 | // a quote char is encountered, the tokenizer will switch into a mode where |