Function PutTokenizer

pkg/sql/tokenizer/pool.go:129–138

PutTokenizer returns a Tokenizer instance to the pool for reuse. This must be called after you're done with a Tokenizer obtained from GetTokenizer() to enable instance reuse and prevent memory leaks. The tokenizer is automatically reset before being returned to the pool, clearing all state includi

(t *Tokenizer)

//   - Debug logger cleared
//   - Keywords preserved (immutable configuration)
func PutTokenizer(t *Tokenizer) {
	if t != nil {
		t.Reset()
		tokenizerPool.Put(t)

		// Record pool return
		metrics.RecordPoolPut()
		metrics.RecordNamedPoolPut("tokenizer")
	}
}

// Reset clears a Tokenizer's state for reuse while preserving allocated memory.
//