This object represents response to a given query

This class wraps an LLM implementation and run inference (aka 'query' method) in separate processes on the local box. The configuration woul

This is a trivial implementation of an LLM used for unit tests and an example for other implementations. The configuration looks like:

This class represents a request ot make a query to the LLM.

Strategy to migrate a compilation unit

This class adds a capability to query chat GPT for a completion. The configuration looks like: ``` llm: class: ChatGptLLM

This is a model that represents Huggingface 'AutoModelForCausalLM' transformer model. llm: class: HuggingfaceLLM config: