Types & classes — github.com/anarchy-ai/LLM-VM

CodeHub MCPcopy Create free account

hub / github.com/anarchy-ai/LLM-VM / types & classes

Types & classes98 in github.com/anarchy-ai/LLM-VM

⨍ Functions 280◇ Types & classes 98 ↳ Endpoints 2

↓ 12 callersClassClient

This is a class sets up a Local optimizer around a LLM for easy access. Attributes: optimizer (LocalOptimizer): Anarchy LLM Optimize

src/llm_vm/client.py:42

↓ 4 callersClassGenerativeCompletion

src/llm_vm/guided_completion.py:37

↓ 3 callersClassFinetuningDataset

src/llm_vm/onsite_llm.py:83

↓ 2 callersClassAgent

src/llm_vm/agents/REBEL/agent.py:179

↓ 2 callersClassDataSynthesis

src/llm_vm/completion/data_synthesis.py:13

↓ 2 callersClassGrammarCompletion

src/llm_vm/guided_completion.py:72

↓ 2 callersClassLocalOptimizer

src/llm_vm/completion/optimize.py:178

↓ 2 callersClasssuppress_output

eval_finetuned.py:10

↓ 1 callersClassAgent

src/llm_vm/agents/FLAT/agent.py:14

↓ 1 callersClassGrammarLogitsProcessor

src/llm_vm/guided_completion.py:381

↓ 1 callersClassLocalEphemeral

src/llm_vm/completion/optimize.py:57

↓ 1 callersClassPineconeDB

src/llm_vm/vector_db.py:36

↓ 1 callersClassRAMLogger

src/llm_vm/utils/ram.py:4

↓ 1 callersClassSimple_Inference_Client

src/llm_vm/client.py:32

↓ 1 callersClassTreeToJson

src/llm_vm/guided_completion.py:300

↓ 1 callersClasssuppress_output

src/llm_vm/agents/REBEL/test_agent.py:18

ClassAnswerFromMemoryModelData

src/llm_vm/utils/typings_llm.py:101

ClassAnswerFromMemoryModelData

src/llm_vm/agents/FLAT/typings.py:96

ClassAnswerInMemoryModel

src/llm_vm/utils/typings_llm.py:178

ClassAnswerInMemoryModel

src/llm_vm/agents/FLAT/typings.py:173

ClassAnswerInMemoryModelData

src/llm_vm/utils/typings_llm.py:172

ClassAnswerInMemoryModelData

src/llm_vm/agents/FLAT/typings.py:167

ClassBaseCtransformersLLM

Base Class for running Ctransformers/GGML models Attributes: model_uri (str): Ctransformers uri for LLM model_kwargs (dict):

src/llm_vm/onsite_llm.py:887

ClassBaseOnsiteLLM

src/llm_vm/onsite_llm.py:92

ClassBase_Llama2_13b_Q4

Class for running quantized Llama 2 13b base model instance Properties: model_uri: Ctransformers uri for LLM model_file: ggu

src/llm_vm/onsite_llm.py:987

ClassBase_Llama2_7b_Q4

Class for running quantized Llama 2 7b base model instance Properties: model_uri: Ctransformers uri for LLM model_file: gguf

src/llm_vm/onsite_llm.py:973

This is a class for openAI's gpt-3.5-turbo LLM Methods: generate: Generates a response from a given prompt through OpenAI's endpoint

src/llm_vm/onsite_llm.py:827

ClassChat_Llama2_13b_Q4

Class for running Llama2-13b-Chat model instance Properties: model_uri: Ctransformers uri for LLM model_file: gguf or bin fi

src/llm_vm/onsite_llm.py:1028

ClassChat_Llama2_13b_Q6

Class for running Llama2-13b-Chat model instance Properties: model_uri: Ctransformers uri for LLM model_file: gguf or bin fi

src/llm_vm/onsite_llm.py:1042

ClassChat_Llama2_7b_Q4

Class for running Llama2-7b-Chat model instance Properties: model_uri: Ctransformers uri for LLM model_file: gguf or bin fil

src/llm_vm/onsite_llm.py:1001

ClassChat_Llama2_7b_Q6

Class for running Llama2-7b-Chat model instance Properties: model_uri: Ctransformers uri for LLM model_file: gguf or bin fil

src/llm_vm/onsite_llm.py:1014

ClassCodeLlama13b

This is a class for Meta's code-llama-13b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (Auto

src/llm_vm/onsite_llm.py:636

ClassCodeLlama34b

This is a class for Meta's code-llama-34b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (Auto

src/llm_vm/onsite_llm.py:659

ClassCodeLlama7b

This is a class for Meta's code-llama-7b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoT

src/llm_vm/onsite_llm.py:613

ClassCompletion

A class used to generate completions when optimize.complete is called

src/llm_vm/guided_completion.py:13

ClassDebugCalls

src/llm_vm/utils/typings_llm.py:182

ClassDebugCalls

src/llm_vm/agents/FLAT/typings.py:177

ClassDecisionStep

src/llm_vm/utils/typings_llm.py:21

ClassDecisionStep

src/llm_vm/agents/FLAT/typings.py:16

ClassDefaultTools

src/llm_vm/utils/typings_llm.py:27

ClassDefaultTools

src/llm_vm/agents/FLAT/typings.py:22

ClassDefaultTrainingTools

src/llm_vm/utils/typings_llm.py:38

ClassDefaultTrainingTools

src/llm_vm/agents/FLAT/typings.py:33

This is a class for openAI's completion endpoint Methods: generate: Generates a response from a given prompt with OpenAI's completio

src/llm_vm/onsite_llm.py:730

This is a class for openAI's gpt-4 LLM Methods: generate: Generates a response from a given prompt through OpenAI's endpoint

src/llm_vm/onsite_llm.py:789

ClassGrammarConstraint

src/llm_vm/guided_completion.py:125

ClassHostedOptimizer

src/llm_vm/completion/optimize.py:137

ClassJSONConstraint

src/llm_vm/guided_completion.py:247

ClassLLMCallParams

src/llm_vm/utils/typings_llm.py:116

ClassLLMCallParams

src/llm_vm/agents/FLAT/typings.py:111

ClassLLMCallType

src/llm_vm/utils/typings_llm.py:16

ClassLLMCallType

src/llm_vm/agents/FLAT/typings.py:11

ClassLLMTrainingResult

src/llm_vm/utils/typings_llm.py:126

ClassLLMTrainingResult

src/llm_vm/agents/FLAT/typings.py:121

ClassLLMTrainingResultMeta

src/llm_vm/utils/typings_llm.py:131

ClassLLMTrainingResultMeta

src/llm_vm/agents/FLAT/typings.py:126

ClassLocalOpenOrca2

This is a class for Openlm-Research's open_orca-3b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM to

src/llm_vm/onsite_llm.py:495

ClassLocalOpenPlatypus

This is a class for Open Orca's OpenOrca Platypus2-13b LLM Attributes: model_uri (str): Hugging Face Endpoint for LL

src/llm_vm/onsite_llm.py:543

ClassOpenAIModel

src/llm_vm/utils/typings_llm.py:9

ClassOpenAIModel

src/llm_vm/agents/FLAT/typings.py:4

src/llm_vm/completion/optimize.py:109

ClassPromptModelEntry

src/llm_vm/utils/typings_llm.py:112

ClassPromptModelEntry

src/llm_vm/agents/FLAT/typings.py:107

ClassPythonConstraint

src/llm_vm/guided_completion.py:156

ClassQuestionSplitInputModel

src/llm_vm/utils/typings_llm.py:107

ClassQuestionSplitInputModel

src/llm_vm/agents/FLAT/typings.py:102

ClassQuestionSplitModelData

src/llm_vm/utils/typings_llm.py:95

ClassQuestionSplitModelData

src/llm_vm/agents/FLAT/typings.py:90

ClassQuestionSplitModelJSONData

src/llm_vm/utils/typings_llm.py:90

ClassQuestionSplitModelJSONData

src/llm_vm/agents/FLAT/typings.py:85

ClassSingleTool

src/llm_vm/utils/typings_llm.py:61

ClassSingleTool

src/llm_vm/agents/FLAT/typings.py:56

ClassSmallLocalBERT

This is a class for BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding The base model needs finetuning in almos

src/llm_vm/onsite_llm.py:706

ClassSmallLocalBloom

This is a class for BigScience's bloom-560 LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTok

src/llm_vm/onsite_llm.py:426

ClassSmallLocalFlanT5

This is a class for Google's flan-t5 LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTokenizer

src/llm_vm/onsite_llm.py:683

ClassSmallLocalLLama

This is a class for Meta's llama-7b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTokenizer)

src/llm_vm/onsite_llm.py:589

ClassSmallLocalNeo

Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTokenizer): Tokenizer from Transformer's library

src/llm_vm/onsite_llm.py:449

ClassSmallLocalOpenLLama

This is a class for Openlm-Research's open_llama-3b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer

src/llm_vm/onsite_llm.py:566

ClassSmallLocalOpenMistral

This is a class for OpenOrca's Mistral-7b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tok

src/llm_vm/onsite_llm.py:519

ClassSmallLocalOpenOrca

This is a class for Openlm-Research's open_orca-3b LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokeni

src/llm_vm/onsite_llm.py:471

ClassSmallLocalOpt

This is a class for Facebook's OPT-350m LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTokeni

src/llm_vm/onsite_llm.py:404

ClassSmallLocalPythia

This is a class for ElutherAI's Pythia-70m LLM Attributes: model_uri (str): Hugging Face Endpoint for LLM tokenizer (AutoTok

src/llm_vm/onsite_llm.py:379

ClassToolInputModel

src/llm_vm/utils/typings_llm.py:152

ClassToolInputModel

src/llm_vm/agents/FLAT/typings.py:147

ClassToolInputModelData

src/llm_vm/utils/typings_llm.py:145

ClassToolInputModelData

src/llm_vm/agents/FLAT/typings.py:140

ClassToolInputModelJSONData

src/llm_vm/utils/typings_llm.py:139

ClassToolInputModelJSONData

src/llm_vm/agents/FLAT/typings.py:134

ClassToolTypeArgs

src/llm_vm/utils/typings_llm.py:52

ClassToolTypeArgs

src/llm_vm/agents/FLAT/typings.py:47

ClassToolpickerInputModel

src/llm_vm/utils/typings_llm.py:168

ClassToolpickerInputModel

src/llm_vm/agents/FLAT/typings.py:163

ClassToolpickerInputModelData

src/llm_vm/utils/typings_llm.py:161

ClassToolpickerInputModelData

src/llm_vm/agents/FLAT/typings.py:156

ClassToolpickerInputModelJSONData

src/llm_vm/utils/typings_llm.py:156

ClassToolpickerInputModelJSONData

src/llm_vm/agents/FLAT/typings.py:151

src/llm_vm/vector_db.py:9

ClassWeaviateDB

src/llm_vm/vector_db.py:74