Functions — github.com/Jaykef/mlx-rag-gguf

CodeHub MCPcopy Create free account

hub / github.com/Jaykef/mlx-rag-gguf / functions

Functions42 in github.com/Jaykef/mlx-rag-gguf

⨍ Functions 42 ◇ Types & classes 14

↓ 4 callersMethod__init__

(self, dim, hidden_dim)

↓ 2 callersMethod__init__

(self, config: ModelConfig)

↓ 2 callersMethoddecode

(self, toks: List[int])

↓ 2 callersMethodrun

(self, input_text: List[str])

↓ 1 callersFunctionaverage_pool

(last_hidden_state: mx.array, attention_mask: mx.array)

↓ 1 callersFunctionchunks_to_mx_array

(chunks: List[str])

↓ 1 callersMethodencode

↓ 1 callersFunctionget_config

(metadata: dict)

↓ 1 callersMethodingest

(self, content: str)

↓ 1 callersFunctionmx_array_to_chunks

(data: mx.array, lengths: mx.array)

↓ 1 callersMethodquery

(self, text: str)

↓ 1 callersFunctionrag

( model: gguf.Model, tokenizer: gguf.GGUFTokenizer, prompt: str, max_tokens: int, temp: fl

↓ 1 callersFunctionsample

↓ 1 callersMethodsavez

(self, vdb_file)

↓ 1 callersFunctionsplit_text_into_chunks

Split text into chunks with a specified size and overlap. Parameters: - text (str): The input text to be split into chunks. - chunk_

↓ 1 callersFunctiontranslate_weight_names

↓ 1 callersFunctionvdb_from_pdf

(pdf_file: str)

( self, x: mx.array, mask: Optional[mx.array] = None, cache: Optional[Tuple[mx

( self, x: mx.array, mask: Optional[mx.array] = None, cache: Optional[Tuple[mx

( self, inputs: mx.array, cache=None, )

( self, inputs: mx.array, cache=None, )

(self, x, mask)

(self, x, mask)

(self, input_ids: mx.array, token_type_ids: mx.array)

( self, input_ids: mx.array, token_type_ids: mx.array, attention_mask: mx.arra

(self, vdb_file: Optional[str] = None)

(self, args: ModelArgs)

(self, args: ModelArgs)

(self, args: ModelArgs)

(self, args: ModelArgs)

(self, metadata)

( self, dims: int, num_heads: int, mlp_dims: Optional[int] = None, lay

( self, num_layers: int, dims: int, num_heads: int, mlp_dims: Optional[int] = None )

(self, config: ModelConfig)

Method__post_init__

Methodeos_token_id

Methodfrom_dict

Functiongenerate

(prompt: mx.array, model: Model, temp: float = 0.0, max_tokens: int = 512, verbose: bool = False)

(gguf_file: str, repo: str = None)

Functionspm_tokenizer