Functions — github.com/AtomaAI/atoma-infer

CodeHub MCPcopy Create free account

hub / github.com/AtomaAI/atoma-infer / functions

Functions613 in github.com/AtomaAI/atoma-infer

⨍ Functions 613◇ Types & classes 173

Functiontest_user_message_only

server/src/api/chat_completions.rs:1393

Functionthread_reduce_

csrc/kernels/softmax.h:23

Functionto_vec3_round

(t: Tensor, digits: i32)

models/src/flash_attention.rs:707

Functionto_vec3_round

(t: Tensor, digits: i32)

csrc/tests/flash_attn_tests.rs:5

server/src/api/chat_completions.rs:809

Methodtop_logprobs

server/src/api/chat_completions.rs:773

(value: Option<&str>)

server/src/api/chat_completions.rs:965

Methodupdate_from_generation_config

(&mut self, eos_token_ids: Vec<u32>)

backends/vllm/src/sampling_params.rs:403

Methodupdate_num_hashed_tokens

Set `num_hashed_tokens`

backends/vllm/src/block.rs:217

backends/vllm/src/scheduler.rs:266

Functionvalidate_completion_handler

( Json(instance): Json<serde_json::Value>, )

server/src/server.rs:310

Functionverify_request_schema

Used in tandem with a schema file, this will check if there are changes to the JSON API schema, and show a diff if so. If there are changes, running t

server/src/api/chat_completions.rs:1164

Functionverify_swap

( src: &Tensor, original_dst: &Tensor, swapped_dst: &Tensor, block_mapping: &H

csrc/tests/cache_manager_tests.rs:24

← previous601–613 of 613, ranked by callers