MCPcopy Create free account

hub / github.com/AtomaAI/atoma-infer / functions

Functions613 in github.com/AtomaAI/atoma-infer

⨍ Functions 613◇ Types & classes 173
Functiontest_decode_schedule_preempted
Test sequence cannot be scheduled due to block manager has no capacity
backends/vllm/src/scheduler.rs:3255
Functiontest_decode_swap_beam_search
Test best_of > 1 swap out blocks
backends/vllm/src/scheduler.rs:3302
Functiontest_deserialize_chat_completion_chunk
()
server/src/api/chat_completions.rs:2161
Functiontest_deserialize_chat_completion_response
()
server/src/api/chat_completions.rs:1985
Functiontest_deserialize_choice
()
server/src/api/chat_completions.rs:2034
Functiontest_deserialize_choice_with_logprobs
()
server/src/api/chat_completions.rs:2083
Functiontest_deserialize_delta
()
server/src/api/chat_completions.rs:2121
Functiontest_deserialize_finish_reason
()
server/src/api/chat_completions.rs:2052
Functiontest_deserialize_stream_choice
()
server/src/api/chat_completions.rs:2141
Functiontest_deserialize_usage
()
server/src/api/chat_completions.rs:2068
Functiontest_empty_prompt
()
server/src/api/chat_completions.rs:1373
Functiontest_empty_string_message
()
server/src/api/chat_completions.rs:1847
Functiontest_flash_attn_kv_cache_with_block_table
()
csrc/tests/flash_attn_tests.rs:240
Functiontest_fork
()
backends/vllm/src/block_manager.rs:1314
Functiontest_forward
()
models/src/flash_attention.rs:549
Functiontest_forward_with_varlen
()
models/src/flash_attention.rs:633
Functiontest_free
()
backends/vllm/src/block_manager.rs:1494
Functiontest_get_kv_cache_shape
()
models/src/flash_attention.rs:515
Functiontest_hermes3_empty_messages
()
server/src/api/chat_completions.rs:1719
Functiontest_hermes3_missing_content_in_message
()
server/src/api/chat_completions.rs:1728
Functiontest_hermes3_multiple_tool_calls
()
server/src/api/chat_completions.rs:1740
Functiontest_hermes3_system_and_user_message_no_content
()
server/src/api/chat_completions.rs:1784
Functiontest_hermes3_tool_message_with_tool_call_id
()
server/src/api/chat_completions.rs:1772
Functiontest_infeasible_swap
()
backends/vllm/src/scheduler.rs:3589
Functiontest_llama_model
()
backends/vllm/src/tests/llama.rs:12
Functiontest_llama_model
()
models/src/llama.rs:525
Functiontest_llama_model_batch
()
models/src/llama.rs:1401
Functiontest_llama_model_llama3_2_1b
()
models/src/llama.rs:1156
Functiontest_llama_model_long
()
models/src/llama.rs:709
Functiontest_llama_model_random_block_order
()
models/src/llama.rs:920
Functiontest_llama_nccl_model
()
backends/vllm/src/tests/llama_nccl.rs:11
Functiontest_llama_nccl_model_random_block_order
()
models/src/llama_nccl.rs:363
Functiontest_llm_engine
()
backends/vllm/src/tests/mod.rs:167
Functiontest_llm_engine_with_enable_chunking
()
backends/vllm/src/tests/mod.rs:261
Functiontest_messages_to_llama2_prompt
()
server/src/api/chat_completions.rs:1802
Functiontest_mistral_model
()
models/src/mistral.rs:456
Functiontest_mistral_model_batch
()
models/src/mistral.rs:652
Functiontest_mistral_model_long
()
models/src/mistral.rs:1023
Functiontest_mixed_messages
()
server/src/api/chat_completions.rs:1687
Functiontest_new
()
models/src/flash_attention.rs:478
Functiontest_new_invalid_head_dim
()
models/src/flash_attention.rs:502
Functiontest_new_invalid_heads
()
models/src/flash_attention.rs:495
Functiontest_no_system_message
()
server/src/api/chat_completions.rs:1875
Functiontest_only_assistant_message
()
server/src/api/chat_completions.rs:1965
Functiontest_only_system_and_assistant_messages
()
server/src/api/chat_completions.rs:1904
Functiontest_only_system_message
()
server/src/api/chat_completions.rs:1946
Functiontest_only_user_message
()
server/src/api/chat_completions.rs:1930
Functiontest_phi3_model
cargo test test_phi3_model -- --exact
models/src/phi3.rs:456
Functiontest_phi3_model_batch
()
models/src/phi3.rs:641
Functiontest_phi3_model_long
()
models/src/phi3.rs:1000
Functiontest_prefill_schedule_max_prompt_len
Test prompt longer than max_prompt_len is aborted
backends/vllm/src/scheduler.rs:3060
Functiontest_prefill_schedule_max_seqs
Test max seq respected
backends/vllm/src/scheduler.rs:3158
Functiontest_prefill_schedule_no_block_manager_capacity
Test sequence cannot be scheduled due to block manager has no capacity
backends/vllm/src/scheduler.rs:3205
Functiontest_prefill_schedule_token_budget
Test token budget respected.
backends/vllm/src/scheduler.rs:3086
Functiontest_reset
()
backends/vllm/src/block_manager.rs:1526
Functiontest_reshape_and_cache_flash_bf16
()
csrc/tests/cache_manager_tests.rs:620
Functiontest_reshape_and_cache_flash_f16
()
csrc/tests/cache_manager_tests.rs:553
Functiontest_reshape_and_cache_flash_invalid_dtype
()
csrc/tests/cache_manager_tests.rs:687
Functiontest_reshape_and_cache_flash_invalid_slot_mapping
()
csrc/tests/cache_manager_tests.rs:743
Functiontest_reshape_and_cache_flash_mismatched_shapes
()
csrc/tests/cache_manager_tests.rs:715
Functiontest_sampler_output_initialization
()
backends/vllm/src/sequence.rs:2304
Functiontest_schedule_decode_blocks_to_copy_update
()
backends/vllm/src/scheduler.rs:3363
Functiontest_schedule_swapped_blocks_to_copy
()
backends/vllm/src/scheduler.rs:3634
Functiontest_schedule_swapped_cannot_swap_in
()
backends/vllm/src/scheduler.rs:3545
Functiontest_schedule_swapped_max_seqs
()
backends/vllm/src/scheduler.rs:3496
Functiontest_schedule_swapped_max_token_budget
()
backends/vllm/src/scheduler.rs:3445
Functiontest_schedule_swapped_simple
()
backends/vllm/src/scheduler.rs:3401
Functiontest_scheduler_abort_sequence_group
()
backends/vllm/src/scheduler.rs:2409
Functiontest_scheduler_add_sequence_group
()
backends/vllm/src/scheduler.rs:2366
Functiontest_scheduler_delay_factor
()
backends/vllm/src/scheduler.rs:2977
Functiontest_scheduler_max_seqs
()
backends/vllm/src/scheduler.rs:2905
Functiontest_scheduler_prefill_prioritized
Verify running batched tokens are not applied to prefill requests.
backends/vllm/src/scheduler.rs:2588
Functiontest_scheduler_schedule_preempt_abort
()
backends/vllm/src/scheduler.rs:2720
Functiontest_scheduler_schedule_simple
()
backends/vllm/src/scheduler.rs:2459
Functiontest_scheduling_budget
()
backends/vllm/src/scheduler.rs:3671
Functiontest_sequence_data_prefill
()
backends/vllm/src/sequence.rs:2344
Functiontest_sequence_group_stage
()
backends/vllm/src/sequence.rs:2371
Functiontest_sliding_window_multi_seq
Tests that memory allocation and deallocation is handled correctly with multiple sequences that exceed the sliding window's capacity.
backends/vllm/src/block_manager.rs:1557
Functiontest_split_kv_cache
()
models/src/flash_attention.rs:521
Functiontest_split_kv_cache_invalid_shape
()
models/src/flash_attention.rs:538
Functiontest_supported_head_sizes
()
models/src/flash_attention.rs:509
Functiontest_swap
()
backends/vllm/src/block_manager.rs:1389
Functiontest_swap_blocks_bf16_cuda
()
csrc/tests/cache_manager_tests.rs:85
Functiontest_swap_blocks_cpu_to_cuda_bf16
()
csrc/tests/cache_manager_tests.rs:147
Functiontest_swap_blocks_cpu_to_cuda_f16
()
csrc/tests/cache_manager_tests.rs:105
Functiontest_swap_blocks_cuda_to_cpu_bf16
()
csrc/tests/cache_manager_tests.rs:168
Functiontest_swap_blocks_cuda_to_cpu_f16
()
csrc/tests/cache_manager_tests.rs:126
Functiontest_swap_blocks_f16_cuda
()
csrc/tests/cache_manager_tests.rs:65
Functiontest_swap_blocks_invalid_dtype
()
csrc/tests/cache_manager_tests.rs:192
Functiontest_system_and_assistant
()
server/src/api/chat_completions.rs:1454
Functiontest_system_and_user
()
server/src/api/chat_completions.rs:1429
Functiontest_system_message
()
server/src/api/chat_completions.rs:1610
Functiontest_system_message_only
()
server/src/api/chat_completions.rs:1380
Functiontest_system_user_assistant
()
server/src/api/chat_completions.rs:1506
Functiontest_tool_call_in_assistant_message
()
server/src/api/chat_completions.rs:1664
Functiontest_tool_call_with_multiple_functions
()
server/src/api/chat_completions.rs:1572
Functiontest_tool_message
()
server/src/api/chat_completions.rs:1652
Functiontest_tool_message_only
()
server/src/api/chat_completions.rs:1417
Functiontest_user_and_assistant
()
server/src/api/chat_completions.rs:1481
Functiontest_user_message
()
server/src/api/chat_completions.rs:1624
← previousnext →501–600 of 613, ranked by callers