MCPcopy Create free account
hub / github.com/PaddlePaddle/FastDeploy / SampleRequest

Class SampleRequest

fastdeploy/benchmarks/datasets.py:42–52  ·  view source on GitHub ↗

Represents a single inference request for benchmarking.

Source from the content-addressed store, hash-verified

40
41@dataclass
42class SampleRequest:
43 """
44 Represents a single inference request for benchmarking.
45 """
46
47 no: int
48 prompt: Union[str, Any]
49 history_QA: Union[str, Any]
50 json_data: Optional[dict]
51 prompt_len: int
52 expected_output_len: int
53
54
55class BenchmarkDataset(ABC):

Callers 15

test_calculate_metricsMethod · 0.90
mock_request_genMethod · 0.90
test_benchmarkMethod · 0.90
test_get_requestMethod · 0.90
test_main_asyncMethod · 0.90
test_run_fdMethod · 0.90
test_run_fd_chatMethod · 0.90
test_run_hfMethod · 0.90
test_get_requestsMethod · 0.90
test_main_fastdeployMethod · 0.90
test_main_hfMethod · 0.90
test_main_fastdeploy_chatMethod · 0.90

Calls

no outgoing calls

Tested by 14

test_calculate_metricsMethod · 0.72
mock_request_genMethod · 0.72
test_benchmarkMethod · 0.72
test_get_requestMethod · 0.72
test_main_asyncMethod · 0.72
test_run_fdMethod · 0.72
test_run_fd_chatMethod · 0.72
test_run_hfMethod · 0.72
test_get_requestsMethod · 0.72
test_main_fastdeployMethod · 0.72
test_main_hfMethod · 0.72
test_main_fastdeploy_chatMethod · 0.72