MCPcopy Create free account
hub / github.com/TabbyML/tabby / forward_batch_async

Method forward_batch_async

src/encoder.cc:5–13  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

3namespace ctranslate2 {
4
5 std::future<EncoderForwardOutput>
6 Encoder::forward_batch_async(std::vector<std::vector<std::string>> tokens,
7 std::vector<std::vector<size_t>> token_type_ids) {
8 return post<EncoderForwardOutput>(
9 [tokens = std::move(tokens), token_type_ids = std::move(token_type_ids)]
10 (models::SequenceEncoderReplica& encoder) {
11 return encoder.forward(tokens, token_type_ids);
12 });
13 }
14
15 std::future<EncoderForwardOutput>
16 Encoder::forward_batch_async(std::vector<std::vector<size_t>> ids,

Callers 2

forward_batchMethod · 0.45
forward_batchMethod · 0.45

Calls 2

forwardMethod · 0.80
sync_copyMethod · 0.80

Tested by

no test coverage detected