Functions — github.com/M4THYOU/TokenDagger

CodeHub MCPcopy Create free account

hub / github.com/M4THYOU/TokenDagger / functions

Functions724 in github.com/M4THYOU/TokenDagger

⨍ Functions 724◇ Types & classes 198

Methodcalc_bson_entry_header_size

! @return The size of a BSON document entry header, including the id marker and the entry name size (and its null-terminator). */

src/nlohmann/json.hpp:15999

Methodcalc_bson_integer_size

! @return The size of the BSON-encoded integer @a value */

src/nlohmann/json.hpp:16076

Methodcalc_bson_object_size

! @brief Calculates the size of the BSON serialization of the given JSON-object @a j. @param[in] value JSON value to serialize

src/nlohmann/json.hpp:16298

Methodcalc_bson_string_size

! @return The size of the BSON-encoded string in @a value */

src/nlohmann/json.hpp:16046

Methodcalc_bson_unsigned_size

! @return The size of the BSON-encoded unsigned integer in @a j */

src/nlohmann/json.hpp:16104

src/tiktoken/hash_table8.hpp:404

src/tiktoken/hash_table8.hpp:408

Methodcheck_expand_need

Can we fit another element?

src/tiktoken/hash_table8.hpp:1243

Methodcheck_expand_need

Can we fit another element?

src/tiktoken/hash_set8.hpp:975

Methodclear_empty

src/tiktoken/hash_table8.hpp:1025

Functionclear_subtype

@brief clears the binary subtype @sa https://json.nlohmann.me/api/byte_container_with_subtype/clear_subtype/

src/nlohmann/json.hpp:5960

src/tiktoken/hash_table8.hpp:973

src/tiktoken/hash_set8.hpp:801

src/tiktoken/hash_table8.hpp:348

src/tiktoken/hash_set8.hpp:316

Functionconditional_static_cast

src/nlohmann/json.hpp:4050

Methodconst_iterator

Maak constructoren constexpr

src/tiktoken/hash_table8.hpp:193

Methodconst_iterator

src/tiktoken/hash_set8.hpp:179

Methodconstruct

src/nlohmann/json.hpp:5425

Methodconstruct

src/nlohmann/json.hpp:5438

Methodconstruct

src/nlohmann/json.hpp:5471

Methodconstruct

src/nlohmann/json.hpp:5493

Methodconstruct

src/nlohmann/json.hpp:5506

Methodconstruct

src/nlohmann/json.hpp:5519

Methodconstruct

src/nlohmann/json.hpp:5532

Methodconstruct

src/nlohmann/json.hpp:5602

Functioncontains

src/nlohmann/json.hpp:14383

src/tiktoken/hash_table8.hpp:603

Functionconvert

can't use conversion operator because of ambiguity

src/nlohmann/json.hpp:14640

src/nlohmann/json.hpp:19264

src/tiktoken/hash_table8.hpp:609

src/nlohmann/json.hpp:4482

src/nlohmann/json.hpp:4526

src/nlohmann/json.hpp:4544

src/nlohmann/json.hpp:4561

src/nlohmann/json.hpp:4578

src/nlohmann/json.hpp:6489

src/nlohmann/json.hpp:6513

src/nlohmann/json.hpp:6546

Functioncreate_tokenizer

Create a tokenizer from in-memory data. Args: name: Name of the tokenizer pattern: Regex pattern for text splitting v

tokendagger/wrapper.py:358

! @brief check whether a string is UTF-8 encoded The function checks each byte of a string whether it is UTF-8 encoded. The result of the

src/nlohmann/json.hpp:18908

Methoddecode_batch

Decode multiple token sequences in parallel. Args: tokens: Sequence of token sequences to decode num_threads:

tokendagger/wrapper.py:237

Methoddiagnostics

src/nlohmann/json.hpp:4392

src/nlohmann/json.hpp:16971

Methoddo_assign

src/tiktoken/hash_table8.hpp:740

Methoddo_assign

src/tiktoken/hash_set8.hpp:617

Methoddo_insert

-----------------------------------------------------

src/tiktoken/hash_table8.hpp:699

Methoddo_insert

-----------------------------------------------------

src/tiktoken/hash_set8.hpp:576

Methoddump_statics

src/tiktoken/hash_table8.hpp:517

Methoddump_statics

src/tiktoken/hash_set8.hpp:479

src/tiktoken/hash_table8.hpp:815

Methodemplace_hint

src/tiktoken/hash_table8.hpp:823

Methodemplace_hint

src/tiktoken/hash_set8.hpp:696

Methodemplace_unique

src/tiktoken/hash_table8.hpp:845

src/tiktoken/hash_table8.hpp:415

Methodencode_with_special_tokens

Encode text including all special tokens. Args: text: Text to encode Returns: List of to

tokendagger/wrapper.py:198

Methodencode_with_special_tokens

probably shouldn't use this function. Better for the caller to _know_ which special tokens are allowed and make that explicit.

src/tiktoken/tiktoken.cpp:268

Functionend_array

src/nlohmann/json.hpp:6910

Methodend_array

src/nlohmann/json.hpp:7138

Functionend_object

src/nlohmann/json.hpp:6888

Methodend_object

src/nlohmann/json.hpp:7085

src/nlohmann/json.hpp:3625

src/nlohmann/json.hpp:3649

Methodequal_range

src/tiktoken/hash_table8.hpp:617

Methodequal_range

src/tiktoken/hash_set8.hpp:548

Methoderase_bucket

src/tiktoken/hash_table8.hpp:1295

Methoderase_bucket

src/tiktoken/hash_set8.hpp:1004

src/tiktoken/hash_table8.hpp:943

src/tiktoken/hash_set8.hpp:771

Methoderase_slot

src/tiktoken/hash_table8.hpp:1267

Methoderase_slot

src/tiktoken/hash_set8.hpp:987

Methodexception_message

! @param[in] format the current format @param[in] detail a detailed error message @param[in] context further context information

src/nlohmann/json.hpp:12058

Methodexception_message

src/nlohmann/json.hpp:12646

Methodfill_buffer

src/nlohmann/json.hpp:6321

Methodfill_buffer

src/nlohmann/json.hpp:6379

Methodfill_buffer

src/nlohmann/json.hpp:6468

Methodfind_empty_bucket

Different probing techniques usually provide a trade-off between memory locality and avoidance of clustering. Since Robin Hood hashing is relative

src/tiktoken/hash_table8.hpp:1579

Methodfind_empty_bucket

Different probing techniques usually provide a trade-off between memory locality and avoidance of clustering. Since Robin Hood hashing is relatively r

src/tiktoken/hash_set8.hpp:1274

Methodfind_filled_bucket

Find the slot with this key, or return bucket size

src/tiktoken/hash_table8.hpp:1333

Methodfind_filled_bucket

Find the slot with this key, or return bucket size

src/tiktoken/hash_set8.hpp:1044

Methodfind_filled_slot

src/tiktoken/hash_table8.hpp:1367

Methodfind_filled_slot

Find the slot with this key, or return bucket size

src/tiktoken/hash_set8.hpp:1075

Methodfind_hash_bucket

src/tiktoken/hash_table8.hpp:1401

Methodfind_hash_bucket

src/tiktoken/hash_set8.hpp:1107

Methodfind_last_bucket

src/tiktoken/hash_table8.hpp:1635

Methodfind_last_bucket

src/tiktoken/hash_set8.hpp:1335

Methodfind_next_special_token

src/tiktoken/tiktoken.cpp:130

Methodfind_or_allocate

src/tiktoken/hash_table8.hpp:1496

Methodfind_or_allocate

** inserts a new key into a hash table; first, check whether key's main ** bucket/position is free. If not, check whether colliding node/bucket is in

src/tiktoken/hash_set8.hpp:1202

Methodfind_prev_bucket

src/tiktoken/hash_table8.hpp:1649

Methodfind_prev_bucket

src/tiktoken/hash_set8.hpp:1349

Methodfind_slot_bucket

Find the slot with this key, or return bucket size

src/tiktoken/hash_table8.hpp:1315

Methodfind_slot_bucket

Find the slot with this key, or return bucket size

src/tiktoken/hash_set8.hpp:1024

Methodfind_sorted_bucket

only for find/can not insert

src/tiktoken/hash_table8.hpp:1433

Methodfind_sorted_bucket

src/tiktoken/hash_set8.hpp:1138

Methodfind_unique_bucket

src/tiktoken/hash_table8.hpp:1543

Methodfind_unique_bucket

src/tiktoken/hash_set8.hpp:1241

-------------------------------------------------------------

src/tiktoken/hash_table8.hpp:391

-------------------------------------------------------------

src/tiktoken/hash_set8.hpp:352

Functionfrom_bson

src/nlohmann/json.hpp:23889

← previous next →301–400 of 724, ranked by callers