MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / unicode_utf8_to_byte

Function unicode_utf8_to_byte

smallthinker/src/unicode.cpp:653–656  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

651}
652
653uint8_t unicode_utf8_to_byte(const std::string & utf8) {
654 static std::unordered_map<std::string, uint8_t> map = unicode_utf8_to_byte_map();
655 return map.at(utf8);
656}
657
658uint32_t unicode_tolower(uint32_t cpt) {
659 // binary search

Callers 1

llama_decode_textFunction · 0.85

Calls 1

unicode_utf8_to_byte_mapFunction · 0.85

Tested by

no test coverage detected