MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / unicode_byte_to_utf8

Function unicode_byte_to_utf8

smallthinker/src/unicode.cpp:648–651  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

646}
647
648std::string unicode_byte_to_utf8(uint8_t byte) {
649 static std::unordered_map<uint8_t, std::string> map = unicode_byte_to_utf8_map();
650 return map.at(byte);
651}
652
653uint8_t unicode_utf8_to_byte(const std::string & utf8) {
654 static std::unordered_map<std::string, uint8_t> map = unicode_utf8_to_byte_map();

Callers 2

byte_to_tokenMethod · 0.85

Calls 1

unicode_byte_to_utf8_mapFunction · 0.85

Tested by

no test coverage detected