Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/deeppavlov/ru_sentence_tokenizer
/ functions
Functions
4 in github.com/deeppavlov/ru_sentence_tokenizer
⨍
Functions
4
◇
Types & classes
1
↓ 22 callers
Function
ru_sent_tokenize
(text: str, shortenings: Set[str] = SHORTENINGS, joining_shortenings
rusenttokenize/tokenizer.py:92
↓ 1 callers
Function
_is_sentence_end
(left: str, right: str, shortenings: Set[str], joining_shortenings:
rusenttokenize/tokenizer.py:37
↓ 1 callers
Function
_regex_split_separators
(text: str)
rusenttokenize/tokenizer.py:33
Method
test_ru_sent_tokenize
(self)
tests/test_tokenizer.py:6