MCPcopy Create free account
hub / github.com/UndCover/PyramidStore / cleanText

Method cleanText

base/spider.py:49–51  ·  view source on GitHub ↗
(self,src)

Source from the content-addressed store, hash-verified

47 def str2json(self,str):
48 return json.loads(str)
49 def cleanText(self,src):
50 clean = re.sub('[\U0001F600-\U0001F64F\U0001F300-\U0001F5FF\U0001F680-\U0001F6FF\U0001F1E0-\U0001F1FF]', '', src)
51 return clean
52 def fetch(self,url,headers={},cookies=""):
53 rsp = requests.get(url,headers=headers,cookies=cookies)
54 rsp.encoding='utf-8'

Callers 13

searchContentMethod · 0.95
categoryContentMethod · 0.95
detailContentMethod · 0.95
categoryContentMethod · 0.95
detailContentMethod · 0.95
searchContentMethod · 0.95
playerContentMethod · 0.95
searchContentMethod · 0.95
homeVideoContentMethod · 0.95
categoryContentMethod · 0.95
detailContentMethod · 0.95
searchContentMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected