MCPcopy Create free account
hub / github.com/BIT-DataLab/LakeBench / preprocessListValues

Function preprocessListValues

union/Santos/expandSearch.py:34–41  ·  view source on GitHub ↗
(valueList)

Source from the content-addressed store, hash-verified

32 return 0
33
34def preprocessListValues(valueList):
35 valueList = [x.lower() for x in valueList if checkIfNullString(x) !=0]
36 valueList = [re.sub(r'[^\w]', ' ', string) for string in valueList]
37 valueList = [x.replace('nbsp','') for x in valueList ] #remove html whitespace
38 valueList = [" ".join(x.split()) for x in valueList]
39 valueList = [x for x in valueList if x != np.nan]
40 valueList = list(set(valueList))
41 return valueList
42
43def cleanBracesContents(stringList):
44 output = []

Callers 1

expandQueryFunction · 0.70

Calls 1

checkIfNullStringFunction · 0.70

Tested by

no test coverage detected