MCPcopy Create free account
hub / github.com/OpenRaiser/PaperFlow / dedupe_strings

Function dedupe_strings

experiments/baselines/scinup_strict/runner.py:113–125  ·  view source on GitHub ↗
(values: Iterable[Any])

Source from the content-addressed store, hash-verified

111
112
113def dedupe_strings(values: Iterable[Any]) -> List[str]:
114 result: List[str] = []
115 seen: set[str] = set()
116 for value in values:
117 cleaned = str(value or "").strip()
118 if not cleaned:
119 continue
120 marker = cleaned.casefold()
121 if marker in seen:
122 continue
123 seen.add(marker)
124 result.append(cleaned)
125 return result
126
127
128def normalize_phrase_text(value: Any) -> str:

Callers 2

seed_direction_phrasesFunction · 0.70
build_query_profileFunction · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected