Method normalize

src/textcode/gibberish.py:43–47

Return only the subset of chars from accepted_chars. This helps keep the model relatively small by ignoring punctuation, infrequenty symbols, etc.

(self, line)

                setattr(self, key, value)

    def normalize(self, line):
        """ Return only the subset of chars from accepted_chars.
        This helps keep the  model relatively small by ignoring punctuation,
        infrequenty symbols, etc. """
        return [c.lower() for c in line if c.lower() in accepted_chars]

    def ngram(self, n, l):
        """ Return all n grams from l after normalizing """