Function get_matched_starts

src/licensedcode/match_aho.py:317–325

Yield tuples of matched positions as (qstart, [(rule_length, rule_id), ...). Match `tokens` sequence of token ids starting at the `qbegin` absolute query start position position using the `automaton`.

(tokens, qbegin, automaton, len_start=SMALL_RULE)

def get_matched_starts(tokens, qbegin, automaton, len_start=SMALL_RULE):
    """
    Yield tuples of matched positions as (qstart, [(rule_length, rule_id), ...).
    Match `tokens` sequence of token ids starting at the `qbegin` absolute query
    start position position using the `automaton`.
    """
    for qend, values in get_matches(tokens, qbegin, automaton):
        qstart = qend - len_start
        yield qstart, values