Args: gold_entities (List[Entity]): the gold standard entity annotations guess_entities (List[Entity]): a system's entity guesses

Args: entities (Iterable[Entity]): Returns: Set[Tuple[str]]

Args: gold (Iterable[T]): guess (Iterable[T]): Returns: Set[T]

Args: entities (Iterable[Entity]): Returns: Set[Tuple[Tuple[str],str]]:

Args: lines (Iterable[str]): the lines in a document Returns: Dictionary[str,List[List[Tokens]]]: a nested list of list of t

Args: entities (Iterable[Entity]): the entities in a sentence p (Call[[Entity],bool): the predicate Returns: List(En

Args: nested (Iterable[Iterable[T]]): a nested iterator Returns: List[T]: the iterator flattened into a list

Args: tokens (Dict[str,List[Tokens]): a dictionary of gold and guess tokens all_entities (Dict[str,List[Entity]): a dictionary of

Args: tp (Set[T]): fp (Set[T]): fn (Set[T]): _all (Iterable[T]): Returns: Set[T]

Args: lines (Iterator[str]): the lines in a document Returns: Dictionary[str,List[Entities]]: a lists of all entities in the

Args: lines (Iterator[str]): the lines in a document Returns: Dictionary[str,List[List[Entity]]]: a nested list of lists of

Args: lines (Iterator[str]): the lines in a document Returns: Dictionary[str,List[Tokens]]: a lists of all tokens in the doc

Args: entities (Iterable[Entity]): Returns: Iterator[Entity]

Args: entity (Entity): Returns: List[Token]:

Args: gold (Iterable[T]): guess (Iterable[T]): Returns: Set[T]

Args: gold (Iterable[T]): guess (Iterable[T]): Returns: Set[T]

Args: lines (Iterable[str]): the lines Yields: List[str]: the lines delimited by an empty line

Args: entities (Dict[str,List[Entity]]): Returns: Dict[str,List[Entity]]

Args: entities (Iterable[Entity]): the entities in a sentence Returns: Set[str]: a set of their tags, excluding 'O'

Args: gold (Iterable[T]): guess (Iterable[T]): Returns: Set[T]

Args: line (str): the input line sent_id (int): the current sentence ID word_id (int): the current word ID Returns:

Args: word (str): the surface form of the word bio_tag (str): the tag with BIO annotation sent_id (int): the sentence ID

Args: sent (Iterator[str]): the lines that comprise a sentence sent_id (int): the sentence ID Returns: Dictionary[st

Args: tok (Token): Returns: str:

Args: toks (Iterable[Token]): the tokens in a sentence Returns: Iterable[Entity]: the corresponding entities in a sentence

Args: entity (Entity): Returns: List[str]: a conll-formatted token tag

Args: gold (Iterator[T]): guess (Iterator[T]): _all (Iterator[T]): Returns: Tuple[Set[str],Set[str],Set[st

Args: gold: List[Entity] guess: List[Entity] _all: List[Entity] Returns: Tuple[Set[str],Set[str],Set[str],Se

Args: entity (Entity): Returns: bool