Implements the abbreviation detection algorithm in "A simple algorithm for identifying abbreviation definitions in biomedical text.", (Schwar

Check whether sequence str contains ANY of the items in set.

Returns the legislation.gov.uk URL for the identified provision, e.g. http://www.legislation.gov.uk/ukpga/1998/42/section/20.

Extract relationships between provisions and instruments identified by Blackstone's NER with the assistance of the dependency parser. Th

Functional version of calling the matcher for a single span. This method is helpful if you already have an abbreviation which

Returns the legislation.gov.uk for the identified instrument, e.g. http://www.legislation.gov.uk/ukpga/1999/17/contents. The legislation

Filter out overlapping spans. Returns a list of Spans.

Check if the provision candidate contains a digit.

set_legislation_target makes requests to a website, which we shouldn't run in automated tests.

Builds word embeddings using gensim Word2Vec. This function takes a file contained single sentences per line and writes the computed vect

Merge a number of frequency counts generated from `count_frequencies` into a single file, written to `output_path`.

Handle .gz, .tar.gz or unzipped files

The training data is derived from sources that have a fair bit of errant whitespace. This function takes a list of annotations and trims nau

Given a file containing single documents per line (in this case, sentences for the ICLR case law corpus), split the text using a science

Create a new model from raw data, like word frequencies, Brown clusters and word vectors.

Load the model, set up the pipeline and train the entity recognizer.

Load the model, set up the pipeline and train the entity recognizer.

Create a JSONL patterns file from a terminology list for use in Prodigy and spaCy's EntityRuler. This function receives a spaCy model, th