Args: uuid (str): unique identifier for inference request model_name (str): name of model to use model_tag (str): tag of

Data that is published as a server-sent event.

Args: log_prob_sum (float): sum of log probabilities simple_prob_sum (float): sum of simple probabilities tokens (dict):

Class for huggingface local inference

Args: uuid (str): unique identifier for inference request model_name (str): name of model to use model_tag (str): tag of

Args: api_key (str): API key for provider version_key (str): version key for provider

A :class:`flask.Blueprint` subclass that knows how to publish, subscribe to, and stream server-sent events.