parse a sparql query into a s-expression @param query: sparql query @param mid_list: all mids appeared in the sparql query

Parse WebQSP sparqls into s-expressions

r""" Implements training loop for the PPO stage, like _inner_training_loop() in Huggingface's Trainer.

r""" Includes: (1) cast the layernorm in fp32 (2) make output embedding layer require grads (3) upcast the lm_head to fp32

r""" Removes basic config of root logger

r""" Saves model predictions to `output_dir`. A custom behavior that not contained in Seq2SeqTrainer.

r""" Saves model predictions to `output_dir`. A custom behavior that not contained in Seq2SeqTrainer.

Check the type of a token, e.g. Integer, Float or date. Return original token if no type is detected.

Check the type of a token, e.g. Integer, Float or date. Return original token if no type is detected.

Stardardize all entity labels

textualize a logical form, replace mids with labels Returns: (str): normalized s_expr

r""" Pads batched data to the longest sequence in the batch. We generate 2 * n examples where the first n examples represent chosen e

r""" Uses the model predictions to compute metrics.

r""" Pads batched data to the longest sequence in the batch. We generate 2 * n examples where the first n examples represent chosen e

r""" Encodes formatted inputs to pairs of token ids. Turn 0: bos + prefix + query resp + eos Turn t: bos + query

r""" Calculates model outputs in multiple batches. Subclass and override to inject custom behavior.

remove illegal unicode characters

r""" Computes pairwise loss. The first n examples are chosen and the last n examples are rejected. Subclass and override to inject cu