MCPcopy Create free account

hub / github.com/google-research/language / functions

Functions6,154 in github.com/google-research/language

Methodmodel_weight_path
(self)
language/serene/training.py:532
Functionmodified_cantor_pairing
Given integer tensors a and b, produces tensor of hashes.
language/mentionmemory/utils/mention_preprocess_utils.py:749
Functionmodule_fn
Module function.
language/orqa/models/ict_model.py:27
Functionmodule_fn
Module function.
language/multivec/models/export_to_tfhub.py:55
Functionmrqa_eval_fn
(dataset_file, predictions_file, skip_no_answer=True)
language/labs/drkit/evaluate.py:412
Functionmrr_score
MRR score computation. Args: relevances: List[float], The list of relevance scores. hit_val: float, The value from which a relevance score
language/search_agents/muzero/utils.py:162
Functionmtb_loss
Compute MTB loss over global batch (over all devices). Args: mention_encodings: [n_mentions, hidden_dim] mention encodings to be used for
language/mentionmemory/modules/mention_losses.py:297
Functionmultibootstrap
Compute bootstrap samples of score_fn using multibootstrap over seeds and examples. Args: run_info: DataFrame with columns 'seed' (any type) an
language/multiberts/multibootstrap.py:27
Functionmultihop_eval_fn
Compute evaluation metrics for OneHopDataset or TwoHopDataset. Args: dataset: An object of type OneHopDataset. results: A list of result di
language/labs/drkit/evaluate.py:158
Functionmuzeroconfig_from_flags
Initializes a MuZeroConfig from flags and `env_descriptor`.
language/search_agents/muzero/agent_lib.py:52
Methodmy_callback
(fd, loss, secs)
language/nql/nql/util_test.py:267
Methodmy_func
(t: tf.Tensor)
language/canine/tensor_contracts_test.py:25
Methodname
Name of the underlying TensorFlow expression. Returns: The Tensorflow expression name computing this.
language/nql/nql/__init__.py:169
Methodname
(self)
language/boolq/utils/best_checkpoint_exporter.py:57
Methodname
(self)
language/common/utils/exporters.py:174
Functionndcg
NDCG metric.
language/search_agents/t5/t5_agent_lib.py:213
Functionndcg_score
nDCG score computation. We normalize using the "ideal" result set which has only relevant results. This scales the DCG scores for any number of r
language/search_agents/muzero/utils.py:144
Methodnear
(x)
language/nql/nql/nql_test.py:297
Methodneighbors1
(c)
language/nql/nql/nql_test.py:800
Methodneighbors2
(c)
language/nql/nql/nql_test.py:803
Methodnext_inputs
(self, time, outputs, state, sample_ids, name=None)
language/labs/consistent_zero_shot_nmt/modules/helpers.py:54
Methodnext_inputs
Compute the next inputs and state.
language/labs/consistent_zero_shot_nmt/modules/helpers.py:123
Methodnext_inputs
(self, time, outputs, state, sample_ids, name=None)
language/labs/consistent_zero_shot_nmt/modules/helpers.py:166
Methodnext_inputs
next_inputs_fn for TrainingHelper.
language/conpono/reconstruct/model_builder.py:30
Functionno_definition_strategy
(example: WinoDictExample)
language/wino_dict/utils.py:673
Functionnode_fn
(span_begin, span_end, rule, children)
language/compgen/csl/model/data/parsing_utils.py:131
Functionnode_fn
(unused_span_begin, unused_span_end, rule, children)
language/compgen/csl/model/inference/inference_parser.py:73
Functionnode_fn
(span_begin, span_end, rule, children)
language/compgen/csl/induction/derivation_utils.py:72
Functionnode_fn
(span_begin, span_end, rule, children)
language/compgen/nqg/model/parser/data/parsing_utils.py:104
Functionnode_fn
(span_begin, span_end, rule, children)
language/compgen/nqg/model/parser/inference/inference_parser.py:66
Functionnode_fn
Represent nodes as integer counts of possible derivations.
language/compgen/nqg/model/induction/codelength_utils.py:53
Functionnormalize
Applies sentence level edits to a source document.
language/fruit/rendering_utils.py:701
Functionnormalize_text
Lower text and remove punctuation, articles and extra whitespace.
language/decontext/eval_util.py:44
Methodnormalize_whitespace
(s: str)
language/search_agents/muzero/types.py:137
Methodnum_completed_requests
(self)
language/search_agents/muzero/types.py:302
Methodnum_examples
The number of examples for each split.
language/gscan/xattn_model/dataset/gscan_dataset.py:105
Methodon_epoch_end
At the end of the epoch, trigger computing/saving fever metrics. Args: epoch: The current epoch logs: The logs dictionary containing
language/serene/callbacks.py:297
Methodoov_token
(self)
language/serene/preprocessing.py:284
Functionoptimize_log_loss
Optimize log loss. Args: decoder_tgt: gold outputs. [batch_size, len, vocab_size] decoder_outputs: predictions. [batch_size, len, vocab_siz
language/labs/exemplar_decoding/models/common.py:123
Methodoutput_size
(self)
language/labs/exemplar_decoding/models/output_wrapper.py:106
Methodoutput_size
(self)
language/labs/exemplar_decoding/models/hyperlstm.py:306
Functionoverlap_probability
Returns the probability that the given n-gram overlaps with the table. A simple implementation which checks how many tokens in the n-gram are also
language/table_text_eval/table_text_eval.py:176
Functionoverlap_probability
Returns the probability that the given n-gram overlaps with the table. A simple implementation which checks how many tokens in the n-gram are also
language/totto/totto_parent_eval.py:156
Functionpad_fn
Pads a batch up to specified batch size and adds sample weights.
language/mentionmemory/utils/data_utils.py:30
Methodpad_idx
(self)
language/gscan/xattn_model/dataset/preprocess.py:114
Functionpad_or_truncate
(token_ids, sequence_length, cls_id, sep_id)
language/orqa/utils/bert_utils.py:92
Functionpad_or_truncate_pair
Pad or truncate pair.
language/orqa/utils/bert_utils.py:103
Methodpadded_shapes
Return padding shapes for use by tf.data.Dataset.padded_batch. Returns: Padding shapes used by the encoder
language/serene/preprocessing.py:154
Methodpadded_shapes
(self)
language/serene/preprocessing.py:404
Functionpadded_where
TPU friendly version of tf.where(cond) with fixed length and padding. This is a wrapper around tf.where(cond) that returns the coordinates of the
language/common/utils/tensor_utils.py:101
Functionpara_question_overlap
Overlap paragraph and question based on word level F1.
language/bert_extraction/steal_bert_qa/data_generation/preprocess_util.py:178
Functionparse
Run bottom up parser where all inputs are terminals.
language/compgen/csl/cky/cfg_parser.py:273
Functionparse
Run bottom up parser using variant of CKY algorithm.
language/compgen/nqg/common/cky/cky_utils.py:28
Functionparse
Run bottom up parser. Let T be an arbitrary type for chart entries, specified by the return type of populate_fn. Examples for T are simple types
language/compgen/nqg/common/cky/cfg_parser.py:28
Functionparse
Run bottom up parser using Trie-based implementation.
language/compgen/nqg/common/cky/trie_utils.py:125
Methodparse_derivation_repr
Parse new Derivation class from string.
language/gscan/data/dataset.py:139
Functionparse_example
Parse example.
language/question_answering/decatt_docreader/datasets/nq_long_dataset.py:44
Functionparse_example
Parse example.
language/question_answering/decatt_docreader/datasets/nq_short_pipeline_dataset.py:46
Functionparse_example
Parse a serialized example proto.
language/capwap/datasets/wsp_dataset.py:39
Functionparse_example
Parse a serialized example proto.
language/capwap/datasets/rc_dataset.py:38
Functionparse_example
Parse a serialized example proto.
language/capwap/datasets/captions_dataset.py:38
Functionparse_example
Parse a serialized example proto.
language/capwap/datasets/vqa_dataset.py:38
Functionparse_examples
Make retrieval examples.
language/orqa/predict/encode_blocks.py:72
Functionparse_examples
Make retrieval examples.
language/multivec/predict/encode_blocks.py:111
Functionparse_fever_line
Convert FEVER sample from a string.
language/orqa/datasets/text_classification_dataset.py:44
Functionparse_image
Decodes an image, resizes and scales RGB values to be in [0, 1].
language/question_answering/b2t2/compute_vcr_features.py:99
Functionparse_line
Parse line.
language/orqa/datasets/orqa_dataset.py:23
Functionparse_lines
Parses lines from dataset file.
language/labs/consistent_zero_shot_nmt/data_generators/translate_multilingual.py:153
Functionparse_object_features
Parse ObjectDetectionOutput from TensorProtos.
language/capwap/utils/image_utils.py:99
Functionparse_sql
Parse SQL string and return Node representing parse tree.
language/compgen/nqg/tasks/spider/sql_parser.py:346
Functionparse_t5_response
Parse the response of the T5 agent model. Args: response: The T5 response given as a string. Returns: A triple: (success, stop, terms).
language/search_agents/t5/t5_agent_lib.py:172
Functionparse_tf_example
(serialized)
language/realm/retrieval.py:596
Functionparse_wiki_dump_from_json
(json_value)
language/serene/wikipedia_processing.py:95
Functionparse_wikitext
Parses the wikitext markup in an article to text.
language/fruit/beam_pipelines.py:110
Methodpartial_kmeans_step
(centroids, observations)
language/mentionmemory/modules/kmeans_test.py:87
Methodpartial_pkmeans_step
(centroids, observations)
language/mentionmemory/modules/kmeans_test.py:103
Functionpipeline
Beam pipeline for converting CCNews files to TF Examples.
language/conpono/cpc/preproc/ccnews_preproc_pipeline.py:168
Functionpipeline
Beam pipeline for converting CCNews files to TF Examples.
language/conpono/cpc/preproc/raw_books_preproc_pipeline.py:203
Functionpipeline
Beam pipeline for converting Books Corpus files to TF Examples.
language/conpono/cpc/preproc/books_preproc_pipeline.py:256
Functionpipeline
Beam pipeline for converting WikiText103 files to TF Examples.
language/conpono/cpc/preproc/wiki_preproc_pipeline.py:192
Functionpipeline
Beam pipeline for converting Books Corpus files to TF Examples.
language/conpono/create_pretrain_data/books_preproc_pipeline.py:202
Functionpipeline
Beam pipeline for converting WikiText103 files to TF Examples.
language/conpono/create_pretrain_data/wiki_preproc_pipeline.py:160
Functionpipeline
(root, input_path, output_path, params)
language/capwap/preprocessing/text_synthetic_qa.py:165
Functionplaceholder_for_type
Produce a Tensorflow placeholder for this type_spec. Args: context: a NeuralQueryContext type_spec: a single type_spec (see tuple_dataset)
language/nql/nql/dataset.py:223
Functionplot_histogram
Plots a length histogram.
language/fruit/beam_pipelines.py:812
Functionpop_example
Pop an example from the given rpc server. This op intentionally fails when the server is unavailable. This is because the RPC op silently fails t
language/realm/preprocessing.py:108
Functionpopulate_abstract_sql
Populate SQL in example. Args: example: NLToSQLExample instance with utterance populated. sql_string: SQL query as string. table_schema
language/xsp/data_preprocessing/abstract_sql_converters.py:670
Functionpopulate_fn
(span_begin, span_end, parser_rule, children)
language/compgen/csl/qcfg/qcfg_parser.py:99
Functionpopulate_fn
(span_begin, span_end, parser_rule, children)
language/compgen/csl/qcfg/qcfg_target_parser.py:99
Functionpopulate_fn
(unused_span_begin, unused_span_end, parser_rule, children)
language/compgen/nqg/tasks/spider/sql_parser.py:86
Methodpopulate_fn
(unused_span_begin, unused_span_end, parser_rule, children)
language/compgen/csl/augment/joint_sampler.py:249
Methodposition_table
(self)
language/capwap/utils/transformer_utils.py:162
Functionpostprocess_cell_fn
Filter and merge generated nodes.
language/compgen/csl/qcfg/qcfg_parser.py:145
Functionpostprocess_cell_fn
(nodes)
language/compgen/csl/model/inference/inference_parser.py:82
Functionpostprocess_cell_fn
Filter and merge generated nodes.
language/compgen/csl/induction/derivation_utils.py:76
Functionpostprocess_cell_fn
Filter and merge generated nodes.
language/compgen/nqg/model/qcfg/qcfg_parser.py:125
Functionpostprocess_cell_fn
(nodes)
language/compgen/nqg/model/parser/inference/inference_parser.py:72
Functionpostprocess_example
Converts examples to dictionaries.
language/fruit/tf_utils.py:72
Functionpostprocess_fn
(nodes)
language/compgen/csl/model/data/parsing_utils.py:137
Functionpostprocess_fn
Merge and sum all nodes.
language/compgen/nqg/model/induction/codelength_utils.py:57
← previousnext →4,901–5,000 of 6,154, ranked by callers