MCPcopy Create free account

hub / github.com/google-research/language / functions

Functions6,154 in github.com/google-research/language

↓ 1 callersFunctioncompute_predictions
Converts an example into an NQEval object for evaluation.
language/question_answering/bert_joint/run_nq.py:1164
↓ 1 callersFunctioncompute_predictions
Converts an eval_example into a `ScoreSummary` object for evaluation. This performs python post-processing (after running NN graph in tensorflow)
language/canine/tydiqa/postproc.py:64
↓ 1 callersFunctioncompute_qa_rewards
Compute all QA-based rewards. Args: question_ids: <int32> [batch_size, question_length] question_mask: <int32> [batch_size, question_length
language/capwap/utils/reward_utils.py:417
↓ 1 callersFunctioncompute_spider_coverage
Prints out statistics for asql conversions.
language/xsp/data_preprocessing/compute_asql_coverage_spider.py:49
↓ 1 callersFunctioncompute_thresholded_labels
Computes thresholded labels. Args: labels: <int32> [batch_size, num_annotators] null_threshold: If number of null annotations is greater th
language/question_answering/decatt_docreader/utils/nq_long_utils.py:86
↓ 1 callersMethodcompute_topk_fact_logits
Get the logits between query and facts with topk_fact_idx. Args: topk_fact_idx: topk ids from scam -- batch_size, topk query_embs: em
language/emql/model.py:794
↓ 1 callersFunctioncompute_which_mentions_fit_with_entity_tokens
Computes a mask for which mentions will fit after adding entity tokens.
language/mentionmemory/utils/mention_preprocess_utils.py:557
↓ 1 callersMethodconfig_context
Configure a context object, to use to help build the model. Subclass this for a particular modeling task. Args: context: a NeuralQuery
language/nql/nql/util.py:261
↓ 1 callersMethodconfig_model
Configure an existing Model. model.context should be already be set when this is called. Args: model: model to configure feature
language/nql/nql/util.py:244
↓ 1 callersMethodconstruct_dataset
Construct datasets for training and testing. Args: name: name of the learning task train_split: percentage of data for training
language/emql/data_loader.py:235
↓ 1 callersMethodconstruct_membership
Construct sets from KB. A natural set is defined as a set of entities that share the same property, e.g. movies directed by Nolan, or actors
language/emql/data_loader.py:271
↓ 1 callersMethodconstruct_metaqa_data
Load MetaQA datasets from files. Args: train_file: filename for train data test_file: filename for test data Returns: a li
language/emql/data_loader.py:396
↓ 1 callersMethodconstruct_query2box
Load query2box data into a list of examples.
language/emql/data_loader.py:553
↓ 1 callersMethodconstruct_set_follow_facts
Construct datasets from KB that a set of entities follow a relation. Note that the results of a set-follow operation can be multiple entities.
language/emql/data_loader.py:351
↓ 1 callersMethodconstruct_set_pairs
Construct pairs of sets from KB with at least one entity in common. Args: train_split: percentage of data for training Returns:
language/emql/data_loader.py:307
↓ 1 callersMethodconstruct_webqsp
Load WebQuestionsSP datasets from files. Args: train_file: filename for train data test_file: filename for test data max_webqsp
language/emql/data_loader.py:428
↓ 1 callersMethodcontains_word
(self, word)
language/gscan/xattn_model/dataset/preprocess.py:97
↓ 1 callersFunctioncontinuous_eval
Run continuous evaluation on given TFRecords file.
language/labs/drkit/run_dualencoder_lsf.py:2145
↓ 1 callersFunctioncontinuous_eval
Run continuous evaluation on given TFRecords file.
language/labs/drkit/run_multihop_follow.py:577
↓ 1 callersFunctionconvert_example_to_cands
Generate candidate completions for each example.
language/conpono/evals/model_builder.py:418
↓ 1 callersFunctionconvert_examples_to_features
Loads a data file into a list of `InputBatch`s.
language/labs/drkit/hotpotqa/preprocessing/create_tfrecords.py:353
↓ 1 callersFunctionconvert_examples_to_features
Loads a data file into a list of `InputBatch`s.
language/labs/drkit/preprocessing/preprocess_qa.py:353
↓ 1 callersFunctionconvert_examples_to_features
Converts a list of NqExamples into InputFeatures.
language/question_answering/bert_joint/run_nq.py:545
↓ 1 callersFunctionconvert_instance_to_tf_example
Convert a list of strings into a tf.Example.
language/conpono/cpc/preproc/ccnews_preproc_pipeline.py:87
↓ 1 callersFunctionconvert_instance_to_tf_example
Convert a list of strings into a tf.Example.
language/conpono/cpc/preproc/raw_books_preproc_pipeline.py:101
↓ 1 callersFunctionconvert_michigan
Converts a Michigan example to a NLToSQLExample.
language/xsp/data_preprocessing/michigan_preprocessing.py:115
↓ 1 callersFunctionconvert_neighbor_to_json
convert data format for nearest neighbors. Args: infn: tsv file downloaded from MSMARCO dataset. outfn: path to output neighors. Returns
language/multivec/utils/convert_tsv_to_json.py:49
↓ 1 callersFunctionconvert_search_to_vector
Create vector from search indices and distances.
language/labs/drkit/model_fns.py:155
↓ 1 callersFunctionconvert_single_example
Converts a single `InputExample` into a single `InputFeatures`.
language/bert_extraction/steal_bert_classifier/models/run_classifier_distillation.py:313
↓ 1 callersFunctionconvert_single_example
Converts a single `InputExample` into a single `InputFeatures`.
language/conpono/evals/run_finetune_coherence.py:344
↓ 1 callersFunctionconvert_single_example
Converts a single `InputExample` into a single `InputFeatures`.
language/conpono/evals/classifier_utils.py:593
↓ 1 callersFunctionconvert_single_example
Loads a data file into a list of `InputBatch`s.
language/conpono/evals/race_utils.py:144
↓ 1 callersFunctionconvert_single_example
Converts a single `InputExample` into a single `InputFeatures`.
language/conpono/evals/model_builder.py:221
↓ 1 callersFunctionconvert_single_example
Converts a single `InputExample` into one or more `InputFeatures`.
language/multivec/preprocessing/create_training_data.py:403
↓ 1 callersFunctionconvert_single_example
Converts a single `TyDiExample` into a list of InputFeatures. Args: tydi_example: `TyDiExample` from a single JSON line in the corpus. toke
language/canine/tydiqa/preproc.py:406
↓ 1 callersFunctionconvert_single_example_dual
Converts a single `InputExample` into one or more `DualInputFeatures`. Args: ex_index: index of the example example: InputExample max_s
language/multivec/preprocessing/create_training_data.py:517
↓ 1 callersFunctionconvert_single_example_for_bilinear
Converts a single `InputExample` into a single `InputFeatures`.
language/conpono/evals/model_builder.py:108
↓ 1 callersFunctionconvert_single_example_record
Convert single record example to features.
language/conpono/evals/model_builder.py:444
↓ 1 callersFunctionconvert_spider
Converts a Spider example to the standard format. Args: spider_example: JSON object for SPIDER example in original format. schema: JSON obj
language/xsp/data_preprocessing/spider_preprocessing.py:83
↓ 1 callersFunctionconvert_to_jsonl
Convert to jsonl from reading the task.
language/fruit/convert_task_to_jsonl.py:89
↓ 1 callersFunctionconvert_tokens_to_ids_and_pad
Converts the input tokens to padded ids and mask. Args: word_pieces: list of word-piece tokens. max_length: length sequences should be padd
language/mentionmemory/utils/tokenization_utils.py:47
↓ 1 callersFunctionconvert_wikisql
Converts a WikiSQL example into a NLToSQLExample.
language/xsp/data_preprocessing/wikisql_preprocessing.py:55
↓ 1 callersFunctioncooccur_probability_fn
Returns function for computing entailment probability. Args: counts: Dict mapping unigrams / bigrams (joined using "|||") to their counts
language/table_text_eval/table_text_eval.py:114
↓ 1 callersFunctioncopy_checkpoint
Copies a checkpoint to a new directory. Args: checkpoint_path: Specific checkpoint path to copy. to_dir: The target directory to copy to.
language/multivec/models/checkpoint_utils.py:30
↓ 1 callersFunctioncopy_checkpoint
(source, target)
language/xsp/training/train_model.py:80
↓ 1 callersFunctioncosine_similarity
Compute cosine similarity along final dimension of tensors. In tensor size descriptions, ... indicates an arbitrary number of dimensions. For exa
language/serene/layers.py:322
↓ 1 callersMethodcount_equivalent_examples
Faster version to count the number of equivalent examples in two splits.
language/gscan/data/dataset.py:152
↓ 1 callersFunctioncount_tf_records
Counts the number of records in a GZIP'd TFRecord file.
language/realm/retrieval.py:129
↓ 1 callersFunctioncreate_and_start_server
Create a server for pushing examples and starts it. Args: port: Port for the gRPC server to listen on. servicer: A PreprocessingServicer o
language/realm/preprocessing.py:55
↓ 1 callersFunctioncreate_attention_mask_from_input_mask
Create 3D attention mask from a 2D tensor mask. Args: from_tensor: 2D or 3D Tensor of shape [batch_size, from_seq_length, ...]. to_mask: in
language/canine/bert_modeling.py:547
↓ 1 callersFunctioncreate_ca_model
Creates a ranking model using cross attention representations.
language/multivec/models/ranking_model_experiment_inbatch.py:414
↓ 1 callersMethodcreate_classification_model
Creates a classification model.
language/canine/tydiqa/tydi_modeling.py:45
↓ 1 callersFunctioncreate_cpc_input_from_text
Parse text into BERT input.
language/conpono/evals/discriminative_eval.py:220
↓ 1 callersFunctioncreate_cpc_model
Creates a classification model. Args: model: the BERT model from modeling.py num_choices: number of negatives samples + 1 is_training:
language/conpono/evals/coherence_eval.py:180
↓ 1 callersFunctioncreate_cpc_model
Creates a classification model. Args: model: the BERT model from modeling.py num_choices: number of negatives samples + 1 is_training:
language/conpono/evals/discriminative_eval.py:146
↓ 1 callersFunctioncreate_cpc_model_and_placeholders
Build model and placeholders.
language/conpono/evals/coherence_eval.py:222
↓ 1 callersFunctioncreate_cpc_model_and_placeholders
Build model and placeholders.
language/conpono/evals/discriminative_eval.py:182
↓ 1 callersFunctioncreate_de_model
Creates a ranking model using cosine and dual encoder representations.
language/multivec/models/ranking_model_experiment_inbatch.py:503
↓ 1 callersFunctioncreate_decode_hparams
()
language/labs/consistent_zero_shot_nmt/bin/t2t_decoder.py:79
↓ 1 callersMethodcreate_encoder_model
(self, is_training, input_ids, input_mask, segment_ids)
language/canine/tydiqa/tydi_modeling.py:41
↓ 1 callersFunctioncreate_entry_from_json
Creates an TyDi 'entry' from the raw JSON. The 'TyDiEntry' dict is an intermediate format that is later converted into the main `TyDiExample` for
language/canine/tydiqa/preproc.py:37
↓ 1 callersMethodcreate_example
Create example.
language/orqa/preprocessing/wiki_preprocessor.py:68
↓ 1 callersMethodcreate_example
Create example.
language/multivec/utils/data_processor.py:59
↓ 1 callersFunctioncreate_example_from_jsonl
Creates an NQ example from a given line of JSON.
language/question_answering/bert_joint/run_nq.py:347
↓ 1 callersFunctioncreate_float_feature
(values)
language/bert_extraction/steal_bert_classifier/models/run_classifier_distillation.py:433
↓ 1 callersFunctioncreate_float_feature
(values)
language/bert_extraction/steal_bert_qa/utils/run_bert_boolq_diff.py:296
↓ 1 callersFunctioncreate_float_feature
(values)
language/bert_extraction/steal_bert_qa/models/run_bert_boolq_distill.py:333
↓ 1 callersFunctioncreate_float_feature
(values)
language/conpono/cpc/preproc/preprocessing_utils.py:107
↓ 1 callersFunctioncreate_float_feature
(values)
language/conpono/create_pretrain_data/preprocessing_utils.py:99
↓ 1 callersFunctioncreate_float_feature
(values)
language/conpono/evals/classifier_utils.py:718
↓ 1 callersFunctioncreate_float_feature
(values)
language/question_answering/b2t2/run_b2t2.py:695
↓ 1 callersFunctioncreate_float_feature
(values)
language/question_answering/b2t2/run_dual_encoder.py:443
↓ 1 callersFunctioncreate_ict_module
Create hub module.
language/orqa/models/ict_model.py:64
↓ 1 callersFunctioncreate_int_feature
(values)
language/conpono/cpc/preproc/ccnews_preproc_pipeline.py:82
↓ 1 callersFunctioncreate_int_feature
(values)
language/conpono/cpc/preproc/raw_books_preproc_pipeline.py:96
↓ 1 callersFunctioncreate_mapping
Creates a mapping from context offsets to plaintext offsets. Args: start_offsets: List of offsets relative to a TyDi entry's `contexts`. en
language/canine/tydiqa/preproc.py:667
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/labs/drkit/run_dualencoder_qa.py:370
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/labs/drkit/run_dualencoder_lsf.py:1110
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_classifier/models/run_classifier_membership.py:522
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_classifier/models/run_classifier_distillation.py:517
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_classifier/models/run_classifier.py:769
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_qa/utils/run_bert_boolq_diff.py:376
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_qa/models/run_squad.py:562
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_qa/models/run_squad_membership.py:461
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_qa/models/run_bert_boolq_distill.py:413
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/bert_extraction/steal_bert_qa/models/run_bert_boolq.py:395
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/evals/run_squad.py:549
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/evals/classifier_utils.py:811
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/evals/run_classifier.py:676
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/evals/run_concat_classifier.py:681
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/evals/race_utils.py:275
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/conpono/binary_order/run_binary_coherence.py:202
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/boolq/run_bert_boolq.py:380
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/question_answering/bert_joint/run_nq.py:837
↓ 1 callersFunctioncreate_model
Creates a model.
language/question_answering/b2t2/run_dual_encoder.py:155
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/relation_learning/models/bert_fewshot_classifier.py:238
↓ 1 callersFunctioncreate_model
Creates a classification model.
language/capwap/synthetic/generate_answers.py:222
↓ 1 callersFunctioncreate_objective_fn
Build an objective function using final layer of flex BERT model.
language/bert_extraction/steal_bert_classifier/embedding_perturbations/embedding_util.py:113
↓ 1 callersFunctioncreate_optimizer
Creates an optimizer training op, optionally excluding BERT vars.
language/labs/drkit/run_dualencoder_qa.py:440
↓ 1 callersFunctioncreate_optimizer
Creates an optimizer training op, optionally excluding BERT vars.
language/labs/drkit/run_dualencoder_lsf.py:1274
← previousnext →1,801–1,900 of 6,154, ranked by callers