Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/google-research/language
/ functions
Functions
6,154 in github.com/google-research/language
⨍
Functions
6,154
◇
Types & classes
800
↳
Endpoints
12
Function
main
(_)
language/question_answering/bert_joint/prepare_nq_data.py:63
Function
main
(_)
language/question_answering/b2t2/compute_vcr_features.py:277
Function
main
(_)
language/question_answering/b2t2/run_b2t2.py:620
Function
main
(_)
language/question_answering/b2t2/run_dual_encoder.py:368
Function
main
(_)
language/question_answering/decatt_docreader/preprocessing/create_nq_short_pipeline_examples.py:98
Function
main
(_)
language/question_answering/decatt_docreader/preprocessing/create_nq_long_examples.py:114
Function
main
(_)
language/question_answering/decatt_docreader/experiments/nq_export_scorer.py:203
Function
main
(_)
language/question_answering/decatt_docreader/experiments/nq_long_experiment.py:27
Function
main
(_)
language/question_answering/decatt_docreader/experiments/nq_short_pipeline_experiment.py:29
Function
main
(argv)
language/fruit/convert_task_to_jsonl.py:154
Function
main
(_)
language/fruit/scripts/get_topics.py:104
Function
main
(_)
language/fruit/scripts/convert_to_jsonl.py:37
Function
main
(_)
language/fruit/scripts/run_filter_for_generation_pipeline.py:93
Function
main
(_)
language/fruit/scripts/run_process_snapshot_pipeline.py:97
Function
main
(_)
language/fruit/scripts/run_redirect_table_pipeline.py:46
Function
main
(_)
language/fruit/scripts/evaluate_t5x_jsonl.py:54
Function
main
(_)
language/fruit/scripts/run_to_tfrecords_pipeline.py:132
Function
main
(_)
language/fruit/scripts/run_convert_to_jsonl.py:37
Function
main
(_)
language/fruit/scripts/evaluate_direct_jsonls.py:76
Function
main
(_)
language/totto/create_table_to_text_html.py:35
Function
main
(_)
language/totto/prepare_references_for_eval.py:128
Function
main
(_)
language/totto/totto_bleurt_eval.py:93
Function
main
(_)
language/totto/prepare_predictions_for_eval.py:39
Function
main
(_)
language/totto/totto_parent_eval.py:447
Function
main
(_)
language/totto/baseline_preprocessing/preprocess_data_main.py:99
Function
main
(_)
language/relation_learning/models/bert_fewshot_classifier.py:374
Function
main
(_)
language/canine/tydiqa/run_tydi.py:307
Function
main
(_)
language/canine/tydiqa/prepare_tydi_data.py:117
Function
main
(_)
language/capwap/utils/tsv_to_hdf5.py:42
Function
main
(argv)
language/capwap/preprocessing/text_synthetic_qa.py:176
Function
main
(argv)
language/capwap/preprocessing/vqa_qa.py:121
Function
main
(argv)
language/capwap/preprocessing/coco_synthetic_qa.py:119
Function
main
(argv)
language/capwap/preprocessing/gqa_qa.py:97
Function
main
(argv)
language/capwap/preprocessing/coco_ood_captions.py:83
Function
main
(argv)
language/capwap/preprocessing/coco_text_planner.py:74
Function
main
(argv)
language/capwap/preprocessing/weakly_supervised.py:98
Function
main
(argv)
language/capwap/preprocessing/v7w_qa.py:145
Function
main
(argv)
language/capwap/preprocessing/vizwiz_qa.py:115
Function
main
(argv)
language/capwap/synthetic/filter_round_trip.py:131
Function
main
(_)
language/capwap/synthetic/generate_answers.py:599
Function
main
(_)
language/capwap/synthetic/generate_questions.py:463
Function
main
(argv)
language/capwap/training/train_supervised.py:151
Function
main
(argv)
language/capwap/training/train_reinforce.py:100
Function
main
(argv)
language/capwap/evaluation/infer_wsp_captions.py:164
Function
main
(argv)
language/capwap/evaluation/infer_captions.py:57
Function
main
(argv)
language/capwap/evaluation/score_captions.py:65
Function
main
(argv)
language/decontext/eval.py:88
Function
main
(unused_argv)
language/xsp/model/run_inference.py:487
Function
main
(unused_argv)
language/xsp/training/train_model.py:104
Function
main
(unused_argv)
language/xsp/data_preprocessing/convert_to_tfrecords.py:482
Function
main
(unused_argv)
language/xsp/data_preprocessing/convert_to_examples.py:210
Function
main
(unused_argv)
language/xsp/data_preprocessing/abstract_sql_main.py:77
Function
main
(unused_argv)
language/xsp/data_preprocessing/create_vocabularies.py:37
Function
main
(unused_argv)
language/xsp/data_preprocessing/compute_asql_coverage_spider.py:83
Function
main
(unused_argv)
language/xsp/data_preprocessing/estimate_asql_coverage_michigan.py:131
Function
main
(unused_argv)
language/xsp/evaluation/restore_from_asql_main.py:55
Function
main
(unused_argv)
language/xsp/evaluation/convert_preds_for_spider_eval.py:147
Method
make_attention_layer
()
language/mentionmemory/encoders/mention_memory_encoder.py:245
Method
make_collater_fn
Produces function to preprocess batches for mention classification task. This function samples and flattens mentions from input data. Args:
language/mentionmemory/tasks/mention_classifier_task.py:70
Method
make_collater_fn
Produces function to preprocess batches. See BaseTask. Batches text identifiers after standard mention preprocessing. Args: confi
language/mentionmemory/tasks/mention_memory_task.py:367
Method
make_collater_fn
Produces function to preprocess batches. For a selected subset of mentions in the batch, we retrieve the corresponding mention from the menti
language/mentionmemory/tasks/mauto_task.py:182
Method
make_collater_fn
Produces function to preprocess batches. See BaseTask.
language/mentionmemory/tasks/example_task.py:100
Method
make_collater_fn
Produces function to preprocess batches for relation classification task. This function samples and flattens mentions from input data. Args:
language/mentionmemory/tasks/relation_classifier_task.py:182
Method
make_collater_fn
Produces function to preprocess batches. See BaseTask. Our encoders take a flat tensor of mentions as input for the whole batch of passa
language/mentionmemory/tasks/text_classifier.py:163
Method
make_collater_fn
Produces function to preprocess batches. See BaseTask. Batches text identifiers after standard mention preprocessing. Also masks out men
language/mentionmemory/tasks/memory_generation_task.py:142
Method
make_collater_fn
Produces function to preprocess batches. See BaseTask. In the collater we subsample and flatten mentions across the batch, and sample me
language/mentionmemory/tasks/mention_encoder_task.py:106
Function
make_empty_dir
Makes an empty directory at `path`, deleting `path` first if needed.
language/common/utils/file_utils.py:26
Function
make_float_feature
(v)
language/question_answering/b2t2/compute_vcr_features.py:91
Function
make_grid
Create a grid, with relations for going n, s, e, w.
language/nql/nql/nql_test_lib.py:30
Method
make_loss_fn
Creates task loss function. See BaseTask. The Mention Memory encoder is pre-trained with a combination of 1) MLM loss, 2) same-entity re
language/mentionmemory/tasks/mention_memory_task.py:77
Method
make_loss_fn
Creates loss function for Ultra Fine Entity Typing training. TODO(urikz): Write detailed description. See https://www.aclweb.org/anthology/P1
language/mentionmemory/tasks/ultra_fine_entity_typing_task.py:151
Method
make_loss_fn
Creates task loss function. See BaseTask. Model is trained using entity linking loss. Args: config: contains experiment hyperpara
language/mentionmemory/tasks/embedding_based_entity_qa_task.py:56
Method
make_loss_fn
Creates task loss function. See BaseTask. The ReadTwice encoder is pre-trained with a combination of 1) MLM loss, 2) same-entity retriev
language/mentionmemory/tasks/readtwice_task.py:75
Method
make_loss_fn
Creates task loss function.
language/mentionmemory/tasks/mauto_task.py:78
Method
make_loss_fn
Creates task loss function.
language/mentionmemory/tasks/example_task.py:56
Method
make_loss_fn
Creates loss function for Relation Classifier training. TODO(urikz): Write detailed description. Args: config: task configuration.
language/mentionmemory/tasks/relation_classifier_task.py:112
Method
make_loss_fn
Creates task loss function.
language/mentionmemory/tasks/text_classifier.py:86
Method
make_loss_fn
Creates task loss function. Args: config: contains experiment hyperparameters. Returns: Loss function.
language/mentionmemory/tasks/base_task.py:43
Method
make_loss_fn
Creates task loss function. See BaseTask. Model is trained using same-entity retrieval loss encouraging retrieval of mentions of the sam
language/mentionmemory/tasks/mention_based_entity_qa_task.py:93
Method
make_memory_attention_layer
()
language/mentionmemory/encoders/readtwice_encoder.py:137
Method
make_output_postprocess_fn
Postprocess task samples (input and output). See BaseTask.
language/mentionmemory/encoders/mention_memory_encoder.py:572
Method
make_output_postprocess_fn
Produces function to postprocess task samples (input and output). The method is called occasionally during training or evaluation to save mod
language/mentionmemory/encoders/base_encoder.py:64
Method
make_output_postprocess_fn
Postprocess task samples (input and output). See BaseTask.
language/mentionmemory/tasks/downstream_encoder_task.py:50
Method
make_output_postprocess_fn
Postprocess task samples (input and output). See BaseTask.
language/mentionmemory/tasks/mention_encoder_task.py:292
Function
make_paired_annotations
Reads annotations from files and match them based on the text. Args: gold_generation_fi: Path to the gold examples. This file should be provide
language/diffqg/annotation.py:120
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask. Here we add a text identifier hash to the standard MentionEncoderTask preprocessi
language/mentionmemory/tasks/mention_memory_task.py:334
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask.
language/mentionmemory/tasks/mauto_task.py:162
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask.
language/mentionmemory/tasks/example_task.py:89
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask. During preprocessing we mask entity mentions as well as non-mention tokens. Args
language/mentionmemory/tasks/entity_qa_task.py:43
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask.
language/mentionmemory/tasks/text_classifier.py:152
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask. Here we add a text identifier hash to the standard MentionEncoderTask preprocessi
language/mentionmemory/tasks/memory_generation_task.py:109
Method
make_preprocess_fn
Produces function to preprocess samples. See BaseTask. During preprocessing we mask entity mentions as well as non-mention tokens. Args
language/mentionmemory/tasks/mention_encoder_task.py:34
Function
make_query
Modifies a `base`-query with addition and subtraction terms. Args: base: Base query, as is, i.e. without manual escaping nor operators. ad
language/search_agents/t5/t5_agent_lib.py:65
Function
make_sequences_compatible
Preprocesses sequences to make them compatible for computing a loss. Args: seq1: <type> [batch_size, seq_len, ...]. seq2: <type> [batch_siz
language/labs/consistent_zero_shot_nmt/utils/model_utils.py:376
Method
make_transformer_block
(n_layers: int)
language/mentionmemory/encoders/mention_memory_encoder.py:232
Method
make_transformer_block
(n_layers: int)
language/mentionmemory/encoders/readtwice_encoder.py:124
Function
map_fn
(inputs)
language/capwap/utils/reward_utils.py:79
Function
mapper
(*tuple_args)
language/nql/nql/dataset.py:258
Function
mask_logits
Mask `vec` in log-space. Elements in `vec` that are not in `mask` will be set to be very negative, so that when no longer in log-space (e.i., aft
language/boolq/utils/ops.py:79
Function
mask_mentions_and_tokens
Randomly masks whole mentions and random tokens up to a maximum. First, mentions are masked according to mention mask rate. If a mention is maske
language/mentionmemory/utils/mention_preprocess_utils.py:244
← previous
next →
4,701–4,800 of 6,154, ranked by callers