MCPcopy Create free account
hub / github.com/togethercomputer/OpenChatKit / add_task_arguments

Function add_task_arguments

training/utils/dist_args_utils.py:29–43  ·  view source on GitHub ↗
(parser)

Source from the content-addressed store, hash-verified

27
28
29def add_task_arguments(parser):
30 parser.add_argument('--train-data', nargs='+', default=['./glue_dataset/data/QQP/train.tsv'], metavar='S',
31 help='path to the training data')
32 parser.add_argument('--valid-data', nargs='+', default=['./glue_dataset/data/QQP/test.tsv'], metavar='S',
33 help='path to the training data')
34 parser.add_argument('--tokenizer-type', type=str, default='BertWordPieceLowerCase', metavar='S',
35 help='which tokenizer to use.')
36 parser.add_argument('--vocab-file', type=str, default='./glue_dataset/data/bert-large-cased-vocab.txt', metavar='S',
37 help='which tokenizer to use.')
38 parser.add_argument('--vocab-extra-ids', type=int, default=0, metavar='N',
39 help='-')
40 parser.add_argument('--make-vocab-size-divisible-by', type=int, default=128, metavar='N',
41 help='-')
42 parser.add_argument('--optimizer', type=str, default='adamw', metavar='N',
43 help='-')
44
45
46def add_model_arguments(parser):

Callers 2

mainFunction · 0.85
mainFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected