MCPcopy Create free account
hub / github.com/google-research/language / PaddingInputExample

Class PaddingInputExample

language/conpono/evals/run_classifier.py:156–166  ·  view source on GitHub ↗

Fake example so the num input examples is a multiple of the batch size. When running eval/predict on the TPU, we need to pad the number of examples to be a multiple of the batch size, because the TPU requires a fixed batch size. The alternative is to drop the last batch, which is bad because

Source from the content-addressed store, hash-verified

154
155
156class PaddingInputExample:
157 """Fake example so the num input examples is a multiple of the batch size.
158
159 When running eval/predict on the TPU, we need to pad the number of examples
160 to be a multiple of the batch size, because the TPU requires a fixed batch
161 size. The alternative is to drop the last batch, which is bad because it means
162 the entire output data won't be generated.
163
164 We use this class instead of `None` because treating `None` as padding
165 battches could cause silent errors.
166 """
167
168
169class InputFeatures:

Callers 1

mainFunction · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…