MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / fp32_to_float16

Function fp32_to_float16

codegeex/megatron/model/module.py:131–142  ·  view source on GitHub ↗

Convert fp32 `val` to fp16/bf16

(val, float16_convertor)

Source from the content-addressed store, hash-verified

129
130
131def fp32_to_float16(val, float16_convertor):
132 """Convert fp32 `val` to fp16/bf16"""
133
134 def half_conversion(val):
135 val_typecheck = val
136 if isinstance(val_typecheck, (Parameter, Variable)):
137 val_typecheck = val.data
138 if isinstance(val_typecheck, _FLOAT_TYPES):
139 val = float16_convertor(val)
140 return val
141
142 return conversion_helper(val, half_conversion)
143
144
145def float16_to_fp32(val):

Callers 1

forwardMethod · 0.85

Calls 1

conversion_helperFunction · 0.85

Tested by

no test coverage detected