clamping 0 values of sqrt input to avoid NAN gradients

r""" Return state dict for lora weights and the network alphas. <Tip warning={true}> We support loading A1111 formatted LoRA

Creates a new logger with the given name :param name: The name of the logger :param logging_level: The logging level :param add_strea

Inject loras into model to be evaluated within a batch

Generate orthonormal coordinate system based on surface normal [Duff et al. 17] Building An Orthonormal Basis, Revisited. JCGT. 2017. :pa

:param: color (bn, c, h, w) :param: wi (*, *, c, h, w), supposed to be normalized :param: wo (*, *, c, h, w), supposed to be normalized

:param: albedo/roughness/metallic (bn, c, h, w) :param: wi (*, *, 3, h, w), supposed to be normalized :param: wo (*, *, 3, h, w), suppose

:param: color (bn, c, h, w) :param: roughness/metallic (bn, 1, h, w) :param: wi (*, *, c, h, w), supposed to be normalized :param: wo