Method get_command

Megatron-LM/data_utils/tokenization.py:253–255

get command token corresponding to `name`

(self, name)

        return self.num_tokens

    def get_command(self, name):
        """get command token corresponding to `name`"""
        return self.command_name_map[name]

    def get_type(self, name):
        """get type token corresponding to `name`"""