Functionhttp_bot(state, model_selector, temperature, top_p, max_new_tokens, request: gr.Request)
bunny/serve/gradio_web_server.py:184
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
bunny/model/language_model/bunny_qwen2.py:88
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
bunny/model/language_model/bunny_phi3.py:88
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
bunny/model/language_model/bunny_llama.py:93
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
bunny/model/language_model/bunny_phi.py:88
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
bunny/model/language_model/qwen2/modeling_qwen2.py:1214
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
bunny/model/language_model/phi/modeling_phi.py:1087
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, cache_position=None,
bunny/model/language_model/llama/modeling_llama.py:1531
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
bunny/model/language_model/phi3/modeling_phi3.py:1317