Functionhttp_bot(state, model_selector, temperature, top_p, max_new_tokens, request: gr.Request)
colongpt/serve/gradio_web_server_stg1.py:184
Functionhttp_bot(state, model_selector, temperature, top_p, max_new_tokens, request: gr.Request)
colongpt/serve/gradio_web_server_stg2.py:184
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
colongpt/model/language_model/colongpt_phi.py:86
Methodprepare_inputs_for_generation(self, input_ids, past_key_values=None, inputs_embeds=None, attention_mask=None,
colongpt/model/language_model/colongpt_phi3.py:85
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
colongpt/model/language_model/phi/modeling_phi.py:1088
Methodprepare_inputs_for_generation(
self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs
)
colongpt/model/language_model/phi3/modeling_phi3.py:1317