Chat completion request model
| 110 | |
| 111 | |
| 112 | class ChatCompletionRequest(BaseModel): |
| 113 | """Chat completion request model""" |
| 114 | |
| 115 | model: str |
| 116 | messages: list[Message] |
| 117 | stream: bool | None = Field(default=False) |
| 118 | user: str | None = Field(default=None) |
| 119 | temperature: float | None = Field(default=0.7) |
| 120 | top_p: float | None = Field(default=1.0) |
| 121 | max_tokens: int | None = Field(default=None) |
| 122 | tools: list[Tool] | None = Field(default=None) |
| 123 | tool_choice: ( |
| 124 | Literal["none"] | Literal["auto"] | Literal["required"] | ToolChoiceFunction | None |
| 125 | ) = Field(default=None) |
| 126 | response_format: dict[str, Any] | None = Field(default=None) |
| 127 | |
| 128 | |
| 129 | class ChatCompletionResponse(BaseModel): |
nothing calls this directly
no outgoing calls
no test coverage detected