Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat Support chat completion response format and seed new fields #525

Merged
merged 11 commits into from
Nov 7, 2023
Merged

Feat Support chat completion response format and seed new fields #525

Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
d2cee30
feat: support chat completion response format
henomis Nov 6, 2023
5d6a6b5
Merge remote-tracking branch 'upstream/master' into feat/support-chat…
henomis Nov 6, 2023
2996042
fix linting error
henomis Nov 7, 2023
7b2ffe2
fix
henomis Nov 7, 2023
015c6ad
fix linting
henomis Nov 7, 2023
81f62f6
Revert "fix linting"
henomis Nov 7, 2023
9f8d177
Revert "fix"
henomis Nov 7, 2023
dc1d625
Revert "fix linting error"
henomis Nov 7, 2023
5d9af11
chore: add seed new parameter
henomis Nov 7, 2023
5d0fb31
Merge remote-tracking branch 'upstream/master' into feat/support-chat…
henomis Nov 7, 2023
5502fce
fix
henomis Nov 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 23 additions & 10 deletions chat.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,18 +69,31 @@ type FunctionCall struct {
Arguments string `json:"arguments,omitempty"`
}

type ChatCompletionResponseFormatType string

const (
ChatCompletionResponseFormatTypeJSONObject ChatCompletionResponseFormatType = "json_object"
ChatCompletionResponseFormatTypeText ChatCompletionResponseFormatType = "text"
)

type ChatCompletionResponseFormat struct {
Type ChatCompletionResponseFormatType `json:"type"`
}

// ChatCompletionRequest represents a request structure for chat completion API.
type ChatCompletionRequest struct {
Model string `json:"model"`
Messages []ChatCompletionMessage `json:"messages"`
MaxTokens int `json:"max_tokens,omitempty"`
Temperature float32 `json:"temperature,omitempty"`
TopP float32 `json:"top_p,omitempty"`
N int `json:"n,omitempty"`
Stream bool `json:"stream,omitempty"`
Stop []string `json:"stop,omitempty"`
PresencePenalty float32 `json:"presence_penalty,omitempty"`
FrequencyPenalty float32 `json:"frequency_penalty,omitempty"`
Model string `json:"model"`
Messages []ChatCompletionMessage `json:"messages"`
MaxTokens int `json:"max_tokens,omitempty"`
Temperature float32 `json:"temperature,omitempty"`
TopP float32 `json:"top_p,omitempty"`
N int `json:"n,omitempty"`
Stream bool `json:"stream,omitempty"`
Stop []string `json:"stop,omitempty"`
PresencePenalty float32 `json:"presence_penalty,omitempty"`
ResponseFormat ChatCompletionResponseFormat `json:"response_format,omitempty"`
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is optional. So it should have been a pointer: *ChatCompletionResponseFormat. Now I get:

status code: 400, message: '' is not one of ['json_object', 'text'] - 'response_format.type'

Seed *int `json:"seed,omitempty"`
FrequencyPenalty float32 `json:"frequency_penalty,omitempty"`
// LogitBias is must be a token id string (specified by their token ID in the tokenizer), not a word string.
// incorrect: `"logit_bias":{"You": 6}`, correct: `"logit_bias":{"1639": 6}`
// refs: https://platform.openai.com/docs/api-reference/chat/create#chat/create-logit_bias
Expand Down
Loading