Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Check a redis key periodically, and afte revery nth chunk to "stop generating" #1

Open
tomlynchRNA opened this issue Nov 14, 2023 · 1 comment
Open

Check a redis key periodically, and afte revery nth chunk to "stop generating" #1

tomlynchRNA opened this issue Nov 14, 2023 · 1 comment

Comments

@tomlynchRNA
Copy link

add/pass redis to chatcompletionproxy

just raise an exception with a message about stopping generating
tomlynchRNA added a commit that referenced this issue Nov 14, 2023
@tomlynchRNA
Add session ID, redis, and nth chunk checking of a specific redis key…
75e95a5 
… to stop generating ref #1
@tomlynchRNA
Copy link
Author

ref rnadigital/agentcloud#23

joshkyh pushed a commit that referenced this issue Jan 22, 2024
@maxim-saplin @sonichi
Switched to AzureOpenAI for api_type=="azure" (microsoft#1232)
00dbcb2 
* Switched to AzureOpenAI for api_type=="azure"

* Setting AzureOpenAI to empty object if no `openai`

* extra_ and openai_ kwargs

* test_client, support for Azure and "gpt-35-turbo-instruct"

* instruct/azure model in test_client_stream

* generalize aoai support (#1)

* generalize aoai support

* Null check, fixing tests

* cleanup test

---------

Co-authored-by: Maxim Saplin <smaxmail@gmail.com>

* Returning back model names for instruct

* process model in create

* None check

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tomlynchRNA