Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Manually stop generation. #815

Open
Quairon-Nailo opened this issue Jan 24, 2024 · 2 comments
Open

Feature request: Manually stop generation. #815

Quairon-Nailo opened this issue Jan 24, 2024 · 2 comments
Labels
approved The feature or enhancement is approved OR the bug is confirmed.

Comments

@Quairon-Nailo
Copy link

When stream response is on, many times I already know I'm going to regenerate the response very early in (for example, when the AI starts generating my own actions), but I still have to wait until the response is completely generated to do so. It's be great if we cut off the bod mid-way, stopping the generation, and leaving only the portion of the response it had already given (in case it started well and then fell of a cliff). It's a feature I miss coming from other platforms.

@sceuick sceuick added the approved The feature or enhancement is approved OR the bug is confirmed. label Feb 17, 2024
@sceuick
Copy link
Member

sceuick commented Feb 17, 2024

When stopping a generation, does it leave the "dangling" text behind or clear it?

@Quairon-Nailo
Copy link
Author

It should leave the text that's already generated, in case any of it is useful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved The feature or enhancement is approved OR the bug is confirmed.
Projects
None yet
Development

No branches or pull requests

2 participants