Gemini on Vertex AI aborts half-way through completions #4283
Unanswered
JeongJuhyeon
asked this question in
Troubleshooting
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Error
Reproduction steps
Background info
Because I also see issues using Bedrock (#4282) this might suggest a server setup error on our side (e.g. response size/duration limits), but out of the 6 endpoints we have installed, 4 of them (Anthropic, OpenAI, Fireworks and Groq) all work well with zero such issues when using the same prompts.
Beta Was this translation helpful? Give feedback.
All reactions