Vision capabilitie for OpenAI assistant

[robertsmaoui]

What happened?

OpenAI assistant not detect image content when sending image in chat

but it works fine with openai model like gpt4o

Steps to Reproduce

in librechat.yaml :

endpoints:
assistants:
disableBuilder: false # Disable Assistants Builder Interface by setting to `tru
ASSISTANTS_API_KEY: "sk-proj-rPKccccccccccTsA"
capabilities:
- "tools"
- "image_vision"
and .env :

ENDPOINTS=openAI,assistants

OPENAI_API_KEY=sk-proj-rPhhhhhhhhhhhhhhhhhhhhhhhsA
OPENAI_MODELS=gpt-4o-mini

ASSISTANTS_API_KEY=sk-proj-rPK3XvvvvvvvvvvvvvvvvvvvvvvvvvNKlTsA
ASSISTANTS_MODELS=gpt-4o-mini

What browsers are you seeing the problem on?

No response

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

The “image vision” capability is no longer used since OpenAI started supporting vision natively with supported models.

use a supported vision model, gpt-4o is one of them

[robertsmaoui]

The vision not works in librechat in openai assistant chat !!

[danny-avila]

I investigated it and it looks like OpenAI changed the way they are handling images. Will look into it.

[robertsmaoui]

Thank you !

[faniereynders]

any update on this?