Unable to Request Images from Plugins

[pzcn]

What happened?

I am unable to request images from various plugins. I have tried using Dalle-3, Earth, QRcodes, and more, but none of them are returning images. Instead, I am receiving responses similar to the following:
"I apologize, but as a text-based AI, I am unable to draw or provide visual content. However, you can easily find a map of London by searching online or using a mapping application on your device. There are many reliable sources that offer detailed maps of London, including Google Maps, Apple Maps, and various travel websites."
When attempting to use Dalle-3, I checked the API backend and noticed that no API request was generated.

Any assistance in resolving this issue would be greatly appreciated.

Steps to Reproduce

1.Try to request an image from Dalle-3, Earth, or QRcodes plugin.
2.Observe the response from the plugin.

What browsers are you seeing the problem on?

Microsoft Edge

Relevant log output

{
  "level": "error",
  "message": "[OpenAIClient] There was an issue generating title with LangChain, trying the old method... No function_call in message [
    {
      "text": "I apologize, but as a text-based AI, I am unable to draw or provide visual content. However, you can easily find a map of London by searching online or using a mapping application on your device. There are many reliable sources that offer detailed maps of London, including Google Maps, Apple Maps, and various travel websites.",
      "message": {
        "lc": 1,
        "type": "constructor",
        "id": ["langchain", "schema", "AIMessage"],
        "kwargs": {
          "content": "I apologize, but as a text-based AI, I am unable to draw or provide visual content. However, you can easily find a map of London by searching online or using a mapping application on your device. There are many reliable sources that offer detailed maps of London, including Google Maps, Apple Maps, and various travel websites.",
          "additional_kwargs": {}
        }
      },
      "generationInfo": {
        "finish_reason": "stop"
      }
    }
  ]",
  "stack": "Error: No function_call in message [
    {
      "text": "I apologize, but as a text-based AI, I am unable to draw or provide visual content. However, you can easily find a map of London by searching online or using a mapping application on your device. There are many reliable sources that offer detailed maps of London, including Google Maps, Apple Maps, and various travel websites.",
      "message": {
        "lc": 1,
        "type": "constructor",
        "id": ["langchain", "schema", "AIMessage"],
        "kwargs": {
          "content": "I apologize, but as a text-based AI, I am unable to draw or provide visual content. However, you can easily find a map of London by searching online or using a mapping application on your device. There are many reliable sources that offer detailed maps of London, including Google Maps, Apple Maps, and various travel websites.",
          "additional_kwargs": {}
        }
      },
      "generationInfo": {
        "finish_reason": "stop"
      }
    }
  ]
    at OutputFunctionsParser.parseResult (/app/api/node_modules/langchain/dist/output_parsers/openai_functions.cjs:48:23)
    at FunctionCallStructuredOutputParser.parseResult (/app/api/node_modules/langchain/dist/chains/openai_functions/structured_output.cjs:52:63)
    at FunctionCallStructuredOutputParser.parseResultWithPrompt (/app/api/node_modules/langchain/dist/schema/output_parser.cjs:22:21)
    at LLMChain._getFinalOutput (/app/api/node_modules/langchain/dist/chains/llm_chain.cjs:124:55)
    at LLMChain._call (/app/api/node_modules/langchain/dist/chains/llm_chain.cjs:159:46)
    at process.processTicksAndRejections (node:internal/process/task_queue:95:5)
    at async LLMChain.call (/app/api/node_modules/langchain/dist/chains/base.cjs:104:28)
    at async runTitleChain (/app/api/app/clients/chains/runTitleChain.js:38:25)
    at async PluginsClient.titleConvo (/app/api/app/clients/OpenAIClient.js:553:15)
    at async addTitle (/app/api/server/services/Endpoints/openAI/addTitle.js:15:17)"
}

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Something's up with your setup because it's definitely working. It could be your reverse proxy if you're using one

Would need to see your .env file setup omitting sensitive credentials of course

Also, what are your Agent settings?

[pzcn]

Thanks for answer.
Below are my env (Sensitive information removed) and agent settings
and I can not see the option to choose which plugin in anwser
I am trying to start a new vps and try

#=============================================================#
#                   LibreChat Configuration                   #
#=============================================================#
# Please refer to the reference documentation for assistance  #
# with configuring your LibreChat environment. The guide is   #
# available both online and within your local LibreChat       #
# directory:                                                  #
# Online: https://docs.librechat.ai/install/dotenv.html       #
# Locally: ./docs/install/dotenv.md                           #
#=============================================================#

#==================================================#
#               Server Configuration               #
#==================================================#

APP_TITLE=xx
CUSTOM_FOOTER="xx"

DEBUG_LOGGING=TRUE

HOST=0.0.0.0
PORT=3080

MONGO_URI=mongodb://127.0.0.1:27017/LibreChat

DOMAIN_CLIENT=https://xxxx/
DOMAIN_SERVER=https://xxxx/

#=============#
# Permissions #
#=============#

# UID=1000
# GID=1000

#===================================================#
#                     Endpoints                     #
#===================================================#

ENDPOINTS=openAI,bingAI,google,gptPlugins,anthropic

PROXY=

#============#
# Anthropic  #
#============#

ANTHROPIC_API_KEY=user_provided
ANTHROPIC_MODELS=claude-1,claude-instant-1,claude-2
# ANTHROPIC_REVERSE_PROXY=

#============#
# Azure      #
#============#

# AZURE_API_KEY=
AZURE_OPENAI_MODELS=gpt-3.5-turbo,gpt-4
# AZURE_OPENAI_DEFAULT_MODEL=gpt-3.5-turbo
# PLUGINS_USE_AZURE="true"

AZURE_USE_MODEL_AS_DEPLOYMENT_NAME=TRUE

# AZURE_OPENAI_API_INSTANCE_NAME=
# AZURE_OPENAI_API_DEPLOYMENT_NAME=
# AZURE_OPENAI_API_VERSION=
# AZURE_OPENAI_API_COMPLETIONS_DEPLOYMENT_NAME=
# AZURE_OPENAI_API_EMBEDDINGS_DEPLOYMENT_NAME=

#============#
# BingAI     #
#============#

BINGAI_TOKEN=user_provided
# BINGAI_HOST=https://cn.bing.com

#============#
# ChatGPT    #
#============#

CHATGPT_TOKEN=
CHATGPT_MODELS=text-davinci-002-render-sha
# CHATGPT_REVERSE_PROXY=<YOUR REVERSE PROXY>

#============#
# Google     #
#============#

GOOGLE_KEY=user_provided
# GOOGLE_REVERSE_PROXY=

#============#
# OpenAI     #
#============#

OPENAI_API_KEY=sk-xxx
OPENAI_MODELS=gpt-4-32k,gpt-3.5-turbo-1106,gpt-3.5-turbo-16k,text-davinci-003,gpt-4-1106-preview,gpt-4-vision-preview

DEBUG_OPENAI=false

# TITLE_CONVO=false
OPENAI_TITLE_MODEL=gpt-3.5-turbo-16k

# OPENAI_SUMMARIZE=true
# OPENAI_SUMMARY_MODEL=gpt-3.5-turbo-16k

# OPENAI_FORCE_PROMPT=true

OPENAI_REVERSE_PROXY=https://xxx.xxx/v1/chat/completions

#============#
# OpenRouter #
#============#

# OPENROUTER_API_KEY=

#============#
# Plugins    #
#============#

PLUGIN_MODELS=gpt-4-32k,gpt-3.5-turbo-1106,gpt-3.5-turbo-16k,text-davinci-003,gpt-4-1106-preview,

DEBUG_PLUGINS=false
  
CREDS_KEY= aefe0682f02e188fba761b47c9975a92e8a6a581ff17aef3322b9265ff273385
CREDS_IV= 5c00de0e655a852f35fcbf54c0f232fa

# Azure AI Search
#-----------------
AZURE_AI_SEARCH_SERVICE_ENDPOINT=
AZURE_AI_SEARCH_INDEX_NAME=
AZURE_AI_SEARCH_API_KEY=

AZURE_AI_SEARCH_API_VERSION=
AZURE_AI_SEARCH_SEARCH_OPTION_QUERY_TYPE=
AZURE_AI_SEARCH_SEARCH_OPTION_TOP=
AZURE_AI_SEARCH_SEARCH_OPTION_SELECT=

# DALL·E 3
#----------------
DALLE_API_KEY=sk-xxx
# DALLE3_SYSTEM_PROMPT="Your System Prompt here"
DALLE_REVERSE_PROXY=https://xxx.xxx/v1

# Google
#-----------------
GOOGLE_API_KEY=
GOOGLE_CSE_ID=

# SerpAPI
#-----------------
SERPAPI_API_KEY=

# Stable Diffusion
#-----------------
#SD_WEBUI_URL=http://host.docker.internal:7860

# WolframAlpha
#-----------------
WOLFRAM_APP_ID=

# Zapier
#-----------------
ZAPIER_NLA_API_KEY=

#==================================================#
#                      Search                      #
#==================================================#

SEARCH=true
MEILI_NO_ANALYTICS=true
MEILI_HOST=http://meilisearch:7700
MEILI_HTTP_ADDR=meilisearch:7700
MEILI_MASTER_KEY=DrhYf7zENyR6AlUCKmnz0eYASOQdl6zxH7s7MKFSfFCt

#===================================================#
#                    User System                    #
#===================================================#

#========================#
# Moderation             #
#========================#

BAN_VIOLATIONS=true
BAN_DURATION=1000 * 60 * 60 * 2
BAN_INTERVAL=20

LOGIN_VIOLATION_SCORE=1
REGISTRATION_VIOLATION_SCORE=1
CONCURRENT_VIOLATION_SCORE=1
MESSAGE_VIOLATION_SCORE=1
NON_BROWSER_VIOLATION_SCORE=20

LOGIN_MAX=7
LOGIN_WINDOW=5
REGISTER_MAX=5
REGISTER_WINDOW=60

LIMIT_CONCURRENT_MESSAGES=true
CONCURRENT_MESSAGE_MAX=2

LIMIT_MESSAGE_IP=true
MESSAGE_IP_MAX=40
MESSAGE_IP_WINDOW=1

LIMIT_MESSAGE_USER=false
MESSAGE_USER_MAX=40
MESSAGE_USER_WINDOW=1

#========================#
# Balance                #
#========================#

CHECK_BALANCE=false

#========================#
# Registration and Login #
#========================#

ALLOW_EMAIL_LOGIN=true
ALLOW_REGISTRATION=false
ALLOW_SOCIAL_LOGIN=false
ALLOW_SOCIAL_REGISTRATION=false

SESSION_EXPIRY=1000 * 60 * 15
REFRESH_TOKEN_EXPIRY=(1000 * 60 * 60 * 24) * 7

JWT_SECRET=16f8c0ef4a5d391b26034086c628469d3f9f497f08163ab9b40137092f2909ef
JWT_REFRESH_SECRET=eaa5191f2914e30b9387fd84e254e4ba6fc51b4654968a9b0803b456a54b8418

# Discord
DISCORD_CLIENT_ID=
DISCORD_CLIENT_SECRET=
DISCORD_CALLBACK_URL=/oauth/discord/callback

# Facebook
FACEBOOK_CLIENT_ID=
FACEBOOK_CLIENT_SECRET=
FACEBOOK_CALLBACK_URL=/oauth/facebook/callback

# GitHub
GITHUB_CLIENT_ID=
GITHUB_CLIENT_SECRET=
GITHUB_CALLBACK_URL=/oauth/github/callback

# Google
GOOGLE_CLIENT_ID=
GOOGLE_CLIENT_SECRET=
GOOGLE_CALLBACK_URL=/oauth/google/callback

# OpenID
OPENID_CLIENT_ID=
OPENID_CLIENT_SECRET=
OPENID_ISSUER=
OPENID_SESSION_SECRET=
OPENID_SCOPE="openid profile email"
OPENID_CALLBACK_URL=/oauth/openid/callback

OPENID_BUTTON_LABEL=
OPENID_IMAGE_URL=

#========================#
# Email Password Reset   #
#========================#

EMAIL_SERVICE=                  
EMAIL_HOST=                     
EMAIL_PORT=25                   
EMAIL_ENCRYPTION=               
EMAIL_ENCRYPTION_HOSTNAME=      
EMAIL_ALLOW_SELFSIGNED=         
EMAIL_USERNAME=                 
EMAIL_PASSWORD=                 
EMAIL_FROM_NAME=                
EMAIL_FROM=noreply@librechat.ai

#==================================================#
#                      Others                      #
#==================================================#
#   You should leave the following commented out   #

# NODE_ENV=

# REDIS_URI=
# USE_REDIS=

# E2E_USER_EMAIL=
# E2E_USER_PASSWORD=

[danny-avila]

Which reverse proxy service are you using?

[pzcn]

What I purchased is from an unofficial API, but only OPENAI_REVERSE_PROXY and DALLE_REVERSE_PROXY are set. Will it affect the global situation?

[pzcn]

so okay, i change another api and it works.By the way, I have a question, can the request plugin be initiated directly from the localhost? If the request is not made through OPENAI_REVERSE_PROXY, this problem can be solved. Or the request must be sent to the reverse proxy server. Hope you can get the answer, thank you