ollama models

[martinjaco]

How to make use of ollama models instead of Openai models?

[boyuZh]

As far as I know, most of the open-source models supported by ollama do not support tool usage. But if you find one, you can modify the openai api as per this doc.

[zhengr]

The Agent stuff totally leverage the LLM model functionality, such as function calling. If you want to try ollama, check the model`s function calling. Most of them are not good enough.