(v0.4.0) 【Bookish Tea Talk】 chatTTS support! KG graphRAG neo4j support!More access to social apps! #55
heshengtao
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
✨v0.4.0✨【书香茶话】【Bookish Tea Talk】
This release includes the following features:
chunk_overlap
refers to how many characters overlap in the split text. This allows for batch input of long texts; just click mindlessly or enable loop execution in ComfyUI, and it will automatically execute. Remember to enable theis_locked
attribute to automatically lock the workflow at the end of the input, preventing further execution. Example workflow: Text Iterative Inputmodel name
attribute to the local LLM loader, local llava loader, and local guff loader. If empty, it uses the various local paths in the node. If not empty, it will use the path parameters you filled inconfig.ini
. If not empty and not inconfig.ini
, it will download from Hugging Face or load from the Hugging Face model save directory. If you want to download from Hugging Face, please fill in themodel name
attribute in the format likeTHUDM/glm-4-9b-chat
. Note! The model loaded this way must be compatible with the transformer library.is_tools_in_sys_prompt
attribute (local LLMs do not need to enable it by default, automatically adapted). After enabling, tool information will be added to the system prompt, allowing LLM to call tools. Related paper on the implementation principle: Achieving Tool Calling Functionality in LLMs Using Only Prompt Engineering Without Fine-Tuningcustom_tool
folder for storing custom tool code. You can refer to the code in the custom_tool folder, place the custom tool code in thecustom_tool
folder, and then call the custom tool in LLM.model_path
parameter can be empty! It is recommended to use the HF mode to load the model, which will automatically download from Hugging Face without manual download; if using local loading, please place the model'sasset
andconfig
folders in the root directory. Baidu Cloud Address, extraction code: qyhu; if usingcustom
mode loading, please place the model'sasset
andconfig
folders in themodel_path
.本次发行包含如下功能:
config.ini
中你自己填写的路径参数加载。如果不为空且不在config.ini
中,则会从huggingface上下载或则从huggingface的模型保存目录中加载。如果你想从huggingface上下载,请按照例如:THUDM/glm-4-9b-chat
的格式填写model name属性。注意!这样子加载的模型必须适配transformer库。飞书机器人。
model_path
参数可以为空!推荐使用HF模式加载模型,模型会自动从hugging face上下载,无需手动下载;如果使用local加载,请将模型的asset
和config
文件夹放到根目录下。百度云地址,提取码:qyhu;如果使用custom
模式加载,请将模型的asset
和config
文件夹放到model_path
下。Beta Was this translation helpful? Give feedback.
All reactions