关于显存占用 #10
HelloEveryonehh
started this conversation in
General
关于显存占用
#10
Replies: 1 comment
-
|
信息不足，无法给出准确数据。什么工具，什么精度？你参考以下数据吧。 llama.cpp下Q6_K（GGUF格式），35.74 GiB（磁盘占用大小）：
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
作者您好，我想请教一下128K，64K上下文，需要的显存分别是多少？
Beta Was this translation helpful? Give feedback.
All reactions