Share the Open Source Models You've Discovered

[stevenlu137]

With the recent release of a series of 8x22B models, my dual 4090 setup is struggling to cope with the memory demands of the new generation of open-source models. For some models, excessive quantization could significantly impact their performance in executing agent tasks. Therefore, we hope users with hardware resources can share their findings here.