Skip to content
/ text_generation_webui_llama.cpp_cuda35 Public

Fork Text Generation WebUI for Large Language Models (IA) with llama-cpp-python for CUDA 3.5 GPUs

License

View license
0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

babal35/text_generation_webui_llama.cpp_cuda35

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
.github
.github
 
 
docker
docker
 
 
docs
docs
 
 
instruction-templates
instruction-templates
 
 
js
js
 
 
modules
modules
 
 
training/formats
training/formats
 
 
.gitignore
.gitignore
 
 
LICENSE
LICENSE
 
 
cmd_linux.sh
cmd_linux.sh
 
 
cmd_macos.sh
cmd_macos.sh
 
 
cmd_windows.bat
cmd_windows.bat
 
 
cmd_wsl.bat
cmd_wsl.bat
 
 
convert-to-safetensors.py
convert-to-safetensors.py
 
 
download-model.py
download-model.py
 
 
one_click.py
one_click.py
 
 
requirements.txt
requirements.txt
 
 
requirements_amd.txt
requirements_amd.txt
 
 
requirements_amd_noavx2.txt
requirements_amd_noavx2.txt
 
 
requirements_apple_intel.txt
requirements_apple_intel.txt
 
 
requirements_apple_silicon.txt
requirements_apple_silicon.txt
 
 
requirements_cpu_only.txt
requirements_cpu_only.txt
 
 
requirements_cpu_only_noavx2.txt
requirements_cpu_only_noavx2.txt
 
 
requirements_noavx2.txt
requirements_noavx2.txt
 
 
requirements_nowheels.txt
requirements_nowheels.txt
 
 
server.py
server.py
 
 
setup.cfg
setup.cfg
 
 
start_linux.sh
start_linux.sh
 
 
start_macos.sh
start_macos.sh
 
 
start_windows.bat
start_windows.bat
 
 
start_wsl.bat
start_wsl.bat
 
 
update_wizard_linux.sh
update_wizard_linux.sh
 
 
update_wizard_macos.sh
update_wizard_macos.sh
 
 
update_wizard_windows.bat
update_wizard_windows.bat
 
 
update_wizard_wsl.bat
update_wizard_wsl.bat
 
 
wsl.sh
wsl.sh
 
 

Repository files navigation

text_generation_webui_llama.cpp_cuda35

Fork of (https://github.com/oobabooga/text-generation-webui) WebUI for text generation with automatic use of pytorch and precompiled llama-cpp-python (make sure both are installed and compiled for a version CUDA 11.4) for CUDA 11.4 ​​for CUDA 3.5 GPUs not compatible with llama-cpp-python natively.

About

Fork Text Generation WebUI for Large Language Models (IA) with llama-cpp-python for CUDA 3.5 GPUs

Resources

Readme

License

View license
Activity

Stars

0 stars

Watchers

2 watching

Forks

0 forks
Report repository

Releases

No releases published

Sponsor this project

  •  
Learn more about GitHub Sponsors

Packages

No packages published

Languages