Skip to content

Xia-Weiwen/bitsandbytes_ops_cpu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bitsandbytes_ops_cpu

Python implementation of bisandbytes ops for CPU

Run tests

python test_ops.py

Run benchmarks

Eager vs. inductor (torch.compile)

# Latency
numactl -m <node id> -C <core list> python benchmarks.py --all
# Profiling
numactl -m <node id> -C <core list> python benchmarks.py --all --profile

About

Python implementation of bisandbytes ops for CPU

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages