Training Transformers with 4-bit Integers #994
hwu36
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This paper uses CUTLASS 4bit int gemm to train Transformer.
Beta Was this translation helpful? Give feedback.
All reactions