New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: support for optimum #826

Merged

Giuseppe5 merged 20 commits into dev from optimum

Feb 6, 2024

Collaborator

Giuseppe5 commented Feb 6, 2024 •

edited

Loading

Groundwork for huggingface/optimum-amd#54

Giuseppe5 commented

View reviewed changes

src/brevitas/function/shape.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas/fx/value_tracer.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas/fx/value_tracer.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas/graph/equalize.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas/graph/equalize.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/common/generative/quantizers.py Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/eval.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/run_utils.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/run_utils.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/run_utils.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/run_utils.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/run_utils.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/llm_quant/sharded_mlir_group_export.py Outdated Show resolved Hide resolved

Giuseppe5 commented

View reviewed changes

src/brevitas_examples/llm/main.py Outdated Show resolved Hide resolved

nickfraser and others added 16 commits

February 6, 2024 18:57


          optimum: initial optimum integration

35785ea


          Refined solution for offloading

faebbb5


          Fix (optimum): clean-up (#802)

023fa1e


          Fix (optimum): dataloader and forward cleanup (#807)


          Fix (optimum): forward pass + fx (#808)

beaffa9


          FX forward, GPTQ, Export (#809)

95ac67a

* Forward pass with fx and pkv

* Restore eval

* Restore quantization

* Experimental export

* Fix GPTQ + Export


          Fix 2GB ONNX export error

c6cf2a7


          Fix gptq + speedup

8e973f8


          Feat (offload/fx): better buffer/params + call_functional (#816)

38dc8b3


          Fix: typo to setting weight handlers

158b573


          Feat (optimum): better call_function FX offload (#817)

4e49db1


          Refactored per row quantization. JIT not working (#818)

f0236c9


          Better structure for QDQ weights (#822)

5eaa5b4


          Fix (export): flag for torch qcdq export (#823)

43a1ec8


          Setup: remove optimum folder (#825)

a653be0


          Add/fix comments

e01f0d1


          Fix llm example

acf95e3

Giuseppe5 force-pushed the optimum branch from 432bf3f to acf95e3 Compare

February 6, 2024 19:12


          Misc: pre-commit fix

c9f28d7

Giuseppe5 requested a review from nickfraser

February 6, 2024 19:19


          Fix (graph/equalize): new transpose interface

3f8e41a

Giuseppe5 requested review from nickfraser and removed request for nickfraser

February 6, 2024 19:49


          Fix (examples/llm): no constant folding for group quant

6c79063

Giuseppe5 merged commit 45a7acc into dev

21 of 22 checks passed

Giuseppe5 deleted the optimum branch

February 12, 2024 09:59

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet