huggingface peft Q A · Discussions · GitHub

Hallucinations with 8bit Whisper PEFT model - solved with full / half precision
General sanchit-gandhi

Sort by: Latest activity

Q&A Discussions

Ask the community for help

You must be logged in to vote

AdaLoRA without update_and_allocate

h4iku asked Jul 1, 2024 in Q&A · Unanswered

1
You must be logged in to vote

enable_input_require_grads is called twice with use_gradient_checkpointing=True and bnb quantisation; is there any effect?

nzw0301 asked Apr 5, 2024 in Q&A · Answered

5
You must be logged in to vote

Help Needed: Implementing QLoRA on AutoGPTQ Model - Unsupported Module Error

SkanderGhariani asked Jun 14, 2024 in Q&A · Answered

5
You must be logged in to vote

What are good configs for training UNet3DConditionModel on 8 GB VRAM? (64x64x64 inputs)

RandomGamingDev asked Jun 3, 2024 in Q&A · Closed · Answered

7
You must be logged in to vote

GPU Memory-Usage, full finetuning vs LoRA vs LoRA + CPU Offloading

EthanChen1234 asked May 27, 2024 in Q&A · Closed · Unanswered

2
You must be logged in to vote

Does inference with a PEFT model require all merged LoRA models or just the final saved LoRA and the base model?

BGFGB asked May 29, 2024 in Q&A · Unanswered

1
You must be logged in to vote

Is there any reason not to use the tokenizer after applying LORA?

seona21 asked May 16, 2024 in Q&A · Answered

3
You must be logged in to vote

Trained layers with LoRA will be merged into model?

lavinal712 asked May 12, 2024 in Q&A · Unanswered

14
You must be logged in to vote

QLoRa with Vision Transformers

anwai98 asked Apr 23, 2024 in Q&A · Unanswered

2
You must be logged in to vote

How can I train the adalora about nn.Conv1d?

girlsending0 asked Apr 11, 2024 in Q&A · Unanswered

2
You must be logged in to vote

prompt-tuning & p-tuning with Seq2Seq2LM t5

whdnjsdyd111 asked Apr 5, 2024 in Q&A · Closed · Unanswered

0
You must be logged in to vote

The multi-task prompt tuning of PEFT library

lhyscau asked Mar 25, 2024 in Q&A · Unanswered

5
You must be logged in to vote

peft provides the position of the model input?

ciaoyizhen asked Mar 19, 2024 in Q&A · Unanswered

0
You must be logged in to vote

How to train a custom model

nguyenhoanganh2002 asked Mar 14, 2024 in Q&A · Answered

12
You must be logged in to vote

What is the intended way of doing EMA with PEFT?

samedii asked Mar 12, 2024 in Q&A · Answered

10
You must be logged in to vote

Possible issue with whisper example notebook

rosyvs asked Aug 1, 2023 in Q&A · Unanswered

1
You must be logged in to vote

What is the intended way of saving the base model when finetuning both an adapter and some layers in the base model?

samedii asked Mar 9, 2024 in Q&A · Answered

2
You must be logged in to vote

Load and unload different LORAs during training

antoni4040 asked Feb 14, 2024 in Q&A · Unanswered

3
You must be logged in to vote

Resume training from a checkpoint with different hyperparameters when training with transformers

jonflynng asked Feb 16, 2024 in Q&A · Unanswered

1
You must be logged in to vote

Is there any way to extract lora adapter from merged model?

tjtanaa asked Dec 5, 2023 in Q&A · Unanswered

6
You must be logged in to vote

Multitask Prompt Tuning Confusion

atastats asked Feb 1, 2024 in Q&A · Unanswered

5
You must be logged in to vote

Got Error on Fine-tuning TrOCR with LoRA

bustamiyusoef asked Dec 30, 2023 in Q&A · Unanswered

1
You must be logged in to vote

Inference with a PEFT adapter is slow

alexflint asked Jul 10, 2023 in Q&A · Unanswered

5
You must be logged in to vote

Are there any plans to implement concurrent LoRa inference with multiple adapters (such as S-lora)?

SamGalanakis asked Dec 8, 2023 in Q&A · Unanswered

3
You must be logged in to vote

Recovering the Learnt Prompt in text

pharringtonp19 asked Dec 12, 2023 in Q&A · Unanswered

4