Skip to content

Commit

Permalink
formated code with black
Browse files Browse the repository at this point in the history
  • Loading branch information
mylesgoose committed Oct 2, 2024
1 parent a075e4b commit cf40f5b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion transformer_lens/loading_from_pretrained.py
Original file line number Diff line number Diff line change
Expand Up @@ -1201,7 +1201,7 @@ def convert_hf_model_config(model_name: str, **kwargs):
"rotary_dim": hf_config.hidden_size // hf_config.num_attention_heads,
"final_rms": True,
"gated_mlp": True,
}
}
elif architecture == "QWenLMHeadModel":
cfg_dict = {
"d_model": hf_config.hidden_size,
Expand Down

0 comments on commit cf40f5b

Please sign in to comment.