Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

set bias=True for linear layer (#526) #527

Closed
wants to merge 1 commit into from
Closed

set bias=True for linear layer (#526) #527

wants to merge 1 commit into from

Commits on Apr 9, 2024

  1. set bias=True for linear layer (facebookresearch#527) 

    Summary:


1. for output projection in text decoder, change bias=False to True. In many other places, e.g., LP head, ember's  output module and LLAVA, they are using bias=True (which is default value in Linear).
2. add configuration of using MLP instead of attention pooler for vision adapter;

Differential Revision:
D55897450

Privacy Context Container: 303860477774201
    @zhangtemplar @facebook-github-bot
    zhangtemplar authored and facebook-github-bot committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    92bd094 View commit details
    Browse the repository at this point in the history