Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate X-LoRA #1491

Merged
merged 190 commits into from
Jul 5, 2024
Merged

Integrate X-LoRA #1491

merged 190 commits into from
Jul 5, 2024

Commits on Mar 29, 2024

  1. Initial commit of integration

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9aeb69c View commit details
    Browse the repository at this point in the history

  2. Pass a reference back to the peftmodel when creating

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b9d3878 View commit details
    Browse the repository at this point in the history

  3. Check base model in from_pretrained

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    bbd3ad4 View commit details
    Browse the repository at this point in the history

  4. Fix assert, attr

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ea53917 View commit details
    Browse the repository at this point in the history

  5. Fix inheritance from peft model

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    79c4df9 View commit details
    Browse the repository at this point in the history

  6. Update inheritance again

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    2ee88af View commit details
    Browse the repository at this point in the history

  7. Update inheritance again and properly instantiate

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    19063dc View commit details
    Browse the repository at this point in the history

  8. Update comment

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    d364e5b View commit details
    Browse the repository at this point in the history

  9. Export config, model

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c9ab310 View commit details
    Browse the repository at this point in the history

  10. Remove use of default attr

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9ed665e View commit details
    Browse the repository at this point in the history

  11. Remove use of default attr

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ae32006 View commit details
    Browse the repository at this point in the history

  12. Update imports

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9bfe8a6 View commit details
    Browse the repository at this point in the history

  13. Update imports

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    048958f View commit details
    Browse the repository at this point in the history

  14. Update imports

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    024ce15 View commit details
    Browse the repository at this point in the history

  15. Work on circular import

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    3d08fc9 View commit details
    Browse the repository at this point in the history

  16. Work on circular import again

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    7e5332b View commit details
    Browse the repository at this point in the history

  17. Remove another circular import

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    d5193f4 View commit details
    Browse the repository at this point in the history

  18. Remove another circular import

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    5d7ff64 View commit details
    Browse the repository at this point in the history

  19. Slightly refactor

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b41089d View commit details
    Browse the repository at this point in the history

  20. Update with EricLBuehler/xlora#20

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    bfd794f View commit details
    Browse the repository at this point in the history

  21. Make signature an exact copy

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    726f8a8 View commit details
    Browse the repository at this point in the history

  22. Refactor util fns

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    8a1c68c View commit details
    Browse the repository at this point in the history

  23. Update the typing structure

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1a34615 View commit details
    Browse the repository at this point in the history

  24. Pass super() the dict

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1f0e03a View commit details
    Browse the repository at this point in the history

  25. Add capability to disable default injection

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c326560 View commit details
    Browse the repository at this point in the history

  26. Set base model for loading adapter

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c9dab76 View commit details
    Browse the repository at this point in the history

  27. Set peft type

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    980b2c8 View commit details
    Browse the repository at this point in the history

  28. Default adapter name

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c3f4ed9 View commit details
    Browse the repository at this point in the history

  29. Ensure all nonzero length

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    effaca0 View commit details
    Browse the repository at this point in the history

  30. Fix get nb trainable params

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    031fabb View commit details
    Browse the repository at this point in the history

  31. Add some docs to tuner class

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9a7943e View commit details
    Browse the repository at this point in the history

  32. Update post init of xlora config

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    deeb169 View commit details
    Browse the repository at this point in the history

  33. Mention method swapping

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1e73f3d View commit details
    Browse the repository at this point in the history

  34. Remove incorrect example

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    73901e8 View commit details
    Browse the repository at this point in the history

  35. Update to use default args for compat

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    279036d View commit details
    Browse the repository at this point in the history

  36. Move API for nice visibility

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    644a562 View commit details
    Browse the repository at this point in the history

  37. Remove use of __slots__

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    6e3dc3d View commit details
    Browse the repository at this point in the history

  38. Remove passing of classifier

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    012ed6f View commit details
    Browse the repository at this point in the history

  39. Remove passing of classifier

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    510247d View commit details
    Browse the repository at this point in the history

  40. Remove many asserts, converting to exceptions

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    f3e3d1f View commit details
    Browse the repository at this point in the history

  41. Update naming convention

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a24f51b View commit details
    Browse the repository at this point in the history

  42. Refactor Lora layers toreduce code repetion

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    358ea19 View commit details
    Browse the repository at this point in the history

  43. Remove _disable_inject hack

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    e6126fa View commit details
    Browse the repository at this point in the history

  44. Remove passing peftmodel to super

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    de76531 View commit details
    Browse the repository at this point in the history

  45. Use post init fn to improve separation of concerns

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1dace56 View commit details
    Browse the repository at this point in the history

  46. Update naming and fix call

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    e11e433 View commit details
    Browse the repository at this point in the history

  47. Remove 'n_predictions_lifetime'

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    63debdb View commit details
    Browse the repository at this point in the history

  48. Move generate to XLoraModel, simplifying PeftModelWrapper

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    226ab92 View commit details
    Browse the repository at this point in the history

  49. Simplify save pretrained and from pretrained

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    feba4f6 View commit details
    Browse the repository at this point in the history

  50. Do not save to nested dir

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    fd0ab4b View commit details
    Browse the repository at this point in the history

  51. Use new _save_pretrained_hook to reduce code duplication

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c44cd5a View commit details
    Browse the repository at this point in the history

  52. Add explaining comment

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1f36837 View commit details
    Browse the repository at this point in the history

  53. Call .clear on log scalings

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    d2d3b6a View commit details
    Browse the repository at this point in the history

  54. Seperate method use cases

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9a7032b View commit details
    Browse the repository at this point in the history

  55. Prefix with _

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    f4a5314 View commit details
    Browse the repository at this point in the history

  56. Remove get, print trainable params as they are redundant

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    cf4fa9d View commit details
    Browse the repository at this point in the history

  57. Fix inclusion of old kwarg

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    862b880 View commit details
    Browse the repository at this point in the history

  58. Remove circular imports

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9c5e3be View commit details
    Browse the repository at this point in the history

  59. Override method

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    34694d5 View commit details
    Browse the repository at this point in the history

  60. Set target modules to None

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    18bd1b8 View commit details
    Browse the repository at this point in the history

  61. Do not set target modules to None

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    306bb34 View commit details
    Browse the repository at this point in the history

  62. Try to avoid checking target_modules

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b8121ac View commit details
    Browse the repository at this point in the history

  63. Remove circular import

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    44cdc07 View commit details
    Browse the repository at this point in the history

  64. Override another method

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ba905a6 View commit details
    Browse the repository at this point in the history

  65. Override _check_target_module_exists

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    d5446f6 View commit details
    Browse the repository at this point in the history

  66. Make method instance

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    2e7f51a View commit details
    Browse the repository at this point in the history

  67. Make a nicer check for having target_modules

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    7c354d9 View commit details
    Browse the repository at this point in the history

  68. Avoid unnecessary injection

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    76b26b5 View commit details
    Browse the repository at this point in the history

  69. Remove xlora conf from mark only adapters as trainable

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    5828ab4 View commit details
    Browse the repository at this point in the history

  70. Account for property

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9b56c2a View commit details
    Browse the repository at this point in the history

  71. Call correct method

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    0ea1fa2 View commit details
    Browse the repository at this point in the history

  72. Fix for scoping

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    8f67a6b View commit details
    Browse the repository at this point in the history

  73. Set active adapter to not 'default'

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a4823fe View commit details
    Browse the repository at this point in the history

  74. Fix recursion err

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1bafcd8 View commit details
    Browse the repository at this point in the history

  75. Index into config to check

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b5f5563 View commit details
    Browse the repository at this point in the history

  76. Get and pass scalings

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    e6b45c3 View commit details
    Browse the repository at this point in the history

  77. Remove deprecated attr

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b8ba669 View commit details
    Browse the repository at this point in the history

  78. Remove the xloralayer for a hook, refactoring changes

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    31b121c View commit details
    Browse the repository at this point in the history

  79. Add copywright notice

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    df6867d View commit details
    Browse the repository at this point in the history

  80. Remove some typing things

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9025310 View commit details
    Browse the repository at this point in the history

  81. Remove some typing things

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    506e96e View commit details
    Browse the repository at this point in the history

  82. Add note to docstring

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    07ff71f View commit details
    Browse the repository at this point in the history

  83. Add to config

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a111787 View commit details
    Browse the repository at this point in the history

  84. Update for new saving

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    15b7bec View commit details
    Browse the repository at this point in the history

  85. Fix topk impl

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    0ef9181 View commit details
    Browse the repository at this point in the history

  86. Update based on comments

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    3804d6a View commit details
    Browse the repository at this point in the history

  87. Add the xlora layer structure back in

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ea3ea8f View commit details
    Browse the repository at this point in the history

  88. Add the xlora layer structure back in

    @EricLBuehler
    EricLBuehler committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    1ce8391 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Make some style changes

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    b48d4af View commit details
    Browse the repository at this point in the history

  2. Fix some bugs

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    4d48c59 View commit details
    Browse the repository at this point in the history

  3. Remove base model id as unnecessary

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    93069bb View commit details
    Browse the repository at this point in the history

  4. Format with ruff

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    3ee9350 View commit details
    Browse the repository at this point in the history

  5. Add xlora test

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    7c1bcfa View commit details
    Browse the repository at this point in the history

  6. Handle lack of target modules in lora method

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    e627525 View commit details
    Browse the repository at this point in the history

  7. Handle lack of layer_replication in lora method

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    aa189c6 View commit details
    Browse the repository at this point in the history

  8. Handle lack of target_modules in check target modules exists

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    2df1d5f View commit details
    Browse the repository at this point in the history

  9. Handle lack of target_modules in inject_adapter

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    b14c335 View commit details
    Browse the repository at this point in the history

  10. Fix the recursion err

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    8bec326 View commit details
    Browse the repository at this point in the history

  11. Formatting

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    c79b37c View commit details
    Browse the repository at this point in the history

  12. Do not include device in config

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    e453747 View commit details
    Browse the repository at this point in the history

  13. Cleaner method to eliminate adapters

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    10161b3 View commit details
    Browse the repository at this point in the history

  14. Cleaner method to eliminate adapters

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    f223168 View commit details
    Browse the repository at this point in the history

  15. Remove unnecessary methods

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    31078a6 View commit details
    Browse the repository at this point in the history

  16. Error on multiple xlora adapters

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    d52f6ce View commit details
    Browse the repository at this point in the history

  17. Error on use of dora

    @EricLBuehler
    EricLBuehler committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    7e3c0d0 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Raise errors and other misc fixes

    @EricLBuehler
    EricLBuehler committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    1edeb96 View commit details
    Browse the repository at this point in the history

  2. Depend on use trainable adapters

    @EricLBuehler
    EricLBuehler committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    bb5e546 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Implement another test and restructure the model

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    a4479b6 View commit details
    Browse the repository at this point in the history

  2. Inherit

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    81b069b View commit details
    Browse the repository at this point in the history

  3. Impl some abstract methods and remove the special cases

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    33c2623 View commit details
    Browse the repository at this point in the history

  4. Fix return

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    63f3418 View commit details
    Browse the repository at this point in the history

  5. Make some progress

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    31863fa View commit details
    Browse the repository at this point in the history

  6. Make some progress

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    34f7594 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into add_xlora

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    a234676 View commit details
    Browse the repository at this point in the history

  8. Working version and add some tests

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    7468114 View commit details
    Browse the repository at this point in the history

  9. Explain need for refreezing

    @EricLBuehler
    EricLBuehler committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e4053bc View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Fix some ruff lints

    @EricLBuehler
    EricLBuehler committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    cc0cfee View commit details
    Browse the repository at this point in the history

  2. Get adapter names and handle gracefully with subfolders

    @EricLBuehler
    EricLBuehler committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    9debbe3 View commit details
    Browse the repository at this point in the history

  3. Fix unused

    @EricLBuehler
    EricLBuehler committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a283ea8 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Rewrite the flush_log_scalings function with new functionality

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    aca6044 View commit details
    Browse the repository at this point in the history

  2. Use some fixtures

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    d10f4ee View commit details
    Browse the repository at this point in the history

  3. Fix passing arg

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    677c64e View commit details
    Browse the repository at this point in the history

  4. Remove unnecessary checks

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    93db8bc View commit details
    Browse the repository at this point in the history

  5. Fix test

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    99fff5c View commit details
    Browse the repository at this point in the history

  6. Fix a bug

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    42db87c View commit details
    Browse the repository at this point in the history

  7. More sensible defaults

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    6787b9f View commit details
    Browse the repository at this point in the history

  8. Cast

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    6fe86d1 View commit details
    Browse the repository at this point in the history

  9. Refactor forward pass

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    f948883 View commit details
    Browse the repository at this point in the history

  10. Finish refactoring of model forward

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    83ecd37 View commit details
    Browse the repository at this point in the history

  11. Remove some dead code

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    ba4093a View commit details
    Browse the repository at this point in the history

  12. Run formatting

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    e19cbc6 View commit details
    Browse the repository at this point in the history

  13. Add test for saving and loading

    @EricLBuehler
    EricLBuehler committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    cf54d6a View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Fix determining adapter device for embedding 

    Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
    @EricLBuehler @BenjaminBossan
    EricLBuehler and BenjaminBossan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    750e7ac View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. Fix the save and load

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    a7ac01c View commit details
    Browse the repository at this point in the history

  2. Fix the save and load

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    7fd76ca View commit details
    Browse the repository at this point in the history

  3. Comment

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    dc8bd3b View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    b888a69 View commit details
    Browse the repository at this point in the history

  5. Update the docstrings

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    c379f70 View commit details
    Browse the repository at this point in the history

  6. Remove the hacking

    @EricLBuehler
    EricLBuehler committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    eaf5052 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Merge

    @EricLBuehler
    EricLBuehler committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    76070d6 View commit details
    Browse the repository at this point in the history

  2. Remove the post_init_lora

    @EricLBuehler
    EricLBuehler committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    a510560 View commit details
    Browse the repository at this point in the history

  3. Fix

    @EricLBuehler
    EricLBuehler committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    c9339a6 View commit details
    Browse the repository at this point in the history

  4. More tests

    @EricLBuehler
    EricLBuehler committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    a6d92b0 View commit details
    Browse the repository at this point in the history

  5. Remove custom load and save code

    @EricLBuehler
    EricLBuehler committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    261b336 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    763bf7f View commit details
    Browse the repository at this point in the history

  2. Improve tests

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    3c07d18 View commit details
    Browse the repository at this point in the history

  3. Remove InhibitorFlagPayload

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    44a3bb9 View commit details
    Browse the repository at this point in the history

  4. Improve the docstrings

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    b9c80ef View commit details
    Browse the repository at this point in the history

  5. Fix the docstrings and clean up a bit

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    72f9610 View commit details
    Browse the repository at this point in the history

  6. Remove some redundant config options

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    f4b2df9 View commit details
    Browse the repository at this point in the history

  7. Remove redundant case

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    a8fbf85 View commit details
    Browse the repository at this point in the history

  8. Better docstrings

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    3fb0cd0 View commit details
    Browse the repository at this point in the history

  9. Remove *et_use_trainable_adapters

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    5e62d66 View commit details
    Browse the repository at this point in the history

  10. Remove method and clean up checks

    @EricLBuehler
    EricLBuehler committed May 21, 2024
    Configuration menu
    Copy the full SHA
    8faaa0f View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Minor fixes

    @EricLBuehler
    EricLBuehler committed May 22, 2024
    Configuration menu
    Copy the full SHA
    6b54244 View commit details
    Browse the repository at this point in the history

  2. Remove custom loading and saving code

    @EricLBuehler
    EricLBuehler committed May 22, 2024
    Configuration menu
    Copy the full SHA
    0d7f9d3 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Update tests

    @EricLBuehler
    EricLBuehler committed May 23, 2024
    Configuration menu
    Copy the full SHA
    8c58e1c View commit details
    Browse the repository at this point in the history

  2. Remove monkey patching for scalings passing

    @EricLBuehler
    EricLBuehler committed May 23, 2024
    Configuration menu
    Copy the full SHA
    430f9e4 View commit details
    Browse the repository at this point in the history

  3. Add tests for disabling adapters

    @EricLBuehler
    EricLBuehler committed May 23, 2024
    Configuration menu
    Copy the full SHA
    53f0342 View commit details
    Browse the repository at this point in the history

  4. Add test for embedding model

    @EricLBuehler
    EricLBuehler committed May 23, 2024
    Configuration menu
    Copy the full SHA
    ee19910 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Use peft forward hook

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    1735deb View commit details
    Browse the repository at this point in the history

  2. Fix disable adapter test

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    d661266 View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary var

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    8601832 View commit details
    Browse the repository at this point in the history

  4. Add futures annotations

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    a3b83c1 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    e3db8df View commit details
    Browse the repository at this point in the history

  6. Fix changes to lora prepare adapter config

    @EricLBuehler
    EricLBuehler committed May 29, 2024
    Configuration menu
    Copy the full SHA
    b0f3062 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Fix tests

    @EricLBuehler
    EricLBuehler committed May 30, 2024
    Configuration menu
    Copy the full SHA
    81e337d View commit details
    Browse the repository at this point in the history

  2. Fix hacks

    @EricLBuehler
    EricLBuehler committed May 30, 2024
    Configuration menu
    Copy the full SHA
    7ddd14b View commit details
    Browse the repository at this point in the history

  3. Use infer_device

    @EricLBuehler
    EricLBuehler committed May 30, 2024
    Configuration menu
    Copy the full SHA
    7ea1a12 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Fix the tests and provide fake default values

    @EricLBuehler
    EricLBuehler committed May 31, 2024
    Configuration menu
    Copy the full SHA
    7058c15 View commit details
    Browse the repository at this point in the history

  2. Fix a mistake

    @EricLBuehler
    EricLBuehler committed May 31, 2024
    Configuration menu
    Copy the full SHA
    587c78a View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    2b1193a View commit details
    Browse the repository at this point in the history

  2. Fix .weight

    @EricLBuehler
    EricLBuehler committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    6a809cb View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Format

    @EricLBuehler
    EricLBuehler committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    164af91 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    096927a View commit details
    Browse the repository at this point in the history

  2. Embedding does not support DoRA 

    Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
    @EricLBuehler @BenjaminBossan
    EricLBuehler and BenjaminBossan committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    fadc5d9 View commit details
    Browse the repository at this point in the history

  3. Remove xlora for embedding layers

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    013a084 View commit details
    Browse the repository at this point in the history

  4. Change order of scalings application

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    14efafa View commit details
    Browse the repository at this point in the history

  5. Add tests

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    624d316 View commit details
    Browse the repository at this point in the history

  6. Handle case when inserting

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    1505f31 View commit details
    Browse the repository at this point in the history

  7. Check exact type

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    0b2dcd0 View commit details
    Browse the repository at this point in the history

  8. Fix target modules

    @EricLBuehler
    EricLBuehler committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    abdcb50 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Somehow it didn't get formatted

    @EricLBuehler
    EricLBuehler committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    aecd492 View commit details
    Browse the repository at this point in the history

  2. Make tmp dir and tokenizer function scoped

    @EricLBuehler
    EricLBuehler committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    68e5f2f View commit details
    Browse the repository at this point in the history

  3. Scope the lora adapters too

    @EricLBuehler
    EricLBuehler committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    1628227 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Use unique temp dirs for lora adapters, all tests

    @EricLBuehler
    EricLBuehler committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    5a889be View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Seperation of concerns for xlora and lora

    @EricLBuehler
    EricLBuehler committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    072987e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into add_xlora

    @EricLBuehler
    EricLBuehler committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    13edc61 View commit details
    Browse the repository at this point in the history

  3. Prevent inf recursion as per 1892

    @EricLBuehler
    EricLBuehler committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    77fb6b0 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Prevent inf recursion on lora_model

    @EricLBuehler
    EricLBuehler committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    2f85f91 View commit details
    Browse the repository at this point in the history