Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test (example/llm): Refactor and add basic tests for the LLM entry-point #1002

Merged
merged 53 commits into from
Sep 11, 2024
Merged

Test (example/llm): Refactor and add basic tests for the LLM entry-point #1002

merged 53 commits into from
Sep 11, 2024

Commits on Sep 5, 2024

  1. feat (example/llm): Moved argument parser to separate function.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    7a4642f View commit details
    Browse the repository at this point in the history

  2. Refactor (example/llm): Refactor to prepare for automated tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    cd73b14 View commit details
    Browse the repository at this point in the history

  3. test (example/llm): Added inital end-to-end example for LLM entry-point.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    dcd6a78 View commit details
    Browse the repository at this point in the history

  4. setup (requirements): added requirements file for LLM example for eas… 

    …ier testing
    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    3ef28d4 View commit details
    Browse the repository at this point in the history

  5. Fix: pre-commit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5aad69e View commit details
    Browse the repository at this point in the history

  6. test (ex/llm): reorg code a little bit.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    25d79e3 View commit details
    Browse the repository at this point in the history

  7. test (ex/llm): removed quant_ppl to model definition

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e3575f4 View commit details
    Browse the repository at this point in the history

  8. test (ex/llm): removed replace MHA from toggle tests

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6f8b186 View commit details
    Browse the repository at this point in the history

  9. test (ex/llm): added accuracy tests for some basic configurations

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a5eedeb View commit details
    Browse the repository at this point in the history

  10. test (ex/llm): Added initial tests that layers are inserted properly.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    89ffa00 View commit details
    Browse the repository at this point in the history

  11. test (ex/llm): allowed testing of multiple layer types

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    cb149b4 View commit details
    Browse the repository at this point in the history

  12. test (ex/llm): Added extra layer replacement checks

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5e7a7e7 View commit details
    Browse the repository at this point in the history

  13. Fix (ex/gen): Bugfix when applying MX as activation quantization type

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9dd38aa View commit details
    Browse the repository at this point in the history

  14. test (ex/llm): Added tests for FP8, MX datatypes

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9940a9f View commit details
    Browse the repository at this point in the history

  15. setup (ex/llm): Renamed requirements to match other examples.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b84a645 View commit details
    Browse the repository at this point in the history

  16. req (ex/llm): Added explicit dependencies

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9f23bfb View commit details
    Browse the repository at this point in the history

  17. test (ex/llm): added weight-only test

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    af6af4b View commit details
    Browse the repository at this point in the history

  18. precommit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    70145da View commit details
    Browse the repository at this point in the history

  19. Feat (ex/llm): Allow supplying a prefix for the exported ONNX/TS model

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f0ec89e View commit details
    Browse the repository at this point in the history

  20. test (ex/llm): Added ONNX export and torchscript tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c9d9b66 View commit details
    Browse the repository at this point in the history

  21. test (ex/llm): marked llm tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9a6e509 View commit details
    Browse the repository at this point in the history

  22. test (ex/llm): Added commented-out mixtral model

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c39749b View commit details
    Browse the repository at this point in the history

  23. test (ex/llm): Renamed llm test file.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f214f7c View commit details
    Browse the repository at this point in the history

  24. test (ex/llm): improved test compatibility with test infrastructure

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    852714f View commit details
    Browse the repository at this point in the history

  25. precommit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c778818 View commit details
    Browse the repository at this point in the history

  26. test (gha/ex/llm): Added new workflow to testing LLM example

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c659e64 View commit details
    Browse the repository at this point in the history

  27. test (ex/llm): Removed onnx dependency when collecting tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1deb288 View commit details
    Browse the repository at this point in the history

  28. test (ex/llm): softened accuracy conditions

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    7b63723 View commit details
    Browse the repository at this point in the history

  29. test (ex/llm): reorganise to prevent export issues

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0235b5c View commit details
    Browse the repository at this point in the history

  30. precommit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    bedf1b3 View commit details
    Browse the repository at this point in the history

  31. test (ex/llm): remove upgrade flag to prevent new pytorch from being … 

    …installed
    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    79c271a View commit details
    Browse the repository at this point in the history

  32. test (gha/ex/llm): Added custom pytorch versions for LLM tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    44d2e56 View commit details
    Browse the repository at this point in the history

  33. test (ex/llm/gha): Fixed custom pytorch versions for LLM test

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    32ea1ef View commit details
    Browse the repository at this point in the history

  34. Bugfixes

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0a8d7ee View commit details
    Browse the repository at this point in the history

  35. test (ex/llm/nox): Better exclusion for examples.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b3bcedd View commit details
    Browse the repository at this point in the history

  36. Revert "test (ex/llm): reorganise to prevent export issues" 

    This reverts commit a9d6361.
    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    47d7cbb View commit details
    Browse the repository at this point in the history

  37. Revert "test (ex/llm): Removed onnx dependency when collecting tests." 

    This reverts commit d4509c6.
    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9e3638b View commit details
    Browse the repository at this point in the history

  38. Precommit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a60911e View commit details
    Browse the repository at this point in the history

  39. test (nox): Updated pytorch torchvision version list

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a48c74e View commit details
    Browse the repository at this point in the history

  40. Updated install method for PT>=2.4

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2c5e01a View commit details
    Browse the repository at this point in the history

  41. test (llm/nox/gha): Updated env setup

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    36c6037 View commit details
    Browse the repository at this point in the history

  42. test (ex/llm): Updated test settings across multiple versions

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6215aa9 View commit details
    Browse the repository at this point in the history

  43. test (ex/llm): partitioned tests between pytorch versions.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    3cac63e View commit details
    Browse the repository at this point in the history

  44. test (ex/llm): Check input_view_impl for MX types

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b0d6c63 View commit details
    Browse the repository at this point in the history

  45. test (example/llm): Switched to PyTest cases. Added ids for more read… 

    …able tests.
    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f5dbed2 View commit details
    Browse the repository at this point in the history

  46. test (example/llm): Added comment about Mixtral case

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c544d57 View commit details
    Browse the repository at this point in the history

  47. pre-commit

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    08b8b73 View commit details
    Browse the repository at this point in the history

  48. test (example/llm): Removed JIT clause for accuracy tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6d33990 View commit details
    Browse the repository at this point in the history

  49. test (example/test): Removed extra JIT checks.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e59287b View commit details
    Browse the repository at this point in the history

  50. test (example/llm): refactor run tests.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1399d84 View commit details
    Browse the repository at this point in the history

  51. test (example/llm): Added comments about PT versions.

    @nickfraser
    nickfraser committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0e762f7 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. test (example/llm): Added tests to ensure all args to main are also… 

    … in `parse_args`
    @nickfraser
    nickfraser committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    6e9283a View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. test (example/llm): fixed indentation for toggle_run_args

    @nickfraser
    nickfraser committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    d071199 View commit details
    Browse the repository at this point in the history