Code

Add support for Whisper#693

Code

Merged

TimoImhof merged 72 commits intoadapter-hub:mainadapter-hub/adapters:mainfrom TimoImhof:dev/whisperTimoImhof/adapters:dev/whisperCopy head branch name to clipboardAug 8, 2024

+1,637-48

Commits

Commits on Apr 2, 2024

• save current progress:

  Show description for ad9fe2b
  TimoImhof

  committed
  ad9fe2b

• Merge branch 'adapter-hub:main' into dev/whisper

  TimoImhof

  authored
  7ebb5e8

Commits on Apr 12, 2024

• Implement WhisperAdapterModel:

  Show description for 1e10398
  TimoImhof

  committed
  1e10398

• add logger for Attention module

  TimoImhof

  committed
  c775d43

• Add Whisper model to documentation

  TimoImhof

  committed
  23f1c68

• Add WhisperDecoderWrapperAdaptersMixin:

  Show description for f4b3df8
  TimoImhof

  committed
  f4b3df8

• Add tests

  TimoImhof

  committed
  dc40973

Commits on Apr 19, 2024

• save progress

  TimoImhof

  committed
  a0a89ed

Commits on Apr 25, 2024

• save progress

  TimoImhof

  committed
  f36133c

Commits on Apr 26, 2024

• overwrite get_input_samples method to fix tests requiring simple input and add documentation

  TimoImhof

  committed
  f011bb3

• add support for speech samples with "input_features" as tensor name

  TimoImhof

  committed
  08464c2

• fix wrong input argument

  TimoImhof

  committed
  32a6434

Commits on Apr 28, 2024

• upload dev files for experiments

  TimoImhof

  committed
  d13b6d3

• upload dev files for experiments

  TimoImhof

  committed
  f5e4269

• update SpeechTestBase

  TimoImhof

  committed
  70f7651

Commits on Apr 30, 2024

• Add copy info and add flash attention

  TimoImhof

  committed
  e38cd9e

• Changes:

  Show description for 8587f0f
  TimoImhof

  committed
  8587f0f

• Changes:

  Show description for 909fecb
  TimoImhof

  committed
  909fecb

• Delete dev dir

  TimoImhof

  committed
  fcaa21e

• add TODOS

  TimoImhof

  committed
  9bd7065

• make method more general

  TimoImhof

  committed
  25171bb

Commits on May 2, 2024

• add methods necessary for head usage

  TimoImhof

  committed
  6405be4

• Add TODO

  TimoImhof

  committed
  c52f0c3

• remove redundant code

  TimoImhof

  committed
  cc00ed6

• add comment & enable all tests

  TimoImhof

  committed
  24f72d6

• Add special check for vision models

  TimoImhof

  committed
  182f5a5

• make style

  TimoImhof

  committed
  e44a482

Commits on May 5, 2024

• add speech_classification head

  TimoImhof

  committed
  ca41958

Commits on May 8, 2024

• Adapting tests:

  Show description for 158165b
  TimoImhof

  committed
  158165b

• update dataset

  TimoImhof

  committed
  0eadf6d

• residual updates:

  Show description for d4117b7
  TimoImhof

  committed
  d4117b7

Commits on May 14, 2024

• Include adapters.init() support for:

  Show description for 091d947
  TimoImhof

  committed
  091d947

Commits on May 15, 2024

• Adapt Testbase

  TimoImhof

  committed
  5e8bf99

• Fixes:

  Show description for c483068
  TimoImhof

  committed
  c483068

Commits on May 21, 2024

• Changes:

  Show description for 480b4b6
  TimoImhof

  committed
  480b4b6

Commits on May 23, 2024

• Add custom classification head

  TimoImhof

  committed
  38bbb06

• Fix embedding text:

  Show description for 4ddc919
  TimoImhof

  committed
  4ddc919

Commits on May 24, 2024

• Fix generation

  TimoImhof

  committed
  4d6e9cc

Commits on May 25, 2024

• Fix composition and invertible adapters

  TimoImhof

  committed
  e54f1c4

Commits on May 26, 2024

• Merge branch 'main' into dev/whisper

  TimoImhof

  authored
  1c6aebd

Commits on Jun 4, 2024

• Revert test changes:

  Show description for 980a3f4
  TimoImhof

  committed
  980a3f4

• manually handle failing style checks:

  Show description for 11daca4
  TimoImhof

  committed
  11daca4

Commits on Jun 5, 2024

• - remove audio classification from WhisperAdapterModel head classes

  Show description for 63ca22a
  TimoImhof

  committed
  63ca22a

Commits on Jun 7, 2024

• Remove redundant code:

  Show description for 4069c94
  TimoImhof

  committed
  4069c94

• fix typo

  TimoImhof

  committed
  6beba77

• fix conditional case and remove redundant code line

  TimoImhof

  committed
  faf54b6

Commits on Jun 11, 2024

• fix prompt tuning test

  lenglaender

  committed
  fcdc409

• Add ConversionTests and AudioClassificationMixin

  TimoImhof

  committed
  e513263

Commits on Jun 18, 2024

• polish docs

  TimoImhof

  committed
  acd5332

• polish docs

  TimoImhof

  committed
  c8427b0

• Fix import

  TimoImhof

  committed
  7e3e108

• Remove redundant files

  TimoImhof

  committed
  69e3c99

Commits on Jul 9, 2024

• Update src/adapters/model_mixin.py

  Show description for af2ddc2
  

  TimoImhof

  and

  calpt

  authored
  af2ddc2

• Apply suggestions

  TimoImhof

  committed
  57b411a

• Merge remote-tracking branch 'origin/dev/whisper' into dev/whisper

  TimoImhof

  committed
  61f3742

• Merge branch 'main' into dev/whisper

  TimoImhof

  authored
  f01b51e

Commits on Jul 10, 2024

• Fix failing test and refactor speech model case handling

  TimoImhof

  committed
  1f8573f

• Fix failing test

  TimoImhof

  committed
  8d04de1

• Fix overwriting arguments

  TimoImhof

  committed
  5b41382

• make style

  TimoImhof

  committed
  327381e

Commits on Jul 24, 2024

• Address remaining comments, fix conversion test, correct documentation, fix seq2seq trainer bug

  TimoImhof

  committed
  a30bb6c

Commits on Jul 27, 2024

• Revert forward function signature modification

  TimoImhof

  committed
  ad47696

Commits on Jul 30, 2024

• Merge branch 'adapter-hub:main' into dev/whisper

  TimoImhof

  authored
  6111b07

• make style

  TimoImhof

  committed
  53b9cd9

• Remove redundant head - not supported by any model

  TimoImhof

  committed
  7526514

Commits on Aug 1, 2024

• Add Future TODO for seq2seqtrainer

  TimoImhof

  committed
  0588db6

Commits on Aug 3, 2024

• Merge branch 'refs/heads/main' into dev/whisper

  Show description for 1751a25
  TimoImhof

  committed
  1751a25

• Incorporate pyreft tests

  TimoImhof

  committed
  08911d8

• Add check for changing hidden_states size

  TimoImhof

  committed
  88bd867

Commits on Aug 4, 2024

• Adapt checking logic

  TimoImhof

  committed
  3de2581

• Merge branch 'refs/heads/main' into dev/whisper

  TimoImhof

  committed
  89377f8

Commits on Aug 7, 2024

• Fix attention classes and generation

  TimoImhof

  committed
  5f4f20c