Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Utilser de l'apprentissage profond .. wouhou #28

Merged
merged 90 commits into from
Jul 16, 2024
Merged

Utilser de l'apprentissage profond .. wouhou #28

merged 90 commits into from
Jul 16, 2024

Commits on Jun 26, 2024

  1. chore: update baselines

    @dhdaines
    dhdaines committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    a3c52ce View commit details
    Browse the repository at this point in the history

  2. refactor: rendre filter_tab reutilisable

    @dhdaines
    dhdaines committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    42a0f71 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. refactor: remove useless results

    @dhdaines
    dhdaines committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    056bdb6 View commit details
    Browse the repository at this point in the history

  2. docs: update todo

    @dhdaines
    dhdaines committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    eca4df8 View commit details
    Browse the repository at this point in the history

  3. feat: prendre en charge tokenisation 

    Mais! Fais pas ca ... ca marche pas bien
    @dhdaines
    dhdaines committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    5d715d8 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. feat: RNN training

    @dhdaines
    dhdaines committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    d88b7a1 View commit details
    Browse the repository at this point in the history

  2. feat: same eval as train_crf, results not too bad

    @dhdaines
    dhdaines committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    e825586 View commit details
    Browse the repository at this point in the history

  3. refactor: reorganize 1

    @dhdaines
    dhdaines committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    f9775bc View commit details
    Browse the repository at this point in the history

  4. fix: do cross validation properly

    @dhdaines
    dhdaines committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    1b1222f View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. feat: add (scaled) vector features

    @dhdaines
    dhdaines committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    6fce712 View commit details
    Browse the repository at this point in the history

  2. fix: slightly better scaling

    @dhdaines
    dhdaines committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    e66c0a6 View commit details
    Browse the repository at this point in the history

  3. feat: more features

    @dhdaines
    dhdaines committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d061594 View commit details
    Browse the repository at this point in the history

  4. docs: record of scores

    @dhdaines
    dhdaines committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    a8f9b82 View commit details
    Browse the repository at this point in the history

  5. fix: featnames redundant

    @dhdaines
    dhdaines committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    957a9f5 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. feat: use the knowledge based features too

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    6094af7 View commit details
    Browse the repository at this point in the history

  2. fix: use 4 dimensions

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    7bf8370 View commit details
    Browse the repository at this point in the history

  3. feat: embed things and report

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    9f23f46 View commit details
    Browse the repository at this point in the history

  4. feat: take best model

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    9ae6742 View commit details
    Browse the repository at this point in the history

  5. fix: scale by page height for robust

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    32dcbc2 View commit details
    Browse the repository at this point in the history

  6. feat: 64

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    977e09a View commit details
    Browse the repository at this point in the history

  7. feat: weight up B

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    dc3679c View commit details
    Browse the repository at this point in the history

  8. fix: smaller

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    163cba1 View commit details
    Browse the repository at this point in the history

  9. fix: same width for all embeddings is best

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    59464ad View commit details
    Browse the repository at this point in the history

  10. docs: some results

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    da4a603 View commit details
    Browse the repository at this point in the history

  11. docs: more todo

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    2c9cafd View commit details
    Browse the repository at this point in the history

  12. docs: todo

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    7607b4b View commit details
    Browse the repository at this point in the history

  13. refactor: refactor

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    98de1a2 View commit details
    Browse the repository at this point in the history

  14. feat: CRF output layer, working finally!

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    20f7a48 View commit details
    Browse the repository at this point in the history

  15. fix: horrible python error

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    1beb864 View commit details
    Browse the repository at this point in the history

  16. fix: lower lr

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    615ce0a View commit details
    Browse the repository at this point in the history

  17. feat: more parameters

    @dhdaines
    dhdaines committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    0ed5d58 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. docs: scores

    @dhdaines
    dhdaines committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    b3db683 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2024

  1. docs: more todos

    @dhdaines
    dhdaines committed Jul 6, 2024
    Configuration menu
    Copy the full SHA
    46fdd5c View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2024

  1. refactor: move CSV without PDF to a subdirectory

    @dhdaines
    dhdaines committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    2ea590a View commit details
    Browse the repository at this point in the history

  2. chore: retrain

    @dhdaines
    dhdaines committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    bdece2c View commit details
    Browse the repository at this point in the history

  3. feat: derp lerning for the win!

    @dhdaines
    dhdaines committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    e4f75a0 View commit details
    Browse the repository at this point in the history

  4. feat: refactor out rnn/rnncrf stuff and add dimensions

    @dhdaines
    dhdaines committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    d9b5b10 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. feat: parameters (and best results of search)

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    0ca9a71 View commit details
    Browse the repository at this point in the history

  2. docs: tdo

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    aacf31d View commit details
    Browse the repository at this point in the history

  3. feat: better updates

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    e6a70c3 View commit details
    Browse the repository at this point in the history

  4. feat: data processing for LayoutLM

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    7b8bede View commit details
    Browse the repository at this point in the history

  5. fix: Figure a pas daffaire la

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    27a39e1 View commit details
    Browse the repository at this point in the history

  6. fix: normalize box

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    b9cb436 View commit details
    Browse the repository at this point in the history

  7. fix: ensure box

    @dhdaines
    dhdaines committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    e9d69f9 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. fix: remove bogus line

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    e57c4d4 View commit details
    Browse the repository at this point in the history

  2. fix: make repeatable so it does not seem like random crashing!

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    73e4a13 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/more_derp_lerning' into more_der… 

    …p_lerning
    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    ee1f2f5 View commit details
    Browse the repository at this point in the history

  4. fix: fix some errors

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    b404332 View commit details
    Browse the repository at this point in the history

  5. fix(test): fix test

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    012aa57 View commit details
    Browse the repository at this point in the history

  6. fix: dropout not useful

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    35221fa View commit details
    Browse the repository at this point in the history

  7. chore: update scores

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    bcf5591 View commit details
    Browse the repository at this point in the history

  8. feat: activer mode test pour rnn

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    168177c View commit details
    Browse the repository at this point in the history

  9. docs: todo

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    5066606 View commit details
    Browse the repository at this point in the history

  10. fix: poutyne removal

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    9f07412 View commit details
    Browse the repository at this point in the history

  11. feat: equivalence RNN/CRF pour segmentation

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    d93d469 View commit details
    Browse the repository at this point in the history

  12. fix: si y a pas de zonage

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    ff48c8b View commit details
    Browse the repository at this point in the history

  13. fix: no need for batch in predict

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    c75ab0c View commit details
    Browse the repository at this point in the history

  14. feat: do not early stop by default

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    d1e0ee2 View commit details
    Browse the repository at this point in the history

  15. feat: cross validation

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8a1c6ee View commit details
    Browse the repository at this point in the history

  16. docs: cross validation layoutlm

    @dhdaines
    dhdaines committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    519e7da View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. feat: try to weight

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    c8b13d5 View commit details
    Browse the repository at this point in the history

  2. feat: weight labels

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    cbc0a0a View commit details
    Browse the repository at this point in the history

  3. chore: updates

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3a8539c View commit details
    Browse the repository at this point in the history

  4. feat: support bonly, tonly, iobonly

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    8329e8b View commit details
    Browse the repository at this point in the history

  5. feat: use tonly

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    2bffab3 View commit details
    Browse the repository at this point in the history

  6. docs: various only results

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    5346c47 View commit details
    Browse the repository at this point in the history

  7. docs: more scores

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    10852f9 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into more_derp_lerning

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    921b85d View commit details
    Browse the repository at this point in the history

  9. Revert "fix: Figure a pas daffaire la" 

    This reverts commit 27a39e1.
    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    774fbc2 View commit details
    Browse the repository at this point in the history

  10. refactor: patches to patches

    @dhdaines
    dhdaines committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    820da70 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. fix: better crf-rnn with allennlp

    @dhdaines
    dhdaines committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    c7b7a10 View commit details
    Browse the repository at this point in the history

  2. feat: try label weights

    @dhdaines
    dhdaines committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    65d20ae View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. feat: make train_rnn_crf work with acc/f1 and weights

    @dhdaines
    dhdaines committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    ac9a8ac View commit details
    Browse the repository at this point in the history

  2. feat: synchroniser train_rnn_crf avec train_rnn

    @dhdaines
    dhdaines committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    f0c1ba6 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. feat: standardize rnn and rnncrf scripts

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    cd8de0f View commit details
    Browse the repository at this point in the history

  2. feat: test with majority vote rnn

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    1460096 View commit details
    Browse the repository at this point in the history

  3. fix: label weights are exponential it seems

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    144a8fa View commit details
    Browse the repository at this point in the history

  4. fix: weight transitions too (it is better)

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    0c9da54 View commit details
    Browse the repository at this point in the history

  5. docs: minor updates

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    48ea479 View commit details
    Browse the repository at this point in the history

  6. docs: scores for best rnn-crf

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    c0558d4 View commit details
    Browse the repository at this point in the history

  7. fix: no need for separate test_rnn_crf

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    d1b63a8 View commit details
    Browse the repository at this point in the history

  8. feat: add voting for CRF

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    b8a75eb View commit details
    Browse the repository at this point in the history

  9. feat: reuse RNN code

    @dhdaines
    dhdaines committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    947c350 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. feat: enable --labels bonly and decoding

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    66accf3 View commit details
    Browse the repository at this point in the history

  2. feat: initialize RNN-CRF from RNN (helps a lot)

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    ce8ca79 View commit details
    Browse the repository at this point in the history

  3. feat: train and support RNN and RNN-CRF

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    fe126a7 View commit details
    Browse the repository at this point in the history

  4. feat: add rnn+crf training

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    2f47f04 View commit details
    Browse the repository at this point in the history

  5. chore: retrain

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    c81e9f4 View commit details
    Browse the repository at this point in the history

  6. feat: workflow (will it work...flow?)

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    5cf98a1 View commit details
    Browse the repository at this point in the history

  7. fix: format and lint

    @dhdaines
    dhdaines committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    25e789e View commit details
    Browse the repository at this point in the history