Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge ms1 #84

Draft
wants to merge 14 commits into
base: master
Choose a base branch
from
Draft

Merge ms1 #84

wants to merge 14 commits into from

Conversation

apardyl
Copy link
Member

@apardyl apardyl commented Dec 3, 2020

TODO: check if it actually works.
TODO: check migration from current master.

DominikWolek and others added 14 commits May 3, 2020 22:23
* Add FileTextExtractor interface

* Add TikaFileTextExtractor

* Add FileUploadSession

* Add MetadaGarbageCollector

* Change FileUploadSession from entitity to data class

* Add MetadataCrawler

* Add metadata extractor

* Add FileEntryCreator

* Add FileContentRepository

* Add FileHashProvider

* Add toString implementation to metadata entities

* Update tests
* Implement file upload

* Remove button

* Implement file removal UI

* Create file removal dialog component

* Handle file removal

* Display name of the selected file

* Session review list

* Preapre for session approve

* Make modal generic

* Split preview to separate components

* Session review page

* Polish review session view

* travis, fok u

* Fix rootPath of RepositoryService of Session

* List sessions to review

* Fix files deletion and movement

* Delete old FileEntry on move file

* Move file upload requests mapping to another controller

* Yeah, it will fail

* Add  breadcrumb to session review

* Download file of unrecognized type

* Create session bar as a component

* Add timestamp

* Fix file deletion

* Update src/main/resources/templates/layout.html

Co-authored-by: Adam Pardyl <adam@pardyl.com>

* Code review changes

* Update src/main/resources/templates/layout.html

Co-authored-by: Adam Pardyl <adam@pardyl.com>

Co-authored-by: Jakub Kiermasz <jakub.kiermasz@summer.agency>
Co-authored-by: DominikWolek <dominik.artur.wolek@gmail.com>
Co-authored-by: Adam Pardyl <adam@pardyl.com>
This prevents OutOfMemoryError while reading large files (> 2GB)
* Add AutoDetectTextExtractor

* Add bytedeco ImageTextExtractor

* Add PDF text extractor

* Add max length validation

* Add white chars filter

* Add minimum word length validator
* Create a path picker prototype

* Create path picker modal

* Update src/main/kotlin/pl/edu/uj/ii/ksi/mordor/controllers/FileUploadController.kt

* Review changes

Co-authored-by: Jakub Kiermasz <kiermasz.k@gmail.com>
* Add progress to MetadataCrawler and GarbageCollector

* Implement remaining functions in FileUploadSessionRepository

* Add mutex to MetadataCrawler and GarbageCollector
* Add thumbnail extractors

* Add thumbnail to File Entry

* Add choosing icon or thumbnail in html
* Fix tesseract too low dpi error, remove debug logs

* Add previously removed debug logs
* Add conditional crawlers' beans generation

* Check if metadata gathering is allowed upon saving a new file
@kkiermasz
Copy link
Member

@apardyl @DominikWolek What do we want to do with this?

@apardyl
Copy link
Member Author

apardyl commented Feb 28, 2022

@apardyl @DominikWolek What do we want to do with this?

@kkiermasz
Copy link
Member

@apardyl kurwa opie

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants