Skip to content

Commit

Permalink
dev: remove extra/tokenizers
Browse files Browse the repository at this point in the history
  • Loading branch information
BlueGreenMagick committed Jun 25, 2024
1 parent fe33c25 commit 923d40c
Show file tree
Hide file tree
Showing 10 changed files with 14 additions and 384 deletions.
124 changes: 14 additions & 110 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 0 additions & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ members = [
"unidic",
"unidic-types",
"extra/generate-license/rust",
"extra/tokenizers",
]
resolver = "2"

Expand Down
1 change: 0 additions & 1 deletion extra/tokenizers/.gitignore

This file was deleted.

19 changes: 0 additions & 19 deletions extra/tokenizers/Cargo.toml

This file was deleted.

10 changes: 0 additions & 10 deletions extra/tokenizers/README.md

This file was deleted.

3 changes: 0 additions & 3 deletions extra/tokenizers/src/lib.rs

This file was deleted.

69 changes: 0 additions & 69 deletions extra/tokenizers/src/lindera.rs

This file was deleted.

Loading

0 comments on commit 923d40c

Please sign in to comment.