GitHub - SimonWang9610/gpt_tokenizer: BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

SimonWang9610 / gpt_tokenizer Public

Notifications You must be signed in to change notification settings
Fork 6
Star 7

BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

pub.dev/packages/flutter_gpt_tokenizer

7 stars 6 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 22 Commits
assets		assets
packages		packages
scripts		scripts
.gitignore		.gitignore
Cargo.toml		Cargo.toml
README.md		README.md
analysis_options.yaml		analysis_options.yaml
melos.yaml		melos.yaml
pubspec.yaml		pubspec.yaml

Repository files navigation

cargo build only re-run tokenizer/build.rs when the symbols are changed
cocopods 1.12.0 supports slice_type: .dylib. see github
build-apple.sh
- if LIBNAME=libgpt_tokenizer.a, everything works well