v0.5.8

What's Changed

• Add: macOS arm64 by @zrll12 in #142
• Fail softly when loading models on startup failed. by @cryscan in #144

New Contributors

• @zrll12 made their first contribution in #142

Full Changelog: v0.5.7...v0.5.8

v0.5.7

What's Changed

• Update dependencies. by @cryscan in #140
• Link ort dynamically in Windows. by @cryscan in #141

Full Changelog: v0.5.6...v0.5.7

v0.5.6

Bump version to v0.5.6

v0.5.5

Fix typical sampling.

v0.5.4

Bump version to v0.5.4

v0.5.3

What's Changed

• Switch to Koishi's BNF (KBNF) implementation by @cryscan in #132
• Fix streaming end with delta: {}. by @cryscan in #133

Full Changelog: v0.5.2...v0.5.3

v0.5.2

What's Changed

• Choose API by @cryscan in #126
• OAI APIs support states. by @cryscan in #127
• Rework cache and inference loop such that it also includes outputs. by @cryscan in #128
• Api-doc-improvement by @cryscan in #129
• Implement speculative caching. by @cryscan in #130
• api 区分为 admin 和 api by @cgisky1980 in #131

Full Changelog: v0.5.1...v0.5.2

v0.5.1

❣What's Changed⁉

✅ Support for new sampler : Typical !❗

---

• Sampling refactor by @cryscan in #119
• Bump vite from 5.1.6 to 5.2.11 by @dependabot in #121
• fix doc typo by @shoumenchougou in #123
• UI & docs by @cgisky1980 in #124
• Docs by @cryscan in #125

New Contributors

• @shoumenchougou made their first contribution in #122

Full Changelog: v0.5.0...v0.5.1

v0.5.0

What's Changed

• Split the project into core and server. by @cryscan in #117
• Move converter into a package. by @cryscan in #118

Full Changelog: v0.4.9...v0.5.0

v0.4.9

🙄What's Changed ⁉

1. Dynamically load initial state and LoRA in WebUI.
2. BNF support in WebUI "Writing" section (scroll down the left penal).
3. Export static quantization models as prefab format in the WebUI.

What is BNF?

BNF forces the model to output in your desired format (e.g., JSON, markdown with specified fields).

📢Ai00 Naming Convention for Models:✨🔆

Ai00 now recognizes different types of model files using the convention present here.

1. ✅File Extensions

• Base models: .st
• Initial states: .state
• LoRA: .lora

2. 💘Model Naming Convention

[name][-(Version number, e.g., x060)][-(World version number, e.g., w021)][-(Model parameters, e.g., 3B)].[Extension (st\state\lora\prefab)]

For example:

x060-w021-3B.st
x060-w021-3B.prefab
example-x060-3B.lora
example2-x060-3B.state

👽BNF Example

Here is an example BNF for JSON with fields name and age:

<start> ::= <json_object>
<json_object> ::= "{" <object_members> "}"
<object_members> ::= <json_member> | <json_member> ", " <object_members>
<json_member> ::= <json_key> ": " <json_value>
<json_key> ::= '"' "name" '"' | '"' "age" '"' | '"' "job" '"'
<json_value> ::= <json_string> | <json_number>
<json_string>::='"'<content>'"'
<content>::=<except!([escaped_literals])>|<except!([escaped_literals])><content>|'\\"'<content>|'\\"'
<escaped_literals>::='\t'|'\n'|'\r'|'"'
<json_number> ::= <positive_digit><digits>|'0'
<digits>::=<digit>|<digit><digits>
<digit>::='0'|<positive_digit>
<positive_digit>::="1"|"2"|"3"|"4"|"5"|"6"|"7"|"8"|"9"

• Cgisky1980 patch 1 by @cgisky1980 in #116
  Full Changelog: v0.4.8...v0.4.9