0.12.0 - LLama3
Major Changes
- May 2024 Binary Update (Take 2) by @martindevans in #712
- Logging interceptor by @martindevans in #649
- fix: add cuda llava native libraries. by @AsakusaRinne in #647
- Added Whisper.net x LLamaSharp examples for Speech Chat by @Lyrcaxis in #656
- Extension LLava with in memory images by @zsogitbe in #653
- Llava Initial approach to clear images by @SignalRT in #664
- BatchedExecutor Save/Load by @martindevans in #681
- Interruptible Async Model Loading With Progress Monitoring by @martindevans in #702
- LLava Async Loading by @martindevans in #703
- Optional IHistoryTransform added to ChatSession.InitializeSessionFromHistoryAsync by @Norne9 in #711
- Implement context shifting in executor base by @ksanman in #714
- Llama Text Templater by @martindevans in #715
- Make
LLamaKvCacheView
Safe by @martindevans in #721
Documentation
- Removed
ContextSize
from most examples by @martindevans in #663 - Add issue templates. by @AsakusaRinne in #700
- Add LLaMA3 chat session example. by @AsakusaRinne in #708
- Improved Example Docs by @martindevans in #728
Bug Fixes
- fix: llava backend ignores avx and cuda. by @AsakusaRinne in #642
- Embeddings correction by @zsogitbe in #674
- Fix context params defaults by @dlyz in #729
- Made special tokens included in prompts tokenize as intended by @Lyrcaxis in #677
- Fixed Minor Issues With Model Loading by @martindevans in #697
- Empty batch check by @martindevans in #691
- Optimize Semantic Kernel LLamaSharpChatCompletion when running with StatefulExecutorBase models by @kidkych in #671
- SemanticKernel: Correcting non-standard way of working with PromptExecutionSettings by @zsogitbe in #689
- Fix cublas build action by @martindevans in #725
Other Changes
- build(deps): bump System.Text.Json from 8.0.2 to 8.0.3 by @dependabot in #636
- build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.2 to 8.0.3 by @dependabot in #638
- build(deps): bump Microsoft.Extensions.Logging.Abstractions from 8.0.0 to 8.0.1 by @dependabot in #637
- April 2024 Binary Update by @martindevans in #662
- Slightly Safer Quantize Params by @martindevans in #698
- Removed Unnecessary Constructor From Safe Handles by @martindevans in #696
- ci: add workflow to check the spellings. by @AsakusaRinne in #710
- ci: add a workflow to check code format. by @AsakusaRinne in #709
- Remove
Conversation.Prompt(String)
by @martindevans in #719 - ci: add benchmark test. by @AsakusaRinne in #720
New Contributors
- @Lyrcaxis made their first contribution in #656
- @Norne9 made their first contribution in #711
- @ksanman made their first contribution in #714
- @dlyz made their first contribution in #729
- @eltociear made their first contribution in #730
Full Changelog: 0.11.1...v0.12.0