Skip to content

Commit

Permalink
[Version] v1.8.1. (#30)
Browse files Browse the repository at this point in the history
  • Loading branch information
Duyi-Wang committed Jul 31, 2024
1 parent aaf5dc5 commit df57cb2
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 1 deletion.
12 changes: 12 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,16 @@
# CHANGELOG
# [Version v1.8.1](https://github.com/intel/xFasterTransformer/releases/tag/v1.8.1)
v1.8.1

## Functionality
- Expose the interface of embedding lookup.

## Performance
- Optimized the performance of grouped query attention (GQA).
- Enhanced the performance of creating keys for the oneDNN primitive cache.
- Set the [bs][nh][seq][hs] layout as the default for KV Cache, resulting in better performance.
- Improved the task split imbalance issue in self-attention.

# [Version v1.8.0](https://github.com/intel/xFasterTransformer/releases/tag/v1.8.0)
v1.8.0 Continuous Batching on Single ARC GPU and AMX_FP16 Support.

Expand Down
2 changes: 1 addition & 1 deletion VERSION
Original file line number Diff line number Diff line change
@@ -1 +1 @@
1.8.0
1.8.1

0 comments on commit df57cb2

Please sign in to comment.