Improve Test Vector Generation

[Xeratec]

This PR improves the test vector generation and ensure that we have non-constant output vectors. Furthermore, it fixes the too small bit width of the weights.

Added

• Print and raise warnings for problematic vectors
• Print and check the error of the partial streaming softmax relative to the integer softmax

Changed

• Reduce calculated bit width of AV (This assumes that the attention is distributed among different values and not on one token)

Fixed

• Fix wrong bitwidth of weights (the -1 is already handled in the random_shuffled_tensor function)

[gamzeisl]

LGTM