-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
efficient implementation #5
Comments
yea definitely have you found En-transformer useful? |
yes ...it is pretty useful however I believe that distances should be used to allow nodes positional encoding. I mean something like IPA (invariant point attention) or schnet like encoding for distances using RBF. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I wonder if relative distances and coordinates can be handled more efficiently using memory efficient attention as in " Self-attention Does Not Need O(n^2) Memory". It is straightforward for the scalar part.
The text was updated successfully, but these errors were encountered: