You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We tried to create an Azure cloud virtual machine with 120 cores. The library supports only 64 since this is the max reported by
the system calls.
To get around that (in Windows):
-> one would need to count the number of cores differently
-> there is the concept of processor groups in windows -> assign the threads to groups.
I took the liberty to implement such a thing in: https://github.com/mikerabat/neural-api
a fork of this project that includes some bugfixes/enhancements (Delphi AVX dot product, some tests to avoid problems in
different environments, GELu activiation function and others)
In case that it is interesting please merge the code. I'm to dumb to do that and have quite some problem with the git philosophy....
The text was updated successfully, but these errors were encountered:
@mikerabat , thank you for sharing it! I'm certain that there are other users that will benefit from your branch. I'll eventually look at it with care.
I'm glad to help - there were also a few minor things regarding console output and other things that my branch includes. In addition I wanted to check if I could add AVX512 support... the code wouldn't be that hard to implement but I lack of such a cpu :/
Also (at least for my problems) I only implemented a AVX dot product and AVX Mul Add function - these were the two functions that are predominantly called in my nets...
We tried to create an Azure cloud virtual machine with 120 cores. The library supports only 64 since this is the max reported by
the system calls.
To get around that (in Windows):
-> one would need to count the number of cores differently
-> there is the concept of processor groups in windows -> assign the threads to groups.
I took the liberty to implement such a thing in:
https://github.com/mikerabat/neural-api
a fork of this project that includes some bugfixes/enhancements (Delphi AVX dot product, some tests to avoid problems in
different environments, GELu activiation function and others)
In case that it is interesting please merge the code. I'm to dumb to do that and have quite some problem with the git philosophy....
The text was updated successfully, but these errors were encountered: