You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Not sure whether it should be mentioned here or in ReactiveMP.jl, but for certain applications it is highly beneficial to support inplace operations (rules, computations, basically everything). In my experiments I am running into the issue where memory consumption roughly blows up with 1GB per second, significantly slowing down the inference speed.
Especially in the rxinference() function, where the same model gets used to process a stream of data it is very important to have these inplace operations to prevent memory from leaking away and to prevent the garbage collection from slowing down the inference speed.
The text was updated successfully, but these errors were encountered:
Not sure whether it should be mentioned here or in
ReactiveMP.jl
, but for certain applications it is highly beneficial to support inplace operations (rules, computations, basically everything). In my experiments I am running into the issue where memory consumption roughly blows up with 1GB per second, significantly slowing down the inference speed.Especially in the
rxinference()
function, where the same model gets used to process a stream of data it is very important to have these inplace operations to prevent memory from leaking away and to prevent the garbage collection from slowing down the inference speed.The text was updated successfully, but these errors were encountered: