[CUDA][HIP] Associate queue with device in context #1992
Conversation
github-actions
bot
added
cuda
This is a weird case and maybe we need to consider what the expectation from the UR API is. In the L0 adapter it just picks the first device in the platform, not even caring if it is actually in the context. |
I think that's a good idea. I am inclined to think that we shouldn't allow the
That seems bad. |
|
Could we separate the discussion about multi-device context from this single-device context fix? This PR brings back the (relatively uncontroversial) behaviour broken recently and we have a customer waiting for this fix. |
|
Good idea. Sorry I have been sleeping on this one. I'll make an issue about this question and then hopefully we can merge this. |
|
Ping @steffenlarsen are you happy to continue discussion about this entry point in the linked issue? If so are you happy with this as a quick-fix change? |
Making a native queue doesn't require hDevice to be non null, but this associates the queue with a null device, even if hContext contains valid devices. This fixes the behaviour for a single device context, making the queue be associated with the only device in the context. But there is a question mark over whether this entry point makes sense for a multi device UR context. Should we be able to construct a queue with a native queue without knowing what the UR device associated with the queue is? Probably not.
hdelan
force-pushed
the
use-only-device-in-context
branch
from
2b95c9f
to
15408ff
Compare
Making a native queue doesn't require hDevice to be non null, but this associates the queue with a null device, even if hContext contains valid devices.
This fixes the behaviour for a single device context, making the queue be associated with the only device in the context. But there is a question mark over whether this entry point makes sense for a multi device UR context. Should we be able to construct a queue with a native queue without knowing what the UR device associated with the queue is? Probably not.