-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Replaceing KV actor by Ray API #136
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As discussed offline, we should enable tests in client mode.
fed/_private/compatible_utils.py
Outdated
return ray.get(o) | ||
# Note(NKcqx): internval_kv is always initiated after `ray.init`, | ||
# calling this is equal to directly return "True" | ||
return self._client_api_stub._internal_kv_initialized() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So we should mark this method as deprecated?
|
||
def reset(self): | ||
o = self._internal_kv_actor.reset.remote() | ||
return ray.get(o) | ||
# Note(NKcqx): No `gcs_client` is instantiated for kv, and the 'initialized' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mark as deprecated.
Signed-off-by: NKcqx <892670992@qq.com>
Unfortunately, Ray's client mode internal_kv accessing has a BUG that causes the call of |
It turns out to be a dumb BUG in Ray, fix PR: |
If the current ray doesn't support it, how can we handle to get compatible with all versions? |
Do we need go with this PR? @ray-project/rayfed |
Signed-off-by: NKcqx <892670992@qq.com> Conflicts: fed/_private/compatible_utils.py tests/test_internal_kv.py
Signed-off-by: NKcqx <892670992@qq.com>
Signed-off-by: NKcqx <892670992@qq.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Resolves #135