Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Full-split : Remote Runner setup #214

Open
DervinSun opened this issue Nov 21, 2024 · 5 comments
Open

Full-split : Remote Runner setup #214

DervinSun opened this issue Nov 21, 2024 · 5 comments

Comments

@DervinSun
Copy link

I didn't quite find much explanation for this point on the documentations. How would I set up a remote runner on a different machine in a full-split setup?

Is there a specific runner option that I need to change?

@gpetretto
Copy link
Contributor

Hi @DervinSun,

there is no particular option that needs to be set in the runner. It just means that at least some of the workers are of type: remote. There is also no configuration that needs to be done on the worker machine either, but the python environment should be equivalent to the one on the runner machine.

Does this answer your question?

@DervinSun
Copy link
Author

So if I put in "jf runner start", it will automatically start the runner on the server?

@gpetretto
Copy link
Contributor

I am not sure which machine you are referring to with the "server".
The Runner needs to be executed only on one machine (and not more than one), that is responsible to manage the execution of the Jobs by sending them to the workers. Maybe this part of the documentation may help clarify the point: https://matgenix.github.io/jobflow-remote/user/introduction.html#working-principles
jf runner start will start the runner on the machine where you execute the command. This will start a daemon locally. If you have a remote worker (e.g. a cluster) this will submit your jobs there on its own, so nothing needs to be executed manually on the worker, aside from the set up.
Does this help clarifying the procedure?

@DervinSun
Copy link
Author

Sorry, for not being very clear. When I said "server" I mean the machine that have the runner. So if I understand correctly, as long as I have a runner start on one machine, I do not need to run the "jf runner start" command on any other machine. It will just work?
Let me give it a try, which should probably help me understand.

@gpetretto
Copy link
Contributor

So if I understand correctly, as long as I have a runner start on one machine, I do not need to run the "jf runner start" command on any other machine.

Yes

It will just work?

As long as everything is propely configured, it should indeed work just like that 😃

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants