kill the running jobs on the cluster when I hit ctrl-C in the CLI

[xelax]

when I quit the scoobi "launcher" program in the CLI gateway machine I quit the launcher but the hadoop job keeps running and I need to go and kill it manually. Ideally it would be nice if scoobi would catch the ctrl-C and kill the hadoop job before quitting.

[espringe]

Isn't this the behavior of hadoop normally? But I agree that if you abort a scoobi project, killing the job makes sense -- as a half-finished scoobi job isn't useful for anyone. But what about the case it's executing the last map-reduce job of the pipeline? In that case, it would seem to match semantics to let it run until completion ?

[xelax]

well, if i decide to hit ctrl-C it means that I just want to stop the computation, so I'd keep ti simple and simply kill all the hadoop jobs. Is not uncommon to realize that you started a job with some fatal flaw.

[raronson]

Just wanted to add that Pig has this behavior - killing any running M/R jobs when you hit ctrl-C.