Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Dropwizard Task to flush output and upload. #4

Open
prb opened this issue Apr 24, 2013 · 3 comments
Open

Add Dropwizard Task to flush output and upload. #4

prb opened this issue Apr 24, 2013 · 3 comments

Comments

@prb
Copy link
Member

prb commented Apr 24, 2013

This would be used when bringing down a node (after taking it out of the active pool) to ensure no data was lost.

@prb
Copy link
Member Author

prb commented Jun 5, 2013

(From discussion with @lorrin.)
Task is one option here, and a CLI command is another. For the CLI command, the workflow would be:

  1. Shutdown the service.
  2. Invoke the CLI with a "flush logs" command that starts the Skid Road infrastructure and pushes out any "WRITING" or in-need-of-retry files.
  3. Decommission the node.

@lorrin
Copy link
Member

lorrin commented Jul 23, 2013

Initial command implementation in, handles happy-case where everything uploads cleanly on first try. But still needs:

  • command-line argument to specify max wait time (currently waits indefinitely)
  • more nuanced retry configuration so we retry more intensively than usual
  • more aggressive retry that tries all items once rather than pausing after first failure

@prb
Copy link
Member Author

prb commented Jul 23, 2013

It's OK if the container owns the status but not the retry execution itself. It can be up to the client of the command/task to check status.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants