Skip to content

TMP: check list of ktest2 release

Daejun Park edited this page Nov 21, 2013 · 18 revisions

Requirements

  • include feature. especially, kompile-options/krun-options of include elements

  • default value of --programs and --results options should be the directory where config.xml file resides

  • directory attributes

  • --ignore-white-spaces, --ignore-parentheses, --ignore-colors

  • experimental options group: --help-experimental

  • junit-report

  • timeouts

  • thread safe? asynchronous? IOUtils.toString? Is the function asynchronous? It has to be a non-blocking IO. https://github.com/kframework/k/commit/f1ec99424e75711b368ba51e65e90367867583d0

  • relative paths in stderr (i.e., *.err files)

Optional

  • central controls of error messages Although it was not discussed before, as you can see the issue #138, we need to centralize the error messages in order for the English to be polished by native speakers. https://github.com/kframework/k/issues/138

  • multiple in/out pairs https://github.com/kframework/k/issues/23

  • specific programs: https://github.com/kframework/k/issues/140

  • generate results: https://github.com/kframework/k/issues/133

  • option names without dashes: https://github.com/kframework/k/issues/132

  • print failure summary at the end: https://github.com/kframework/k/issues/161

  • generalized ktest: generalized tasks Actually, I hoped that the all-new ktest operates in the generalized tasks basis. As we've talked before, we can customize ktest by only replacing the front end which generates a totally different tasks (not just confined to kompile/krun tasks). In that sense, CmdArgs and Config package is really great, but Test package seems to be not that much. For example, we can have Task and TaskRunner(?) classes where Task's are created from each TestCase and just simply executed by TaskRunner.

  • make a single job mode share more stuff with a batch mode: generating dom or xml for a single job mode Although, of course, it has hugely improved than the current ktest, I think we can make them share more stuffs. For example, we can generate a dom data or even an xml file from a single job mode arguments, and then just pass it to the batch mode processor.

Clone this wiki locally