-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use Julia package for benchmarking #1698
Comments
This one? https://github.com/JuliaCI/PkgBenchmark.jl I'm aware of |
PkgBenchmark.jl has been around for a while but doesn't seem very actively maintained. Also for CI integration it recommends an unmaintained package. PkgJogger.jl seems like a better maintained alternative that has nicer local workflows, with easier CI integration. Though less mature, Lilith's work in https://chairmarks.lilithhafner.com/v1.2.1/regressions seems very nice as well. Perhaps I'd try that first. In terms of published benchmark tracking, there is https://github.com/SciML/SciMLBenchmarks.jl but comparing commits over time like https://lux.csail.mit.edu/benchmarks/ also looks nice. |
In issue #462, regression test is set up for comparing output of a run with the benchmark.
@visr suggests to add runtime into benchmark and make use one of existing Julia package to illustrate the benchmark result better
The text was updated successfully, but these errors were encountered: