Skip to content

Latest commit

 

History

History
79 lines (57 loc) · 3.98 KB

README.md

File metadata and controls

79 lines (57 loc) · 3.98 KB
Raw

BLinkTree Benchmark

The BLinkTree-benchmark stores 8 byte numeric keys and values. Call ./bin/blinktree_benchmark -h for help and parameters.

How to generate YCSB workload

  • Workload specifications are done by files in workloads_specification/.
  • Call make ycsb-a and make ycsb-c to generate workloads A and C.
  • Workload files are stored in workloads/
  • Use ./bin/blinktree_benchmark -f <fill-file> <mixed-file> to pass the desired workload.
  • Default (if not specified) is -f workloads/fill_randint_workloada workloads/mixed_randint_workloada.

Important CLI arguments

  • The first argument is the number of cores:
    • ./bin/blinktree_benchmark 1 for using a single core.
    • ./bin/blinktree_benchmark 1:24 for using cores 1 up to 24.
  • -i <NUMBER> specifies the number of repetitions of each workload.
  • -s <NUMBER> steps of the cores:
    • -s 1 will increase the used cores by one (core ids: 0,1,2,3,4,5,6,7,..,23).
    • -s 2 will skip every second core (core ids: 0,1,3,5,7,..23).
  • -pd <NUMBER> specifies the prefetch distance.
  • -p or --perf will activate performance counter (result will be printed to console and output file).
  • --latched will enable latches for synchronization (default off).
  • --exclusive forces the tasks to access tree nodes exclusively (e.g. by using spinlocks or core-based sequencing) (default off).
  • --sync4me will use built-in synchronization selection to choose the matching primitive based on annotations.
  • -o <FILE> will write the results in json format to the given file.

Understanding the output

After started, the benchmark will print a summary of configured cores and workload:

core configuration: 
  1: 0
  2: 0 1
  4: 0 1 2 3
workload: fill: 5m / readonly: 5m

Here, we configured the benchmark to use one to four cores; each line of the core configuration displays the number of cores and the core identifiers.

Following, the benchmark will be started and print the results for every iteration:

1	1	0	1478 ms	3.38295e+06 op/s
1	1	1	1237 ms	4.04204e+06 op/s
2	1	0	964 ms	5.18672e+06 op/s
2	1	1	675 ms	7.40741e+06 op/s
4	1	0	935 ms	5.34759e+06 op/s
4	1	1	532 ms	9.3985e+06 op/s
  • The first column is the number of used cores.
  • The second column displays the iteration of the benchmark (configured by -i X).
  • Thirdly, the phase-identifier will be printed: 0 for initialization phase (which will be only inserts) and 1 for the workload phase (which is read-only here).
  • After that, the time and throughput are written.
  • If --perf is enabled, the output will be extended by some perf counters, which are labeled (like throughput).

Plot the results

When using -o FILE, the results will be written to the given file, using JSON format. The plot script scripts/plot_blinktree_benchmark INPUT_FILE [INPUT_FILE ...] will aggregate and plot the results using one or more of those JSON files.

Examples

Running workload A using optimistic synchronization
./bin/blinktree_benchmark 1: -s 2 -i 3 -pd 3 -p -f workloads/fill_randint_workloada workloads/mixed_randint_workloada -o optimistic.json
Running workload A using best matching synchronization
./bin/blinktree_benchmark 1: -s 2 -i 3 -pd 3 -p --sync4me -f workloads/fill_randint_workloada workloads/mixed_randint_workloada -o sync4me.json
Running workload A using reader/writer-locks
./bin/blinktree_benchmark 1: -s 2 -i 3 -pd 3 -p --latched -f workloads/fill_randint_workloada workloads/mixed_randint_workloada -o rwlocked.json
Running workload A using core-based sequencing
./bin/blinktree_benchmark 1: -s 2 -i 3 -pd 3 -p --exclusive -f workloads/fill_randint_workloada workloads/mixed_randint_workloada -o core-sequenced.json
Running workload A using spin-locks
./bin/blinktree_benchmark 1: -s 2 -i 3 -pd 3 -p --latched --exclusive -f workloads/fill_randint_workloada workloads/mixed_randint_workloada -o spinlocked.json