Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix to affectedbit for symbolic measurements #414

Merged
merged 1 commit into from
Nov 2, 2024
Merged

fix to affectedbit for symbolic measurements #414

merged 1 commit into from
Nov 2, 2024

Conversation

Krastanov
Copy link
Member

If you want to submit an unfinished piece of work in order to get comments and discuss, please mark the pull request as a draft and ping the repository maintainer.

Please address only one topic or issue per pull request! Many small PRs are much easier to review and merge than one large PR.

Before merging, all changes and new functionality should be marked in the CHANGELOG file, but feel free to just leave your CHANGELOG notes in the PR description, to avoid merge conflicts with other requests modifying that file. The maintainer will add these CHANGELOG notes for you if you do so.

Before considering your pull request ready for review and merging make sure that all of the following are completed (please keep the clecklist as part of your PR):

  • The code is properly formatted and commented.
  • Substantial new functionality is documented within the docs.
  • All new functionality is tested.
  • All of the automated tests on github pass.
  • We recently started enforcing formatting checks. If formatting issues are reported in the new code you have written, please correct them. There will be plenty of old code that is flagged as we are slowly transitioning to enforced formatting. Please do not worry about or address older formatting issues -- keep your PR just focused on your planned contribution.

If possible, keep your git history not too wild (rebase and squash commits, keep commits small and semantically separated) so that review is easier.

@codecov Codecov
Copy link

codecov bot commented Nov 2, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.81%. Comparing base (f69e49c) to head (83ce6b6).
Report is 2 commits behind head on master.

Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #414      +/-   ##
==========================================
+ Coverage   82.46%   82.81%   +0.34%     
==========================================
  Files          70       70              
  Lines        4580     4579       -1     
==========================================
+ Hits         3777     3792      +15     
+ Misses        803      787      -16

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Nov 2, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Nov 2024 - 13:52
  • Baseline: 2 Nov 2024 - 13:59
  • Package commits:
  • Target: 9c7afe
  • Baseline: abfcd3
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.88 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.89 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.82 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.03 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.05 (5%) ❌ 1.01 (1%)
["stabilizer", "canon", "diag_cano500"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 2244 s 0 s 140 s 5815 s 0 s
 #2 2939 MHz 2589 s 0 s 139 s 5478 s 0 s
 #3 3244 MHz 2164 s 0 s 152 s 5878 s 0 s
 #4 3247 MHz 1674 s 0 s 158 s 6371 s 0 s
 Memory: 15.606487274169922 GB (13622.74609375 MB free)
 Uptime: 823.54 sec
 Load Avg: 1.01 1.02 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3243 MHz 3277 s 0 s 176 s 9047 s 0 s
 #2 3205 MHz 3606 s 0 s 172 s 8728 s 0 s
 #3 3003 MHz 3332 s 0 s 189 s 8976 s 0 s
 #4 2593 MHz 2823 s 0 s 196 s 9487 s 0 s
 Memory: 15.606487274169922 GB (13532.05859375 MB free)
 Uptime: 1254.51 sec
 Load Avg: 1.0 1.0 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Nov 2024 - 13:52
  • Package commit: 9c7afe
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.985 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.243 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.246 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 177.011 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.013 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 117.990 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.357 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.688 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.114 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.456 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.035 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.131 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 48.991 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.421 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.674 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.919 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.523 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.465 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.420 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.237 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.528 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.965 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 483.744 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.131 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.143 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.259 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.162 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.234 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.524 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.560 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 483.804 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 697.423 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 577.959 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.678 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.324 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.816 ms (5%) 1.37 MiB (1%) 22191
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.043 ms (5%) 2.71 MiB (1%) 39916
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.382 ms (5%) 2.77 MiB (1%) 40442
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.460 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.769 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.146 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 379.219 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.098 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.433 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 796.675 ms (5%) 5.745 ms 171.22 MiB (1%) 587731
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.674 s (5%) 14.661 ms 346.82 MiB (1%) 1203398
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.701 s (5%) 15.442 ms 352.33 MiB (1%) 1232571
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 402.399 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 814.032 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 816.909 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.783 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.416 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.708 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.072 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.581 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.768 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.169 ns (5%)
["pauli", "mul", "100000"] 715.534 ns (5%)
["pauli", "mul", "20000000"] 198.250 μs (5%)
["stabilizer", "canon", "cano500"] 2.804 ms (5%)
["stabilizer", "canon", "diag_cano500"] 559.502 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.526 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 421.448 μs (5%)
["stabilizer", "canon", "gott500"] 10.673 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.343 ms (5%)
["stabilizer", "canon", "rref500"] 2.605 ms (5%)
["stabilizer", "project", "destabilizer"] 13.775 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.831 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.487 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.907 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.199 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.620 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 2244 s 0 s 140 s 5815 s 0 s
 #2 2939 MHz 2589 s 0 s 139 s 5478 s 0 s
 #3 3244 MHz 2164 s 0 s 152 s 5878 s 0 s
 #4 3247 MHz 1674 s 0 s 158 s 6371 s 0 s
 Memory: 15.606487274169922 GB (13622.74609375 MB free)
 Uptime: 823.54 sec
 Load Avg: 1.01 1.02 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Nov 2024 - 13:59
  • Package commit: abfcd3
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.977 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.397 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.152 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 175.998 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.817 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.511 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.057 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.018 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 59.101 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 161.310 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.038 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.951 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 55.663 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.645 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.041 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.671 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.530 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.523 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.405 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.118 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.492 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.743 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 406.969 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.362 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.072 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.249 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.192 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.495 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.427 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 406.920 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.424 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.826 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.165 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.042 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.708 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.659 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.335 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.674 ms (5%) 1.37 MiB (1%) 22215
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.760 ms (5%) 2.72 MiB (1%) 40108
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 5.322 ms (5%) 2.81 MiB (1%) 40946
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.648 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.895 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.955 ms (5%) 7.86 MiB (1%) 228620
["ecc", "evaluate_decoder", "shor_table_comm"] 380.951 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.096 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.418 ms (5%) 349.61 KiB (1%) 3642
["ecc", "evaluate_decoder", "toric8_bp_comm"] 803.100 ms (5%) 5.626 ms 174.22 MiB (1%) 597803
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.624 s (5%) 15.841 ms 352.70 MiB (1%) 1223178
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.618 s (5%) 18.759 ms 350.21 MiB (1%) 1224507
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 403.174 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 812.367 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 804.133 ms (5%) 17.27 MiB (1%) 291041
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.785 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.363 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.445 ms (5%) 6.43 MiB (1%) 66248
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.102 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.499 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.578 ms (5%) 6.00 MiB (1%) 66063
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.379 ns (5%)
["pauli", "mul", "100000"] 721.351 ns (5%)
["pauli", "mul", "20000000"] 189.514 μs (5%)
["stabilizer", "canon", "cano500"] 2.803 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.566 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.527 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 421.778 μs (5%)
["stabilizer", "canon", "gott500"] 10.609 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.339 ms (5%)
["stabilizer", "canon", "rref500"] 2.601 ms (5%)
["stabilizer", "project", "destabilizer"] 14.046 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.921 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.524 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.781 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.219 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.660 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3243 MHz 3277 s 0 s 176 s 9047 s 0 s
 #2 3205 MHz 3606 s 0 s 172 s 8728 s 0 s
 #3 3003 MHz 3332 s 0 s 189 s 8976 s 0 s
 #4 2593 MHz 2823 s 0 s 196 s 9487 s 0 s
 Memory: 15.606487274169922 GB (13532.05859375 MB free)
 Uptime: 1254.51 sec
 Load Avg: 1.0 1.0 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Nov 2024 - 13:52
  • Baseline: 2 Nov 2024 - 13:59
  • Package commits:
  • Target: 9c7afe
  • Baseline: abfcd3
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.88 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.89 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.82 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.03 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.05 (5%) ❌ 1.01 (1%)
["stabilizer", "canon", "diag_cano500"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 2244 s 0 s 140 s 5815 s 0 s
 #2 2939 MHz 2589 s 0 s 139 s 5478 s 0 s
 #3 3244 MHz 2164 s 0 s 152 s 5878 s 0 s
 #4 3247 MHz 1674 s 0 s 158 s 6371 s 0 s
 Memory: 15.606487274169922 GB (13622.74609375 MB free)
 Uptime: 823.54 sec
 Load Avg: 1.01 1.02 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3243 MHz 3277 s 0 s 176 s 9047 s 0 s
 #2 3205 MHz 3606 s 0 s 172 s 8728 s 0 s
 #3 3003 MHz 3332 s 0 s 189 s 8976 s 0 s
 #4 2593 MHz 2823 s 0 s 196 s 9487 s 0 s
 Memory: 15.606487274169922 GB (13532.05859375 MB free)
 Uptime: 1254.51 sec
 Load Avg: 1.0 1.0 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Nov 2024 - 13:52
  • Package commit: 9c7afe
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.985 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.243 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.246 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 177.011 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.013 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 117.990 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.357 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.688 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.114 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.456 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.035 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.131 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 48.991 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.421 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.674 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.919 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.523 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.465 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.420 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.237 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.528 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.965 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 483.744 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.131 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.143 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.259 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.162 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.234 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.524 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.560 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 483.804 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 697.423 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 577.959 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.678 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.324 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.816 ms (5%) 1.37 MiB (1%) 22191
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.043 ms (5%) 2.71 MiB (1%) 39916
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.382 ms (5%) 2.77 MiB (1%) 40442
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.460 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.769 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.146 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 379.219 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.098 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.433 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 796.675 ms (5%) 5.745 ms 171.22 MiB (1%) 587731
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.674 s (5%) 14.661 ms 346.82 MiB (1%) 1203398
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.701 s (5%) 15.442 ms 352.33 MiB (1%) 1232571
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 402.399 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 814.032 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 816.909 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.783 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.416 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.708 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.072 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.581 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.768 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.169 ns (5%)
["pauli", "mul", "100000"] 715.534 ns (5%)
["pauli", "mul", "20000000"] 198.250 μs (5%)
["stabilizer", "canon", "cano500"] 2.804 ms (5%)
["stabilizer", "canon", "diag_cano500"] 559.502 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.526 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 421.448 μs (5%)
["stabilizer", "canon", "gott500"] 10.673 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.343 ms (5%)
["stabilizer", "canon", "rref500"] 2.605 ms (5%)
["stabilizer", "project", "destabilizer"] 13.775 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.831 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.487 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.907 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.199 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.620 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 2244 s 0 s 140 s 5815 s 0 s
 #2 2939 MHz 2589 s 0 s 139 s 5478 s 0 s
 #3 3244 MHz 2164 s 0 s 152 s 5878 s 0 s
 #4 3247 MHz 1674 s 0 s 158 s 6371 s 0 s
 Memory: 15.606487274169922 GB (13622.74609375 MB free)
 Uptime: 823.54 sec
 Load Avg: 1.01 1.02 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Nov 2024 - 13:59
  • Package commit: abfcd3
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.977 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.397 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.152 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 175.998 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.817 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.511 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.057 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.018 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 59.101 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 161.310 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.038 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.951 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 55.663 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.645 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.041 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.671 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.530 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.523 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.405 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.118 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.492 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.743 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 406.969 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.362 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.072 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.249 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.192 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.495 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.427 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 406.920 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.424 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.826 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.165 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.042 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.708 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.659 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.335 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.674 ms (5%) 1.37 MiB (1%) 22215
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.760 ms (5%) 2.72 MiB (1%) 40108
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 5.322 ms (5%) 2.81 MiB (1%) 40946
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.648 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.895 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.955 ms (5%) 7.86 MiB (1%) 228620
["ecc", "evaluate_decoder", "shor_table_comm"] 380.951 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.096 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.418 ms (5%) 349.61 KiB (1%) 3642
["ecc", "evaluate_decoder", "toric8_bp_comm"] 803.100 ms (5%) 5.626 ms 174.22 MiB (1%) 597803
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.624 s (5%) 15.841 ms 352.70 MiB (1%) 1223178
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.618 s (5%) 18.759 ms 350.21 MiB (1%) 1224507
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 403.174 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 812.367 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 804.133 ms (5%) 17.27 MiB (1%) 291041
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.785 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.363 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.445 ms (5%) 6.43 MiB (1%) 66248
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.102 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.499 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.578 ms (5%) 6.00 MiB (1%) 66063
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.379 ns (5%)
["pauli", "mul", "100000"] 721.351 ns (5%)
["pauli", "mul", "20000000"] 189.514 μs (5%)
["stabilizer", "canon", "cano500"] 2.803 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.566 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.527 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 421.778 μs (5%)
["stabilizer", "canon", "gott500"] 10.609 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.339 ms (5%)
["stabilizer", "canon", "rref500"] 2.601 ms (5%)
["stabilizer", "project", "destabilizer"] 14.046 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.921 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.524 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.781 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.219 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.660 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3243 MHz 3277 s 0 s 176 s 9047 s 0 s
 #2 3205 MHz 3606 s 0 s 172 s 8728 s 0 s
 #3 3003 MHz 3332 s 0 s 189 s 8976 s 0 s
 #4 2593 MHz 2823 s 0 s 196 s 9487 s 0 s
 Memory: 15.606487274169922 GB (13532.05859375 MB free)
 Uptime: 1254.51 sec
 Load Avg: 1.0 1.0 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Nov 2024 - 13:52
  • Baseline: 2 Nov 2024 - 13:59
  • Package commits:
  • Target: 9c7afe
  • Baseline: abfcd3
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.88 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.89 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 1.08 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.82 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.03 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.05 (5%) ❌ 1.01 (1%)
["stabilizer", "canon", "diag_cano500"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 2244 s 0 s 140 s 5815 s 0 s
 #2 2939 MHz 2589 s 0 s 139 s 5478 s 0 s
 #3 3244 MHz 2164 s 0 s 152 s 5878 s 0 s
 #4 3247 MHz 1674 s 0 s 158 s 6371 s 0 s
 Memory: 15.606487274169922 GB (13622.74609375 MB free)
 Uptime: 823.54 sec
 Load Avg: 1.01 1.02 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3243 MHz 3277 s 0 s 176 s 9047 s 0 s
 #2 3205 MHz 3606 s 0 s 172 s 8728 s 0 s
 #3 3003 MHz 3332 s 0 s 189 s 8976 s 0 s
 #4 2593 MHz 2823 s 0 s 196 s 9487 s 0 s
 Memory: 15.606487274169922 GB (13532.05859375 MB free)
 Uptime: 1254.51 sec
 Load Avg: 1.0 1.0 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Nov 2024 - 13:52
  • Package commit: 9c7afe
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.985 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.243 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.246 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 177.011 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.013 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 117.990 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.357 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.688 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.114 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.456 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.035 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.131 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 48.991 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.421 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.674 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.919 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.523 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.465 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.420 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.237 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.528 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.965 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 483.744 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.131 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.143 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.259 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.162 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.234 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.524 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.560 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 483.804 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 697.423 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 577.959 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.678 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.324 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.816 ms (5%) 1.37 MiB (1%) 22191
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.043 ms (5%) 2.71 MiB (1%) 39916
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.382 ms (5%) 2.77 MiB (1%) 40442
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.460 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.769 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.146 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 379.219 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.098 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.433 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 796.675 ms (5%) 5.745 ms 171.22 MiB (1%) 587731
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.674 s (5%) 14.661 ms 346.82 MiB (1%) 1203398
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.701 s (5%) 15.442 ms 352.33 MiB (1%) 1232571
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 402.399 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 814.032 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 816.909 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.783 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.416 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.708 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.072 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.581 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.768 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.169 ns (5%)
["pauli", "mul", "100000"] 715.534 ns (5%)
["pauli", "mul", "20000000"] 198.250 μs (5%)
["stabilizer", "canon", "cano500"] 2.804 ms (5%)
["stabilizer", "canon", "diag_cano500"] 559.502 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.526 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 421.448 μs (5%)
["stabilizer", "canon", "gott500"] 10.673 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.343 ms (5%)
["stabilizer", "canon", "rref500"] 2.605 ms (5%)
["stabilizer", "project", "destabilizer"] 13.775 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.831 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.487 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.907 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.199 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.620 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dff...*[Comment body truncated]*

@Krastanov Krastanov merged commit 4cc664e into master Nov 2, 2024
15 of 18 checks passed
@Krastanov Krastanov deleted the affectedqubits branch November 2, 2024 14:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Krastanov