Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

initial implementation for nonclifford gates #126

Merged
merged 12 commits into from
Jul 11, 2023
Merged

initial implementation for nonclifford gates #126

merged 12 commits into from
Jul 11, 2023

Conversation

Krastanov
Copy link
Member

No description provided.

@Krastanov
Copy link
Member Author

@ChenZhao44 @hongyehu -- here is the slightly updated code on which we worked yesterday. Pardon the delay in sending, it is a very busy Thu/Fri. There are a few more things that I am sending to Chen (probably tomorrow, Friday), related to ECC demo sims.

@codecov
Copy link

codecov bot commented Jun 9, 2023 •
edited
Loading

Codecov Report

Merging #126 (106a32e) into master (dc27a71) will decrease coverage by 2.11%.
The diff coverage is 17.20%.

❗ Current head 106a32e differs from pull request most recent head bef9860. Consider uploading reports for the commit bef9860 to get more accurate results

@@            Coverage Diff             @@
##           master     #126      +/-   ##
==========================================
- Coverage   86.20%   84.09%   -2.11%     
==========================================
  Files          34       35       +1     
  Lines        2951     3044      +93     
==========================================
+ Hits         2544     2560      +16     
- Misses        407      484      +77
Impacted Files Coverage Δ
src/QuantumClifford.jl 91.01% <ø> (ø)
src/nonclifford.jl 0.00% <0.00%> (ø)
src/mul_leftright.jl 97.67% <88.88%> (-1.43%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions
Copy link
Contributor

github-actions bot commented Jun 9, 2023 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Jun 2023 - 04:25
  • Baseline: 9 Jun 2023 - 04:31
  • Package commits:
  • Target: 888df3
  • Baseline: bf8ed7
  • Julia commits:
  • Target: d04116
  • Baseline: d04116
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r100"] 0.85 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 0.87 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.85 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 0.86 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 0.84 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 0.87 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_dense500_destab"] 1.06 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_destab"] 1.11 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_dense500_destab"] 1.07 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_destab"] 1.26 (5%) ❌ 1.00 (1%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 0.82 (5%) ✅ 1.00 (1%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 0.80 (5%) ✅ 1.00 (1%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 0.80 (5%) ✅ 1.00 (1%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 0.80 (5%) ✅ 1.00 (1%)
["pauli", "mul", "20000000"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 7801 s 0 s 193 s 1684 s 0 s
 #2 2593 MHz 1056 s 0 s 188 s 8384 s 0 s
 Memory: 6.7812042236328125 GB (5071.546875 MB free)
 Uptime: 973.39 sec
 Load Avg: 1.03 1.0 0.7
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10787 s 0 s 205 s 1910 s 0 s
 #2 2593 MHz 1288 s 0 s 200 s 11356 s 0 s
 Memory: 6.7812042236328125 GB (5025.98828125 MB free)
 Uptime: 1295.98 sec
 Load Avg: 1.02 1.01 0.81
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 9 Jun 2023 - 4:25
  • Package commit: 888df3
  • Julia commit: d04116
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 21.791 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 242.604 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 20.991 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 171.404 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 20.932 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 166.603 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 88.201 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.060 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 11.120 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 8.933 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 74.902 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.046 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 11.090 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.450 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 36.100 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.003 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 11.070 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.650 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 16.299 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.420 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.561 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 869.217 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 76.602 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 33.000 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 37.301 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.900 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 16.308 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.419 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.565 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 869.317 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.086 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.244 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.746 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.086 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.025 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 4.371 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.060 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 4.357 μs (5%)
["pauli", "mul", "100"] 17.134 ns (5%)
["pauli", "mul", "1000"] 30.181 ns (5%)
["pauli", "mul", "100000"] 737.608 ns (5%)
["pauli", "mul", "20000000"] 461.909 μs (5%)
["stabilizer", "canon", "cano500"] 4.498 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.445 ms (5%)
["stabilizer", "canon", "diag_gott500"] 12.343 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.265 ms (5%)
["stabilizer", "canon", "gott500"] 15.571 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.019 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.005 ms (5%)
["stabilizer", "canon", "rref500"] 4.576 ms (5%)
["stabilizer", "project", "destabilizer"] 25.100 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 11.600 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 4.214 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.972 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 43.301 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 35.301 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 7801 s 0 s 193 s 1684 s 0 s
 #2 2593 MHz 1056 s 0 s 188 s 8384 s 0 s
 Memory: 6.7812042236328125 GB (5071.546875 MB free)
 Uptime: 973.39 sec
 Load Avg: 1.03 1.0 0.7
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 9 Jun 2023 - 4:31
  • Package commit: bf8ed7
  • Julia commit: d04116
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 21.740 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 241.604 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 20.980 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 170.203 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 20.927 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 166.803 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 88.002 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.248 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 12.810 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 8.900 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 76.001 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.229 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 12.830 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.650 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 36.501 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.191 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 12.751 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.737 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.308 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.461 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.408 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 868.917 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 76.202 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 31.801 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 36.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 15.265 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.426 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.238 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 869.417 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.083 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.521 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.745 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.354 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.975 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 5.443 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.080 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 5.443 μs (5%)
["pauli", "mul", "100"] 17.234 ns (5%)
["pauli", "mul", "1000"] 30.484 ns (5%)
["pauli", "mul", "100000"] 735.208 ns (5%)
["pauli", "mul", "20000000"] 435.409 μs (5%)
["stabilizer", "canon", "cano500"] 4.682 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.446 ms (5%)
["stabilizer", "canon", "diag_gott500"] 12.348 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.223 ms (5%)
["stabilizer", "canon", "gott500"] 15.999 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.019 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.944 ms (5%)
["stabilizer", "canon", "rref500"] 4.692 ms (5%)
["stabilizer", "project", "destabilizer"] 25.400 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 11.900 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 4.323 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.157 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 42.900 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 35.600 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10787 s 0 s 205 s 1910 s 0 s
 #2 2593 MHz 1288 s 0 s 200 s 11356 s 0 s
 Memory: 6.7812042236328125 GB (5025.98828125 MB free)
 Uptime: 1295.98 sec
 Load Avg: 1.02 1.01 0.81
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.81
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Jun 2023 - 04:38
  • Baseline: 9 Jun 2023 - 04:44
  • Package commits:
  • Target: 8f4606
  • Baseline: bf8ed7
  • Julia commits:
  • Target: d04116
  • Baseline: d04116
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 1.12 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 1.10 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 0.00 (5%) ✅ 0.00 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
 speed user nice sys idle irq
 #1 2394 MHz 2002 s 0 s 226 s 7310 s 0 s
 #2 2394 MHz 7784 s 0 s 232 s 1506 s 0 s
 Memory: 6.7812042236328125 GB (5081.55859375 MB free)
 Uptime: 964.45 sec
 Load Avg: 1.0 1.02 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
 speed user nice sys idle irq
 #1 2394 MHz 4836 s 0 s 240 s 7920 s 0 s
 #2 2394 MHz 8400 s 0 s 249 s 4324 s 0 s
 Memory: 6.7812042236328125 GB (5028.23046875 MB free)
 Uptime: 1310.93 sec
 Load Avg: 1.06 1.03 0.88
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 9 Jun 2023 - 4:38
  • Package commit: 8f4606
  • Julia commit: d04116
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 41.191 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 280.700 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 39.863 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 205.001 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 39.488 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 198.898 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 100.900 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.293 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 15.490 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 10.000 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 79.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.254 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 15.687 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 8.125 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 38.900 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.209 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 15.438 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.962 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 16.986 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 9.235 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.200 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 680.400 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 73.100 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 35.100 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 36.600 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 17.414 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 9.365 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.194 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 680.401 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.314 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.417 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 2.049 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.300 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 8.233 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 5.183 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 8.200 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 5.150 μs (5%)
["pauli", "mul", "100"] 18.455 ns (5%)
["pauli", "mul", "1000"] 29.246 ns (5%)
["pauli", "mul", "100000"] 1.230 μs (5%)
["pauli", "mul", "20000000"] 370.000 μs (5%)
["stabilizer", "canon", "cano500"] 4.469 ms (5%)
["stabilizer", "canon", "diag_cano500"] 983.001 μs (5%)
["stabilizer", "canon", "diag_gott500"] 12.845 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 940.900 μs (5%)
["stabilizer", "canon", "gott500"] 16.744 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.995 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.023 ms (5%)
["stabilizer", "canon", "rref500"] 4.515 ms (5%)
["stabilizer", "project", "destabilizer"] 9.780 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 9.500 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 4.014 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.486 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 44.500 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 12.540 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
 speed user nice sys idle irq
 #1 2394 MHz 2002 s 0 s 226 s 7310 s 0 s
 #2 2394 MHz 7784 s 0 s 232 s 1506 s 0 s
 Memory: 6.7812042236328125 GB (5081.55859375 MB free)
 Uptime: 964.45 sec
 Load Avg: 1.0 1.02 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 9 Jun 2023 - 4:44
  • Package commit: bf8ed7
  • Julia commit: d04116
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 41.006 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 276.700 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 39.634 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 205.401 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 39.000 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 199.500 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 90.400 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.272 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 15.834 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.100 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 79.500 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.254 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 3.919 s (5%) 112.211 ms 206.10 MiB (1%) 3357430
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 8.100 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 39.000 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.213 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 15.051 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.950 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 16.775 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 9.145 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.199 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 680.804 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 72.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 34.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 36.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.700 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 17.204 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.967 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.192 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 680.203 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.313 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.419 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 2.078 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.301 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 8.167 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 5.200 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 8.267 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 5.117 μs (5%)
["pauli", "mul", "100"] 18.455 ns (5%)
["pauli", "mul", "1000"] 29.447 ns (5%)
["pauli", "mul", "100000"] 1.240 μs (5%)
["pauli", "mul", "20000000"] 380.000 μs (5%)
["stabilizer", "canon", "cano500"] 4.455 ms (5%)
["stabilizer", "canon", "diag_cano500"] 983.800 μs (5%)
["stabilizer", "canon", "diag_gott500"] 13.272 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 970.303 μs (5%)
["stabilizer", "canon", "gott500"] 16.938 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.008 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.001 ms (5%)
["stabilizer", "canon", "rref500"] 4.695 ms (5%)
["stabilizer", "project", "destabilizer"] 9.680 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 9.300 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 4.022 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.586 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 44.700 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 12.400 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1459
Commit d041162594d (2023-06-09 01:42 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
 speed user nice sys idle irq
 #1 2394 MHz 4836 s 0 s 240 s 7920 s 0 s
 #2 2394 MHz 8400 s 0 s 249 s 4324 s 0 s
 Memory: 6.7812042236328125 GB (5028.23046875 MB free)
 Uptime: 1310.93 sec
 Load Avg: 1.06 1.03 0.88
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
CPU family: 6
Model: 63
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 2
BogoMIPS: 4788.91
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm invpcid_single pti fsgsbase bmi1 avx2 smep bmi2 erms invpcid xsaveopt md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 512 KiB (2 instances)
L3 cache: 30 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Vendor :Intel
Architecture :Haswell
Model Family: 0x06, Model: 0x3f, Stepping: 0x02, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 30720) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 11 Jun 2023 - 17:31
  • Baseline: 11 Jun 2023 - 17:36
  • Package commits:
  • Target: f2a84f
  • Baseline: ff94dd
  • Julia commits:
  • Target: c58e50
  • Baseline: c58e50
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r100"] 0.80 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 0.84 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.80 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 0.84 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 0.79 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 0.84 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 1.37 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_stab"] 0.94 (5%) ✅ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 1.36 (5%) ❌ 1.00 (1%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.25 (5%) ❌ 1.00 (1%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.29 (5%) ❌ 1.00 (1%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 1.19 (5%) ❌ 1.00 (1%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 1.29 (5%) ❌ 1.00 (1%)
["pauli", "mul", "1000"] 1.25 (5%) ❌ 1.00 (1%)
["stabilizer", "trace", "stabilizer"] 1.13 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6842 s 0 s 186 s 2248 s 0 s
 #2 2593 MHz 1723 s 0 s 192 s 7326 s 0 s
 Memory: 6.7812042236328125 GB (5095.21484375 MB free)
 Uptime: 932.03 sec
 Load Avg: 1.0 1.0 0.75
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6882 s 0 s 194 s 5296 s 0 s
 #2 2593 MHz 4783 s 0 s 208 s 7357 s 0 s
 Memory: 6.7812042236328125 GB (5026.9453125 MB free)
 Uptime: 1242.69 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 11 Jun 2023 - 17:31
  • Package commit: f2a84f
  • Julia commit: c58e50
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 21.705 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 245.804 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 20.898 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 171.303 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 20.807 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 166.703 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 91.102 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.070 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 11.026 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.200 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 73.401 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.047 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 11.064 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.425 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 35.600 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.009 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 10.951 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.625 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.927 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.372 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.564 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 953.816 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 73.801 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 32.000 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 38.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.200 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 15.989 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.420 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.574 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 953.816 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.080 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.546 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.774 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.394 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.075 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 5.633 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.075 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 5.583 μs (5%)
["pauli", "mul", "100"] 17.134 ns (5%)
["pauli", "mul", "1000"] 37.790 ns (5%)
["pauli", "mul", "100000"] 739.698 ns (5%)
["pauli", "mul", "20000000"] 410.507 μs (5%)
["stabilizer", "canon", "cano500"] 4.563 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.444 ms (5%)
["stabilizer", "canon", "diag_gott500"] 12.395 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.268 ms (5%)
["stabilizer", "canon", "gott500"] 15.935 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.031 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.015 ms (5%)
["stabilizer", "canon", "rref500"] 4.759 ms (5%)
["stabilizer", "project", "destabilizer"] 25.100 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 11.900 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 3.943 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.029 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 44.000 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 40.001 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6842 s 0 s 186 s 2248 s 0 s
 #2 2593 MHz 1723 s 0 s 192 s 7326 s 0 s
 Memory: 6.7812042236328125 GB (5095.21484375 MB free)
 Uptime: 932.03 sec
 Load Avg: 1.0 1.0 0.75
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 11 Jun 2023 - 17:36
  • Package commit: ff94dd
  • Julia commit: c58e50
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 21.717 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 251.004 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 20.981 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 172.603 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 21.346 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 166.703 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 90.201 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.332 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 13.164 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.200 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 73.501 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.310 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 13.150 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.375 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 36.700 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.277 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 13.101 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.725 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 16.122 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.072 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.535 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 697.912 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 75.702 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 34.001 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 38.201 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 17.901 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 16.163 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.122 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.584 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 698.813 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.073 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.241 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.723 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.081 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.900 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 4.717 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.975 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 4.333 μs (5%)
["pauli", "mul", "100"] 17.134 ns (5%)
["pauli", "mul", "1000"] 30.251 ns (5%)
["pauli", "mul", "100000"] 738.111 ns (5%)
["pauli", "mul", "20000000"] 400.607 μs (5%)
["stabilizer", "canon", "cano500"] 4.524 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.443 ms (5%)
["stabilizer", "canon", "diag_gott500"] 12.671 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.224 ms (5%)
["stabilizer", "canon", "gott500"] 15.714 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.058 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.030 ms (5%)
["stabilizer", "canon", "rref500"] 4.637 ms (5%)
["stabilizer", "project", "destabilizer"] 25.201 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 11.700 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 3.921 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.914 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 44.000 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 35.400 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6882 s 0 s 194 s 5296 s 0 s
 #2 2593 MHz 4783 s 0 s 208 s 7357 s 0 s
 Memory: 6.7812042236328125 GB (5026.9453125 MB free)
 Uptime: 1242.69 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.80
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 11 Jun 2023 - 19:32
  • Baseline: 11 Jun 2023 - 19:38
  • Package commits:
  • Target: 668142
  • Baseline: ff94dd
  • Julia commits:
  • Target: c58e50
  • Baseline: c58e50
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 1.09 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 0.87 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 1.09 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.89 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 0.00 (5%) ✅ 0.00 (1%) ✅
["circuitsim", "pftrajectories_union", "q1001_r100"] 0.88 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 0.86 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_destab"] 1.12 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 1.24 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot_on_diag500_destab"] 1.05 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 1.24 (5%) ❌ 1.00 (1%)
["pauli", "mul", "20000000"] 0.90 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 2181 s 0 s 211 s 6852 s 0 s
 #2 2593 MHz 7066 s 0 s 194 s 1986 s 0 s
 Memory: 6.7812042236328125 GB (5089.3203125 MB free)
 Uptime: 933.47 sec
 Load Avg: 1.0 1.0 0.73
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1467
Commit c58e508fddb (2023-06-10 16:12 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5138 s 0 s 225 s 7244 s 0 s
 #2 2593 MHz 7465 s 0 s 207 s 4927 s 0 s
 Memory: 6.7812042236328125 GB (5029.18359375 MB free)
 Uptime: 1270.05 sec
 Load Avg: 1.

@ChenZhao44
Copy link
Contributor

Thanks for the update. Let us keep working on it.

@Krastanov Krastanov merged commit 095c69c into master Jul 11, 2023
@Krastanov Krastanov deleted the nonclifford branch July 11, 2023 22:52
@Krastanov
Copy link
Member Author

@hongyehu , the initial support (including embed) is now merged. Conversion to density matrices is not merged yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Krastanov @ChenZhao44