Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

initial implementation of stab_to_ket and cliff_to_unitary #120

Merged
merged 7 commits into from
Jul 12, 2023

Conversation

Krastanov
Copy link
Member

a few TODOs left in

main goal is to move this away from QuantumSymbolics

it requires some upstreaming to QuantumOptics

@codecov
Copy link

codecov bot commented May 24, 2023

Codecov Report

Merging #120 (7966951) into master (095c69c) will increase coverage by 0.76%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #120      +/-   ##
==========================================
+ Coverage   86.08%   86.84%   +0.76%     
==========================================
  Files          36       37       +1     
  Lines        3082     3154      +72     
==========================================
+ Hits         2653     2739      +86     
+ Misses        429      415      -14     
Impacted Files Coverage Δ
src/QuantumClifford.jl 90.17% <ø> (ø)
...tumCliffordQOpticsExt/QuantumCliffordQOpticsExt.jl 100.00% <100.00%> (ø)
src/nonclifford.jl 93.57% <100.00%> (+14.19%) ⬆️
src/useful_states.jl 95.89% <100.00%> (+0.57%) ⬆️

... and 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions
Copy link
Contributor

github-actions bot commented May 24, 2023

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 24 May 2023 - 21:14
  • Baseline: 24 May 2023 - 21:19
  • Package commits:
  • Target: 82b352
  • Baseline: c9c686
  • Julia commits:
  • Target: aea56a
  • Baseline: aea56a
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 1.06 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 1.06 (5%) ❌ 1.00 (1%)
["pauli", "mul", "100"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1366
Commit aea56a9d954 (2023-05-24 15:01 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6353 s 0 s 186 s 1866 s 0 s
 #2 2793 MHz 2262 s 0 s 176 s 5970 s 0 s
 Memory: 6.781208038330078 GB (4953.890625 MB free)
 Uptime: 847.78 sec
 Load Avg: 1.0 1.0 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1366
Commit aea56a9d954 (2023-05-24 15:01 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6698 s 0 s 196 s 4614 s 0 s
 #2 2793 MHz 5018 s 0 s 189 s 6310 s 0 s
 Memory: 6.781208038330078 GB (4887.96484375 MB free)
 Uptime: 1158.86 sec
 Load Avg: 1.0 1.0 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 24 May 2023 - 21:14
  • Package commit: 82b352
  • Julia commit: aea56a
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.582 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 261.500 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.809 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 182.300 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.777 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 179.800 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 92.099 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 824.199 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 10.387 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.500 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 71.700 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 791.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 10.333 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.275 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 38.900 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 765.800 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 10.316 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.962 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 20.852 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 10.191 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.271 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 540.399 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 58.200 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 27.599 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 32.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 16.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 20.905 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 10.191 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.076 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 540.300 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.214 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.106 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.820 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 927.500 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.125 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.587 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.125 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.587 μs (5%)
["pauli", "mul", "100"] 17.133 ns (5%)
["pauli", "mul", "1000"] 30.584 ns (5%)
["pauli", "mul", "100000"] 950.000 ns (5%)
["pauli", "mul", "20000000"] 409.000 μs (5%)
["stabilizer", "canon", "cano500"] 4.967 ms (5%)
["stabilizer", "canon", "diag_cano500"] 623.100 μs (5%)
["stabilizer", "canon", "diag_gott500"] 11.516 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 517.601 μs (5%)
["stabilizer", "canon", "gott500"] 16.051 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.215 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.222 ms (5%)
["stabilizer", "canon", "rref500"] 5.034 ms (5%)
["stabilizer", "project", "destabilizer"] 26.700 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 12.100 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.736 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.725 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 45.900 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.933 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1366
Commit aea56a9d954 (2023-05-24 15:01 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6353 s 0 s 186 s 1866 s 0 s
 #2 2793 MHz 2262 s 0 s 176 s 5970 s 0 s
 Memory: 6.781208038330078 GB (4953.890625 MB free)
 Uptime: 847.78 sec
 Load Avg: 1.0 1.0 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 24 May 2023 - 21:19
  • Package commit: c9c686
  • Julia commit: aea56a
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.481 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 254.100 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.770 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 183.900 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.747 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 179.900 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 87.200 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 803.300 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 10.336 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.000 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 71.000 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 784.801 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 10.398 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 7.250 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 38.500 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 750.000 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 10.290 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.950 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 20.823 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 10.013 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.273 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 540.700 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 57.800 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 27.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 32.600 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 16.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 20.851 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 10.019 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.077 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 540.701 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.189 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.115 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.815 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 926.400 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.150 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.575 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.075 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.538 μs (5%)
["pauli", "mul", "100"] 16.232 ns (5%)
["pauli", "mul", "1000"] 30.483 ns (5%)
["pauli", "mul", "100000"] 962.500 ns (5%)
["pauli", "mul", "20000000"] 415.500 μs (5%)
["stabilizer", "canon", "cano500"] 4.894 ms (5%)
["stabilizer", "canon", "diag_cano500"] 628.200 μs (5%)
["stabilizer", "canon", "diag_gott500"] 11.479 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 509.500 μs (5%)
["stabilizer", "canon", "gott500"] 16.063 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 2.269 ms (5%)
["stabilizer", "canon", "md_rref500"] 2.245 ms (5%)
["stabilizer", "canon", "rref500"] 4.992 ms (5%)
["stabilizer", "project", "destabilizer"] 26.100 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 12.400 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.869 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.712 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 47.000 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.867 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1366
Commit aea56a9d954 (2023-05-24 15:01 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6698 s 0 s 196 s 4614 s 0 s
 #2 2793 MHz 5018 s 0 s 189 s 6310 s 0 s
 Memory: 6.781208038330078 GB (4887.96484375 MB free)
 Uptime: 1158.86 sec
 Load Avg: 1.0 1.0 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 15 Jun 2023 - 02:08
  • Baseline: 15 Jun 2023 - 02:13
  • Package commits:
  • Target: 4e67cb
  • Baseline: cd7e90
  • Julia commits:
  • Target: 9e4349
  • Baseline: 9e4349
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.92 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.93 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 0.87 (5%) ✅ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 0.87 (5%) ✅ 1.00 (1%)
["pauli", "mul", "1000"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1490
Commit 9e43494bdc0 (2023-06-14 22:37 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 1592 s 0 s 158 s 6653 s 0 s
 #2 2793 MHz 6844 s 0 s 213 s 1336 s 0 s
 Memory: 6.7812042236328125 GB (5089.72265625 MB free)
 Uptime: 848.5 sec
 Load Avg: 1.0 1.0 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1490
Commit 9e43494bdc0 (2023-06-14 22:37 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4274 s 0 s 170 s 6991 s 0 s
 #2 2793 MHz 7188 s 0 s 222 s 4009 s 0 s
 Memory: 6.7812042236328125 GB (5052.828125 MB free)
 Uptime: 1151.69 sec
 Load Avg: 1.0 1.0 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 15 Jun 2023 - 2:8
  • Package commit: 4e67cb
  • Julia commit: 9e4349
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.514 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 259.001 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.800 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 183.601 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.704 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 179.901 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 82.300 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.024 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 11.990 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 8.500 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 66.700 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.002 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 12.000 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 6.840 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 34.400 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 974.105 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 11.954 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.513 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 16.016 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.531 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.261 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 635.003 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 57.600 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 28.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 32.500 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 16.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 16.006 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.531 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.066 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 634.303 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.196 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.299 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.827 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.115 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.200 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 4.514 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.125 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 4.486 μs (5%)
["pauli", "mul", "100"] 17.535 ns (5%)
["pauli", "mul", "1000"] 28.844 ns (5%)
["pauli", "mul", "100000"] 952.174 ns (5%)
["pauli", "mul", "20000000"] 391.101 μs (5%)
["stabilizer", "canon", "cano500"] 4.622 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.057 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.273 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.088 ms (5%)
["stabilizer", "canon", "gott500"] 15.113 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.955 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.983 ms (5%)
["stabilizer", "canon", "rref500"] 4.761 ms (5%)
["stabilizer", "project", "destabilizer"] 23.300 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.600 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.329 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.000 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 37.600 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.940 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1490
Commit 9e43494bdc0 (2023-06-14 22:37 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 1592 s 0 s 158 s 6653 s 0 s
 #2 2793 MHz 6844 s 0 s 213 s 1336 s 0 s
 Memory: 6.7812042236328125 GB (5089.72265625 MB free)
 Uptime: 848.5 sec
 Load Avg: 1.0 1.0 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 15 Jun 2023 - 2:13
  • Package commit: cd7e90
  • Julia commit: 9e4349
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.660 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 260.001 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.840 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 183.100 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.737 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 179.701 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 89.100 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 1.029 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 12.065 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 9.100 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 69.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.016 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 12.117 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 6.820 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 34.200 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 971.304 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 11.959 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 3.525 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.973 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_dense500_stab"] 8.571 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_destab"] 1.261 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot250_on_diag500_stab"] 732.103 μs (5%) 608 bytes (1%) 6
["clifford", "dense", "cnot_on_dense500_destab"] 57.700 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_dense500_stab"] 28.300 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_destab"] 33.000 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "cnot_on_diag500_stab"] 16.400 μs (5%) 464 bytes (1%) 7
["clifford", "dense", "dense500_on_dense500_destab"] 16.003 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_dense500_stab"] 8.563 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_destab"] 1.066 ms (5%) 608 bytes (1%) 6
["clifford", "dense", "dense500_on_diag500_stab"] 731.903 μs (5%) 608 bytes (1%) 6
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.197 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.300 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.829 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 1.117 ms (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 7.200 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 4.514 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 7.125 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 4.486 μs (5%)
["pauli", "mul", "100"] 17.836 ns (5%)
["pauli", "mul", "1000"] 30.653 ns (5%)
["pauli", "mul", "100000"] 956.522 ns (5%)
["pauli", "mul", "20000000"] 385.402 μs (5%)
["stabilizer", "canon", "cano500"] 4.630 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.056 ms (5%)
["stabilizer", "canon", "diag_gott500"] 11.270 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.086 ms (5%)
["stabilizer", "canon", "gott500"] 15.077 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.993 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.970 ms (5%)
["stabilizer", "canon", "rref500"] 4.699 ms (5%)
["stabilizer", "project", "destabilizer"] 23.200 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.600 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.256 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 4.029 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 37.700 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.820 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.0-DEV.1490
Commit 9e43494bdc0 (2023-06-14 22:37 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1038-azure #45-Ubuntu SMP Mon Apr 24 15:40:42 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4274 s 0 s 170 s 6991 s 0 s
 #2 2793 MHz 7188 s 0 s 222 s 4009 s 0 s
 Memory: 6.7812042236328125 GB (5052.828125 MB free)
 Uptime: 1151.69 sec
 Load Avg: 1.0 1.0 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 12 Jul 2023 - 14:53
  • Baseline: 12 Jul 2023 - 14:57
  • Package commits:
  • Target: d29095
  • Baseline: 095c69
  • Julia commits:
  • Target: 4995d3
  • Baseline: 4995d3
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 1.06 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 0.91 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.93 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 0.90 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 0.93 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 0.88 (5%) ✅ 1.00 (1%)
["pauli", "mul", "100"] 0.90 (5%) ✅ 1.00 (1%)
["pauli", "mul", "1000"] 0.92 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 1933 s 0 s 159 s 6965 s 0 s
 #2 2793 MHz 6209 s 0 s 190 s 2672 s 0 s
 Memory: 6.7694854736328125 GB (5074.92578125 MB free)
 Uptime: 912.89 sec
 Load Avg: 1.0 0.99 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4581 s 0 s 165 s 6994 s 0 s
 #2 2793 MHz 6244 s 0 s 194 s 5308 s 0 s
 Memory: 6.7694854736328125 GB (5021.48046875 MB free)
 Uptime: 1181.18 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 12 Jul 2023 - 14:53
  • Package commit: d29095
  • Julia commit: 4995d3
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.250 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 259.500 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.349 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.800 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.364 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.201 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 77.600 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 217.301 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.385 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.900 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 40.400 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 175.699 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.335 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.054 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.114 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.500 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 161.800 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.321 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.220 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.143 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.065 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 638.102 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 59.300 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.600 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.200 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.219 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.155 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.066 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 638.402 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.134 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.057 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.764 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 864.402 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.900 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.275 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.860 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 16.233 ns (5%)
["pauli", "mul", "1000"] 29.950 ns (5%)
["pauli", "mul", "100000"] 948.148 ns (5%)
["pauli", "mul", "20000000"] 406.101 μs (5%)
["stabilizer", "canon", "cano500"] 4.564 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.051 ms (5%)
["stabilizer", "canon", "diag_gott500"] 10.927 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.089 ms (5%)
["stabilizer", "canon", "gott500"] 14.582 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.883 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.919 ms (5%)
["stabilizer", "canon", "rref500"] 4.635 ms (5%)
["stabilizer", "project", "destabilizer"] 23.000 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.800 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.253 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.900 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 34.800 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.620 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 1933 s 0 s 159 s 6965 s 0 s
 #2 2793 MHz 6209 s 0 s 190 s 2672 s 0 s
 Memory: 6.7694854736328125 GB (5074.92578125 MB free)
 Uptime: 912.89 sec
 Load Avg: 1.0 0.99 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 12 Jul 2023 - 14:57
  • Package commit: 095c69
  • Julia commit: 4995d3
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.187 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 260.300 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.409 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 174.100 μs (5%) 288 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q1001_r1"] 22.315 ms (5%) 544 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q101_r1"] 173.400 μs (5%) 288 bytes (1%) 7
["circuitsim", "pftrajectories", "q1001_r1"] 73.200 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 225.901 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.521 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 7.525 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 41.600 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 188.000 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.488 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 10.082 ms (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.229 μs (5%) 48 bytes (1%) 1
["circuitsim", "pftrajectories_union", "q1001_r1"] 27.500 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 173.200 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.493 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.822 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 15.234 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 8.158 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 1.065 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 638.202 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 59.000 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 27.700 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 31.100 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 15.900 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 15.220 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 8.169 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 1.065 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 638.101 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 2.133 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 1.058 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.767 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 867.202 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 6.900 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 3.300 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 6.880 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 3.300 μs (5%)
["pauli", "mul", "100"] 18.036 ns (5%)
["pauli", "mul", "1000"] 32.563 ns (5%)
["pauli", "mul", "100000"] 948.148 ns (5%)
["pauli", "mul", "20000000"] 392.000 μs (5%)
["stabilizer", "canon", "cano500"] 4.555 ms (5%)
["stabilizer", "canon", "diag_cano500"] 1.050 ms (5%)
["stabilizer", "canon", "diag_gott500"] 10.921 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 1.090 ms (5%)
["stabilizer", "canon", "gott500"] 14.658 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.908 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.900 ms (5%)
["stabilizer", "canon", "rref500"] 4.621 ms (5%)
["stabilizer", "project", "destabilizer"] 23.000 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 10.800 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 2.225 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 3.862 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 35.200 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 10.600 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4581 s 0 s 165 s 6994 s 0 s
 #2 2793 MHz 6244 s 0 s 194 s 5308 s 0 s
 Memory: 6.7694854736328125 GB (5021.48046875 MB free)
 Uptime: 1181.18 sec
 Load Avg: 1.0 1.0 0.78
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 12 Jul 2023 - 21:50
  • Baseline: 12 Jul 2023 - 21:55
  • Package commits:
  • Target: 7ba963
  • Baseline: 095c69
  • Julia commits:
  • Target: 4995d3
  • Baseline: 4995d3
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r100"] 1.10 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 1.10 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 1.06 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.10 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 1.07 (5%) ❌ 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.10 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 0.89 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_destab"] 1.11 (5%) ❌ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 0.89 (5%) ✅ 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 0.93 (5%) ✅ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6437 s 0 s 173 s 1574 s 0 s
 #2 2793 MHz 1822 s 0 s 168 s 6179 s 0 s
 Memory: 6.7694854736328125 GB (5106.875 MB free)
 Uptime: 825.14 sec
 Load Avg: 1.01 1.0 0.7
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.11.0-DEV.63
Commit 4995d3f5c0b (2023-07-12 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1041-azure #48-Ubuntu SMP Tue Jun 20 20:34:08 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 9360 s 0 s 181 s 1644 s 0 s
 #2 2793 MHz 1898 s 0 s 177 s 9087 s 0 s
 Memory: 6.7694854736328125 GB (5065.0078125 MB free)
 Uptime: 1125.35 sec
 Load Avg: 1.0 1.0 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 12 Jul 2023 - 21:50
  • Package commit: 7ba963
  • Julia commit: 4995d3
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 23.157 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 257.101 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 22.398 ms (5%) 544 bytes (1%) 8
`["circuitsim", "mctrajectories_sumtype",

@Krastanov Krastanov marked this pull request as ready for review July 12, 2023 23:24
@Krastanov Krastanov merged commit 801511a into master Jul 12, 2023
@Krastanov Krastanov deleted the stab_to_ket branch July 12, 2023 23:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant