-
Notifications
You must be signed in to change notification settings - Fork 141
2021 04 09 bench results
Andrea edited this page Apr 9, 2021
·
1 revision
Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM
Benchmark duration per suite: 60s
1 CPU Server
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| rust_tonic_st | 46832 | 1.01 ms | 1.20 ms | 1.30 ms | 1.89 ms | 98.77% | 6.15 MiB |
| java_grpc_pgc | 43904 | 1.08 ms | 1.45 ms | 1.86 ms | 5.04 ms | 100.82% | 108.65 MiB |
| java_grpc_sgc | 40194 | 1.19 ms | 1.67 ms | 2.03 ms | 4.96 ms | 100.88% | 58.77 MiB |
| java_grpc_g1gc | 39849 | 1.20 ms | 1.59 ms | 2.11 ms | 5.55 ms | 100.89% | 86.91 MiB |
| java_grpc_zgc | 39339 | 1.22 ms | 1.54 ms | 1.96 ms | 6.36 ms | 100.86% | 109.27 MiB |
| java_grpc_she | 35048 | 1.37 ms | 1.78 ms | 2.45 ms | 12.50 ms | 100.4% | 314.14 MiB |
| rust_thruster_st | 33216 | 1.44 ms | 1.33 ms | 1.47 ms | 2.08 ms | 89.24% | 7.02 MiB |
| rust_tonic_mt | 32820 | 1.47 ms | 2.24 ms | 2.47 ms | 2.93 ms | 101.58% | 6.13 MiB |
| rust_grpcio | 32526 | 1.48 ms | 1.64 ms | 1.76 ms | 2.22 ms | 97.03% | 17.28 MiB |
| cpp_grpc_st | 29429 | 1.65 ms | 2.00 ms | 2.09 ms | 2.52 ms | 101.85% | 2.94 MiB |
| cpp_grpc_mt | 29113 | 1.67 ms | 2.02 ms | 2.11 ms | 2.53 ms | 102.46% | 3.35 MiB |
| rust_thruster_mt | 28903 | 1.68 ms | 2.61 ms | 2.87 ms | 3.43 ms | 100.56% | 7.23 MiB |
| dotnet_grpc | 28044 | 1.72 ms | 1.78 ms | 2.18 ms | 13.64 ms | 100.86% | 77.59 MiB |
| lua_grpc_st | 17249 | 2.85 ms | 3.83 ms | 4.26 ms | 4.83 ms | 101.24% | 7.57 MiB |
| go_grpc | 14441 | 3.40 ms | 1.91 ms | 3.17 ms | 73.71 ms | 101.36% | 15.27 MiB |
| java_micronaut | 12380 | 3.98 ms | 3.12 ms | 5.01 ms | 63.32 ms | 101.43% | 128.61 MiB |
| node_grpc_st | 11833 | 4.14 ms | 4.48 ms | 5.06 ms | 8.01 ms | 100.81% | 19.35 MiB |
| swift_grpc | 10760 | 4.56 ms | 7.24 ms | 7.55 ms | 8.35 ms | 101.94% | 2.73 MiB |
| dart_grpc | 8304 | 5.96 ms | 25.35 ms | 46.90 ms | 58.95 ms | 101.6% | 25.09 MiB |
| csharp_grpc | 7806 | 6.35 ms | 4.47 ms | 62.58 ms | 76.85 ms | 100.86% | 73.04 MiB |
| kotlin_grpc | 7272 | 6.81 ms | 4.12 ms | 64.46 ms | 79.09 ms | 101.2% | 166.85 MiB |
| node_grpcjs_st | 6402 | 7.72 ms | 10.09 ms | 14.05 ms | 32.41 ms | 101.87% | 30.59 MiB |
| elixir_grpc | 4642 | 10.70 ms | 11.47 ms | 11.98 ms | 15.08 ms | 100.98% | 57.76 MiB |
| java_aot | 3307 | 15.03 ms | 77.79 ms | 92.30 ms | 121.66 ms | 100.89% | 119.1 MiB |
| python_grpc | 2573 | 19.35 ms | 46.15 ms | 48.01 ms | 51.16 ms | 101.93% | 16.55 MiB |
| ruby_grpc | 2414 | 20.62 ms | 41.60 ms | 43.21 ms | 45.50 ms | 102.16% | 17.7 MiB |
| php_grpc | 2357 | 21.13 ms | 85.69 ms | 86.74 ms | 88.55 ms | 101.37% | 40.27 MiB |
| crystal_grpc | 1983 | 25.10 ms | 44.06 ms | 44.17 ms | 44.54 ms | 13.52% | 5.83 MiB |
| scala_akka | 486 | 102.49 ms | 198.11 ms | 297.31 ms | 599.92 ms | 100.52% | 132.9 MiB |
--------------------------------------------------------------------------------------------------------------------------------
2 CPU Server
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| java_grpc_pgc | 70826 | 0.66 ms | 1.10 ms | 1.53 ms | 3.82 ms | 192.34% | 104.61 MiB |
| java_grpc_zgc | 65441 | 0.71 ms | 1.15 ms | 1.51 ms | 3.79 ms | 200.35% | 106.44 MiB |
| java_grpc_g1gc | 64933 | 0.72 ms | 1.24 ms | 1.70 ms | 4.18 ms | 196.42% | 109.87 MiB |
| java_grpc_she | 61228 | 0.77 ms | 1.33 ms | 1.86 ms | 5.10 ms | 196.49% | 350.06 MiB |
| java_grpc_sgc | 58374 | 0.80 ms | 1.34 ms | 1.70 ms | 4.12 ms | 188.76% | 61.98 MiB |
| rust_grpcio | 56117 | 0.84 ms | 1.15 ms | 1.24 ms | 1.74 ms | 202.42% | 13.01 MiB |
| cpp_grpc_mt | 47365 | 1.00 ms | 1.24 ms | 1.52 ms | 16.56 ms | 206.44% | 7.73 MiB |
| rust_tonic_st | 47164 | 1.00 ms | 1.17 ms | 1.27 ms | 1.82 ms | 101.72% | 4.04 MiB |
| rust_tonic_mt | 42746 | 1.12 ms | 1.70 ms | 1.89 ms | 2.31 ms | 197.93% | 4.73 MiB |
| rust_thruster_st | 42237 | 1.13 ms | 1.28 ms | 1.39 ms | 1.97 ms | 100.38% | 5.55 MiB |
| dotnet_grpc | 42152 | 1.13 ms | 1.45 ms | 1.77 ms | 3.65 ms | 196.43% | 93.4 MiB |
| rust_thruster_mt | 39169 | 1.22 ms | 1.87 ms | 2.08 ms | 2.55 ms | 196.78% | 5.56 MiB |
| go_grpc | 29171 | 1.65 ms | 1.61 ms | 2.18 ms | 43.90 ms | 205.06% | 14.26 MiB |
| cpp_grpc_st | 28880 | 1.68 ms | 2.06 ms | 2.17 ms | 2.50 ms | 101.5% | 3.03 MiB |
| java_micronaut | 19986 | 2.44 ms | 2.25 ms | 3.18 ms | 48.02 ms | 205.38% | 146.04 MiB |
| swift_grpc | 19969 | 2.43 ms | 3.87 ms | 4.02 ms | 4.95 ms | 202.03% | 3.0 MiB |
| lua_grpc_st | 18722 | 2.62 ms | 3.53 ms | 3.87 ms | 4.48 ms | 101.64% | 7.67 MiB |
| csharp_grpc | 16119 | 3.04 ms | 2.52 ms | 4.12 ms | 53.49 ms | 204.92% | 75.2 MiB |
| kotlin_grpc | 12907 | 3.80 ms | 2.77 ms | 4.57 ms | 66.34 ms | 204.92% | 182.27 MiB |
| node_grpc_st | 12405 | 3.93 ms | 4.23 ms | 4.36 ms | 5.60 ms | 101.82% | 19.0 MiB |
| dart_grpc | 9819 | 5.04 ms | 25.24 ms | 36.21 ms | 49.60 ms | 113.79% | 25.51 MiB |
| elixir_grpc | 9049 | 5.46 ms | 7.22 ms | 7.75 ms | 9.25 ms | 203.18% | 56.87 MiB |
| node_grpcjs_st | 8055 | 6.11 ms | 7.20 ms | 8.60 ms | 11.54 ms | 118.84% | 30.76 MiB |
| java_aot | 7810 | 6.32 ms | 4.35 ms | 54.50 ms | 86.34 ms | 201.76% | 120.57 MiB |
| php_grpc | 4549 | 10.91 ms | 66.80 ms | 70.29 ms | 71.89 ms | 204.63% | 39.89 MiB |
| python_grpc | 4327 | 11.48 ms | 13.09 ms | 13.70 ms | 16.26 ms | 150.82% | 16.27 MiB |
| ruby_grpc | 2693 | 18.46 ms | 21.59 ms | 22.20 ms | 23.52 ms | 135.31% | 17.77 MiB |
| scala_akka | 2383 | 20.88 ms | 77.75 ms | 81.93 ms | 100.43 ms | 203.17% | 129.54 MiB |
| crystal_grpc | 1841 | 27.03 ms | 44.11 ms | 44.26 ms | 47.78 ms | 16.75% | 5.73 MiB |
--------------------------------------------------------------------------------------------------------------------------------
3 CPU Server (it's the best we could do with our resources, still it was not enough to properly stress all implementations)
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| java_grpc_pgc | 77272 | 0.59 ms | 1.09 ms | 1.46 ms | 3.23 ms | 242.34% | 155.47 MiB |
| java_grpc_zgc | 74253 | 0.62 ms | 1.10 ms | 1.51 ms | 3.58 ms | 260.14% | 115.98 MiB |
| rust_grpcio | 74021 | 0.62 ms | 0.90 ms | 1.09 ms | 2.02 ms | 262.05% | 12.08 MiB |
| java_grpc_g1gc | 73655 | 0.63 ms | 1.21 ms | 1.64 ms | 3.65 ms | 253.33% | 112.04 MiB |
| java_grpc_she | 70913 | 0.65 ms | 1.26 ms | 1.72 ms | 4.16 ms | 262.25% | 361.18 MiB |
| java_grpc_sgc | 69742 | 0.67 ms | 1.27 ms | 1.67 ms | 3.59 ms | 241.1% | 66.88 MiB |
| cpp_grpc_mt | 67485 | 0.69 ms | 1.10 ms | 1.32 ms | 2.29 ms | 287.49% | 8.49 MiB |
| rust_tonic_mt | 56375 | 0.84 ms | 1.28 ms | 1.44 ms | 1.97 ms | 264.84% | 4.63 MiB |
| dotnet_grpc | 50161 | 0.94 ms | 1.31 ms | 1.54 ms | 3.16 ms | 273.89% | 103.0 MiB |
| go_grpc | 48455 | 0.97 ms | 1.39 ms | 1.83 ms | 10.47 ms | 309.33% | 14.93 MiB |
| rust_thruster_mt | 46907 | 1.01 ms | 1.53 ms | 1.71 ms | 2.24 ms | 268.79% | 5.87 MiB |
| rust_tonic_st | 46594 | 1.02 ms | 1.20 ms | 1.30 ms | 1.83 ms | 100.43% | 3.84 MiB |
| rust_thruster_st | 42261 | 1.13 ms | 1.29 ms | 1.40 ms | 1.98 ms | 101.39% | 5.39 MiB |
| java_micronaut | 29539 | 1.63 ms | 2.04 ms | 2.80 ms | 33.31 ms | 306.14% | 138.58 MiB |
| cpp_grpc_st | 28816 | 1.68 ms | 2.10 ms | 2.22 ms | 2.59 ms | 102.38% | 3.12 MiB |
| swift_grpc | 27643 | 1.75 ms | 2.18 ms | 2.29 ms | 2.84 ms | 299.89% | 3.23 MiB |
| csharp_grpc | 27090 | 1.79 ms | 2.00 ms | 3.02 ms | 33.52 ms | 309.58% | 76.74 MiB |
| kotlin_grpc | 22410 | 2.17 ms | 2.27 ms | 3.28 ms | 45.22 ms | 307.05% | 189.04 MiB |
| lua_grpc_st | 19245 | 2.55 ms | 3.43 ms | 3.76 ms | 4.41 ms | 101.58% | 7.3 MiB |
| java_aot | 14348 | 3.41 ms | 2.77 ms | 9.05 ms | 58.57 ms | 302.21% | 119.47 MiB |
| elixir_grpc | 12837 | 3.84 ms | 5.25 ms | 5.99 ms | 7.37 ms | 307.61% | 59.1 MiB |
| node_grpc_st | 12091 | 4.04 ms | 4.33 ms | 4.46 ms | 5.65 ms | 103.67% | 19.69 MiB |
| dart_grpc | 9763 | 5.07 ms | 23.47 ms | 36.87 ms | 49.91 ms | 113.42% | 25.19 MiB |
| node_grpcjs_st | 7773 | 6.33 ms | 7.43 ms | 8.90 ms | 11.79 ms | 117.48% | 29.98 MiB |
| php_grpc | 7559 | 6.55 ms | 5.11 ms | 51.77 ms | 54.46 ms | 311.58% | 40.07 MiB |
| scala_akka | 5293 | 9.37 ms | 12.21 ms | 59.05 ms | 75.65 ms | 302.27% | 145.43 MiB |
| python_grpc | 4281 | 11.61 ms | 13.30 ms | 13.80 ms | 16.29 ms | 149.62% | 16.14 MiB |
| ruby_grpc | 2677 | 18.57 ms | 21.72 ms | 22.34 ms | 23.72 ms | 135.25% | 17.81 MiB |
| crystal_grpc | 1979 | 25.13 ms | 44.10 ms | 44.26 ms | 47.72 ms | 15.31% | 5.88 MiB |
--------------------------------------------------------------------------------------------------------------------------------