-
Notifications
You must be signed in to change notification settings - Fork 141
2021 12 10 bench results
Andrea edited this page Dec 10, 2021
·
1 revision
Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM
Config:
0d5af97 Mon, 22 Nov 2021 10:23:37 +0100 LesnyRumcajs update maintained node bench
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=3
- GRPC_SERVER_RAM=512m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=9
- GRPC_REQUEST_PAYLOAD=100B
1 CPU Server
-----------------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| rust_tonic_st | 53544 | 18.40 ms | 21.47 ms | 23.12 ms | 25.41 ms | 100.93% | 16.81 MiB |
| rust_thruster_st | 47571 | 20.79 ms | 23.64 ms | 26.89 ms | 29.54 ms | 101.16% | 13.72 MiB |
| rust_tonic_mt | 44946 | 22.03 ms | 9.46 ms | 10.97 ms | 541.28 ms | 101.97% | 18.26 MiB |
| rust_thruster_mt | 40265 | 24.64 ms | 10.53 ms | 11.91 ms | 617.00 ms | 100.28% | 15.25 MiB |
| scala_akka | 38729 | 24.66 ms | 61.24 ms | 70.91 ms | 94.27 ms | 102.36% | 225.68 MiB |
| java_quarkus | 36962 | 26.56 ms | 48.82 ms | 53.24 ms | 75.13 ms | 101.03% | 110.43 MiB |
| rust_grpcio | 35974 | 27.54 ms | 30.27 ms | 31.39 ms | 33.99 ms | 102.31% | 26.97 MiB |
| java_hotspot_grpc_pgc | 34094 | 28.90 ms | 54.43 ms | 67.28 ms | 91.66 ms | 102.32% | 196.98 MiB |
| java_hotspot_grpc_g1gc | 31354 | 31.56 ms | 58.19 ms | 67.40 ms | 94.72 ms | 101.61% | 168.84 MiB |
| cpp_grpc_mt | 31337 | 31.81 ms | 36.10 ms | 37.10 ms | 39.42 ms | 102.19% | 10.81 MiB |
| dotnet_grpc | 30931 | 30.03 ms | 52.91 ms | 71.37 ms | 83.28 ms | 100.42% | 95.43 MiB |
| cpp_grpc_st | 30443 | 32.75 ms | 36.28 ms | 38.07 ms | 40.73 ms | 102.21% | 9.29 MiB |
| java_hotspot_grpc_she | 29821 | 33.18 ms | 62.94 ms | 75.34 ms | 91.63 ms | 101.47% | 402.79 MiB |
| cpp_asio_grpc | 29567 | 33.72 ms | 38.84 ms | 39.86 ms | 43.00 ms | 102.54% | 9.23 MiB |
| java_hotspot_grpc_zgc | 29421 | 33.61 ms | 61.66 ms | 81.87 ms | 100.83 ms | 101.43% | 131.45 MiB |
| java_openj9_grpc_gencon | 28222 | 34.95 ms | 69.45 ms | 83.35 ms | 94.87 ms | 97.12% | 124.29 MiB |
| java_hotspot_grpc_sgc | 25070 | 39.51 ms | 68.89 ms | 75.95 ms | 92.10 ms | 101.54% | 86.81 MiB |
| crystal_grpc | 22300 | 44.05 ms | 51.91 ms | 55.04 ms | 58.92 ms | 115.47% | 34.94 MiB |
| kotlin_grpc | 17792 | 55.65 ms | 95.69 ms | 101.20 ms | 118.67 ms | 101.39% | 214.53 MiB |
| go_grpc | 14479 | 65.52 ms | 103.27 ms | 114.24 ms | 195.39 ms | 96.24% | 31.35 MiB |
| java_micronaut | 13225 | 75.27 ms | 100.73 ms | 109.12 ms | 190.87 ms | 101.27% | 467.85 MiB |
| java_micronaut_workstealing | 12450 | 79.97 ms | 97.18 ms | 105.15 ms | 181.53 ms | 102.05% | 452.26 MiB |
| swift_grpc | 12372 | 80.61 ms | 82.38 ms | 83.05 ms | 84.72 ms | 101.3% | 6.66 MiB |
| haskell_mu | 11065 | 90.21 ms | 107.95 ms | 114.52 ms | 131.50 ms | 101.66% | 119.22 MiB |
| php_swoole_grpc | 8996 | 110.99 ms | 125.47 ms | 127.40 ms | 132.78 ms | 100.71% | 13.35 MiB |
| scala_zio | 5976 | 166.74 ms | 224.39 ms | 298.81 ms | 397.77 ms | 100.37% | 264.58 MiB |
| elixir_grpc | 5303 | 188.15 ms | 214.61 ms | 220.20 ms | 235.31 ms | 101.21% | 83.1 MiB |
| node_grpcjs_st | 5115 | 194.89 ms | 213.51 ms | 218.54 ms | 229.53 ms | 100.25% | 47.28 MiB |
| csharp_grpc | 4943 | 201.80 ms | 220.17 ms | 264.48 ms | 280.15 ms | 102.2% | 101.96 MiB |
| scala_fs2 | 2994 | 332.95 ms | 384.60 ms | 489.15 ms | 582.98 ms | 101.97% | 216.28 MiB |
| python_async_grpc | 2750 | 362.44 ms | 391.42 ms | 395.98 ms | 404.20 ms | 101.72% | 59.25 MiB |
| python_grpc | 2350 | 423.80 ms | 461.48 ms | 467.83 ms | 479.50 ms | 101.75% | 35.44 MiB |
| ruby_grpc | 1932 | 515.21 ms | 586.00 ms | 610.34 ms | 692.65 ms | 97.05% | 31.39 MiB |
| java_aot | 1728 | 575.02 ms | 983.24 ms | 1.10 s | 1.39 s | 101.24% | 193.96 MiB |
| php_grpc | 1541 | 645.12 ms | 697.62 ms | 698.95 ms | 701.67 ms | 101.44% | 68.51 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
2 CPU Server
-----------------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| scala_akka | 83491 | 9.77 ms | 19.36 ms | 26.53 ms | 56.99 ms | 200.61% | 239.96 MiB |
| cpp_grpc_mt | 69929 | 12.75 ms | 25.91 ms | 30.49 ms | 37.22 ms | 203.28% | 32.35 MiB |
| rust_tonic_mt | 69155 | 13.64 ms | 36.78 ms | 57.26 ms | 87.06 ms | 200.66% | 21.22 MiB |
| cpp_asio_grpc | 68399 | 13.25 ms | 24.72 ms | 29.42 ms | 36.99 ms | 204.0% | 33.98 MiB |
| rust_thruster_mt | 64066 | 14.74 ms | 39.89 ms | 61.06 ms | 88.89 ms | 199.81% | 15.08 MiB |
| java_hotspot_grpc_pgc | 61623 | 15.06 ms | 34.91 ms | 43.60 ms | 65.32 ms | 203.47% | 204.29 MiB |
| dotnet_grpc | 60423 | 14.58 ms | 20.93 ms | 29.13 ms | 43.94 ms | 201.41% | 167.2 MiB |
| rust_grpcio | 56358 | 17.20 ms | 23.25 ms | 26.39 ms | 30.89 ms | 204.5% | 43.61 MiB |
| java_hotspot_grpc_g1gc | 56330 | 16.60 ms | 44.87 ms | 59.19 ms | 70.24 ms | 202.81% | 175.94 MiB |
| rust_tonic_st | 53654 | 18.37 ms | 22.33 ms | 23.44 ms | 25.82 ms | 102.01% | 15.16 MiB |
| java_hotspot_grpc_she | 52875 | 17.78 ms | 43.08 ms | 53.07 ms | 67.15 ms | 203.68% | 404.46 MiB |
| java_openj9_grpc_gencon | 52098 | 17.91 ms | 44.89 ms | 55.34 ms | 66.17 ms | 203.15% | 139.58 MiB |
| java_hotspot_grpc_zgc | 51746 | 18.21 ms | 41.93 ms | 50.35 ms | 66.99 ms | 203.29% | 113.19 MiB |
| java_quarkus | 49740 | 19.10 ms | 40.13 ms | 43.73 ms | 50.89 ms | 163.1% | 108.79 MiB |
| java_hotspot_grpc_sgc | 49160 | 19.40 ms | 35.52 ms | 41.00 ms | 57.38 ms | 200.5% | 90.38 MiB |
| rust_thruster_st | 47548 | 20.79 ms | 25.47 ms | 26.75 ms | 29.01 ms | 101.27% | 12.48 MiB |
| kotlin_grpc | 44139 | 21.59 ms | 66.58 ms | 74.27 ms | 82.28 ms | 202.9% | 216.14 MiB |
| go_grpc | 40033 | 21.38 ms | 63.54 ms | 69.77 ms | 79.52 ms | 203.6% | 31.14 MiB |
| cpp_grpc_st | 31493 | 31.65 ms | 36.07 ms | 37.14 ms | 38.91 ms | 102.72% | 8.96 MiB |
| java_micronaut | 23733 | 41.49 ms | 69.19 ms | 76.29 ms | 88.38 ms | 176.4% | 502.99 MiB |
| swift_grpc | 23311 | 42.70 ms | 44.98 ms | 45.73 ms | 47.32 ms | 201.1% | 6.36 MiB |
| crystal_grpc | 22383 | 43.86 ms | 51.76 ms | 54.34 ms | 57.91 ms | 107.68% | 35.66 MiB |
| java_micronaut_workstealing | 22324 | 44.19 ms | 69.39 ms | 76.23 ms | 86.58 ms | 160.78% | 500.11 MiB |
| haskell_mu | 18138 | 54.97 ms | 76.44 ms | 81.03 ms | 90.88 ms | 204.03% | 177.27 MiB |
| csharp_grpc | 15490 | 63.94 ms | 91.70 ms | 96.04 ms | 103.04 ms | 204.82% | 105.01 MiB |
| scala_zio | 10809 | 91.44 ms | 123.29 ms | 181.56 ms | 278.91 ms | 202.44% | 264.45 MiB |
| scala_fs2 | 10421 | 95.59 ms | 74.94 ms | 82.74 ms | 110.66 ms | 205.03% | 234.54 MiB |
| elixir_grpc | 9864 | 101.20 ms | 117.11 ms | 122.33 ms | 132.94 ms | 204.28% | 87.84 MiB |
| php_swoole_grpc | 9127 | 109.39 ms | 124.59 ms | 126.12 ms | 132.54 ms | 101.04% | 13.19 MiB |
| java_aot | 6797 | 145.72 ms | 279.91 ms | 305.97 ms | 399.81 ms | 192.41% | 215.43 MiB |
| node_grpcjs_st | 6614 | 150.71 ms | 162.87 ms | 164.72 ms | 169.43 ms | 113.52% | 47.32 MiB |
| python_async_grpc | 5227 | 190.90 ms | 205.59 ms | 210.49 ms | 219.51 ms | 154.69% | 82.76 MiB |
| python_grpc | 4472 | 223.10 ms | 248.28 ms | 251.58 ms | 259.01 ms | 154.96% | 34.6 MiB |
| php_grpc | 3935 | 253.45 ms | 289.54 ms | 290.76 ms | 293.06 ms | 204.33% | 66.95 MiB |
| ruby_grpc | 2569 | 387.70 ms | 422.41 ms | 432.34 ms | 497.07 ms | 132.65% | 31.42 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
3 CPU Server
-----------------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| scala_akka | 94537 | 8.10 ms | 14.29 ms | 18.34 ms | 28.56 ms | 223.63% | 235.24 MiB |
| cpp_grpc_mt | 92771 | 7.98 ms | 14.96 ms | 19.00 ms | 28.42 ms | 268.95% | 43.45 MiB |
| cpp_asio_grpc | 92092 | 8.08 ms | 15.04 ms | 19.04 ms | 28.53 ms | 277.8% | 43.67 MiB |
| java_hotspot_grpc_pgc | 91381 | 8.28 ms | 16.84 ms | 21.53 ms | 30.82 ms | 281.72% | 202.84 MiB |
| java_hotspot_grpc_g1gc | 88383 | 8.78 ms | 17.54 ms | 23.73 ms | 38.18 ms | 296.19% | 218.25 MiB |
| rust_tonic_mt | 87750 | 10.14 ms | 20.45 ms | 27.61 ms | 42.19 ms | 274.7% | 22.4 MiB |
| dotnet_grpc | 85526 | 9.23 ms | 14.36 ms | 17.68 ms | 25.93 ms | 282.69% | 155.91 MiB |
| java_hotspot_grpc_she | 84936 | 9.41 ms | 18.79 ms | 24.36 ms | 38.52 ms | 304.08% | 409.84 MiB |
| java_hotspot_grpc_zgc | 83550 | 9.41 ms | 20.63 ms | 28.85 ms | 47.94 ms | 303.32% | 133.41 MiB |
| java_openj9_grpc_gencon | 83188 | 9.45 ms | 19.37 ms | 24.93 ms | 36.44 ms | 306.26% | 146.19 MiB |
| rust_grpcio | 81697 | 10.79 ms | 16.86 ms | 20.28 ms | 28.40 ms | 282.75% | 44.27 MiB |
| rust_thruster_mt | 80478 | 11.15 ms | 22.50 ms | 29.75 ms | 45.51 ms | 273.79% | 16.53 MiB |
| go_grpc | 78239 | 9.66 ms | 20.75 ms | 25.49 ms | 33.67 ms | 290.51% | 29.49 MiB |
| kotlin_grpc | 74511 | 10.78 ms | 25.48 ms | 37.05 ms | 55.64 ms | 307.59% | 223.54 MiB |
| java_hotspot_grpc_sgc | 63388 | 13.89 ms | 28.61 ms | 33.48 ms | 41.61 ms | 256.9% | 101.9 MiB |
| java_quarkus | 58240 | 15.58 ms | 30.73 ms | 40.56 ms | 48.07 ms | 203.52% | 111.08 MiB |
| rust_tonic_st | 53727 | 18.33 ms | 21.78 ms | 22.95 ms | 25.73 ms | 101.26% | 15.82 MiB |
| rust_thruster_st | 47650 | 20.75 ms | 24.95 ms | 26.63 ms | 29.08 ms | 101.47% | 12.19 MiB |
| csharp_grpc | 34067 | 28.00 ms | 52.27 ms | 56.11 ms | 62.67 ms | 307.51% | 110.26 MiB |
| swift_grpc | 33018 | 30.02 ms | 32.58 ms | 33.55 ms | 34.85 ms | 303.35% | 6.42 MiB |
| cpp_grpc_st | 30826 | 32.34 ms | 35.59 ms | 37.31 ms | 39.54 ms | 102.59% | 9.04 MiB |
| java_micronaut_workstealing | 29133 | 33.23 ms | 50.48 ms | 59.30 ms | 71.01 ms | 224.23% | 511.51 MiB |
| java_micronaut | 27704 | 35.03 ms | 51.21 ms | 58.00 ms | 70.38 ms | 224.84% | 511.43 MiB |
| haskell_mu | 23640 | 42.02 ms | 58.48 ms | 63.16 ms | 71.10 ms | 300.75% | 221.89 MiB |
| crystal_grpc | 22393 | 43.86 ms | 51.77 ms | 54.49 ms | 58.72 ms | 112.88% | 35.01 MiB |
| scala_zio | 16258 | 60.76 ms | 97.08 ms | 123.12 ms | 199.71 ms | 307.02% | 290.39 MiB |
| elixir_grpc | 14354 | 69.53 ms | 82.65 ms | 87.52 ms | 97.94 ms | 305.66% | 86.54 MiB |
| scala_fs2 | 14084 | 70.79 ms | 83.21 ms | 88.18 ms | 112.60 ms | 316.08% | 246.64 MiB |
| java_aot | 12833 | 76.51 ms | 160.12 ms | 187.62 ms | 246.56 ms | 279.21% | 226.76 MiB |
| php_swoole_grpc | 9336 | 106.95 ms | 122.80 ms | 124.77 ms | 129.97 ms | 100.92% | 13.13 MiB |
| node_grpcjs_st | 6666 | 149.59 ms | 161.53 ms | 163.34 ms | 169.95 ms | 116.23% | 46.45 MiB |
| php_grpc | 6493 | 153.68 ms | 182.74 ms | 183.88 ms | 186.09 ms | 309.01% | 67.94 MiB |
| python_async_grpc | 5317 | 187.69 ms | 201.57 ms | 204.86 ms | 216.57 ms | 155.08% | 81.26 MiB |
| python_grpc | 4532 | 220.16 ms | 247.03 ms | 250.63 ms | 259.66 ms | 154.9% | 33.8 MiB |
| ruby_grpc | 2538 | 392.60 ms | 426.41 ms | 438.39 ms | 502.47 ms | 133.41% | 35.84 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------