use NickCondron fsst changes #1158
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Vortex bytes_at
| Benchmark suite | Current: 17fe97d | Previous: e573ab0 | Ratio |
|---|---|---|---|
bytes_at/array_data |
739.0007541483133 ns (1.3797300178088676) |
718.763340691364 ns (1.258836107258844) |
1.03 |
bytes_at/array_view |
518.8502934396538 ns (0.7643031876553437) |
520.4231015225852 ns (0.8617253595969032) |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
DataFusion
| Benchmark suite | Current: 17fe97d | Previous: e573ab0 | Ratio |
|---|---|---|---|
arrow/planning |
771918.4240970846 ns (1990.4437562354724) |
781777.6538255012 ns (1770.0549798540887) |
0.99 |
arrow/exec |
1351639.4896418452 ns (4614.9364098098595) |
1383484.3983088792 ns (3668.93769094476) |
0.98 |
vortex-pushdown-compressed/planning |
477304.0498377723 ns (1086.1444101430825) |
486894.4586811445 ns (1162.7263852903852) |
0.98 |
vortex-pushdown-compressed/exec |
2667161.4942105273 ns (18728.38253289531) |
2598214.9099999997 ns (13992.095324999886) |
1.03 |
vortex-pushdown-uncompressed/planning |
477538.83000340534 ns (833.777482766629) |
490555.17372805625 ns (1102.383938138315) |
0.97 |
vortex-pushdown-uncompressed/exec |
2903958.5805555563 ns (4619.5464236103) |
2960190.204117647 ns (4088.295529411873) |
0.98 |
vortex-nopushdown-compressed/planning |
787735.1664604613 ns (2787.865921186749) |
799084.5583160477 ns (3270.1725334521034) |
0.99 |
vortex-nopushdown-compressed/exec |
3080079.204705882 ns (25367.527852941304) |
3320415.1417647046 ns (43657.16949999984) |
0.93 |
vortex-nopushdown-uncompressed/planning |
785050.2637689859 ns (1665.6843574976083) |
792616.3882617817 ns (1634.6813821189571) |
0.99 |
vortex-nopushdown-uncompressed/exec |
4650495.426363636 ns (25934.711136363912) |
4633130.235454546 ns (13838.65021590842) |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Random Access
| Benchmark suite | Current: 17fe97d | Previous: e573ab0 | Ratio |
|---|---|---|---|
random-access/vortex-tokio-local-disk |
978146.5450463428 ns (6875.390617589583) |
1048476.4421480872 ns (8826.804355363536) |
0.93 |
random-access/vortex-local-fs |
1085832.17271301 ns (6317.505275136791) |
1191278.2604314173 ns (7442.022558873403) |
0.91 |
random-access/parquet-tokio-local-disk |
220288339.33333334 ns (3111838.350000009) |
241197692.0333333 ns (2973156.4049999863) |
0.91 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
TPC-H
| Benchmark suite | Current: 17fe97d | Previous: e573ab0 | Ratio |
|---|---|---|---|
tpch_q1/vortex-in-memory-no-pushdown |
564970719.2 ns (4810073.649999976) |
571203608.9 ns (2574966.2599999905) |
0.99 |
tpch_q1/vortex-in-memory-pushdown |
455260108.4 ns (1739455.143750012) |
456188496.45 ns (1896772.375) |
1.00 |
tpch_q1/arrow |
547617586.8 ns (6264094.45874995) |
557189769.1 ns (3565095.2975000143) |
0.98 |
tpch_q1/parquet |
680870839.3 ns (3337417.2362499833) |
691172554.2 ns (3516320.348749995) |
0.99 |
tpch_q1/vortex-file-compressed |
516257461.1 ns (2449493.4774999917) |
521808070.2 ns (2824183.9825000167) |
0.99 |
tpch_q1/vortex-file-uncompressed |
523372508.5 ns (3417219.063749999) |
538550131.2 ns (2987642.276250005) |
0.97 |
tpch_q2/vortex-in-memory-no-pushdown |
120356587.6426984 ns (1196855.300753951) |
123369991.37873015 ns (1105030.7679176629) |
0.98 |
tpch_q2/vortex-in-memory-pushdown |
120249056.9659524 ns (794571.9355238006) |
123674014.72825396 ns (1063228.3575396761) |
0.97 |
tpch_q2/arrow |
122130102.14242062 ns (1669695.55911012) |
117506963.99777779 ns (735651.7225416675) |
1.04 |
tpch_q2/parquet |
151721999.1647619 ns (996622.2552916557) |
146447466.4959127 ns (694569.6881845295) |
1.04 |
tpch_q2/vortex-file-compressed |
172206993.41813493 ns (2842786.5246775895) |
175875364.5415873 ns (2955655.0158432424) |
0.98 |
tpch_q2/vortex-file-uncompressed |
169342052.53507936 ns (2703287.5711111277) |
173435633.54694447 ns (1305845.0238680393) |
0.98 |
tpch_q3/vortex-in-memory-no-pushdown |
157991759.07857144 ns (700798.7290297598) |
161992117.99805558 ns (1108359.0637534559) |
0.98 |
tpch_q3/vortex-in-memory-pushdown |
181095080.76511905 ns (1467526.8007693738) |
179504065.5948016 ns (906898.0987102985) |
1.01 |
tpch_q3/arrow |
150371338.70190477 ns (1050216.6509523839) |
150051695.39972222 ns (784808.9645312577) |
1.00 |
tpch_q3/parquet |
338519620.55 ns (2039539.6599999964) |
342046221.95 ns (3376872.6306250095) |
0.99 |
tpch_q3/vortex-file-compressed |
299988091.1 ns (1378882.7450000048) |
299662948.8 ns (2743000.276250005) |
1.00 |
tpch_q3/vortex-file-uncompressed |
241549533.7 ns (1290671.6112499833) |
245288693.33333334 ns (2459917.951249987) |
0.98 |
tpch_q4/vortex-in-memory-no-pushdown |
110306638.53670636 ns (774865.5707539767) |
110962299.77047618 ns (284602.6772619039) |
0.99 |
tpch_q4/vortex-in-memory-pushdown |
128704740.97063494 ns (1084881.3286656812) |
129455619.0663492 ns (588847.0960892811) |
0.99 |
tpch_q4/arrow |
183444451.8 ns (1187234.7499999702) |
185840690.06666666 ns (567628.7716666609) |
0.99 |
tpch_q4/parquet |
204203463.06666666 ns (904525.1258333176) |
204306460.36666664 ns (1066623.2383333296) |
1.00 |
tpch_q4/vortex-file-compressed |
255101604 ns (1845386.003124997) |
247347344.15 ns (890156.174999997) |
1.03 |
tpch_q4/vortex-file-uncompressed |
200625900.60000002 ns (1072208.6224999875) |
202363946.56666666 ns (1994071.1670833677) |
0.99 |
tpch_q5/vortex-in-memory-no-pushdown |
296344686.6 ns (1889175.400000006) |
295452764.1 ns (4105074.160000026) |
1.00 |
tpch_q5/vortex-in-memory-pushdown |
293649863.4 ns (1569482.2843749821) |
288084576.7 ns (3835180.8674999774) |
1.02 |
tpch_q5/arrow |
279745332.8 ns (2730020.40625) |
263188650.4 ns (1417732.824999988) |
1.06 |
tpch_q5/parquet |
439953223.7 ns (2291328.675000012) |
454725145.45 ns (3806376.3568750024) |
0.97 |
tpch_q5/vortex-file-compressed |
361847045.2 ns (2114436.1875) |
366091343.35 ns (2215967.6731250286) |
0.99 |
tpch_q5/vortex-file-uncompressed |
336628963.65 ns (4068353.0693750083) |
333848754.15 ns (1771861.6481249928) |
1.01 |
tpch_q6/vortex-in-memory-no-pushdown |
36358243.537447095 ns (226401.92541914433) |
35259634.02977513 ns (214562.94401587173) |
1.03 |
tpch_q6/vortex-in-memory-pushdown |
69586208.33954366 ns (287236.6562261954) |
70274398.97765873 ns (272461.32130207866) |
0.99 |
tpch_q6/arrow |
26282856.366666667 ns (536655.601994792) |
27535264.939831346 ns (278732.4520337302) |
0.95 |
tpch_q6/parquet |
137839194.26039684 ns (876577.0146825463) |
138876971.14238095 ns (942451.5527648926) |
0.99 |
tpch_q6/vortex-file-compressed |
70347497.62355159 ns (245827.45867981762) |
71075626.80402778 ns (541267.8066284582) |
0.99 |
tpch_q6/vortex-file-uncompressed |
166202052.6902381 ns (736265.8912499845) |
167332925.39920634 ns (804646.6428968161) |
0.99 |
tpch_q7/vortex-in-memory-no-pushdown |
558321380.4 ns (3921371.1875) |
537057277.1 ns (2776169.4487499893) |
1.04 |
tpch_q7/vortex-in-memory-pushdown |
589428028 ns (4428026.026250005) |
587602685 ns (6255224.449999988) |
1.00 |
tpch_q7/arrow |
521797223.2 ns (3806168.8012500107) |
552185792.5 ns (4712525.450000048) |
0.94 |
tpch_q7/parquet |
658727808.9 ns (10348853.033749998) |
662010226.1 ns (5412805.147500038) |
1.00 |
tpch_q7/vortex-file-compressed |
687771974.6 ns (8475899.367500007) |
708367866.5 ns (3009428.446249962) |
0.97 |
tpch_q7/vortex-file-uncompressed |
652306975.7 ns (5550933.926249981) |
666646944.8 ns (5609128.1762500405) |
0.98 |
tpch_q8/vortex-in-memory-no-pushdown |
224285473.9 ns (2395119.728333354) |
223075396.06666666 ns (2373771.530000001) |
1.01 |
tpch_q8/vortex-in-memory-pushdown |
237471568.4333333 ns (3460879.6724999845) |
227821098.60000005 ns (1368472.497083351) |
1.04 |
tpch_q8/arrow |
211370192.3 ns (1868966.0033333153) |
207819460.26666665 ns (1035633.299999997) |
1.02 |
tpch_q8/parquet |
494725691.1 ns (8902865.446249992) |
483995543.1 ns (2715459.8368749917) |
1.02 |
tpch_q8/vortex-file-compressed |
306233998.55 ns (2455761.5462499857) |
312813123.15 ns (3846514.404374987) |
0.98 |
tpch_q8/vortex-file-uncompressed |
301486106.8 ns (5298446.957499981) |
294833551.35 ns (2046248.7537499964) |
1.02 |
tpch_q9/vortex-in-memory-no-pushdown |
410133810.85 ns (3909131.851249993) |
429147113.5 ns (3006576.507499993) |
0.96 |
tpch_q9/vortex-in-memory-pushdown |
414770206.05 ns (10581843.474999994) |
409053992.3 ns (2524305.8068750203) |
1.01 |
tpch_q9/arrow |
400243224.4 ns (7927034.636874974) |
412199979.05 ns (5986357.150000006) |
0.97 |
tpch_q9/parquet |
712311978.6 ns (7038130.600000024) |
703770980.4 ns (3098165.905000031) |
1.01 |
tpch_q9/vortex-file-compressed |
481915042.9 ns (9362948.158125013) |
506843338 ns (2760599.03125) |
0.95 |
tpch_q9/vortex-file-uncompressed |
472623361.1 ns (10490473.162499934) |
474984613.05 ns (2784599.3318749964) |
1.00 |
tpch_q10/vortex-in-memory-no-pushdown |
272015550.8 ns (3361825.503124982) |
282863462.25 ns (3137844.6087499857) |
0.96 |
tpch_q10/vortex-in-memory-pushdown |
305121793.75 ns (5133957.949999988) |
307901631.95 ns (1759319.026875019) |
0.99 |
tpch_q10/arrow |
260495515.75 ns (3246294.690624997) |
269323620.8 ns (2491656.368749991) |
0.97 |
tpch_q10/parquet |
490523603.5 ns (3099819.204374969) |
496357736.65 ns (3932942.3693749905) |
0.99 |
tpch_q10/vortex-file-compressed |
403650156.2 ns (1631327.3381250203) |
416648918.85 ns (2965237.9743749797) |
0.97 |
tpch_q10/vortex-file-uncompressed |
387451150.05 ns (1243531.1287499666) |
386002426.35 ns (1409389.224999994) |
1.00 |
tpch_q11/vortex-in-memory-no-pushdown |
177326034.81865078 ns (2525390.962426573) |
178831621.7454762 ns (1983243.6116934717) |
0.99 |
tpch_q11/vortex-in-memory-pushdown |
177569446.15317458 ns (887255.9100793749) |
177089827.3881349 ns (1448691.2491443455) |
1.00 |
tpch_q11/arrow |
177883470.54158732 ns (1813105.9717252105) |
172709499.80015874 ns (648584.5188928545) |
1.03 |
tpch_q11/parquet |
187387074.8 ns (1560314.9691666663) |
188819111.06666666 ns (2830000.0741666555) |
0.99 |
tpch_q11/vortex-file-compressed |
285500017 ns (8034509.248124987) |
263560777.8 ns (4034305.024999991) |
1.08 |
tpch_q11/vortex-file-uncompressed |
261842955.55 ns (3887841.2212499827) |
270158674.65 ns (6501483.200000018) |
0.97 |
tpch_q12/vortex-in-memory-no-pushdown |
234767852.13333336 ns (1692661.820416674) |
231122506.2 ns (590936.5704166442) |
1.02 |
tpch_q12/vortex-in-memory-pushdown |
250919748.4 ns (545701.8812500089) |
248073811.09999996 ns (619925.8391666561) |
1.01 |
tpch_q12/arrow |
187205670.9 ns (511416.5295833498) |
188055970.6 ns (480397.0600000173) |
1.00 |
tpch_q12/parquet |
337315738.55 ns (2577315.699999988) |
334319852.45 ns (1086679.6368750036) |
1.01 |
tpch_q12/vortex-file-compressed |
397525697.4 ns (2791176.766874999) |
397721325 ns (1517796.776249975) |
1.00 |
tpch_q12/vortex-file-uncompressed |
392111481.1 ns (4309525.203125) |
383612181.35 ns (1093248.834374994) |
1.02 |
tpch_q13/vortex-in-memory-no-pushdown |
183290114.17619047 ns (5064342.0935714245) |
188370063.6742857 ns (5274411.304017857) |
0.97 |
tpch_q13/vortex-in-memory-pushdown |
189655201.7546429 ns (9941139.147559509) |
178146797.56666666 ns (6069678.322500005) |
1.06 |
tpch_q13/arrow |
178603040.08615083 ns (7087979.260385409) |
169154263.3774603 ns (4216696.431984112) |
1.06 |
tpch_q13/parquet |
342433287.4 ns (5043400.125) |
332741850.7 ns (4359523.844999999) |
1.03 |
tpch_q13/vortex-file-compressed |
206556215.26666668 ns (2486437.2833333164) |
215739157.8 ns (2794730.8666666746) |
0.96 |
tpch_q13/vortex-file-uncompressed |
204867077 ns (2039193.362500012) |
207086105.2666667 ns (2613097.1379166543) |
0.99 |
tpch_q14/vortex-in-memory-no-pushdown |
45925645.314702384 ns (474502.61373734847) |
43607893.13003968 ns (664397.3867410719) |
1.05 |
tpch_q14/vortex-in-memory-pushdown |
74725358.60378969 ns (557033.5489813983) |
75379308.33291666 ns (457018.2033333257) |
0.99 |
tpch_q14/arrow |
34810004.17271163 ns (419407.9847552888) |
37223084.34497355 ns (301704.0961904749) |
0.94 |
tpch_q14/parquet |
226807966.83333334 ns (1945874.5595833212) |
225089647.13333336 ns (838811.237916708) |
1.01 |
tpch_q14/vortex-file-compressed |
117026375.26115079 ns (1017380.1462301612) |
119570532.15257938 ns (564292.1851661801) |
0.98 |
tpch_q14/vortex-file-uncompressed |
139199363.9320635 ns (2395916.8026250005) |
138458601.0123413 ns (1304064.780721724) |
1.01 |
tpch_q15/vortex-in-memory-no-pushdown |
74761190.3005754 ns (656363.0736904666) |
71546626.89123017 ns (621950.0163323432) |
1.04 |
tpch_q15/vortex-in-memory-pushdown |
107348592.00047618 ns (2724885.7973035797) |
105383255.01781747 ns (566290.2233705372) |
1.02 |
tpch_q15/arrow |
61428989.32803571 ns (2175104.9453571364) |
61559582.06773809 ns (874960.7214002945) |
1.00 |
tpch_q15/parquet |
300607167.15 ns (1457423.75) |
299592129 ns (831723.3293749988) |
1.00 |
tpch_q15/vortex-file-compressed |
225801208.4333333 ns (2475695.966250032) |
220368383.56666666 ns (1921009.648750037) |
1.02 |
tpch_q15/vortex-file-uncompressed |
260208421.65 ns (2643196.951250002) |
255998997.3 ns (1022086.759375006) |
1.02 |
tpch_q16/vortex-in-memory-no-pushdown |
111030703.05166666 ns (1035939.0095624998) |
108142421.54408729 ns (620613.0198214278) |
1.03 |
tpch_q16/vortex-in-memory-pushdown |
120348846.78619048 ns (963988.6813720167) |
119413633.31015873 ns (366127.99638890475) |
1.01 |
tpch_q16/arrow |
107824917.17892857 ns (1457627.6573839262) |
109775962.94242063 ns (584094.1979231164) |
0.98 |
tpch_q16/parquet |
120327327.64674604 ns (837832.0167599246) |
116577681.45170636 ns (1585265.2452857122) |
1.03 |
tpch_q16/vortex-file-compressed |
142027777.15293652 ns (1883125.082301572) |
135053298.42507938 ns (1081166.9941339344) |
1.05 |
tpch_q16/vortex-file-uncompressed |
140089145.1479365 ns (2277761.113601193) |
134898817.7209524 ns (1182369.669303596) |
1.04 |
tpch_q17/vortex-in-memory-no-pushdown |
555787150.7 ns (10983858.125) |
581018462 ns (15123969.495000005) |
0.96 |
tpch_q17/vortex-in-memory-pushdown |
659990313.6 ns (15028218.75999993) |
621763365.4 ns (7565346.849999964) |
1.06 |
tpch_q17/arrow |
587181339.8 ns (18799001.12624997) |
514503289.1 ns (8777844.794999987) |
1.14 |
tpch_q17/parquet |
661651592.7 ns (15878234.449999988) |
648531031.9 ns (5615499.25) |
1.02 |
tpch_q17/vortex-file-compressed |
672336998.3 ns (12387859.893750012) |
640867794.6 ns (6815559.80250001) |
1.05 |
tpch_q17/vortex-file-uncompressed |
618474500.4 ns (8491809.277500033) |
640028695.4 ns (22935498.143750012) |
0.97 |
tpch_q18/vortex-in-memory-no-pushdown |
1070109297.6 ns (19709671.88374996) |
1171762445.2 ns (8144528.706249952) |
0.91 |
tpch_q18/vortex-in-memory-pushdown |
1129768845.8 ns (35130382.19999993) |
1092330340.7 ns (13944485.5) |
1.03 |
tpch_q18/arrow |
1035029135.1 ns (21992938.078750014) |
1068374003.2 ns (14643035.817499936) |
0.97 |
tpch_q18/parquet |
1233785472.8 ns (23238955.652500033) |
1212737547.6 ns (13615577.701249957) |
1.02 |
tpch_q18/vortex-file-compressed |
1145163276 ns (23691872.899999976) |
1177570782.5 ns (18200799.502499938) |
0.97 |
tpch_q18/vortex-file-uncompressed |
1130623771.7 ns (21083967.279999852) |
1110251100.3 ns (9209707.56249988) |
1.02 |
tpch_q19/vortex-in-memory-no-pushdown |
183365274.53333336 ns (469469.6166666597) |
181766630.93333334 ns (578473.150000006) |
1.01 |
tpch_q19/vortex-in-memory-pushdown |
255020754.25 ns (1199737.5506250113) |
250812305.9 ns (327944.25749999285) |
1.02 |
tpch_q19/arrow |
169724988.8845635 ns (1297265.8571334481) |
167770276.15892857 ns (357225.4674999714) |
1.01 |
tpch_q19/parquet |
454916100.05 ns (1858214.5006249845) |
451533911.75 ns (570427) |
1.01 |
tpch_q19/vortex-file-compressed |
359737971.4 ns (1761946.6181249917) |
395698128.8 ns (1539084.625) |
0.91 |
tpch_q19/vortex-file-uncompressed |
358132731.15 ns (2818942.113749981) |
353749628.7 ns (2390366.2931250036) |
1.01 |
tpch_q20/vortex-in-memory-no-pushdown |
261516707.15 ns (9001162.848749995) |
245759144.7 ns (4010605.5370833427) |
1.06 |
tpch_q20/vortex-in-memory-pushdown |
271649074.5 ns (4722431.211250007) |
276248300.35 ns (3874000.450000018) |
0.98 |
tpch_q20/arrow |
238819108.0333333 ns (4271073.776666671) |
237269945.2333333 ns (3335378.4762500077) |
1.01 |
tpch_q20/parquet |
368736569.2 ns (2907006.1400000155) |
362922468.7 ns (3101440.9518749714) |
1.02 |
tpch_q20/vortex-file-compressed |
361398449.1 ns (4734246.086250007) |
358566271.4 ns (2387921.7662499845) |
1.01 |
tpch_q20/vortex-file-uncompressed |
376309494.95 ns (4398470.375) |
381252770.75 ns (4838496.525000006) |
0.99 |
tpch_q21/vortex-in-memory-no-pushdown |
914569007.1 ns (20605404.327499986) |
888926782.3 ns (4215409.027499914) |
1.03 |
tpch_q21/vortex-in-memory-pushdown |
924359443.9 ns (11637683.650000036) |
916681043.2 ns (6171126.043749988) |
1.01 |
tpch_q21/arrow |
875990834.2 ns (12385613.04249996) |
854122638.9 ns (5423569.661249995) |
1.03 |
tpch_q21/parquet |
999775306.1 ns (10929409.206250012) |
1000499044.1 ns (17267804.69625002) |
1.00 |
tpch_q21/vortex-file-compressed |
1201996419.9 ns (11903993.566249967) |
1199450481.6 ns (10602774.638749957) |
1.00 |
tpch_q21/vortex-file-uncompressed |
1058853958.8 ns (9747655.55124998) |
1059242924.6 ns (8301620.555000067) |
1.00 |
tpch_q22/vortex-in-memory-no-pushdown |
77364163.46210316 ns (433505.3476512879) |
76297412.47168651 ns (226228.95650272816) |
1.01 |
tpch_q22/vortex-in-memory-pushdown |
76704733.48111111 ns (380254.9792187512) |
75721398.20744047 ns (277226.82695090026) |
1.01 |
tpch_q22/arrow |
76063468.32474205 ns (427548.1791495681) |
75463270.28410713 ns (406816.5257433057) |
1.01 |
tpch_q22/parquet |
92826283.42853175 ns (562643.1786676645) |
92564391.81511906 ns (518196.9342931509) |
1.00 |
tpch_q22/vortex-file-compressed |
120080406.51325396 ns (386829.2467351258) |
121928946.15873015 ns (570102.6642956287) |
0.98 |
tpch_q22/vortex-file-uncompressed |
121097528.51500002 ns (1110856.9166041687) |
118677199.30654761 ns (405134.0633229166) |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Vortex Compression
| Benchmark suite | Current: 17fe97d | Previous: e573ab0 | Ratio |
|---|---|---|---|
compress time/taxi |
1178926684.6 ns (2841033.5499999523) |
1233330040.6 ns (1974839.5812499523) |
0.96 |
compress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
parquet_rs-zstd compress time/taxi |
1772406164.3 ns (2648211) |
1781884262.1 ns (14824306.649999976) |
0.99 |
parquet_rs-zstd compress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
decompress time/taxi |
411280359.9 ns (2032254.2331250012) |
444539171.4 ns (9069563.060000002) |
0.93 |
decompress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
parquet_rs-zstd decompress time/taxi |
309740443.45 ns (925590.2168750167) |
309013386.9 ns (640309.25) |
1.00 |
parquet_rs-zstd decompress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
vortex:parquet-zstd size/taxi |
0.9371102383971927 ratio |
0.9451798857093027 ratio |
0.99 |
vortex:raw size/taxi |
0.11138584110610444 ratio |
0.11234555103717618 ratio |
0.99 |
vortex size/taxi |
52441448 bytes |
52893288 bytes |
0.99 |
compress time/AirlineSentiment |
680164.5594885361 ns (1938.3526410935447) |
682434.7434061834 ns (2872.9851439232007) |
1.00 |
compress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
parquet_rs-zstd compress time/AirlineSentiment |
55982.907635543495 ns (198.12805731402113) |
55944.965097562046 ns (117.10590069499813) |
1.00 |
parquet_rs-zstd compress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
decompress time/AirlineSentiment |
39183.899308346 ns (64.945686470699) |
39606.02336070357 ns (81.35819907515906) |
0.99 |
decompress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
parquet_rs-zstd decompress time/AirlineSentiment |
32273.520982849972 ns (97.33110584624228) |
32223.847676269874 ns (74.36868091310316) |
1.00 |
parquet_rs-zstd decompress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
vortex:parquet-zstd size/AirlineSentiment |
6.196483971044468 ratio |
6.196483971044468 ratio |
1 |
vortex:raw size/AirlineSentiment |
2.9663366336633663 ratio |
2.9663366336633663 ratio |
1 |
vortex size/AirlineSentiment |
5992 bytes |
5992 bytes |
1 |
compress time/Arade |
2214932997.4 ns (11670961) |
2209531085.5 ns (5587174.916249752) |
1.00 |
compress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
parquet_rs-zstd compress time/Arade |
3039868023.5 ns (6341258) |
3022197456.2 ns (2922376.9862499237) |
1.01 |
parquet_rs-zstd compress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
decompress time/Arade |
749369129.1 ns (2146034.9937500358) |
773093529.3 ns (2107772.9000000358) |
0.97 |
decompress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
parquet_rs-zstd decompress time/Arade |
643304025 ns (2037173.407499969) |
643825385.3 ns (2519208.9612500668) |
1.00 |
parquet_rs-zstd decompress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
vortex:parquet-zstd size/Arade |
0.47890649124129325 ratio |
0.47890649124129325 ratio |
1 |
vortex:raw size/Arade |
0.18583271234403392 ratio |
0.18583271234403392 ratio |
1 |
vortex size/Arade |
146254760 bytes |
146254760 bytes |
1 |
compress time/Bimbo |
9919766176.4 ns (8976092.67124939) |
11524153983.4 ns (6913892.3512506485) |
0.86 |
compress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
parquet_rs-zstd compress time/Bimbo |
20571178034.9 ns (34765930.17374992) |
20410254024 ns (32551573.790000916) |
1.01 |
parquet_rs-zstd compress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
decompress time/Bimbo |
4824112215.9 ns (18889581.215000153) |
4957567540.1 ns (55641095.54250002) |
0.97 |
decompress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
parquet_rs-zstd decompress time/Bimbo |
2627181115.1 ns (5798935.561249971) |
2623881980.5 ns (3384710.5499999523) |
1.00 |
parquet_rs-zstd decompress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
vortex:parquet-zstd size/Bimbo |
1.2342855358573495 ratio |
1.236896313823459 ratio |
1.00 |
vortex:raw size/Bimbo |
0.06727519792947187 ratio |
0.06741749936566095 ratio |
1.00 |
vortex size/Bimbo |
479089128 bytes |
480102504 bytes |
1.00 |
compress time/CMSprovider |
11823239024.1 ns (10735038.829999924) |
11949864247 ns (11388671.100000381) |
0.99 |
compress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
parquet_rs-zstd compress time/CMSprovider |
19922450834.5 ns (12815042.367500305) |
19797152189.5 ns (40058101.85625076) |
1.01 |
parquet_rs-zstd compress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
decompress time/CMSprovider |
7931190639.3 ns (31436337.433749676) |
7846866927 ns (44986264.19624996) |
1.01 |
decompress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
parquet_rs-zstd decompress time/CMSprovider |
4864235614.9 ns (12820017.200000286) |
4877662826 ns (44885948.527499676) |
1.00 |
parquet_rs-zstd decompress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
vortex:parquet-zstd size/CMSprovider |
1.2016411980905017 ratio |
1.2144308947077798 ratio |
0.99 |
vortex:raw size/CMSprovider |
0.1795806910971468 ratio |
0.18149167091988855 ratio |
0.99 |
vortex size/CMSprovider |
924683240 bytes |
934523112 bytes |
0.99 |
compress time/Euro2016 |
2649854925 ns (4155674.2937498093) |
2633146991.9 ns (3185942.0499999523) |
1.01 |
compress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
parquet_rs-zstd compress time/Euro2016 |
1580583777.2 ns (2659090.551249981) |
1577443044.6 ns (2751948.868749976) |
1.00 |
parquet_rs-zstd compress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
decompress time/Euro2016 |
302419641.95 ns (1108500.1206249893) |
296893051.35 ns (904775.1600000262) |
1.02 |
decompress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
parquet_rs-zstd decompress time/Euro2016 |
488358681.85 ns (1176911.881249994) |
485645689.6 ns (1654268.025000006) |
1.01 |
parquet_rs-zstd decompress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
vortex:parquet-zstd size/Euro2016 |
1.4383522286595696 ratio |
1.4383522286595696 ratio |
1 |
vortex:raw size/Euro2016 |
0.4348484255644533 ratio |
0.4348484255644533 ratio |
1 |
vortex size/Euro2016 |
171005544 bytes |
171005544 bytes |
1 |
compress time/Food |
1112676777.8 ns (2777304.8162499666) |
1092568987 ns (2037125.669999957) |
1.02 |
compress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
parquet_rs-zstd compress time/Food |
1117840471.8 ns (2422781.09375) |
1109237683.7 ns (1555645.6000000238) |
1.01 |
parquet_rs-zstd compress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
decompress time/Food |
205240122.36666664 ns (1011084.7458333373) |
203477649.5333333 ns (622882.7258333266) |
1.01 |
decompress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
parquet_rs-zstd decompress time/Food |
215693194.86666664 ns (513822.76166668534) |
213854630 ns (492856.6058333367) |
1.01 |
parquet_rs-zstd decompress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
vortex:parquet-zstd size/Food |
1.2386506182043049 ratio |
1.238933256800101 ratio |
1.00 |
vortex:raw size/Food |
0.13487787589780662 ratio |
0.1349086526906225 ratio |
1.00 |
vortex size/Food |
44876328 bytes |
44886568 bytes |
1.00 |
compress time/HashTags |
2581474892.6 ns (4540503.364999771) |
2558169833.1 ns (3318537.971250057) |
1.01 |
compress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
parquet_rs-zstd compress time/HashTags |
2511498695.8 ns (3035341.7962498665) |
2493110834.1 ns (5594067.231250048) |
1.01 |
parquet_rs-zstd compress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
decompress time/HashTags |
621494262.8 ns (3105327.6025000215) |
613654844.7 ns (2017551.6037499905) |
1.01 |
decompress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
parquet_rs-zstd decompress time/HashTags |
782954227.3 ns (3255711.456250012) |
783337097.6 ns (2586534.1412500143) |
1.00 |
parquet_rs-zstd decompress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
vortex:parquet-zstd size/HashTags |
1.656176458210158 ratio |
1.6563035357058875 ratio |
1.00 |
vortex:raw size/HashTags |
0.27578834018024057 ratio |
0.2758095012657322 ratio |
1.00 |
vortex size/HashTags |
221870504 bytes |
221887528 bytes |
1.00 |
compress time/TPC-H l_comment chunked without fsst |
3907784873.1 ns (7525043.30250001) |
3884845979 ns (9062463.5) |
1.01 |
compress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst |
910034610.1 ns (1346064.6187500358) |
909694977.1 ns (1009883.0174999833) |
1.00 |
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
decompress time/TPC-H l_comment chunked without fsst |
112725549.90650794 ns (949682.6510357186) |
112113143.68730159 ns (745239.76482144) |
1.01 |
decompress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst |
249722675.45 ns (1065308.4850000143) |
252841763.15 ns (751980.7343750149) |
0.99 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment chunked without fsst |
4.607553865862867 ratio |
4.607506947983021 ratio |
1.00 |
vortex:raw size/TPC-H l_comment chunked without fsst |
1.052710238309765 ratio |
1.0527120360835673 ratio |
1.00 |
vortex size/TPC-H l_comment chunked without fsst |
262332328 bytes |
262332776 bytes |
1.00 |
compress time/TPC-H l_comment chunked |
913240517.6 ns (1302304.7524999976) |
912961281.1 ns (1314349.9500000477) |
1.00 |
compress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment chunked |
910090997.9 ns (1922674.4225000143) |
911573508.5 ns (1543391.237500012) |
1.00 |
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
decompress time/TPC-H l_comment chunked |
132173249.85099205 ns (541174.7526066452) |
132998218.03388889 ns (467781.3183680624) |
0.99 |
decompress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked |
250321263.7 ns (895018.1037500054) |
252877179.5 ns (735691) |
0.99 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment chunked |
1.3479510793932992 ratio |
1.347939547787981 ratio |
1.00 |
vortex:raw size/TPC-H l_comment chunked |
0.30797293820726396 ratio |
0.3079739655065796 ratio |
1.00 |
vortex size/TPC-H l_comment chunked |
76745960 bytes |
76746216 bytes |
1.00 |
compress time/TPC-H l_comment canonical |
913175686.4 ns (1043565.4224999547) |
911307297.4 ns (878948.6812500358) |
1.00 |
compress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment canonical |
916855867.7 ns (1100448.5675000548) |
920000161 ns (1343787.1312499642) |
1.00 |
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
decompress time/TPC-H l_comment canonical |
131666244.13554235 ns (268014.0574378297) |
132864044.43595238 ns (374078.18170039356) |
0.99 |
decompress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment canonical |
249560538.5961508 ns (661854.073527798) |
252632916.2202579 ns (377227.1150099337) |
0.99 |
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment canonical |
1.3479538493915375 ratio |
1.3479340316133954 ratio |
1.00 |
vortex:raw size/TPC-H l_comment canonical |
0.30797291843349095 ratio |
0.30797394573274056 ratio |
1.00 |
vortex size/TPC-H l_comment canonical |
76745960 bytes |
76746216 bytes |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
|
The results are within margin of error. Not sure small difference in decompression will show up here. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
To run benchmarks for spiraldb/fsst#45