Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Debug](conf) add verbose log on pipeline #37252

Closed
wants to merge 1 commit into from

Conversation

zclllyybb
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

to debug load coredump

@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

github-actions bot commented Jul 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

dataroaring
dataroaring previously approved these changes Jul 3, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 3, 2024
Copy link
Contributor

github-actions bot commented Jul 3, 2024

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Jul 3, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 40320 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9b40e7e5cbed029a743bc291ba1ac3ea152d8d8f, data reload: false

------ Round 1 ----------------------------------
q1	17611	4290	4244	4244
q2	2012	192	182	182
q3	10461	1228	1122	1122
q4	10183	818	739	739
q5	7486	2652	2640	2640
q6	215	137	135	135
q7	964	600	607	600
q8	9223	2078	2045	2045
q9	8893	6487	6476	6476
q10	8877	3724	3676	3676
q11	450	241	244	241
q12	473	237	242	237
q13	17965	2972	3008	2972
q14	263	242	208	208
q15	530	481	483	481
q16	514	375	375	375
q17	957	651	688	651
q18	8030	7391	7323	7323
q19	7746	1479	1421	1421
q20	662	321	338	321
q21	4885	3914	3885	3885
q22	417	352	346	346
Total cold run time: 118817 ms
Total hot run time: 40320 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4368	4265	4264	4264
q2	383	275	264	264
q3	3036	2890	2925	2890
q4	1928	1688	1729	1688
q5	5543	5484	5388	5388
q6	225	129	130	129
q7	2287	1866	1872	1866
q8	3271	3406	3427	3406
q9	8670	8751	8757	8751
q10	4181	3665	3767	3665
q11	615	499	507	499
q12	818	654	661	654
q13	16239	3148	3177	3148
q14	292	287	292	287
q15	528	497	476	476
q16	510	424	447	424
q17	1810	1512	1502	1502
q18	8244	8094	7843	7843
q19	1785	1498	1593	1498
q20	3018	1877	1885	1877
q21	6079	4639	5021	4639
q22	720	569	601	569
Total cold run time: 74550 ms
Total hot run time: 55727 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 171988 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9b40e7e5cbed029a743bc291ba1ac3ea152d8d8f, data reload: false

query1	909	387	374	374
query2	6389	2560	2490	2490
query3	6636	203	218	203
query4	18858	17439	17336	17336
query5	3708	475	503	475
query6	257	177	157	157
query7	4587	286	308	286
query8	342	295	302	295
query9	8579	2501	2473	2473
query10	564	293	273	273
query11	10595	9938	10023	9938
query12	114	88	81	81
query13	1665	375	369	369
query14	10204	7520	6394	6394
query15	234	180	187	180
query16	7771	320	306	306
query17	1785	549	549	549
query18	1919	281	279	279
query19	203	160	157	157
query20	87	83	82	82
query21	225	132	126	126
query22	4336	4227	4271	4227
query23	33792	33581	33692	33581
query24	10905	2852	2867	2852
query25	619	414	402	402
query26	719	158	162	158
query27	2322	329	330	329
query28	6099	2176	2169	2169
query29	911	661	669	661
query30	241	157	170	157
query31	1003	774	753	753
query32	97	55	56	55
query33	685	300	317	300
query34	906	492	502	492
query35	771	668	668	668
query36	1127	996	960	960
query37	142	80	84	80
query38	2978	2861	2798	2798
query39	896	870	833	833
query40	211	127	126	126
query41	56	53	55	53
query42	121	104	104	104
query43	602	563	567	563
query44	1101	741	752	741
query45	202	167	163	163
query46	1081	736	749	736
query47	1832	1738	1770	1738
query48	367	308	312	308
query49	849	486	407	407
query50	779	386	391	386
query51	6816	6799	6766	6766
query52	103	89	90	89
query53	354	289	283	283
query54	869	460	461	460
query55	75	75	72	72
query56	281	256	261	256
query57	1096	1032	1014	1014
query58	255	243	252	243
query59	3530	3372	3384	3372
query60	299	293	290	290
query61	93	89	91	89
query62	592	460	442	442
query63	317	288	297	288
query64	8498	2311	1745	1745
query65	3191	3106	3110	3106
query66	743	325	353	325
query67	15660	14852	15044	14852
query68	8317	542	558	542
query69	711	433	337	337
query70	1195	1083	1154	1083
query71	520	280	273	273
query72	9031	5280	4344	4344
query73	1670	325	324	324
query74	5820	5480	5473	5473
query75	5314	2699	2676	2676
query76	4630	1033	931	931
query77	755	289	300	289
query78	9663	8834	8798	8798
query79	8730	526	518	518
query80	1071	466	467	466
query81	548	220	218	218
query82	766	106	101	101
query83	329	165	161	161
query84	263	90	84	84
query85	1245	282	326	282
query86	392	296	319	296
query87	3332	3093	3061	3061
query88	4693	2387	2380	2380
query89	550	398	383	383
query90	1994	189	189	189
query91	128	99	98	98
query92	63	46	52	46
query93	6840	520	515	515
query94	1311	208	216	208
query95	410	318	319	318
query96	610	267	264	264
query97	3214	3059	2987	2987
query98	212	207	192	192
query99	1159	869	836	836
Total cold run time: 289639 ms
Total hot run time: 171988 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9b40e7e5cbed029a743bc291ba1ac3ea152d8d8f, data reload: false

query1	0.04	0.03	0.02
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.06	0.07
query5	0.50	0.49	0.48
query6	1.15	0.72	0.72
query7	0.01	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.48	0.49
query10	0.55	0.53	0.54
query11	0.15	0.12	0.11
query12	0.15	0.13	0.12
query13	0.58	0.60	0.59
query14	0.77	0.79	0.77
query15	0.85	0.80	0.81
query16	0.37	0.36	0.36
query17	0.94	0.97	0.98
query18	0.22	0.24	0.24
query19	1.89	1.70	1.79
query20	0.01	0.01	0.01
query21	15.39	0.76	0.66
query22	4.10	6.80	2.65
query23	18.37	1.34	1.26
query24	1.85	0.28	0.25
query25	0.14	0.09	0.09
query26	0.27	0.17	0.18
query27	0.08	0.08	0.08
query28	13.22	1.02	1.02
query29	12.62	3.31	3.27
query30	0.25	0.06	0.05
query31	2.87	0.38	0.38
query32	3.28	0.48	0.46
query33	2.86	2.92	2.89
query34	17.18	4.39	4.43
query35	4.44	4.49	4.55
query36	0.65	0.49	0.49
query37	0.19	0.15	0.15
query38	0.15	0.15	0.15
query39	0.05	0.03	0.04
query40	0.20	0.15	0.13
query41	0.10	0.04	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.11 s
Total hot run time: 31.29 s

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jul 4, 2024
@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

github-actions bot commented Jul 4, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40269 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ec94ae8c659cd2b928ceb751b63b417ca4044adc, data reload: false

------ Round 1 ----------------------------------
q1	18298	4556	4408	4408
q2	2368	199	201	199
q3	11336	1165	1068	1068
q4	10300	836	867	836
q5	7831	2714	2679	2679
q6	234	147	145	145
q7	989	624	626	624
q8	9292	2083	2100	2083
q9	8745	6503	6524	6503
q10	8831	3710	3757	3710
q11	455	237	241	237
q12	424	236	234	234
q13	17786	3038	3023	3023
q14	262	230	222	222
q15	511	493	498	493
q16	513	394	377	377
q17	965	711	696	696
q18	8188	7504	7379	7379
q19	4579	1500	1463	1463
q20	689	325	323	323
q21	4802	3313	3224	3224
q22	406	350	343	343
Total cold run time: 117804 ms
Total hot run time: 40269 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4392	4224	4218	4218
q2	372	265	257	257
q3	2963	2750	2720	2720
q4	1831	1632	1607	1607
q5	5275	5275	5291	5275
q6	223	131	133	131
q7	2108	1745	1748	1745
q8	3249	3350	3326	3326
q9	8361	8376	8330	8330
q10	3882	3694	3647	3647
q11	579	506	499	499
q12	784	651	613	613
q13	17527	2980	3010	2980
q14	298	255	263	255
q15	516	490	507	490
q16	471	415	420	415
q17	1798	1484	1486	1484
q18	7668	7634	7442	7442
q19	1761	1710	1420	1420
q20	2000	1806	1788	1788
q21	4911	4833	4657	4657
q22	630	559	533	533
Total cold run time: 71599 ms
Total hot run time: 53832 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172564 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ec94ae8c659cd2b928ceb751b63b417ca4044adc, data reload: false

query1	927	405	364	364
query2	6467	2575	2312	2312
query3	6647	202	209	202
query4	20441	17610	17377	17377
query5	4220	476	486	476
query6	262	163	155	155
query7	4597	299	283	283
query8	331	280	295	280
query9	8647	2469	2445	2445
query10	613	308	280	280
query11	10671	10194	9983	9983
query12	140	84	84	84
query13	1676	368	366	366
query14	10103	7539	7524	7524
query15	236	195	186	186
query16	7918	302	301	301
query17	1828	556	525	525
query18	2003	264	268	264
query19	196	146	149	146
query20	89	84	80	80
query21	214	136	124	124
query22	4407	4010	4043	4010
query23	33690	33167	33322	33167
query24	11972	2780	2794	2780
query25	682	361	362	361
query26	1781	148	154	148
query27	3001	306	312	306
query28	7720	2099	2078	2078
query29	1076	618	624	618
query30	277	164	151	151
query31	977	741	743	741
query32	94	52	54	52
query33	773	287	293	287
query34	988	470	461	461
query35	769	612	614	612
query36	1112	925	944	925
query37	287	74	76	74
query38	2898	2754	2790	2754
query39	887	782	773	773
query40	277	127	125	125
query41	59	50	53	50
query42	124	107	100	100
query43	602	553	552	552
query44	1212	735	739	735
query45	190	160	161	160
query46	1077	707	719	707
query47	1896	1775	1795	1775
query48	361	297	296	296
query49	1219	420	401	401
query50	762	392	387	387
query51	6933	6900	6795	6795
query52	107	91	98	91
query53	354	285	293	285
query54	1008	448	447	447
query55	77	73	74	73
query56	302	324	265	265
query57	1144	1068	1056	1056
query58	270	242	269	242
query59	3642	3431	3125	3125
query60	307	278	290	278
query61	97	93	95	93
query62	646	460	450	450
query63	327	284	283	283
query64	9867	2303	1763	1763
query65	3126	3060	3078	3060
query66	1358	340	328	328
query67	15497	15012	14941	14941
query68	4473	530	549	530
query69	461	299	307	299
query70	1178	1144	1167	1144
query71	394	277	273	273
query72	7121	5291	5396	5291
query73	733	325	325	325
query74	5997	5595	5506	5506
query75	3618	2614	2663	2614
query76	2838	925	942	925
query77	471	291	301	291
query78	9470	8918	8853	8853
query79	2193	524	510	510
query80	1160	460	462	460
query81	574	222	215	215
query82	777	103	103	103
query83	236	166	168	166
query84	238	86	84	84
query85	2028	309	275	275
query86	494	320	298	298
query87	3325	3166	3123	3123
query88	3817	2371	2351	2351
query89	475	373	375	373
query90	1841	183	183	183
query91	126	101	101	101
query92	66	49	50	49
query93	2500	512	517	512
query94	1249	209	211	209
query95	424	305	305	305
query96	589	280	268	268
query97	3157	2994	2977	2977
query98	280	197	200	197
query99	1135	852	836	836
Total cold run time: 277896 ms
Total hot run time: 172564 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ec94ae8c659cd2b928ceb751b63b417ca4044adc, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.49	0.49
query6	1.14	0.74	0.72
query7	0.01	0.01	0.02
query8	0.05	0.05	0.05
query9	0.56	0.50	0.50
query10	0.54	0.54	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.13
query13	0.59	0.60	0.58
query14	0.77	0.77	0.79
query15	0.85	0.81	0.81
query16	0.36	0.38	0.36
query17	0.99	1.01	0.97
query18	0.25	0.23	0.22
query19	1.93	1.82	1.67
query20	0.01	0.01	0.01
query21	15.42	0.73	0.65
query22	3.90	6.97	2.30
query23	18.27	1.40	1.23
query24	2.10	0.22	0.23
query25	0.15	0.10	0.09
query26	0.28	0.18	0.18
query27	0.08	0.08	0.07
query28	13.40	1.04	1.00
query29	12.92	3.30	3.29
query30	0.25	0.08	0.06
query31	2.85	0.39	0.38
query32	3.27	0.49	0.46
query33	2.85	2.90	2.88
query34	17.11	4.37	4.45
query35	4.46	4.48	4.49
query36	0.64	0.46	0.48
query37	0.21	0.15	0.16
query38	0.15	0.14	0.15
query39	0.05	0.03	0.04
query40	0.17	0.13	0.13
query41	0.09	0.05	0.05
query42	0.06	0.04	0.05
query43	0.04	0.04	0.03
Total cold run time: 109.61 s
Total hot run time: 30.81 s

@zclllyybb zclllyybb closed this Jul 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants