Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](function) optimize from_unixtime/date_format by specially format str #40821

Merged
merged 5 commits into from
Sep 18, 2024

Conversation

Mryange
Copy link
Contributor

@Mryange Mryange commented Sep 13, 2024

Proposed changes

 mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp;
+-----------------------------------+
| count(date_format(a, 'yyyyMMdd')) |
+-----------------------------------+
|                          16000000 |
+-----------------------------------+
1 row in set (0.53 sec)


mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp;
+-----------------------------------+
| count(date_format(a, 'yyyyMMdd')) |
+-----------------------------------+
|                          16000000 |
+-----------------------------------+
1 row in set (0.28 sec)

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Mryange
Copy link
Contributor Author

Mryange commented Sep 13, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 42981 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f8110c95ce6d622fb20dcd1b9aa45ab8dd56f808, data reload: false

------ Round 1 ----------------------------------
q1	19212	7460	7299	7299
q2	2017	189	181	181
q3	10467	1341	1422	1341
q4	10150	1001	1089	1001
q5	7707	3206	3154	3154
q6	239	151	151	151
q7	1048	638	628	628
q8	9484	2050	2023	2023
q9	6794	6323	6299	6299
q10	7019	2524	2559	2524
q11	446	250	258	250
q12	409	234	235	234
q13	17762	3030	3006	3006
q14	277	253	252	252
q15	585	530	529	529
q16	520	435	424	424
q17	992	962	964	962
q18	7442	6687	6663	6663
q19	1387	1243	1234	1234
q20	621	359	331	331
q21	3898	3499	3509	3499
q22	1082	996	1002	996
Total cold run time: 109558 ms
Total hot run time: 42981 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7199	7161	7177	7161
q2	349	232	227	227
q3	2967	2927	2901	2901
q4	1957	1964	1947	1947
q5	5459	5421	5408	5408
q6	235	146	144	144
q7	2059	1693	1663	1663
q8	3236	3320	3326	3320
q9	8413	8421	8429	8421
q10	3417	3438	3462	3438
q11	565	470	497	470
q12	797	571	576	571
q13	6807	3033	3030	3030
q14	291	272	268	268
q15	567	518	515	515
q16	500	450	446	446
q17	1759	1684	1715	1684
q18	7851	7458	7499	7458
q19	1739	1718	1699	1699
q20	2028	1822	1806	1806
q21	5504	5446	5495	5446
q22	1081	1010	996	996
Total cold run time: 64780 ms
Total hot run time: 59019 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.90% (9472/25667)
Line Coverage: 28.27% (77906/275586)
Region Coverage: 27.68% (40235/145343)
Branch Coverage: 24.28% (20433/84162)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f8110c95ce6d622fb20dcd1b9aa45ab8dd56f808_f8110c95ce6d622fb20dcd1b9aa45ab8dd56f808/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 195149 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f8110c95ce6d622fb20dcd1b9aa45ab8dd56f808, data reload: false

query1	919	411	392	392
query2	6486	1749	1747	1747
query3	6653	208	217	208
query4	26120	23727	23676	23676
query5	4983	526	535	526
query6	254	181	169	169
query7	4598	319	301	301
query8	275	219	225	219
query9	8512	2603	2618	2603
query10	458	285	283	283
query11	16276	15518	15690	15518
query12	168	105	104	104
query13	1681	398	374	374
query14	10505	7191	7130	7130
query15	206	175	175	175
query16	7569	481	471	471
query17	1543	586	568	568
query18	1895	305	297	297
query19	226	158	159	158
query20	121	115	112	112
query21	213	113	116	113
query22	4553	4273	4349	4273
query23	34411	33786	33755	33755
query24	9998	3138	3104	3104
query25	671	415	416	415
query26	1065	159	161	159
query27	2199	289	290	289
query28	6430	2109	2090	2090
query29	955	454	435	435
query30	294	169	156	156
query31	972	749	768	749
query32	110	56	58	56
query33	729	324	304	304
query34	920	485	500	485
query35	889	761	735	735
query36	1047	928	911	911
query37	146	90	86	86
query38	3920	3863	3855	3855
query39	1469	1432	1411	1411
query40	213	122	121	121
query41	54	50	50	50
query42	127	100	101	100
query43	500	439	430	430
query44	1229	799	782	782
query45	201	175	175	175
query46	1123	820	821	820
query47	1865	1789	1803	1789
query48	379	295	293	293
query49	1130	482	462	462
query50	935	433	440	433
query51	7127	6893	7046	6893
query52	104	94	89	89
query53	261	189	191	189
query54	815	478	473	473
query55	79	83	79	79
query56	306	286	283	283
query57	1206	1086	1077	1077
query58	248	239	246	239
query59	2688	2504	2610	2504
query60	319	292	284	284
query61	127	222	103	103
query62	907	680	697	680
query63	214	186	183	183
query64	5382	694	681	681
query65	3291	3153	3158	3153
query66	1335	307	303	303
query67	16215	15545	15391	15391
query68	3217	887	864	864
query69	443	326	338	326
query70	1112	1133	1134	1133
query71	362	346	348	346
query72	5963	3342	3391	3342
query73	611	599	587	587
query74	9241	9266	9108	9108
query75	3117	3002	2994	2994
query76	1914	871	862	862
query77	454	399	410	399
query78	9397	9421	9200	9200
query79	929	882	880	880
query80	870	848	829	829
query81	437	271	271	271
query82	271	268	263	263
query83	195	191	196	191
query84	232	109	110	109
query85	701	416	395	395
query86	341	324	335	324
query87	4415	4225	4449	4225
query88	4201	4124	4140	4124
query89	387	363	374	363
query90	1330	326	326	326
query91	129	126	169	126
query92	79	81	77	77
query93	1066	1093	1075	1075
query94	622	384	397	384
query95	474	435	435	435
query96	484	485	476	476
query97	3120	3109	3118	3109
query98	232	232	225	225
query99	1565	1342	1310	1310
Total cold run time: 276730 ms
Total hot run time: 195149 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.46 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f8110c95ce6d622fb20dcd1b9aa45ab8dd56f808, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.08	0.08
query5	0.50	0.54	0.50
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.58	0.51	0.52
query10	0.58	0.57	0.58
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.62
query14	1.50	1.49	1.49
query15	0.90	0.90	0.89
query16	0.36	0.37	0.37
query17	1.02	1.05	1.01
query18	0.21	0.21	0.22
query19	1.89	1.82	1.79
query20	0.01	0.01	0.01
query21	15.41	0.66	0.65
query22	4.35	7.68	1.63
query23	18.08	1.24	1.23
query24	2.24	0.22	0.22
query25	0.18	0.08	0.08
query26	0.29	0.18	0.19
query27	0.07	0.08	0.07
query28	13.18	1.14	1.11
query29	12.53	3.34	3.34
query30	0.24	0.05	0.06
query31	2.87	0.42	0.42
query32	3.22	0.50	0.50
query33	3.01	3.05	3.12
query34	15.45	4.31	4.32
query35	4.32	4.38	4.35
query36	0.70	0.49	0.48
query37	0.20	0.17	0.16
query38	0.17	0.15	0.16
query39	0.05	0.04	0.03
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 108.63 s
Total hot run time: 31.46 s

@Mryange Mryange changed the title [only test]Opt time format 2 [opt](function) optimize from_unixtime/date_format by specially format str Sep 13, 2024
@Mryange Mryange marked this pull request as ready for review September 13, 2024 23:50
@Mryange
Copy link
Contributor Author

Mryange commented Sep 13, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.90% (9471/25670)
Line Coverage: 28.27% (77916/275582)
Region Coverage: 27.67% (40223/145346)
Branch Coverage: 24.27% (20431/84166)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b40e4f69549cde64ebea04e6a07ecc1a0b480d34_b40e4f69549cde64ebea04e6a07ecc1a0b480d34/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 42617 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b40e4f69549cde64ebea04e6a07ecc1a0b480d34, data reload: false

------ Round 1 ----------------------------------
q1	17593	7220	7189	7189
q2	2021	185	172	172
q3	10707	1272	1416	1272
q4	10468	924	1010	924
q5	7703	3148	3114	3114
q6	237	153	149	149
q7	1063	656	633	633
q8	9470	2029	2036	2029
q9	6773	6254	6289	6254
q10	7029	2521	2514	2514
q11	444	258	258	258
q12	399	234	226	226
q13	17762	3046	3037	3037
q14	292	247	256	247
q15	564	530	522	522
q16	542	430	430	430
q17	989	946	957	946
q18	7335	6698	6804	6698
q19	1395	1236	1226	1226
q20	602	342	332	332
q21	3868	3478	3479	3478
q22	1076	967	969	967
Total cold run time: 108332 ms
Total hot run time: 42617 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7145	7144	7144	7144
q2	336	234	242	234
q3	3056	3065	3075	3065
q4	2087	2107	2051	2051
q5	5675	5634	5671	5634
q6	240	149	147	147
q7	2135	1786	1771	1771
q8	3359	3441	3409	3409
q9	8746	8850	8755	8755
q10	3530	3504	3531	3504
q11	601	479	468	468
q12	822	652	615	615
q13	9342	3205	3183	3183
q14	303	283	281	281
q15	588	550	536	536
q16	498	464	467	464
q17	1798	1723	1721	1721
q18	8470	8121	8015	8015
q19	1753	1744	1739	1739
q20	2125	1898	1866	1866
q21	5888	5579	5661	5579
q22	1089	1040	1018	1018
Total cold run time: 69586 ms
Total hot run time: 61199 ms

@Mryange
Copy link
Contributor Author

Mryange commented Sep 14, 2024

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 42938 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b40e4f69549cde64ebea04e6a07ecc1a0b480d34, data reload: false

------ Round 1 ----------------------------------
q1	17574	7319	7255	7255
q2	2032	194	185	185
q3	10454	1358	1385	1358
q4	10164	964	1005	964
q5	7728	3206	3146	3146
q6	240	152	155	152
q7	1052	643	631	631
q8	9651	2060	1991	1991
q9	7388	6295	6305	6295
q10	7085	2515	2514	2514
q11	443	259	256	256
q12	430	225	225	225
q13	17760	3049	3037	3037
q14	292	249	252	249
q15	588	538	517	517
q16	553	423	431	423
q17	997	967	942	942
q18	7479	6987	6701	6701
q19	1376	1237	1227	1227
q20	603	332	337	332
q21	3919	3582	3565	3565
q22	1074	973	995	973
Total cold run time: 108882 ms
Total hot run time: 42938 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7175	7143	7154	7143
q2	339	231	246	231
q3	2954	2903	2924	2903
q4	1969	2012	1995	1995
q5	5455	5452	5507	5452
q6	240	147	147	147
q7	2058	1675	1682	1675
q8	3261	3340	3345	3340
q9	8432	8490	8416	8416
q10	3390	3453	3441	3441
q11	569	467	476	467
q12	753	545	612	545
q13	7642	3066	3056	3056
q14	304	277	264	264
q15	576	557	524	524
q16	500	446	454	446
q17	1767	1681	1726	1681
q18	8023	7596	7707	7596
q19	1712	1695	1696	1695
q20	2040	1785	1795	1785
q21	5674	5426	5439	5426
q22	1117	1008	990	990
Total cold run time: 65950 ms
Total hot run time: 59218 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194889 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b40e4f69549cde64ebea04e6a07ecc1a0b480d34, data reload: false

query1	908	395	393	393
query2	4100	1807	1812	1807
query3	4082	207	223	207
query4	27535	24142	23883	23883
query5	2661	547	525	525
query6	256	171	164	164
query7	4197	308	301	301
query8	271	215	215	215
query9	6835	2593	2600	2593
query10	428	292	289	289
query11	16060	15585	15469	15469
query12	156	98	101	98
query13	1686	400	378	378
query14	9279	6765	7101	6765
query15	212	169	185	169
query16	6548	498	487	487
query17	978	582	573	573
query18	1757	298	292	292
query19	200	153	154	153
query20	118	114	113	113
query21	214	109	107	107
query22	4465	4187	4159	4159
query23	34608	33823	33565	33565
query24	9119	3143	3092	3092
query25	655	419	415	415
query26	1345	166	163	163
query27	2156	286	290	286
query28	4781	2102	2088	2088
query29	1054	437	432	432
query30	302	170	160	160
query31	988	781	822	781
query32	106	59	60	59
query33	699	302	325	302
query34	900	481	504	481
query35	890	762	750	750
query36	1092	917	900	900
query37	232	84	88	84
query38	4048	3919	3910	3910
query39	1544	1406	1423	1406
query40	261	117	118	117
query41	50	46	46	46
query42	125	103	100	100
query43	517	446	465	446
query44	1236	781	766	766
query45	197	168	168	168
query46	1102	810	809	809
query47	1847	1761	1783	1761
query48	367	299	293	293
query49	956	449	447	447
query50	933	434	438	434
query51	7155	6970	6957	6957
query52	102	87	87	87
query53	263	191	184	184
query54	814	480	469	469
query55	78	78	76	76
query56	318	281	270	270
query57	1189	1091	1049	1049
query58	244	241	242	241
query59	2826	2602	2547	2547
query60	312	280	276	276
query61	107	105	99	99
query62	929	681	678	678
query63	224	193	186	186
query64	4172	713	690	690
query65	3282	3193	3168	3168
query66	1290	342	291	291
query67	15970	15608	15319	15319
query68	2674	592	589	589
query69	426	283	270	270
query70	1206	1079	1119	1079
query71	333	282	291	282
query72	5602	4030	4026	4026
query73	762	329	334	329
query74	9274	9191	8998	8998
query75	3361	2715	2729	2715
query76	1880	1288	1272	1272
query77	436	325	320	320
query78	10094	9437	9725	9437
query79	921	897	872	872
query80	875	863	860	860
query81	486	328	266	266
query82	276	268	265	265
query83	196	189	193	189
query84	260	107	109	107
query85	723	399	398	398
query86	318	289	315	289
query87	4372	4390	4384	4384
query88	4207	4125	4104	4104
query89	384	378	376	376
query90	1675	323	321	321
query91	128	127	127	127
query92	80	77	77	77
query93	1060	1076	1052	1052
query94	633	389	384	384
query95	481	428	422	422
query96	476	473	475	473
query97	3150	3102	3111	3102
query98	224	247	225	225
query99	1530	1313	1291	1291
Total cold run time: 262834 ms
Total hot run time: 194889 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.97 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b40e4f69549cde64ebea04e6a07ecc1a0b480d34, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.51	0.50	0.51
query6	1.14	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.58	0.52	0.52
query10	0.57	0.60	0.57
query11	0.17	0.12	0.13
query12	0.15	0.13	0.13
query13	0.62	0.60	0.60
query14	1.45	1.48	1.49
query15	0.90	0.88	0.88
query16	0.37	0.36	0.35
query17	0.99	1.04	1.06
query18	0.17	0.16	0.17
query19	1.94	1.83	1.86
query20	0.01	0.01	0.02
query21	15.39	0.69	0.65
query22	4.46	7.62	1.24
query23	17.70	1.27	1.19
query24	2.25	0.21	0.22
query25	0.19	0.08	0.07
query26	0.28	0.18	0.18
query27	0.08	0.07	0.07
query28	13.17	1.12	1.09
query29	12.53	3.30	3.34
query30	0.25	0.06	0.06
query31	2.87	0.43	0.42
query32	3.24	0.51	0.50
query33	3.02	3.05	3.05
query34	15.45	4.31	4.29
query35	4.32	4.37	4.36
query36	0.70	0.51	0.51
query37	0.19	0.17	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.16	0.14	0.14
query41	0.10	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 108.31 s
Total hot run time: 30.97 s

#include <variant>

#include "vec/common/string_ref.h"
namespace doris::vectorized {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

doris::vectorized::time_format_type

namespace time_format_type {

template <typename T>
void inline put_year(T y, char* buf, int& i) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need inline, the template func must be inline

res_data.reserve(len * format.size + len);
null_map.resize_fill(len, false);

if (!format_state->is_valid) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is_valid should set null, is danger behavioer

@Mryange
Copy link
Contributor Author

Mryange commented Sep 14, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 43291 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 33bdf78800d4e5bef5b417a6f76aea811c61fc0d, data reload: false

------ Round 1 ----------------------------------
q1	17601	7337	7330	7330
q2	2066	186	194	186
q3	10634	1273	1432	1273
q4	10294	1090	1056	1056
q5	7734	3186	3183	3183
q6	242	154	148	148
q7	1049	640	604	604
q8	9469	2015	2059	2015
q9	6849	6358	6312	6312
q10	7024	2550	2537	2537
q11	432	254	239	239
q12	401	228	227	227
q13	17757	3047	3035	3035
q14	291	238	247	238
q15	587	547	527	527
q16	524	429	422	422
q17	995	953	976	953
q18	7694	6895	6927	6895
q19	1380	1251	1237	1237
q20	631	338	332	332
q21	3891	3531	3506	3506
q22	1067	1036	1040	1036
Total cold run time: 108612 ms
Total hot run time: 43291 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7190	7223	7165	7165
q2	366	240	242	240
q3	3140	3119	3078	3078
q4	2125	2071	2030	2030
q5	5699	5627	5698	5627
q6	250	150	147	147
q7	2154	1791	1771	1771
q8	3409	3464	3443	3443
q9	8833	8918	8857	8857
q10	3483	3587	3581	3581
q11	581	499	464	464
q12	830	609	624	609
q13	6623	3228	3225	3225
q14	304	281	273	273
q15	617	543	524	524
q16	521	473	460	460
q17	1807	1723	1798	1723
q18	8598	8092	8143	8092
q19	1782	1772	1756	1756
q20	2146	1880	1894	1880
q21	5947	5512	5678	5512
q22	1142	1061	1004	1004
Total cold run time: 67547 ms
Total hot run time: 61461 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.93% (9481/25675)
Line Coverage: 28.29% (77969/275637)
Region Coverage: 27.70% (40265/145374)
Branch Coverage: 24.30% (20455/84180)
Coverage Report: http://coverage.selectdb-in.cc/coverage/33bdf78800d4e5bef5b417a6f76aea811c61fc0d_33bdf78800d4e5bef5b417a6f76aea811c61fc0d/report/index.html

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 14, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@Mryange
Copy link
Contributor Author

Mryange commented Sep 18, 2024

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 41228 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 33bdf78800d4e5bef5b417a6f76aea811c61fc0d, data reload: false

------ Round 1 ----------------------------------
q1	17596	7300	7222	7222
q2	2031	177	151	151
q3	10942	1072	1171	1072
q4	10573	771	708	708
q5	7730	3064	3064	3064
q6	235	151	149	149
q7	999	611	618	611
q8	9423	2058	2025	2025
q9	6900	6402	6419	6402
q10	7052	2274	2316	2274
q11	449	238	249	238
q12	407	216	213	213
q13	17771	2984	2981	2981
q14	238	208	217	208
q15	564	525	511	511
q16	669	618	630	618
q17	980	807	797	797
q18	7299	6551	6583	6551
q19	1455	1069	1026	1026
q20	570	279	284	279
q21	4017	3142	3186	3142
q22	1088	1018	986	986
Total cold run time: 108988 ms
Total hot run time: 41228 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7263	7242	7724	7242
q2	330	229	230	229
q3	3002	2888	2953	2888
q4	2042	1810	1808	1808
q5	5637	5610	5618	5610
q6	241	146	145	145
q7	2193	1786	1771	1771
q8	3399	3423	3450	3423
q9	8785	8937	8758	8758
q10	3547	3448	3488	3448
q11	566	484	473	473
q12	813	587	600	587
q13	9464	3141	3147	3141
q14	308	277	278	277
q15	567	533	538	533
q16	706	680	682	680
q17	1794	1575	1614	1575
q18	8223	7730	7706	7706
q19	1690	1573	1432	1432
q20	2101	1873	1875	1873
q21	5516	5359	5366	5359
q22	1105	1059	1047	1047
Total cold run time: 69292 ms
Total hot run time: 60005 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198385 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 33bdf78800d4e5bef5b417a6f76aea811c61fc0d, data reload: false

query1	1268	886	906	886
query2	6277	2123	2008	2008
query3	10745	3990	3946	3946
query4	62476	29185	23416	23416
query5	5151	485	474	474
query6	409	178	174	174
query7	5418	322	308	308
query8	327	217	223	217
query9	8364	2644	2634	2634
query10	439	277	283	277
query11	17414	15104	15700	15104
query12	150	101	106	101
query13	1467	441	420	420
query14	9746	7653	7457	7457
query15	218	171	172	171
query16	6726	504	502	502
query17	1158	618	594	594
query18	1565	309	312	309
query19	209	157	154	154
query20	129	106	104	104
query21	212	108	106	106
query22	4582	4472	4737	4472
query23	34696	33722	34118	33722
query24	6041	2983	2849	2849
query25	475	382	372	372
query26	645	158	158	158
query27	1693	281	287	281
query28	4005	2433	2432	2432
query29	638	393	406	393
query30	224	151	154	151
query31	955	787	786	786
query32	70	55	55	55
query33	464	275	271	271
query34	902	498	490	490
query35	826	707	717	707
query36	1074	948	942	942
query37	145	83	84	83
query38	3902	3983	3934	3934
query39	1440	1397	1382	1382
query40	206	93	93	93
query41	47	44	47	44
query42	107	91	93	91
query43	512	484	496	484
query44	1136	799	792	792
query45	190	158	163	158
query46	1111	763	740	740
query47	1900	1804	1820	1804
query48	463	349	360	349
query49	693	408	410	408
query50	844	405	402	402
query51	7110	6903	6928	6903
query52	96	87	88	87
query53	246	174	178	174
query54	549	440	454	440
query55	74	74	80	74
query56	283	261	249	249
query57	1186	1079	1090	1079
query58	214	239	231	231
query59	3203	3015	3008	3008
query60	300	277	274	274
query61	104	101	100	100
query62	763	672	658	658
query63	246	186	181	181
query64	1381	652	632	632
query65	3274	3157	3162	3157
query66	690	299	300	299
query67	16160	15611	15388	15388
query68	1232	554	549	549
query69	411	281	274	274
query70	1201	1121	1090	1090
query71	320	272	267	267
query72	5964	4055	3937	3937
query73	757	331	332	331
query74	9315	9140	8919	8919
query75	3340	2616	2703	2616
query76	1355	840	947	840
query77	420	283	292	283
query78	10074	9518	9332	9332
query79	1147	877	857	857
query80	813	565	562	562
query81	494	250	255	250
query82	1116	227	233	227
query83	223	158	156	156
query84	284	97	110	97
query85	731	376	351	351
query86	320	329	304	304
query87	4391	4346	4454	4346
query88	4302	4027	4029	4027
query89	377	352	354	352
query90	1663	310	307	307
query91	162	166	161	161
query92	76	71	78	71
query93	929	877	877	877
query94	668	446	359	359
query95	486	402	406	402
query96	481	478	487	478
query97	3137	3120	3155	3120
query98	230	224	217	217
query99	1471	1298	1285	1285
Total cold run time: 303623 ms
Total hot run time: 198385 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 33bdf78800d4e5bef5b417a6f76aea811c61fc0d, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.49	0.49	0.52
query6	1.15	0.74	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.50	0.49
query10	0.55	0.57	0.55
query11	0.14	0.10	0.11
query12	0.15	0.11	0.11
query13	0.61	0.59	0.59
query14	2.93	2.99	2.98
query15	0.91	0.82	0.81
query16	0.39	0.39	0.38
query17	0.99	1.04	1.05
query18	0.19	0.19	0.19
query19	1.95	1.83	2.05
query20	0.01	0.01	0.01
query21	15.35	0.58	0.58
query22	2.95	2.64	2.30
query23	17.21	0.91	0.82
query24	3.32	1.56	1.39
query25	0.27	0.16	0.10
query26	0.49	0.14	0.14
query27	0.04	0.04	0.04
query28	9.89	1.09	1.08
query29	12.56	3.28	3.26
query30	0.25	0.06	0.06
query31	2.88	0.37	0.39
query32	3.28	0.48	0.45
query33	2.98	2.99	3.03
query34	16.80	4.37	4.37
query35	4.43	4.49	4.44
query36	0.65	0.47	0.47
query37	0.09	0.05	0.05
query38	0.04	0.03	0.03
query39	0.03	0.02	0.03
query40	0.15	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.87 s
Total hot run time: 33.73 s

@HappenLee HappenLee merged commit 32d4b08 into apache:master Sep 18, 2024
23 of 28 checks passed
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
…t str (#40821)

```
 mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp;
+-----------------------------------+
| count(date_format(a, 'yyyyMMdd')) |
+-----------------------------------+
|                          16000000 |
+-----------------------------------+
1 row in set (0.53 sec)


mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp;
+-----------------------------------+
| count(date_format(a, 'yyyyMMdd')) |
+-----------------------------------+
|                          16000000 |
+-----------------------------------+
1 row in set (0.28 sec)
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.3-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants