vLLM model handler efficiency improvements #29766
Job | Run time |
---|---|
14s | |
1m 2s | |
0s | |
17m 23s | |
16m 50s | |
27m 7s | |
14m 29s | |
20m 34s | |
20s | |
23s | |
19s | |
20s | |
4m 21s | |
22s | |
20s | |
19s | |
0s | |
14s | |
5m 21s | |
37s | |
2m 20s | |
51s | |
51s | |
50m 13s | |
0s | |
0s | |
0s | |
2h 44m 50s |
Job | Run time |
---|---|
14s | |
1m 2s | |
0s | |
17m 23s | |
16m 50s | |
27m 7s | |
14m 29s | |
20m 34s | |
20s | |
23s | |
19s | |
20s | |
4m 21s | |
22s | |
20s | |
19s | |
0s | |
14s | |
5m 21s | |
37s | |
2m 20s | |
51s | |
51s | |
50m 13s | |
0s | |
0s | |
0s | |
2h 44m 50s |