fix: Fix speculative decoding #2756
Job | Run time |
---|---|
16s | |
9m 30s | |
1m 23s | |
10m 1s | |
1m 5s | |
1m 21s | |
1m 8s | |
11m 11s | |
1m 12s | |
10m 9s | |
1m 29s | |
1m 19s | |
1m 35s | |
1m 40s | |
53m 19s |
Job | Run time |
---|---|
16s | |
9m 30s | |
1m 23s | |
10m 1s | |
1m 5s | |
1m 21s | |
1m 8s | |
11m 11s | |
1m 12s | |
10m 9s | |
1m 29s | |
1m 19s | |
1m 35s | |
1m 40s | |
53m 19s |