[PySpark] Improve validation performance by enabling cache()
/unpersist()
toggles
#2188
Job | Run time |
---|---|
1m 24s | |
1m 25s | |
1m 50s | |
18m 43s | |
2m 24s | |
13m 28s | |
6m 10s | |
6m 36s | |
14m 45s | |
14m 4s | |
8m 13s | |
6m 24s | |
19m 51s | |
16m 39s | |
7m 49s | |
9m 8s | |
19m 54s | |
22m 43s | |
9m 37s | |
9m 53s | |
14m 35s | |
15m 28s | |
7m 42s | |
10m 39s | |
16m 4s | |
21m 3s | |
14m 14s | |
11m 56s | |
24m 26s | |
23m 11s | |
11m 2s | |
10m 39s | |
30m 57s | |
29m 34s | |
18m 24s | |
15m 2s | |
10m 6s | |
14m 11s | |
10m 35s | |
13m 36s | |
9m 37s | |
10m 49s | |
12m 17s | |
8m 51s | |
12m 29s | |
11m 27s | |
9m 25s | |
8m 3s | |
12m 8s | |
10m 29s | |
12m 7s | |
11m 53s | |
11h 3m 59s |