[PySpark] Improve validation performance by enabling cache()
/unpersist()
toggles
#2199
Job | Run time |
---|---|
2m 12s | |
2m 29s | |
14m 36s | |
2m 17s | |
11m 43s | |
1m 52s | |
6m 20s | |
8m 15s | |
18m 12s | |
11m 49s | |
10m 22s | |
9m 48s | |
16m 7s | |
16m 29s | |
10m 31s | |
6m 0s | |
22m 45s | |
20m 35s | |
9m 33s | |
12m 43s | |
17m 59s | |
14m 28s | |
11m 0s | |
14m 28s | |
23m 17s | |
16m 26s | |
10m 15s | |
12m 9s | |
26m 37s | |
20m 29s | |
8m 51s | |
10m 4s | |
24m 35s | |
26m 28s | |
16m 6s | |
16m 42s | |
11m 14s | |
9m 45s | |
7m 39s | |
10m 41s | |
10m 34s | |
9m 55s | |
9m 8s | |
12m 52s | |
10m 16s | |
10m 25s | |
9m 28s | |
7m 51s | |
16m 3s | |
13m 5s | |
8m 54s | |
12m 10s | |
10h 54m 32s |