[PySpark] Improve validation performance by enabling cache()
/unpersist()
toggles
#2207
Job | Run time |
---|---|
1m 29s | |
1m 54s | |
1m 49s | |
17m 49s | |
1m 44s | |
11m 29s | |
9m 48s | |
8m 7s | |
16m 32s | |
11m 34s | |
6m 28s | |
10m 13s | |
16m 44s | |
19m 53s | |
6m 2s | |
6m 6s | |
19m 19s | |
20m 15s | |
9m 31s | |
11m 56s | |
20m 49s | |
25m 27s | |
11m 44s | |
10m 58s | |
16m 21s | |
17m 38s | |
14m 0s | |
14m 10s | |
22m 55s | |
26m 4s | |
9m 42s | |
14m 28s | |
29m 14s | |
37m 25s | |
16m 48s | |
16m 2s | |
12m 31s | |
10m 11s | |
10m 31s | |
9m 3s | |
11m 24s | |
11m 32s | |
9m 0s | |
9m 47s | |
12m 51s | |
10m 30s | |
8m 50s | |
7m 26s | |
12m 44s | |
9m 46s | |
9m 4s | |
9m 39s | |
11h 17m 16s |