Skip to content

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2207

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2207

Job Run time
1m 29s
1m 54s
1m 49s
17m 49s
1m 44s
11m 29s
9m 48s
8m 7s
16m 32s
11m 34s
6m 28s
10m 13s
16m 44s
19m 53s
6m 2s
6m 6s
19m 19s
20m 15s
9m 31s
11m 56s
20m 49s
25m 27s
11m 44s
10m 58s
16m 21s
17m 38s
14m 0s
14m 10s
22m 55s
26m 4s
9m 42s
14m 28s
29m 14s
37m 25s
16m 48s
16m 2s
12m 31s
10m 11s
10m 31s
9m 3s
11m 24s
11m 32s
9m 0s
9m 47s
12m 51s
10m 30s
8m 50s
7m 26s
12m 44s
9m 46s
9m 4s
9m 39s
11h 17m 16s