Skip to content

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2199

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2199

Job Run time
2m 12s
2m 29s
14m 36s
2m 17s
11m 43s
1m 52s
6m 20s
8m 15s
18m 12s
11m 49s
10m 22s
9m 48s
16m 7s
16m 29s
10m 31s
6m 0s
22m 45s
20m 35s
9m 33s
12m 43s
17m 59s
14m 28s
11m 0s
14m 28s
23m 17s
16m 26s
10m 15s
12m 9s
26m 37s
20m 29s
8m 51s
10m 4s
24m 35s
26m 28s
16m 6s
16m 42s
11m 14s
9m 45s
7m 39s
10m 41s
10m 34s
9m 55s
9m 8s
12m 52s
10m 16s
10m 25s
9m 28s
7m 51s
16m 3s
13m 5s
8m 54s
12m 10s
10h 54m 32s