Skip to content

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2188

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2188

Job Run time
1m 24s
1m 25s
1m 50s
18m 43s
2m 24s
13m 28s
6m 10s
6m 36s
14m 45s
14m 4s
8m 13s
6m 24s
19m 51s
16m 39s
7m 49s
9m 8s
19m 54s
22m 43s
9m 37s
9m 53s
14m 35s
15m 28s
7m 42s
10m 39s
16m 4s
21m 3s
14m 14s
11m 56s
24m 26s
23m 11s
11m 2s
10m 39s
30m 57s
29m 34s
18m 24s
15m 2s
10m 6s
14m 11s
10m 35s
13m 36s
9m 37s
10m 49s
12m 17s
8m 51s
12m 29s
11m 27s
9m 25s
8m 3s
12m 8s
10m 29s
12m 7s
11m 53s
11h 3m 59s