2024.8.2

Changes

• Avoid capturing code of xdist @fjetter (#8846)
• Reduce memory footprint of culling P2P rechunking @hendrikmakait (#8845)
• Add tests for choosing default rechunking method @hendrikmakait (#8843)
• Increase visibility of GPU CI updates @charlesbluca (#8841)
• Bump test_pause_while_idle timeout @fjetter (#8844)
• Concatenate small input chunks before P2P rechunking @hendrikmakait (#8832)
• Remove dump cluster from gen_cluster @fjetter (#8823)
• Bump numpy>=1.24 and pyarrow>=14.0.1 minimum versions @jrbourbeau (#8837)
• Fix PipInstall plugin on Worker @hendrikmakait (#8839)
• Remove more Python 3.10 compatibility code @jrbourbeau (#8824)
• Use task-based rechunking to prechunk along partial boundaries @hendrikmakait (#8831)
• Ensure client_desires_keys does not corrupt Scheduler state @fjetter (#8827)
• Bump minimum cloudpickle to 3 @jrbourbeau (#8836)

See the Changelog for more information.