v23.06.00

🚨 Breaking Changes

• Update minimum Python version to Python 3.9 (#1164) @shwina

🐛 Bug Fixes

• Increase pytest CI timeout (#1196) @pentschev
• Increase minimum timeout to wait for workers in CI (#1193) @pentschev
• Disable np.bool deprecation warning (#1182) @pentschev
• Always upload on branch/nightly builds (#1177) @raydouglass
• Workaround for DeviceHostFile tests with CuPy>=12.0.0 (#1175) @pentschev
• Temporarily relax Python constraint (#1166) @vyasr

📖 Documentation

• [doc] Add document about main guard. (#1157) @trivialfis

🚀 New Features

• Require Numba 0.57.0+ (#1185) @jakirkham
• Revert "Temporarily relax Python constraint" (#1171) @vyasr
• Update to zict 3.0 (#1160) @pentschev

🛠️ Improvements

• Add __main__ entrypoint to dask-cuda-worker CLI (#1181) @hmacdope
• run docs nightly too (#1176) @AyodeAwe
• Fix GHAs Workflows (#1172) @ajschmidt8
• Remove matrix_filter from workflows (#1168) @charlesbluca
• Revert to branch-23.06 for shared-action-workflows (#1167) @shwina
• Update minimum Python version to Python 3.9 (#1164) @shwina
• Remove usage of rapids-get-rapids-version-from-git (#1163) @jjacobelli
• Use ARC V2 self-hosted runners for GPU jobs (#1159) @jjacobelli

v23.04.00

🚨 Breaking Changes

• Pin dask and distributed for release (#1153) @galipremsagar
• Update minimum pandas and numpy pinnings (#1139) @galipremsagar

🐛 Bug Fixes

• Rectify dask-core pinning in pip requirements (#1155) @galipremsagar
• Monkey patching all locations of get_default_shuffle_algorithm (#1142) @madsbk
• Update usage of get_worker() in tests (#1141) @pentschev
• Update rmm_cupy_allocator usage (#1138) @jakirkham
• Serialize of ProxyObject to pickle fixed attributes (#1137) @madsbk
• Explicit-comms: update monkey patching of Dask (#1135) @madsbk
• Fix for bytes/str discrepancy after PyNVML update (#1118) @pentschev

🚀 New Features

• Allow specifying dashboard address in benchmarks (#1147) @pentschev
• Add argument to enable RMM alloaction tracking in benchmarks (#1145) @pentschev
• Reinstate --death-timeout CLI option (#1140) @charlesbluca
• Extend RMM async allocation support (#1116) @pentschev
• Allow using stream-ordered and managed RMM allocators in benchmarks (#1012) @pentschev

🛠️ Improvements

• Pin dask and distributed for release (#1153) @galipremsagar
• Update minimum pandas and numpy pinnings (#1139) @galipremsagar
• Drop Python 3.7 handling for pickle protocol 4 (#1132) @jakirkham
• Adapt to rapidsai/rmm#1221 which moves allocator callbacks (#1129) @wence-
• Merge branch-23.02 into branch-23.04 (#1128) @ajschmidt8
• Template Conda recipe's about metadata (#1121) @jakirkham
• Fix GHA build workflow (#1120) @AjayThorve
• Reduce error handling verbosity in CI tests scripts (#1113) @AjayThorve
• Update shared workflow branches (#1112) @ajschmidt8
• Remove gpuCI scripts. (#1111) @bdice
• Unpin dask and distributed for development (#1110) @galipremsagar
• Move date to build string in conda recipe (#1103) @ajschmidt8

v23.02.01

🚨 Breaking Changes

• Pin dask and distributed for release (#1106) @galipremsagar

🐛 Bug Fixes

• Pin to pynvml < 11.5 (#1123) @wence-
• pre-commit: Update isort version to 5.12.0 (#1098) @wence-
• explicit-comms: don't mix - and _ in config (#1096) @madsbk
• Update cudf.Buffer pointer access method (#1094) @pentschev
• Update tests for Python 3.10 (#1086) @pentschev
• Use pkgutil.iter_modules to get un-imported module for test_pre_import (#1085) @charlesbluca
• Make proxy tests with LocalCUDACluster asynchronous (#1084) @pentschev
• Ensure consistent results from safe_sizeof() in test (#1071) @madsbk
• Pass missing argument to groupby benchmark compute (#1069) @mattf
• Reorder channel priority. (#1067) @bdice
• Fix owner check when the owner is a cupy array (#1061) @wence-

🛠️ Improvements

• Pin dask and distributed for release (#1106) @galipremsagar
• Update shared workflow branches (#1105) @ajschmidt8
• Proxify: make duplicate check optional (#1101) @madsbk
• Fix whitespace & add URLs in pyproject.toml (#1092) @jakirkham
• pre-commit: spell, whitespace, and mypy check (#1091) @madsbk
• shuffle: use cuDF's partition_by_hash() when available (#1090) @madsbk
• add initial docs build (#1089) @AjayThorve
• Remove --get-cluster-configuration option, check for scheduler in dask cuda config (#1088) @charlesbluca
• Add timeout to pytest command (#1082) @ajschmidt8
• shuffle-benchmark: add --partition-distribution (#1081) @madsbk
• Ensure tests run for Python 3.10 (#1080) @ajschmidt8
• Use TrackingResourceAdaptor to get better debug info (#1079) @madsbk
• Improve shuffle-benchmark (#1074) @madsbk
• Update builds for CUDA 11.8 and Python 310 (#1072) @ajschmidt8
• Shuffle by partition to reduce memory usage significantly (#1068) @madsbk
• Enable copy_prs. (#1063) @bdice
• Add GitHub Actions Workflows (#1062) @bdice
• Unpin dask and distributed for development (#1060) @galipremsagar
• Switch to the new dask CLI (#981) @jacobtomlinson

v23.02.00

🚨 Breaking Changes

• Pin dask and distributed for release (#1106) @galipremsagar

🐛 Bug Fixes

• pre-commit: Update isort version to 5.12.0 (#1098) @wence-
• explicit-comms: don't mix - and _ in config (#1096) @madsbk
• Update cudf.Buffer pointer access method (#1094) @pentschev
• Update tests for Python 3.10 (#1086) @pentschev
• Use pkgutil.iter_modules to get un-imported module for test_pre_import (#1085) @charlesbluca
• Make proxy tests with LocalCUDACluster asynchronous (#1084) @pentschev
• Ensure consistent results from safe_sizeof() in test (#1071) @madsbk
• Pass missing argument to groupby benchmark compute (#1069) @mattf
• Reorder channel priority. (#1067) @bdice
• Fix owner check when the owner is a cupy array (#1061) @wence-

🛠️ Improvements

• Pin dask and distributed for release (#1106) @galipremsagar
• Update shared workflow branches (#1105) @ajschmidt8
• Proxify: make duplicate check optional (#1101) @madsbk
• Fix whitespace & add URLs in pyproject.toml (#1092) @jakirkham
• pre-commit: spell, whitespace, and mypy check (#1091) @madsbk
• shuffle: use cuDF's partition_by_hash() when available (#1090) @madsbk
• add initial docs build (#1089) @AjayThorve
• Remove --get-cluster-configuration option, check for scheduler in dask cuda config (#1088) @charlesbluca
• Add timeout to pytest command (#1082) @ajschmidt8
• shuffle-benchmark: add --partition-distribution (#1081) @madsbk
• Ensure tests run for Python 3.10 (#1080) @ajschmidt8
• Use TrackingResourceAdaptor to get better debug info (#1079) @madsbk
• Improve shuffle-benchmark (#1074) @madsbk
• Update builds for CUDA 11.8 and Python 310 (#1072) @ajschmidt8
• Shuffle by partition to reduce memory usage significantly (#1068) @madsbk
• Enable copy_prs. (#1063) @bdice
• Add GitHub Actions Workflows (#1062) @bdice
• Unpin dask and distributed for development (#1060) @galipremsagar
• Switch to the new dask CLI (#981) @jacobtomlinson

v22.12.00

🚨 Breaking Changes

• Make local_directory a required argument for spilling impls (#1023) @wence-

🐛 Bug Fixes

• Fix parse_memory_limit function call (#1055) @galipremsagar
• Work around Jupyter errors in CI (#1041) @pentschev
• Fix version constraint (#1036) @wence-
• Support the new Buffer in cudf (#1033) @madsbk
• Install Dask nightly last in CI (#1029) @pentschev
• Fix recorded time in merge benchmark (#1028) @wence-
• Switch pre-import not found test to sync definition (#1026) @pentschev
• Make local_directory a required argument for spilling impls (#1023) @wence-
• Fixes for handling MIG devices (#950) @pentschev

📖 Documentation

• Merge 22.10 into 22.12 (#1016) @pentschev
• Merge 22.08 into 22.10 (#1010) @pentschev

🚀 New Features

• Allow specifying fractions as RMM pool initial/maximum size (#1021) @pentschev
• Add feature to get cluster configuration (#1006) @quasiben
• Add benchmark option to use dask-noop (#994) @wence-

🛠️ Improvements

• Ensure linting checks for whole repo in CI (#1053) @pentschev
• Pin dask and distributed for release (#1046) @galipremsagar
• Remove pytest-asyncio dependency (#1045) @pentschev
• Migrate as much as possible to pyproject.toml (#1035) @jakirkham
• Re-implement shuffle using staging (#1030) @madsbk
• Explicit-comms-shuffle: fine control of task scheduling (#1025) @madsbk
• Remove stale labeler (#1024) @raydouglass
• Unpin dask and distributed for development (#1005) @galipremsagar
• Support cuDF's built-in spilling (#984) @madsbk

v22.10.00

🐛 Bug Fixes

• Revert "Update rearrange_by_column patch for explicit comms" (#1001) @rjzamora
• Address CI failures caused by upstream distributed and cupy changes (#993) @rjzamora
• DeviceSerialized.reduce_ex: convert frame to numpy arrays (#977) @madsbk

📖 Documentation

• Remove line-break that's breaking link (#982) @ntabris
• Dask-cuda best practices (#976) @quasiben

🚀 New Features

• Add Groupby benchmark (#979) @rjzamora

🛠️ Improvements

• Pin dask and distributed for release (#1003) @galipremsagar
• Update rearrange_by_column patch for explicit comms (#992) @rjzamora
• benchmarks: Add option to suppress output of point to point data (#985) @wence-
• Unpin dask and distributed for development (#971) @galipremsagar

v22.08.00

🚨 Breaking Changes

• Fix useless property (#944) @wence-

🐛 Bug Fixes

• Fix distributed error related to loop_in_thread (#963) @galipremsagar
• Add __rmatmul__ to ProxyObject (#960) @jakirkham
• Always use versioneer command classes in setup.py (#948) @wence-
• Do not dispatch removed cudf.Frame._index object (#947) @pentschev
• Fix useless property (#944) @wence-
• LocalCUDACluster's memory limit: None means no limit (#943) @madsbk
• ProxyManager: support memory_limit=None (#941) @madsbk
• Remove deprecated loop kwarg to Nanny in CUDAWorker (#934) @pentschev
• Import cleanup fixture in test_dask_cuda_worker.py (#924) @pentschev

📖 Documentation

• Switch docs to use common js & css code (#967) @galipremsagar
• Switch language from None to "en" in docs build (#939) @galipremsagar

🚀 New Features

• Add communications bandwidth to benchmarks (#938) @pentschev

🛠️ Improvements

• Pin dask & distributed for release (#965) @galipremsagar
• Test memory_limit=None for CUDAWorker (#946) @wence-
• benchmarks: Record total number of workers in dataframe (#945) @wence-
• Benchmark refactoring: tidy data and multi-node capability via --scheduler-file (#940) @wence-
• Add util functions to simplify printing benchmarks results (#937) @pentschev
• Add --multiprocessing-method option to benchmarks (#933) @wence-
• Remove click pinning (#932) @charlesbluca
• Remove compiler variables (#929) @ajschmidt8
• Unpin dask & distributed for development (#927) @galipremsagar

v22.06.00

🚨 Breaking Changes

• Upgrade numba pinning to be in-line with rest of rapids (#912) @galipremsagar

🐛 Bug Fixes

• Reduce test_cudf_cluster_device_spill test and speed it up (#918) @pentschev
• Update ImportError tests with --pre-import (#914) @pentschev
• Add xfail mark to test_pre_import_not_found (#908) @pentschev
• Increase spill tests timeout to 30 seconds (#901) @pentschev
• Fix errors related with distributed.worker.memory.terminate (#900) @pentschev
• Skip tests on import error for some optional packages (#899) @pentschev
• Update auto host_memory computation when threads per worker > 1 (#896) @ayushdg
• Update black to 22.3.0 (#889) @charlesbluca
• Remove legacy check_python_3 (#886) @pentschev

📖 Documentation

• Add documentation for RAPIDS_NO_INITIALIZE (#898) @charlesbluca
• Use upstream warning functions for CUDA initialization (#894) @charlesbluca

🛠️ Improvements

• Pin dask and distributed for release (#922) @galipremsagar
• Pin dask & distributed for release (#916) @galipremsagar
• Upgrade numba pinning to be in-line with rest of rapids (#912) @galipremsagar
• Removing test of cudf.merge_sorted() (#905) @madsbk
• Disable include-ignored coverage warnings (#903) @pentschev
• Fix ci/local script (#902) @Ethyling
• Use conda to build python packages during GPU tests (#897) @Ethyling
• Pull requirements.txt into Conda recipe (#893) @jakirkham
• Unpin dask & distributed for development (#892) @galipremsagar
• Build packages using mambabuild (#846) @Ethyling

v22.04.00

🚨 Breaking Changes

• Introduce incompatible-types and enables spilling of CuPy arrays (#856) @madsbk

🐛 Bug Fixes

• Resolve build issues / consistency with conda-forge packages (#883) @charlesbluca
• Increase test_worker_force_spill_to_disk timeout (#857) @pentschev

📖 Documentation

• Remove description from non-existing --nprocs CLI argument (#852) @pentschev

🚀 New Features

• Add --pre-import/pre_import argument (#854) @pentschev
• Remove support for UCX < 1.11.1 (#830) @pentschev

🛠️ Improvements

• Raise ImportError when platform is not Linux (#885) @pentschev
• Temporarily disable new ops-bot functionality (#880) @ajschmidt8
• Pin dask & distributed (#878) @galipremsagar
• Upgrade min dask & distributed versions (#872) @galipremsagar
• Add .github/ops-bot.yaml config file (#871) @ajschmidt8
• Make Dask CUDA work with the new WorkerMemoryManager abstraction (#870) @shwina
• Implement ProxifyHostFile.evict() (#862) @madsbk
• Introduce incompatible-types and enables spilling of CuPy arrays (#856) @madsbk
• Spill to disk clean up (#853) @madsbk
• ProxyObject to support matrix multiplication (#849) @madsbk
• Unpin max dask and distributed (#847) @galipremsagar
• test_gds: skip if GDS is not available (#845) @madsbk
• ProxyObject implement array_function (#843) @madsbk
• Add option to track RMM allocations (#842) @shwina

v22.02.00

🐛 Bug Fixes

• Ignore DeprecationWarning from distutils.Version classes (#823) @pentschev
• Handle explicitly disabled UCX transports (#820) @pentschev
• Fix regex pattern to match to in test_on_demand_debug_info (#819) @pentschev
• Fix skipping GDS test if cucim is not installed (#813) @pentschev
• Unpin Dask and Distributed versions (#810) @pentschev
• Update to UCX-Py 0.24 (#805) @pentschev

📖 Documentation

• Fix Dask-CUDA version to 22.02 (#835) @jakirkham
• Merge branch-21.12 into branch-22.02 (#829) @pentschev
• Clarify LocalCUDACluster's n_workers docstrings (#812) @pentschev

🚀 New Features

• Pin dask & distributed versions (#832) @galipremsagar
• Expose rmm-maximum_pool_size argument (#827) @VibhuJawa
• Simplify UCX configs, permitting UCX_TLS=all (#792) @pentschev

🛠️ Improvements

• Add avg and std calculation for time and throughput (#828) @quasiben
• sizeof test: increase tolerance (#825) @madsbk
• Query UCX-Py from gpuCI versioning service (#818) @pentschev
• Standardize Distributed config separator in get_ucx_config (#806) @pentschev
• Fixed ProxyObject.__del__ to use the new Disk IO API from #791 (#802) @madsbk
• GPUDirect Storage (GDS) support for spilling (#793) @madsbk
• Disk IO interface (#791) @madsbk