Highlights
✨ pytask-parallel v0.5.0 is released. What is new?
🚀 pytask supports more backends, like dask and even more importantly, coiled.
coiled allows you to execute individual tasks in virtual machines from the cloud provider of your choice (AWS, GCP, Azure) as serverless functions.
You can also execute every task in a project in a coiled cluster.
There are also some smaller improvements.
- The documentation is now available under https://pytask-parallel.readthedocs.io/en/stable/.
stdout
andstderr
of subprocesses are being forwarded to the main process and displayed in case of errors.
What's Changed
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #83
- Simplify code since loky is a dependency. by @tobiasraabe in #85
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #87
- Restructure the package. by @tobiasraabe in #89
- Add a registry for the parallel backend. by @tobiasraabe in #90
- Update handling of
Traceback
. by @tobiasraabe in #88 - Redirect stdout and stderr. by @tobiasraabe in #92
- Add support for dask. by @tobiasraabe in #86
- Add documentation on rtd. by @tobiasraabe in #93
- Implement a none backend as default. by @tobiasraabe in #94
- Formalize backends and apply wrappers automatically. by @tobiasraabe in #95
- Handle local paths in remote workers. by @tobiasraabe in #96
- Schedule all ready tasks. by @tobiasraabe in #99
- Manage project with rye. by @tobiasraabe in #100
- Enable
@coiled.function
. by @tobiasraabe in #97 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #91
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #103
- Sync local paths in remote environments with the same OS. by @tobiasraabe in #101
- Schedule only all ready tasks when there are coiled functions. by @tobiasraabe in #106
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #105
- Remove
status
frompytask_execute_task_log_start
. by @tobiasraabe in #107 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #108
- Polish the documentation. by @tobiasraabe in #109
- Prepare release of v0.5. by @tobiasraabe in #110
Full Changelog: v0.4.1...v0.5.0