- Update to 2023.1.1
## Enhancements
* P2P shuffle deduplicates data and can be run several times
(GH#7486) Hendrik Makait
* Reverse order of get_logs() and get_worker_logs() (GH#7475)
Nicholas R. Knezek
* Add prometheus metric for time and memory used per task prefix
(GH#7406) Thomas Grainger
* Additive worker counts in Prometheus (GH#7468) crusaderky
* Add help tool for taskstream (GH#7478) Florian Jetter
## Bug Fixes
* Do not allow for a worker to reject a drop replica request
(GH#7490) Hendrik Makait
* Fix un/packing for namedtuples with custom constructors
(GH#7465) antonymayi
* Documentation
* Remove timeout= from docstring example for worker_client
(GH#7497) Florian Jetter
## Maintenance
* Ignore get_default_shuffle_algorithm linting issue (GH#7506)
Florian Jetter
* Remove set_config when using default client (GH#7482) Florian
Jetter
* Update gpuCI RAPIDS_VER to 23.04 (GH#7501)
* Fix test_balance_expensive_tasks and improve helper functions
in test_steal.py (GH#7253) Hendrik Makait
* Sign every compute task with run ID to correlate response
(GH#7463) Hendrik Makait
- Release 2023.1.0
## New Features
* Add local SubprocessCluster that runs workers in separate
processes (GH#7431) Hendrik Makait
## Enhancements
* Ensure client session is quiet after cluster.close() or
client.shutdown() (GH#7429) James Bourbeau
* Set lifetime-stagger default value to None (GH#7445)
bstadlbauer
* Memory thresholds should never be exactly 0.0 (GH#7458) Stuart
Berg
* Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B.
Kristensen
* Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait
* Add support for packing namedtuple and add test for future
resolution in submit (GH#7292) Andrew
* Avoid deep copy on lz4 decompression (GH#7437) crusaderky
* Avoid deep copy of numpy buffers on unspill (GH#7435)
crusaderky
* Don’t error when clicking on empty task stream plot (GH#7432)
James Bourbeau
* Do not count spilled memory when comparing vs. process memory
(GH#7430) crusaderky
* Stop Client periodic callbacks during shutdown() (GH#7428)
James Bourbeau
* Add dask spec CLI (GH#7427) Matthew Rocklin
* Create new zstd (de)compressor for each compression call
(GH#7404) Dylan Wragge
* Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky
* Warn users when sizeof() returns inflated output (GH#7419)
crusaderky
## Bug Fixes
* Ensure dicts are properly recognized as msgpack serializable
(GH#7473) Florian Jetter
* Reset state of ShuffleSchedulerExtension on restart (GH#7446)
Hendrik Makait
* Reject non-string column names in P2P shuffle (GH#7447) Hendrik
Makait
* Avoid int32 in dashboard (GH#7443) Matthew Rocklin
* Fix P2PShuffle serialization for categorical data (GH#7410)
Hendrik Makait
* WorkerPorcess blocks on kill if still starting (GH#7424)
Matthew Rocklin
## Documentation
* Move Prometheus docs from dask/dask (GH#7405) crusaderky
## Maintenance
* Various cleanups in semaphore (GH#5885) Florian Jetter
* test_rlimit fails on MacOSX (GH#7457) crusaderky
* Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464)
* Remove conditional imports of psutil (GH#7462) crusaderky
* Drop support for zict < 2.1.0 (GH#7456) crusaderky
* Fix flaky test_digests (GH#7454) crusaderky
* Add minimum dependency testing to CI (GH#7285) Charles
Blackmon-Luca
* Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin
* Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin
* Add missing skips for pyarrow (GH#7416) Elliott Sales de
Andrade
* Be more permissive about expected ciphers in tests (GH#7417)
Elliott Sales de Andrade
* Revert “TST: Fetch executables from build root (GH#2551)”
(GH#7415) Elliott Sales de Andrade
OBS-URL: https://build.opensuse.org/request/show/1063268
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=130
- Update to version 2021.9.1
* Revert AMM ReduceReplicas and parallel AMMs updates
* Run multiple AMMs in parallel
* AMM ReduceReplicas to iterate only on replicated tasks
* Add type annotations to various functions within
distributed.worker
* Mark test_ucx_config_w_env_var flaky on UCX < 1.11
* Warn if CUDA context is created on incorrect device in UCX
* Remove redundant timeouts from test_client
* Allow Client to subscribe to events // Remote printing and
warning
* Test pickle protocols 4 & 5
* Fix-up test_pickle_empty
* Increase timeout for
test_worker_reconnects_mid_compute_multiple_states_on_scheduler
* Add synced dict between cluster and scheduler to store cluster
info
* Update test_sub_submit_priority
* Revert "Add test setup fixture
* Fix flaky test_worker_reconnects_mid_compute
* Use gen_test in test_adaptive
* Increase worker.suspicious_counter threshold
* Active Memory Manager framework + discard excess replicas
* Add test setup fixture
- Release version 2021.9.0
* Fix add_plugin warnings
* Add list around iterator in handle_missing_dep
* Jupyter-client 7 compatiblity
* Replace atop with blockwise
* Add pytest color to CI
* Fix test_map and others
* Use name argument with Scheduler.remove_plugin calls
* Downgrade to jupyter_client 6
* Migrate Security HTML repr to Jinja2
* Migrate ProcessInterface HTML repr to Jinja2
* Add support for diskless machines to system monitor
* Avoid during-iteration scheduler plugin changes
* Remove GroupProgress scheduler plugin
* Properly check for ipv6 availability
* Improved IPv6 dask-worker support
* Overwrite worker plugins
* Refactor scheduler plugins; store in a dictionary
* Fix "then" -> "than" typo in docs
* Fix typo (remove extra verb "creates") in docs
* Fix "fractiom" -> "fraction" typo in docstring
* Fix "schedulers" -> "scheduler" typo in docs
* Use non-histogram plots up to 100 workers
- Release 2021.08.1
* Rename plots to fit in the labextension
* Log messages for CommClosedError now includes information
about remote address
* Add target='_blank' for redirects of dashboard link
* Update computation code retrieval logic
* Minor polish on cfexecutor
* Use development version of dask in gpuCI build
* Use upstream dask.widgets
* Fix flaky test_worker_reconnects_mid_compute
* Update WorkerPlugin docstring about usage of TaskState objects
* Worker Network Timeseries
* Add HTML Repr for ProcessInterface class and all its subclasses
* Fix an issue where a reconnecting worker could cause an
invalid transition
* Minor fixes for cfexecutor
* Add HTML Repr for Security class
* Fix performance report sizing issue
* Drop RMM compatibility code from RAPIDS < 0.11
- Release 2021.08.0
* Include addresses in closed comm repr
* Test nanny.environ precedence
* Migrating HTML reprs to jinja2
* Fix test_process_executor_kills_process flakyness
* Remove urllib3 as a dependency downloading preloads
* Download preload urls in the Preload constructor
* Avoid recursion error in profile.merge
* Add text exceptions to the Scheduler
* Use kwarg for Theme filename
* Add a .git-ignore-revs file
* Replace not not with bool()
* Resolve deadlock cause by transition error after fetching
dependency
* Set z-index of data-table lower
* Add no-worker - memory transition to scheduler
* Deprecate worker plugin overwrite policy
* Fix flaky tests in CI
* Instructions for jemalloc with brew on macOS
* Bump RAPIDS_VER to 21.10
* Tweak verbiage around async functions
* Use Python 3 super() calls
* Support asynchronous tasks
* Rename total comm bytes and provide doc string
* Add GPU executor if GPU is present
* Fix RMM and UCX tests
* Remove excessive timeout of
test_steal_during_task_deserialization
* Add gpuCI build script
* Demote Worker.ensure_computing to function
OBS-URL: https://build.opensuse.org/request/show/921004
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=100
Dominique Leuenberger
