* see corresponding dask update:
* https://docs.dask.org/en/stable/changelog.html#v2023-12-0
* Bokeh 3.3.0 compatibility
- Update to version 2022.11.1
* Automatically mark all WorkerState tests (:pr:`6706`) crusaderky
- Update to 2022.6.1
- add distributed-fix-python310.patch to fix build with python 3.10
- Update to version 2021.9.1
* Fix add_plugin warnings
* Add list around iterator in handle_missing_dep
* Jupyter-client 7 compatiblity
* Add standalone dashboard page for GPU usage (GH#4556) Jacob
* Handle stream is None case in TCP comm finalizer (GH#4631)
* Include LIST_PICKLE in NumPy array serialization (GH#4632)
* Rename annotation plugin in test_highlevelgraph.py (GH#4618)
* Skip NumPy and pandas tests if not importable (GH#4563) Ben
* Remove utils.shutting_down in favor of sys.is_finalizing
* Introduce events log length config option (GH#4615) Fabian
* Upstream config serialization and inheritance (GH#4372) Jacob
* Add check to scheduler creation in SpecCluster (GH#4605) Jacob
* Make length of events deque configurable (GH#4604) Fabian
* Add explicit fetch state to worker TaskState (GH#4470) Gil
* pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B.
* Switch documentation builds for PRs to readthedocs (GH#4599)
* If SpecCluster fails to start attempt to gracefully close out
* IPython magics: remove deprecated ioloop workarounds (GH#4530)
* Add GitHub actions workflow to cancel duplicate builds
* Remove outdated macOS build badge from README (GH#4576) James
* Change default branch from master to main (GH#4495) Julia
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=149
- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
test code introspection
* Zero-copy P2P Array Rechunking
* Deprecating PyArrow <14.0.1
* Improved PyArrow filesystem for Parquet
* Improve Type Reconciliation in P2P Shuffling
* official support for Python 3.12
* Reduced memory pressure for multi array reductions
* improved P2P shuffling robustness
* Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)
OBS-URL: https://build.opensuse.org/request/show/1127185
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=72
- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090796
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=70
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
* Fix flaky
test_dask_worker.py::test_single_executable_deprecated
(GH#7817) Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090160
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=142
- Update to 2023.3.2
## Enhancements
* Enhanced thread-safety in zict.File (GH#7691) crusaderky
* Future deserialization without available client (GH#7580)
Florian Jetter
* Support adjusting GIL monitoring interval (GH#7650) Miles
* Gracefully stop GIL monitoring if running (GH#7652) Miles
* Fine performance metrics for execute, gather_dep, etc.
(GH#7586) crusaderky
* Add GIL metric to dashboard (GH#7646) Miles
* Expose scheduler idle via RPC and HTTP API (GH#7642) Jacob
Tomlinson
* Add full dashboard link in scheduler logs (GH#7631) Miles
## Bug Fixes
* Tell workers when their peers have left (so they don’t hang
fetching data from them) (GH#7574) Thomas Grainger
* Fix regression in dashboard after (GH#7586) (GH#7683)
crusaderky
* Fix OverflowError in Cluster._sync_cluster_info() (GH#7648)
Hendrik Makait
* Ensure that serialized data is measured correctly (GH#7593)
Florian Jetter
## Maintenance
* Avoid bool object has no attribute close in @gen_cluster
(GH#7657) Thomas Grainger
* Fix failing test_server_close_stops_gil_monitoring (GH#7659)
James Bourbeau
* Remove weakref finalizer for Offload Executor (GH#7644) Florian
Jetter
- Enable python311 build and test: numba not a strict requirement
OBS-URL: https://build.opensuse.org/request/show/1074755
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=138
Has to go together with sr#1071019!
- Skip more flaky tests
- Update to 2023.3.1
## Enhancements
* Add Jupyter link to dashboard menu if --jupyter flag is set
(GH#7638) Jacob Tomlinson
* Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
* Extend dask metapackage dependencies (GH#7630) James Bourbeau
* Further improvements to Client.restart_workers (GH#7620) Miles
* P2P offload get_output_partition (GH#7587) Florian Jetter
* Initial integration of GIL contention metric (GH#7624) Miles
* Add dashboard documentation links (GH#7610) Miles
* Rename shuffle/rechunk config option/kwarg to method (GH#7623)
Hendrik Makait
* Return results in restart_workers (GH#7606) Miles
* Ensure client key cancellation uses ordered messages (GH#7583)
Florian Jetter
## Bug Fixes
* Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
* Don’t send client heartbeat without a scheduler_comm (GH#7612)
James Bourbeau
* Do not unspill on free-keys (GH#7607) crusaderky
## Documentation
* Add notes to Client.submit, Client.map, and Client.scatter with
the description of the current task graph resolution algorithm
limitations (GH#7588) Eugene Druzhynin
## Maintenance
* Use range with pickle protocol versions (GH#7635) jakirkham
* Share thread pool among P2P shuffle runs (GH#7621) Hendrik
Makait
* Replace psutil suspend with BlockedGatherDep in
test_failing_worker_with_additional_replicas_on_cluster
(GH#7633) Thomas Grainger
* Ignore pkg_resources DeprecationWarning for mindeps (GH#7626)
Miles
* Implement wait_for using asyncio.timeout() on 3.11 (GH#7571)
Thomas Grainger
* Use tmp_path fixture instead of outdated tmpdir fixture
(GH#7582) ypogorelova
* Only one crick callback (GH#7614) crusaderky
* Add mindeps + numpy job to tests CI (GH#7609) Miles
* Do not xfail whole tests due to (GH#6705) (GH#7611) crusaderky
OBS-URL: https://build.opensuse.org/request/show/1071516
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=67
- Skip more flaky tests
- Update to 2023.3.1
## Enhancements
* Add Jupyter link to dashboard menu if --jupyter flag is set
(GH#7638) Jacob Tomlinson
* Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
* Extend dask metapackage dependencies (GH#7630) James Bourbeau
* Further improvements to Client.restart_workers (GH#7620) Miles
* P2P offload get_output_partition (GH#7587) Florian Jetter
* Initial integration of GIL contention metric (GH#7624) Miles
* Add dashboard documentation links (GH#7610) Miles
* Rename shuffle/rechunk config option/kwarg to method (GH#7623)
Hendrik Makait
* Return results in restart_workers (GH#7606) Miles
* Ensure client key cancellation uses ordered messages (GH#7583)
Florian Jetter
## Bug Fixes
* Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
* Don’t send client heartbeat without a scheduler_comm (GH#7612)
James Bourbeau
* Do not unspill on free-keys (GH#7607) crusaderky
## Documentation
* Add notes to Client.submit, Client.map, and Client.scatter with
the description of the current task graph resolution algorithm
limitations (GH#7588) Eugene Druzhynin
## Maintenance
* Use range with pickle protocol versions (GH#7635) jakirkham
* Share thread pool among P2P shuffle runs (GH#7621) Hendrik
Makait
OBS-URL: https://build.opensuse.org/request/show/1071308
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=136
- Update to 2023.1.1
## Enhancements
* P2P shuffle deduplicates data and can be run several times
(GH#7486) Hendrik Makait
* Reverse order of get_logs() and get_worker_logs() (GH#7475)
Nicholas R. Knezek
* Add prometheus metric for time and memory used per task prefix
(GH#7406) Thomas Grainger
* Additive worker counts in Prometheus (GH#7468) crusaderky
* Add help tool for taskstream (GH#7478) Florian Jetter
## Bug Fixes
* Do not allow for a worker to reject a drop replica request
(GH#7490) Hendrik Makait
* Fix un/packing for namedtuples with custom constructors
(GH#7465) antonymayi
* Documentation
* Remove timeout= from docstring example for worker_client
(GH#7497) Florian Jetter
## Maintenance
* Ignore get_default_shuffle_algorithm linting issue (GH#7506)
Florian Jetter
* Remove set_config when using default client (GH#7482) Florian
Jetter
* Update gpuCI RAPIDS_VER to 23.04 (GH#7501)
* Fix test_balance_expensive_tasks and improve helper functions
in test_steal.py (GH#7253) Hendrik Makait
* Sign every compute task with run ID to correlate response
(GH#7463) Hendrik Makait
- Release 2023.1.0
## New Features
* Add local SubprocessCluster that runs workers in separate
processes (GH#7431) Hendrik Makait
## Enhancements
* Ensure client session is quiet after cluster.close() or
client.shutdown() (GH#7429) James Bourbeau
* Set lifetime-stagger default value to None (GH#7445)
bstadlbauer
* Memory thresholds should never be exactly 0.0 (GH#7458) Stuart
Berg
* Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B.
Kristensen
* Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait
* Add support for packing namedtuple and add test for future
resolution in submit (GH#7292) Andrew
* Avoid deep copy on lz4 decompression (GH#7437) crusaderky
* Avoid deep copy of numpy buffers on unspill (GH#7435)
crusaderky
* Don’t error when clicking on empty task stream plot (GH#7432)
James Bourbeau
* Do not count spilled memory when comparing vs. process memory
(GH#7430) crusaderky
* Stop Client periodic callbacks during shutdown() (GH#7428)
James Bourbeau
* Add dask spec CLI (GH#7427) Matthew Rocklin
* Create new zstd (de)compressor for each compression call
(GH#7404) Dylan Wragge
* Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky
* Warn users when sizeof() returns inflated output (GH#7419)
crusaderky
## Bug Fixes
* Ensure dicts are properly recognized as msgpack serializable
(GH#7473) Florian Jetter
* Reset state of ShuffleSchedulerExtension on restart (GH#7446)
Hendrik Makait
* Reject non-string column names in P2P shuffle (GH#7447) Hendrik
Makait
* Avoid int32 in dashboard (GH#7443) Matthew Rocklin
* Fix P2PShuffle serialization for categorical data (GH#7410)
Hendrik Makait
* WorkerPorcess blocks on kill if still starting (GH#7424)
Matthew Rocklin
## Documentation
* Move Prometheus docs from dask/dask (GH#7405) crusaderky
## Maintenance
* Various cleanups in semaphore (GH#5885) Florian Jetter
* test_rlimit fails on MacOSX (GH#7457) crusaderky
* Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464)
* Remove conditional imports of psutil (GH#7462) crusaderky
* Drop support for zict < 2.1.0 (GH#7456) crusaderky
* Fix flaky test_digests (GH#7454) crusaderky
* Add minimum dependency testing to CI (GH#7285) Charles
Blackmon-Luca
* Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin
* Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin
* Add missing skips for pyarrow (GH#7416) Elliott Sales de
Andrade
* Be more permissive about expected ciphers in tests (GH#7417)
Elliott Sales de Andrade
* Revert “TST: Fetch executables from build root (GH#2551)”
(GH#7415) Elliott Sales de Andrade
OBS-URL: https://build.opensuse.org/request/show/1063268
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=130
- Update to 2022.12.1
## Enhancements
* SpillBuffer metrics (GH#7368) crusaderky
* Prometheus: measure how much spilling blocks the event loop (GH#7370) crusaderky
* Add transfer_outgoing_bytes_total metric (GH#7388) Gabe Joseph
* Fail P2PShuffle gracefully upon worker failure (GH#7326) Hendrik Makait
## Bug Fixes
* Select queued tasks in stimuli, not transitions (GH#7402) Gabe Joseph
* Check ContextVar in default_client (GH#7369) Matthew Rocklin
* Fix sending event messages to non-subscribers (GH#7014) Laurence Watts
* Set sizing mode on Tabs to avoid layout collapse (GH#7365) Mateusz Paprocki
## Maintenance
* Restructure P2PShuffle extensions (GH#7390) Hendrik Makait
* Add Python 3.11 classifier (GH#7408) James Bourbeau
* Add support for Python 3.11 (GH#7249) Thomas Grainger
* Add test for using annotations with client.submit and client.map (GH#7399) James Bourbeau
* Bump actions/checkout from 3.1.0 to 3.2.0 (GH#7393)
* Remove superfluous ShuffleSchedulerExtension.barriers (GH#7389) Hendrik Makait
* Remove ignore annotation-unchecked (GH#7379) crusaderky
* Remove tornado max version from nightly recipe (GH#7376) Charles Blackmon-Luca
* Remove the experimental feature warning for Semaphore (GH#7373) Florian Jetter
- Release 2022.12.0
## Enhancements
* Expose event loop health metrics in Prometheus (GH#7360) Hendrik Makait
* Allow log propagation by default (GH#5669) Florian Jetter
* Clean up of unpack_remotedata() (GH#7322) Mads R. B. Kristensen
* Upgrade to tornado 6.2 (GH#7286) Thomas Grainger
* Introduce Server level comm counters (GH#7332) Florian Jetter
* Prometheus debug log (GH#7302) Florian Jetter
## Bug Fixes
* Catch BaseException s from user tasks (GH#5997) Gabe Joseph
* Impossible use case of erred deps in transition to waiting (GH#7354) crusaderky
* Fix a deadlock when queued tasks are resubmitted quickly in succession (GH#7348) Florian Jetter
## Maintenance
* Fetch all artifacts (GH#7355) Enrico Minack
* Delay fsspec and urllib3 import time (GH#6659) Florian Jetter
* Bump mypy (GH#7349) crusaderky
* Bump mypy and remove win specific run (GH#7344) Florian Jetter
* Finish overhaul of SchedulerState annotations (GH#7333) crusaderky
* Fix flaky test_pause_while_spilling (GH#7334) Gabe Joseph
* Update gpuCI RAPIDS_VER to 23.02 (GH#7337)
- Drop distributed-pr7286-tornado-6-2.patch
- Move to PEP517 build
OBS-URL: https://build.opensuse.org/request/show/1056224
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=128
- Update to version 2022.11.1
## Enhancements
* Restrict bokeh=3 support (GH#7329) Gabe Joseph (ignored in rpm
fixed by bokek 3.0.2, see gh#dask/dask#9659)
* Respect death timeout when waiting for scheduler file (GH#7296)
Florian Jetter
* Always raise exception if P2PShuffle s send fails (GH#7317)
Hendrik Makait
## Maintenance
* Remove exception handling from transitions (GH#7316) crusaderky
* Turn private functions into private SchedulerState methods
(GH#7260) Hendrik Makait
* Bump toolz minimum version to 0.10.0 (GH#7309) Sam Grayson
- Release 2022.11.0
## Note
* This release changes the default scheduling mode to use
queuing. This will significantly reduce cluster memory use in
most cases, and generally improve stability and performance.
Learn more here and please provide any feedback on this
discussion.
* In rare cases, this could make some workloads slower. See the
documentation for more information, and how to switch back to
the old mode.
## New Features
* Add ForwardOutput worker plugin to forward stdout and stderr to
client. (GH#7297) Hendrik Makait
* Duration counters on prefix level (GH#7288) Florian Jetter
* Include button for launching JupyterLab layout in repr
(GH#7218) Ian Rose
## Enhancements
* Support MIG parsing during CUDA context creation in UCX
initialization (GH#6720) Peter Andreas Entschev
* Handle /metrics endpoint without prometheus-client installed
(GH#7234) Hendrik Makait
* Add support for unpacking namedtuples in remote data (GH#7282)
Andrew
* Enable queuing by default (GH#7279) Florian Jetter
* Fix exists->``exist`` typo in scheduler error messages
(GH#7281) Matthew Plough
* If there’s an exception in the Client async context manager
body then close fast (GH#6920) Thomas Grainger
## Bug Fixes
* Ensure category is optional when logging "warn" events
(GH#7169) James Bourbeau
* Edge and impossible transitions to memory (GH#7205) crusaderky
## Maintenance
* Allow bokeh=3 (GH#5648) James Bourbeau
* Fix typos in P2P shuffle code (GH#7304) Hendrik Makait
* Reenable test_bad_disk (GH#7300) Florian Jetter
* Reduce max-runs in test reports (GH#7299) Florian Jetter
* Revert idle classification when worker-saturation is set
(GH#7278) Florian Jetter
* Fix flaky deadline_expiration (GH#7287) Florian Jetter
* Rewrite of P2P control flow (GH#7268) Florian Jetter
* Bump minimum bokeh version to 2.4.2 (GH#7271) James Bourbeau
* Remove deprecated code calls to IOLoop.make_current() (GH#7240)
Thomas Grainger
* Improved test for balancing expensive tasks (GH#7272) Hendrik
Makait
* Refactor semaphore._Watch into general-purpose Deadline utility
(GH#7238) Hendrik Makait
* Require Click 7.0+ (GH#7226) jakirkham
* Drop tests (GH#7269) Hendrik Makait
* Replace test_(do_not_)steal_communication_heavy_tasks tests
with more robust versions (GH#7243) Hendrik Makait
* xfail test_bad_disk (GH#7265) crusaderky
* Move transition_log from Scheduler to SchedulerState (GH#7254)
crusaderky
* Remove Scheduler.log (GH#7258) crusaderky
* Use latest pickle (GH#5826) jakirkham
* Polish parsing of worker-saturation from config (GH#7255)
crusaderky
* Avoid expensive occupancy calculation when unused (GH#7257)
Gabe Joseph
* Un-skip test_nested_compute (GH#7247) Gabe Joseph
* Review test_do_not_steal_communication_heavy_tasks (GH#7250)
crusaderky
* Fix test_stress_creation_and_deletion (GH#7215) crusaderky
* Raise exceptions in Server.handle_stream instead of
swallowing/logging (GH#7162) Hendrik Makait
* Fix _update_scheduler_info hanging failed tests (GH#7225) Gabe
Joseph
* Bump xarray-contrib/ci-trigger from 1.1 to 1.2 (GH#7232)
- Release 2022.10.2
* Reverted a bug where Bokeh was accidentally made non-optional
(GH#7230) Oliver Holworthy
* Schedule a queued task when a task secedes (GH#7224) Gabe
Joseph
* This was a hotfix release
- Release 2022.10.1
## New Features
* Add Client.restart_workers method (GH#7154) James Bourbeau
* Implement PackageInstall plugin for pip and conda (GH#7126)
Hendrik Makait
## Enhancements
* Add prometheus collector for work-stealing (GH#7206) Hendrik
Makait
* Track reason of workers closing and restarting (GH#7166)
Hendrik Makait
* Show no-worker on task progress bar (GH#7171) Florian Jetter
* Set OPENBLAS_NUM_THREADS by default (GH#7177) James Bourbeau
* Optionally provide local directory to data constructor
(GH#7153) Lawrence Mitchell
* Introduce distributed.comm.ucx.environment config slot
(GH#7164) Lawrence Mitchell
* Log information about memory limit (GH#7160) Florian Jetter
* Improve log messages on scheduler for restart (GH#7150) Florian
Jetter
* More comprehensive WorkerState task counters (GH#7167)
crusaderky
## Bug Fixes
* Update minimum bokeh version message (GH#7172) James Bourbeau
* Revamped implementations of remote print() and warn(), fixing
#7095 (GH#7129) Max Bane
## Maintenance
* Temporarily restrict bokeh<3 (GH#7219) James Bourbeau
* Make Scheduler.reschedule private (GH#7216) crusaderky
* Fix decide_worker_rootish_queuing_disabled assert (GH#7065)
Gabe Joseph
* Fix flaky test_include_communication_in_occupancy (GH#7212)
Gabe Joseph
* Do not raise on leaked websockets (GH#7199) Florian Jetter
* Update nightly recipes with CLI tests, dependency changes
(GH#7201) Charles Blackmon-Luca
* Make p2p shuffle submodules private (GH#7186) Florian Jetter
* Backport tornado PeriodicCallback (GH#7165) Florian Jetter
* Fix mypy failure on CI (GH#7198) Florian Jetter
* User a layer for p2p shuffle (GH#7180) Florian Jetter
* Type annotations for shuffle (GH#7185) Florian Jetter
* Do not close worker on comm error in heartbeat (GH#7163)
Hendrik Makait
* Errors when setting TCP timeouts log as error (GH#7161) Florian
Jetter
* Remove incorrect advice from pre-commit config (GH#7159)
crusaderky
* Use functionalities network for codecov uploader (GH#7148)
Florian Jetter
* Use counter metric type where appropriate, incoming_count was
reporting bytes (GH#7125) Nat Tabris
- Add allow-bokeh3.patch -- raise upper bokeh version, reverts part
of gh#dask/distributed#7329, see also gh#dask/dask#9659
- Replace support-tornado-6-2.patch with
distributed-pr7286-tornado-6-2.patch -- gh#dask/distributed#7286
OBS-URL: https://build.opensuse.org/request/show/1036962
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=124
HAS TO GO WITH THE LATEST SR FOR PYTHON-DASK!
- Update to version 2022.10.0
* Use of new dask CLI (GH#6735) Doug Davis
* Refactor occupancy (GH#7075) Hendrik Makait
* Expose managed/unmanaged/spilled memory to Prometheus (GH#7112)
crusaderky
* Round up saturation-factor (GH#7116) Gabe Joseph
* Return default on KeyError at any level in get_metadata
(GH#7109) Hendrik Makait
* Count task states per task prefix and expose to Prometheus
(GH#7088) Nat Tabris
* Add scheduler-sni option for dask workers (GH#6290) Burt
Holzman
* Improve exception catching in UCX communication (GH#7132) Peter
Andreas Entschev
* Improve robustness of PipInstall plugin (GH#7111) Hendrik
Makait
* Fix dependencies that should point to dask/dask (GH#7138) James
Bourbeau
* Hold on to z.sum() until test completes (GH#7136) Lawrence
Mitchell
* Update typing for system_monitor after python/typeshed#8829
(GH#7131) Lawrence Mitchell
* Fix two potentially flaky queuing tests (GH#7124) Gabe Joseph
* Revamp SystemMonitor (GH#7097) crusaderky
* Adjust hardware benchmarks bokeh test (GH#7096) Florian Jetter
* Multi-platform mypy checks (GH#7094) crusaderky
- update to version 2022.9.2:
* Enhancements
+ Smarter stealing with dependencies (GH#7024) Hendrik Makait
+ Enable Active Memory Manager by default (GH#7042) crusaderky
+ Allow timeout strings in distributed.wait (GH#7081) James
Bourbeau
+ Make AMM memory measure configurable (GH#7062) crusaderky
+ AMM support for actors (GH#7072) crusaderky
+ Expose message-bytes-limit in config (GH#7074) Hendrik Makait
+ Detect mismatching Python version in scheduler (GH#7018) Hendrik
Makait
+ Improve KilledWorker message users see (GH#7043) James Bourbeau
+ Support for cgroups v2 and respect soft limits (GH#7051)
Samantha Hughes
* Bug Fixes
+ Catch BaseException on UCX read error (GH#6996) Peter Andreas
Entschev
+ Fix transfer limiting in _select_keys_for_gather (GH#7071)
Hendrik Makait
+ Parse worker-saturation if a string (GH#7064) Gabe Joseph
+ Nanny(config=...) parameter overlays global dask config
(GH#7069) crusaderky
+ Ensure default clients don’t propagate to subprocesses (GH#7028)
Florian Jetter
* Documentation
+ Improve documentation of message-bytes-limit (GH#7077) Hendrik
Makait
+ Minor tweaks to Sphinx documentation (GH#7041) crusaderky
+ Improve upload_file API documentation (GH#7040) Florian Jetter
* Maintenance
+ test_serialize_numba: Workaround issue with np.empty_like in NP
1.23 (GH#7089) Graham Markall
+ Type platform constants for mypy (GH#7091) jakirkham
+ dask-worker-space (GH#7054) crusaderky
+ Remove failing test case (GH#7087) Hendrik Makait
+ test_default_client (GH#7058) crusaderky
+ Fix pre-commit fails with recent versions of mypy and pandas
(GH#7068) crusaderky
+ Add factorization utility (GH#7048) James Bourbeau
- update to version 2022.9.1:
* Enhancements
+ Add dashboard component for size of open data transfers
(GH#6982) Hendrik Makait
+ Allow very fast keys and very expensive transfers as stealing
candidates (GH#7022) Florian Jetter
* Bug Fixes
+ No longer double count transfer cost in stealing (GH#7036)
Hendrik Makait
* Maintenance
+ Make test_wait_first_completed robust (GH#7039) Florian Jetter
+ Partial annotations for SchedulerState (GH#7023) crusaderky
+ Add more type annotations to stealing.py (GH#7009) Florian
Jetter
+ Update codecov settings (GH#7015) Florian Jetter
+ Speed up test_balance (GH#7008) Florian Jetter
+ Fix test report after queuing job added (GH#7012) Gabe Joseph
+ Clean up env variables in Gihub Actions (GH#7001) crusaderky
+ Make test_steal_reschedule_reset_in_flight_occupancy non timing
dependent (GH#7010) Florian Jetter
+ Replaced distributed.utils.key_split with dask.utils.key_split
(GH#7005) Luke Conibear
+ Revert “Revert “Limit incoming data transfers by amount of data”
(GH#6994)” (:pr:`7007) Florian Jetter
+ CI job running tests with queuing on (GH#6989) Gabe Joseph
+ Fix distributed/tests/test_client_executor.py::test_wait
(GH#6990) Florian Jetter
OBS-URL: https://build.opensuse.org/request/show/1030988
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=60
- Update to 2022.8.1:
* Display unexpected state in Worker.execute validation (:pr:`6856`)
James Bourbeau
* cancelled / resumed -> rescheduled transition (:pr:`6913`) crusaderky
* Fix resource deallocation for resumed tasks (:pr:`6914`) crusaderky
* Only close scheduler in SpecCluster if it exists (:pr:`6888`)
Matthew Rocklin
* Always close BatchedSend write coroutines (:pr:`6865`) Gabe Joseph
* Harden preamble of Worker.execute against race conditions (:pr:`6878`)
crusaderky
* Duplicated code: in_flight_tasks validation (:pr:`6917`) crusaderky
* Overhaul transitions for the resumed state (:pr:`6699`) crusaderky
* Clean up cluster process reaping (:pr:`6840`) Gabe Joseph
* Don't use bokeh Figure in tests (:pr:`6721`) Bryan Van de Ven
* Work around incompatibility of crick with setuptools 65 (:pr:`6887`)
crusaderky
* Replace port = random.randint( with port = d.utils.open_port (:pr:`6883`)
Thomas Grainger
* Fix flaky test_wall_clock (:pr:`6879`) crusaderky
* Add descriptive error message to assert (:pr:`6871`) Hendrik Makait
* Increase timeout in test_quiet_process (:pr:`6857`) Florian Jetter
* Remove redundant use of with clean(): (:pr:`6852`) Thomas Grainger
* Update pre-commit dependencies (:pr:`6851`) Hendrik Makait
* Call exit callback even if AsyncProcess is reaped elsewhere (:pr:`6684`)
Thomas Grainger
* Avoid function calls in argument defaults (:pr:`6812`) Hendrik Makait
* Add Cluster.get_client() method (:pr:`6745`) Julia Signell
* Start bokeh app to activate bokeh's clean session callbacks (:pr:`6728`)
Martí Zamora
* Don't connect to cluster subprocesses at shutdown (:pr:`6829`) Gabe Joseph
OBS-URL: https://build.opensuse.org/request/show/1000573
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=58
* Display unexpected state in Worker.execute validation (:pr:`6856`)
James Bourbeau
* cancelled / resumed -> rescheduled transition (:pr:`6913`) crusaderky
* Fix resource deallocation for resumed tasks (:pr:`6914`) crusaderky
* Only close scheduler in SpecCluster if it exists (:pr:`6888`)
Matthew Rocklin
* Always close BatchedSend write coroutines (:pr:`6865`) Gabe Joseph
* Harden preamble of Worker.execute against race conditions (:pr:`6878`)
crusaderky
* Duplicated code: in_flight_tasks validation (:pr:`6917`) crusaderky
* Overhaul transitions for the resumed state (:pr:`6699`) crusaderky
* Clean up cluster process reaping (:pr:`6840`) Gabe Joseph
* Don't use bokeh Figure in tests (:pr:`6721`) Bryan Van de Ven
* Work around incompatibility of crick with setuptools 65 (:pr:`6887`)
crusaderky
* Replace port = random.randint( with port = d.utils.open_port (:pr:`6883`)
Thomas Grainger
* Fix flaky test_wall_clock (:pr:`6879`) crusaderky
* Add descriptive error message to assert (:pr:`6871`) Hendrik Makait
* Increase timeout in test_quiet_process (:pr:`6857`) Florian Jetter
* Remove redundant use of with clean(): (:pr:`6852`) Thomas Grainger
* Update pre-commit dependencies (:pr:`6851`) Hendrik Makait
* Call exit callback even if AsyncProcess is reaped elsewhere (:pr:`6684`)
Thomas Grainger
* Avoid function calls in argument defaults (:pr:`6812`) Hendrik Makait
* Add Cluster.get_client() method (:pr:`6745`) Julia Signell
* Start bokeh app to activate bokeh's clean session callbacks (:pr:`6728`)
Martí Zamora
* Don't connect to cluster subprocesses at shutdown (:pr:`6829`) Gabe Joseph
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=115
