- Update to 2024.6.2:
* profile._f_lineno: handle next_line being None in Python 3.13
* Cache global query-planning config
* Python 3.13 fixes
* Fix test_map_freq_to_period_start for pandas=3
* Tokenizing memmap arrays will now avoid materializing the array into
memory.
* Fix test_dt_accessor with query planning disabled
* Remove deprecated dask.compatibility module
* Ensure compatibility for xarray.NamedArray
* Avoid rounding error in
test_prometheus_collect_count_total_by_cost_multipliers
* Log key collision count in update_graph log event
* Rename safe to expected in Scheduler.remove_worker
* Eagerly update aggregate statistics for TaskPrefix instead of
calculating them on-demand
* Improve graph submission time for P2P rechunking by avoiding unpack
recursion into indices
* Add safe keyword to remove-worker event
* Improved errors and reduced logging for P2P RPC calls
* Adjust P2P tests for dask-expr
* Iterate over copy of Server.digests_total_since_heartbeat to avoid
RuntimeError
* Add Prometheus gauge for task groups
* Fix too strict assertion in shuffle code for pandas subclasses
* Reduce noise from erring tasks that are not supposed to be running
OBS-URL: https://build.opensuse.org/request/show/1186064
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=81
* profile._f_lineno: handle next_line being None in Python 3.13
* Cache global query-planning config
* Python 3.13 fixes
* Fix test_map_freq_to_period_start for pandas=3
* Tokenizing memmap arrays will now avoid materializing the array into
memory.
* Fix test_dt_accessor with query planning disabled
* Remove deprecated dask.compatibility module
* Ensure compatibility for xarray.NamedArray
* Avoid rounding error in
test_prometheus_collect_count_total_by_cost_multipliers
* Log key collision count in update_graph log event
* Rename safe to expected in Scheduler.remove_worker
* Eagerly update aggregate statistics for TaskPrefix instead of
calculating them on-demand
* Improve graph submission time for P2P rechunking by avoiding unpack
recursion into indices
* Add safe keyword to remove-worker event
* Improved errors and reduced logging for P2P RPC calls
* Adjust P2P tests for dask-expr
* Iterate over copy of Server.digests_total_since_heartbeat to avoid
RuntimeError
* Add Prometheus gauge for task groups
* Fix too strict assertion in shuffle code for pandas subclasses
* Reduce noise from erring tasks that are not supposed to be running
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=169
* see corresponding dask update:
* https://docs.dask.org/en/stable/changelog.html#v2023-12-0
* Bokeh 3.3.0 compatibility
- Update to version 2022.11.1
* Automatically mark all WorkerState tests (:pr:`6706`) crusaderky
- Update to 2022.6.1
- add distributed-fix-python310.patch to fix build with python 3.10
- Update to version 2021.9.1
* Fix add_plugin warnings
* Add list around iterator in handle_missing_dep
* Jupyter-client 7 compatiblity
* Add standalone dashboard page for GPU usage (GH#4556) Jacob
* Handle stream is None case in TCP comm finalizer (GH#4631)
* Include LIST_PICKLE in NumPy array serialization (GH#4632)
* Rename annotation plugin in test_highlevelgraph.py (GH#4618)
* Skip NumPy and pandas tests if not importable (GH#4563) Ben
* Remove utils.shutting_down in favor of sys.is_finalizing
* Introduce events log length config option (GH#4615) Fabian
* Upstream config serialization and inheritance (GH#4372) Jacob
* Add check to scheduler creation in SpecCluster (GH#4605) Jacob
* Make length of events deque configurable (GH#4604) Fabian
* Add explicit fetch state to worker TaskState (GH#4470) Gil
* pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B.
* Switch documentation builds for PRs to readthedocs (GH#4599)
* If SpecCluster fails to start attempt to gracefully close out
* IPython magics: remove deprecated ioloop workarounds (GH#4530)
* Add GitHub actions workflow to cancel duplicate builds
* Remove outdated macOS build badge from README (GH#4576) James
* Change default branch from master to main (GH#4495) Julia
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=149
- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
test code introspection
* Zero-copy P2P Array Rechunking
* Deprecating PyArrow <14.0.1
* Improved PyArrow filesystem for Parquet
* Improve Type Reconciliation in P2P Shuffling
* official support for Python 3.12
* Reduced memory pressure for multi array reductions
* improved P2P shuffling robustness
* Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)
OBS-URL: https://build.opensuse.org/request/show/1127185
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=72
- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090796
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=70
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
* Fix flaky
test_dask_worker.py::test_single_executable_deprecated
(GH#7817) Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090160
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=142
- Update to 2023.3.2
## Enhancements
* Enhanced thread-safety in zict.File (GH#7691) crusaderky
* Future deserialization without available client (GH#7580)
Florian Jetter
* Support adjusting GIL monitoring interval (GH#7650) Miles
* Gracefully stop GIL monitoring if running (GH#7652) Miles
* Fine performance metrics for execute, gather_dep, etc.
(GH#7586) crusaderky
* Add GIL metric to dashboard (GH#7646) Miles
* Expose scheduler idle via RPC and HTTP API (GH#7642) Jacob
Tomlinson
* Add full dashboard link in scheduler logs (GH#7631) Miles
## Bug Fixes
* Tell workers when their peers have left (so they don’t hang
fetching data from them) (GH#7574) Thomas Grainger
* Fix regression in dashboard after (GH#7586) (GH#7683)
crusaderky
* Fix OverflowError in Cluster._sync_cluster_info() (GH#7648)
Hendrik Makait
* Ensure that serialized data is measured correctly (GH#7593)
Florian Jetter
## Maintenance
* Avoid bool object has no attribute close in @gen_cluster
(GH#7657) Thomas Grainger
* Fix failing test_server_close_stops_gil_monitoring (GH#7659)
James Bourbeau
* Remove weakref finalizer for Offload Executor (GH#7644) Florian
Jetter
- Enable python311 build and test: numba not a strict requirement
OBS-URL: https://build.opensuse.org/request/show/1074755
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=138
Has to go together with sr#1071019!
- Skip more flaky tests
- Update to 2023.3.1
## Enhancements
* Add Jupyter link to dashboard menu if --jupyter flag is set
(GH#7638) Jacob Tomlinson
* Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
* Extend dask metapackage dependencies (GH#7630) James Bourbeau
* Further improvements to Client.restart_workers (GH#7620) Miles
* P2P offload get_output_partition (GH#7587) Florian Jetter
* Initial integration of GIL contention metric (GH#7624) Miles
* Add dashboard documentation links (GH#7610) Miles
* Rename shuffle/rechunk config option/kwarg to method (GH#7623)
Hendrik Makait
* Return results in restart_workers (GH#7606) Miles
* Ensure client key cancellation uses ordered messages (GH#7583)
Florian Jetter
## Bug Fixes
* Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
* Don’t send client heartbeat without a scheduler_comm (GH#7612)
James Bourbeau
* Do not unspill on free-keys (GH#7607) crusaderky
## Documentation
* Add notes to Client.submit, Client.map, and Client.scatter with
the description of the current task graph resolution algorithm
limitations (GH#7588) Eugene Druzhynin
## Maintenance
* Use range with pickle protocol versions (GH#7635) jakirkham
* Share thread pool among P2P shuffle runs (GH#7621) Hendrik
Makait
* Replace psutil suspend with BlockedGatherDep in
test_failing_worker_with_additional_replicas_on_cluster
(GH#7633) Thomas Grainger
* Ignore pkg_resources DeprecationWarning for mindeps (GH#7626)
Miles
* Implement wait_for using asyncio.timeout() on 3.11 (GH#7571)
Thomas Grainger
* Use tmp_path fixture instead of outdated tmpdir fixture
(GH#7582) ypogorelova
* Only one crick callback (GH#7614) crusaderky
* Add mindeps + numpy job to tests CI (GH#7609) Miles
* Do not xfail whole tests due to (GH#6705) (GH#7611) crusaderky
OBS-URL: https://build.opensuse.org/request/show/1071516
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=67
