- Update to 2024.12.0
* Revert "Add LLM chatbot to Dask docs (#11556)" @dchudz (#11577)
* Automatically rechunk if array in to_zarr has irregular chunks
@phofl (#11553)
* Blockwise uses Task class @fjetter (#11568)
* Migrate rechunk and reshape to task spec @phofl (#11555)
* Cache svg-representation for arrays @dcherian (#11560)
* Fix empty input for containers @fjetter (#11571)
* Convert Bag graphs to TaskSpec graphs during optimization
@fjetter (#11569)
* add LLM chatbot to Dask docs @dchudz (#11556)
* Add support for Python 3.13 @phofl (#11456)
* Fuse data nodes in linear fusion too @phofl (#11549)
* Migrate slicing code to task spec @phofl (#11548)
* Speed up ArraySliceDep tokenization @phofl (#11551)
* Fix fusing of p2p barrier tasks @phofl (#11543)
* Remove infra/mentions of GPU CI @charlesbluca (#11546)
* Temporarily disable gpuCI update CI job @jrbourbeau (#11545)
* Use BlockwiseDep to implement map_blocks keywords @phofl
(#11542)
* Remove optimize_slices @phofl (#11538)
* Make reshape_blockwise a noop if shape is the same @phofl
(#11541)
* Remove read-only flag from open_arry in open_zarr @phofl
(#11539)
* Implement linear_fusion for task spec class @phofl (#11525)
* Remove recursion from TaskSpec @fjetter (#11477)
* Fixup test after dask-expr change @phofl (#11536)
* Bump codecov/codecov-action from 3 to 5 @dependabot (#11532)
* Create dask-expr frame directly without roundtripping @phofl (forwarded request 1228726 from bnavigator)
OBS-URL: https://build.opensuse.org/request/show/1228729
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=88
* Revert "Add LLM chatbot to Dask docs (#11556)" @dchudz (#11577)
* Automatically rechunk if array in to_zarr has irregular chunks
@phofl (#11553)
* Blockwise uses Task class @fjetter (#11568)
* Migrate rechunk and reshape to task spec @phofl (#11555)
* Cache svg-representation for arrays @dcherian (#11560)
* Fix empty input for containers @fjetter (#11571)
* Convert Bag graphs to TaskSpec graphs during optimization
@fjetter (#11569)
* add LLM chatbot to Dask docs @dchudz (#11556)
* Add support for Python 3.13 @phofl (#11456)
* Fuse data nodes in linear fusion too @phofl (#11549)
* Migrate slicing code to task spec @phofl (#11548)
* Speed up ArraySliceDep tokenization @phofl (#11551)
* Fix fusing of p2p barrier tasks @phofl (#11543)
* Remove infra/mentions of GPU CI @charlesbluca (#11546)
* Temporarily disable gpuCI update CI job @jrbourbeau (#11545)
* Use BlockwiseDep to implement map_blocks keywords @phofl
(#11542)
* Remove optimize_slices @phofl (#11538)
* Make reshape_blockwise a noop if shape is the same @phofl
(#11541)
* Remove read-only flag from open_arry in open_zarr @phofl
(#11539)
* Implement linear_fusion for task spec class @phofl (#11525)
* Remove recursion from TaskSpec @fjetter (#11477)
* Fixup test after dask-expr change @phofl (#11536)
* Bump codecov/codecov-action from 3 to 5 @dependabot (#11532)
* Create dask-expr frame directly without roundtripping @phofl
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=187
- Update to 2024.6.2:
* profile._f_lineno: handle next_line being None in Python 3.13
* Cache global query-planning config
* Python 3.13 fixes
* Fix test_map_freq_to_period_start for pandas=3
* Tokenizing memmap arrays will now avoid materializing the array into
memory.
* Fix test_dt_accessor with query planning disabled
* Remove deprecated dask.compatibility module
* Ensure compatibility for xarray.NamedArray
* Avoid rounding error in
test_prometheus_collect_count_total_by_cost_multipliers
* Log key collision count in update_graph log event
* Rename safe to expected in Scheduler.remove_worker
* Eagerly update aggregate statistics for TaskPrefix instead of
calculating them on-demand
* Improve graph submission time for P2P rechunking by avoiding unpack
recursion into indices
* Add safe keyword to remove-worker event
* Improved errors and reduced logging for P2P RPC calls
* Adjust P2P tests for dask-expr
* Iterate over copy of Server.digests_total_since_heartbeat to avoid
RuntimeError
* Add Prometheus gauge for task groups
* Fix too strict assertion in shuffle code for pandas subclasses
* Reduce noise from erring tasks that are not supposed to be running
OBS-URL: https://build.opensuse.org/request/show/1186064
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=81
* profile._f_lineno: handle next_line being None in Python 3.13
* Cache global query-planning config
* Python 3.13 fixes
* Fix test_map_freq_to_period_start for pandas=3
* Tokenizing memmap arrays will now avoid materializing the array into
memory.
* Fix test_dt_accessor with query planning disabled
* Remove deprecated dask.compatibility module
* Ensure compatibility for xarray.NamedArray
* Avoid rounding error in
test_prometheus_collect_count_total_by_cost_multipliers
* Log key collision count in update_graph log event
* Rename safe to expected in Scheduler.remove_worker
* Eagerly update aggregate statistics for TaskPrefix instead of
calculating them on-demand
* Improve graph submission time for P2P rechunking by avoiding unpack
recursion into indices
* Add safe keyword to remove-worker event
* Improved errors and reduced logging for P2P RPC calls
* Adjust P2P tests for dask-expr
* Iterate over copy of Server.digests_total_since_heartbeat to avoid
RuntimeError
* Add Prometheus gauge for task groups
* Fix too strict assertion in shuffle code for pandas subclasses
* Reduce noise from erring tasks that are not supposed to be running
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=169
* see corresponding dask update:
* https://docs.dask.org/en/stable/changelog.html#v2023-12-0
* Bokeh 3.3.0 compatibility
- Update to version 2022.11.1
* Automatically mark all WorkerState tests (:pr:`6706`) crusaderky
- Update to 2022.6.1
- add distributed-fix-python310.patch to fix build with python 3.10
- Update to version 2021.9.1
* Fix add_plugin warnings
* Add list around iterator in handle_missing_dep
* Jupyter-client 7 compatiblity
* Add standalone dashboard page for GPU usage (GH#4556) Jacob
* Handle stream is None case in TCP comm finalizer (GH#4631)
* Include LIST_PICKLE in NumPy array serialization (GH#4632)
* Rename annotation plugin in test_highlevelgraph.py (GH#4618)
* Skip NumPy and pandas tests if not importable (GH#4563) Ben
* Remove utils.shutting_down in favor of sys.is_finalizing
* Introduce events log length config option (GH#4615) Fabian
* Upstream config serialization and inheritance (GH#4372) Jacob
* Add check to scheduler creation in SpecCluster (GH#4605) Jacob
* Make length of events deque configurable (GH#4604) Fabian
* Add explicit fetch state to worker TaskState (GH#4470) Gil
* pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B.
* Switch documentation builds for PRs to readthedocs (GH#4599)
* If SpecCluster fails to start attempt to gracefully close out
* IPython magics: remove deprecated ioloop workarounds (GH#4530)
* Add GitHub actions workflow to cancel duplicate builds
* Remove outdated macOS build badge from README (GH#4576) James
* Change default branch from master to main (GH#4495) Julia
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=149
- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
test code introspection
* Zero-copy P2P Array Rechunking
* Deprecating PyArrow <14.0.1
* Improved PyArrow filesystem for Parquet
* Improve Type Reconciliation in P2P Shuffling
* official support for Python 3.12
* Reduced memory pressure for multi array reductions
* improved P2P shuffling robustness
* Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)
OBS-URL: https://build.opensuse.org/request/show/1127185
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=72
- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090796
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=70
- Update to 2023.5.1
* This release drops support for Python 3.8
## Enhancements
* Exclude IPython code from computations (GH#7788) Miles
* Drop Python 3.8 support (GH#7840) Thomas Grainger
* Add storage_options to performance_report (GH#7636) ypogorelova
* Don’t warn about mismatched msgpack (GH#7839) Irina Truong
* Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
* Dashboard: Fine Performance Metrics (GH#7725) Miles
## Bug Fixes
* Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
Hendrik Makait
* Minimal change to work around (GH#7726) / support for UCX
(GH#7851) Benjamin Zaitlen
* Don’t end computations until cluster is truly idle (GH#7790)
crusaderky
- Release 2023.5.0
## Enhancements
* Client.upload_file send to both Workers and Scheduler and
rename scratch directory (GH#7802) Miles
* Allow dashboard to be used with bokeh prereleases (GH#7814)
James Bourbeau
## Bug Fixes
* Ensure log_event of non-msgpack serializable object do not kill
servers (GH#7472) Florian Jetter
* Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
Thomas Grainger
* Fix flaky
test_dask_worker.py::test_single_executable_deprecated
(GH#7817) Thomas Grainger
OBS-URL: https://build.opensuse.org/request/show/1090160
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=142
