1
0
Commit Graph

181 Commits

Author SHA256 Message Date
Dominique Leuenberger
ae8f8d35fc Accepting request 1193893 from devel:languages:python:numeric
- switch to modern python for sle15

- Update to 2024.6.2:

OBS-URL: https://build.opensuse.org/request/show/1193893
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=82
2024-08-16 10:23:16 +00:00
3a2da80b47 - switch to modern python for sle15
- Update to 2024.6.2:

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=172
2024-08-14 14:50:54 +00:00
Ana Guerrero
f929bb8c84 Accepting request 1186064 from devel:languages:python:numeric
- Update to 2024.6.2: 
  * profile._f_lineno: handle next_line being None in Python 3.13
  * Cache global query-planning config
  * Python 3.13 fixes
  * Fix test_map_freq_to_period_start for pandas=3
  * Tokenizing memmap arrays will now avoid materializing the array into
    memory.
  * Fix test_dt_accessor with query planning disabled
  * Remove deprecated dask.compatibility module
  * Ensure compatibility for xarray.NamedArray
  * Avoid rounding error in
    test_prometheus_collect_count_total_by_cost_multipliers
  * Log key collision count in update_graph log event
  * Rename safe to expected in Scheduler.remove_worker
  * Eagerly update aggregate statistics for TaskPrefix instead of
    calculating them on-demand
  * Improve graph submission time for P2P rechunking by avoiding unpack
    recursion into indices
  * Add safe keyword to remove-worker event
  * Improved errors and reduced logging for P2P RPC calls
  * Adjust P2P tests for dask-expr
  * Iterate over copy of Server.digests_total_since_heartbeat to avoid
    RuntimeError
  * Add Prometheus gauge for task groups
  * Fix too strict assertion in shuffle code for pandas subclasses
  * Reduce noise from erring tasks that are not supposed to be running

OBS-URL: https://build.opensuse.org/request/show/1186064
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=81
2024-07-08 17:08:34 +00:00
Steve Kowalik
8b7cdc22d0 Fix date
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=170
2024-07-08 04:36:36 +00:00
Steve Kowalik
3c55efc797 - Update to 2024.6.2:
* profile._f_lineno: handle next_line being None in Python 3.13
  * Cache global query-planning config
  * Python 3.13 fixes
  * Fix test_map_freq_to_period_start for pandas=3
  * Tokenizing memmap arrays will now avoid materializing the array into
    memory.
  * Fix test_dt_accessor with query planning disabled
  * Remove deprecated dask.compatibility module
  * Ensure compatibility for xarray.NamedArray
  * Avoid rounding error in
    test_prometheus_collect_count_total_by_cost_multipliers
  * Log key collision count in update_graph log event
  * Rename safe to expected in Scheduler.remove_worker
  * Eagerly update aggregate statistics for TaskPrefix instead of
    calculating them on-demand
  * Improve graph submission time for P2P rechunking by avoiding unpack
    recursion into indices
  * Add safe keyword to remove-worker event
  * Improved errors and reduced logging for P2P RPC calls
  * Adjust P2P tests for dask-expr
  * Iterate over copy of Server.digests_total_since_heartbeat to avoid
    RuntimeError
  * Add Prometheus gauge for task groups
  * Fix too strict assertion in shuffle code for pandas subclasses
  * Reduce noise from erring tasks that are not supposed to be running

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=169
2024-07-05 06:40:17 +00:00
Dominique Leuenberger
db4cf47cef Accepting request 1171089 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1171089
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=80
2024-05-01 12:57:24 +00:00
42c6f04102 Accepting request 1170999 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2024.4.2
  * Trivial Merge Implementation
  * Auto-partitioning in read_parquet
- Release 2024.4.1
  * Fix an error when importing dask.dataframe with Python 3.11.9.
- Release 2024.4.0
  * Query planning fixes
  * GPU metric dashboard fixes
- Release 2024.3.1
  * Demote an exception to a warning if dask-expr is not installed
    when upgrading.
- Release 2024.3.0
  * Query planning
  * Sunset of Pandas 1.X support

OBS-URL: https://build.opensuse.org/request/show/1170999
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=167
2024-05-01 05:57:15 +00:00
Dominique Leuenberger
039281864d Accepting request 1155502 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1155502
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=79
2024-03-06 22:05:52 +00:00
ce9ca4f063 Accepting request 1155360 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2024.2.1
  * Allow silencing dask.DataFrame deprecation warning
  * More robust distributed scheduler for rare key collisions
  * More robust adaptive scaling on large clusters
- Drop distributed-ignore-daskdepr.patch

OBS-URL: https://build.opensuse.org/request/show/1155360
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=165
2024-03-06 09:59:38 +00:00
Ana Guerrero
db58b923e9 Accepting request 1146836 from devel:languages:python:numeric
Forwarded request #1146780 from bnavigator

- Update to 2024.2.0
    * Deprecate Dask DataFrame implementation
    * Improved tokenization
    * https://docs.dask.org/en/stable/changelog.html#v2024-2-0
  - Add distributed-ignore-daskdepr.patch gh#dask/distributed#8504
  - Drop python39 test flavor
  - Fix python312 tests

OBS-URL: https://build.opensuse.org/request/show/1146836
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=78
2024-02-16 20:42:46 +00:00
3b2ea300aa Accepting request 1146780 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2024.2.0
  * Deprecate Dask DataFrame implementation
  * Improved tokenization
  * https://docs.dask.org/en/stable/changelog.html#v2024-2-0
- Add distributed-ignore-daskdepr.patch gh#dask/distributed#8504
- Drop python39 test flavor
- Fix python312 tests

OBS-URL: https://build.opensuse.org/request/show/1146780
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=163
2024-02-15 12:56:11 +00:00
fb78f5106b Accepting request 1144170 from home:bnavigator:branches:devel:languages:python:numeric
- Add python312 test flavor

OBS-URL: https://build.opensuse.org/request/show/1144170
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=162
2024-02-05 12:42:28 +00:00
Ana Guerrero
e57e8f9875 Accepting request 1142780 from devel:languages:python:numeric
- update to 2024.1.1:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-1
  * compatibility updates for latest pandas and scipy

- update to 2024.1.0:

OBS-URL: https://build.opensuse.org/request/show/1142780
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=77
2024-01-30 17:26:59 +00:00
1c4074650b OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=160 2024-01-30 12:26:52 +00:00
b149f02116 - update to 2024.1.1:
* see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-1
  * compatibility updates for latest pandas and scipy
- update to 2024.1.0:

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=159
2024-01-30 09:39:34 +00:00
Ana Guerrero
87381d155f Accepting request 1142208 from devel:languages:python:numeric
Automatic submission by obs-autosubmit

OBS-URL: https://build.opensuse.org/request/show/1142208
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=76
2024-01-29 21:32:28 +00:00
71bc2ce316 - skip one more test for 32bit
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=157
2024-01-22 09:56:46 +00:00
Ana Guerrero
e778845ba1 Accepting request 1140138 from devel:languages:python:numeric
- update to 2023.1.4:
  * see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-0

OBS-URL: https://build.opensuse.org/request/show/1140138
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=75
2024-01-21 22:09:18 +00:00
9611669043 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=155 2024-01-20 19:16:14 +00:00
28795d02e3 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=154 2024-01-20 14:08:53 +00:00
40fc72e7c5 - update to 2023.1.4:
* see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2024-1-0

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=153
2024-01-20 12:43:28 +00:00
Ana Guerrero
ba04669776 Accepting request 1135097 from devel:languages:python:numeric
Automatic submission by obs-autosubmit

OBS-URL: https://build.opensuse.org/request/show/1135097
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=74
2023-12-25 18:06:30 +00:00
5f1c7f64f7 - update to 2023.12.1:
* see corresponding dask update:
  https://docs.dask.org/en/stable/changelog.html#v2023-12-1

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=151
2023-12-18 12:15:02 +00:00
Dominique Leuenberger
e69696a4b4 Accepting request 1132243 from devel:languages:python:numeric
Automatic submission by obs-autosubmit

OBS-URL: https://build.opensuse.org/request/show/1132243
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=73
2023-12-09 21:54:10 +00:00
fc6a4467ef - update to 2023.12.0:
* see corresponding dask update:
  * https://docs.dask.org/en/stable/changelog.html#v2023-12-0
  * Bokeh 3.3.0 compatibility
- Update to version 2022.11.1
  * Automatically mark all WorkerState tests (:pr:`6706`) crusaderky
- Update to 2022.6.1
- add distributed-fix-python310.patch to fix build with python 3.10
- Update to version 2021.9.1
  * Fix add_plugin warnings
  * Add list around iterator in handle_missing_dep
  * Jupyter-client 7 compatiblity
  * Add standalone dashboard page for GPU usage (GH#4556) Jacob
  * Handle stream is None case in TCP comm finalizer (GH#4631)
  * Include LIST_PICKLE in NumPy array serialization (GH#4632)
  * Rename annotation plugin in test_highlevelgraph.py (GH#4618)
  * Skip NumPy and pandas tests if not importable (GH#4563) Ben
  * Remove utils.shutting_down in favor of sys.is_finalizing
  * Introduce events log length config option (GH#4615) Fabian
  * Upstream config serialization and inheritance (GH#4372) Jacob
  * Add check to scheduler creation in SpecCluster (GH#4605) Jacob
  * Make length of events deque configurable (GH#4604) Fabian
  * Add explicit fetch state to worker TaskState (GH#4470) Gil
  * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B.
  * Switch documentation builds for PRs to readthedocs (GH#4599)
  * If SpecCluster fails to start attempt to gracefully close out
  * IPython magics: remove deprecated ioloop workarounds (GH#4530)
  * Add GitHub actions workflow to cancel duplicate builds
  * Remove outdated macOS build badge from README (GH#4576) James
  * Change default branch from master to main (GH#4495) Julia

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=149
2023-12-02 14:15:49 +00:00
Ana Guerrero
89e1b4363a Accepting request 1127185 from devel:languages:python:numeric
- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
  test code introspection
 * Zero-copy P2P Array Rechunking
 * Deprecating PyArrow <14.0.1
 * Improved PyArrow filesystem for Parquet
 * Improve Type Reconciliation in P2P Shuffling
 * official support for Python 3.12
 * Reduced memory pressure for multi array reductions
 * improved P2P shuffling robustness
 * Reduced scheduler CPU load for large graphs (forwarded request 1127182 from mimi_vx)

OBS-URL: https://build.opensuse.org/request/show/1127185
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=72
2023-11-17 19:49:41 +00:00
503385dcf3 Accepting request 1127182 from home:mimi_vx:branches:devel:languages:python:numeric
- Update to 2023.11.0
- add distributed-ignore-rerun.patch to ignore pytest runners during
  test code introspection
 * Zero-copy P2P Array Rechunking
 * Deprecating PyArrow <14.0.1
 * Improved PyArrow filesystem for Parquet
 * Improve Type Reconciliation in P2P Shuffling
 * official support for Python 3.12
 * Reduced memory pressure for multi array reductions
 * improved P2P shuffling robustness
 * Reduced scheduler CPU load for large graphs

OBS-URL: https://build.opensuse.org/request/show/1127182
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=147
2023-11-16 21:29:18 +00:00
Ana Guerrero
6ee0ddef2a Accepting request 1110217 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1110217
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=71
2023-09-11 19:21:53 +00:00
a886418b89 Accepting request 1110163 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2023.9.1
  ## Enhancements
  Raise in P2P if column dtype is wrong (GH#8167) Hendrik Makait
  * Auto-fail tasks with deps larger than the worker memory (GH#8135) crusaderky
  * Make workers table sortable (GH#8153) Jacob Tomlinson
  * Support for unsetting environment variables (GH#8144) crusaderky
  ## Deprecations
  * Deprecate asynchronous Listener.stop() (GH#8151) Hendrik Makait
- Release 2023.9.0
  ## Enhancements
  Don’t capture functools frames in code (GH#8146) crusaderky
  * Ignore asyncio when scraping code (GH#8122) Matthew Rocklin
  * Remove stringification (GH#8083) Florian Jetter
  ## Bug Fixes
  * Ensure NannyPlugin are always installed (GH#8107) Florian Jetter
  * Don’t use exception hooks to shorten tracebacks (GH#8127) crusaderky
  * Fix P2P shuffle with LocalCluster(..., processes=False) (GH#8125) Hendrik Makait
  * Merge with P2P shuffle fails if left_index or right_index is True (GH#8121) Patrick Hoefler
- Release 2023.8.1
  ## New Features
  * Add memray integration (GH#8044) Florian Jetter
  ## Enhancements
  * Await async listener.stop in Worker.close (GH#8118) Hendrik Makait
  * Minor fixes in memray (GH#8113) Florian Jetter
  * Enable basic p2p shuffle for dask-cudf (GH#7743) Richard (Rick) Zamora
  * Don’t shut down unresponsive workers on gather() (GH#8101) crusaderky
  * Propagate CancelledError in gather_from_workers (GH#8089) crusaderky
  * Better logging for anomalous task termination (GH#8082) crusaderky
  ## Bug Fixes
  * Handle null partitions in P2P shuffling (GH#8116) Hendrik Makait

OBS-URL: https://build.opensuse.org/request/show/1110163
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=145
2023-09-11 06:40:13 +00:00
Dominique Leuenberger
ee86787135 Accepting request 1090796 from devel:languages:python:numeric
- Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.

- Update to 2023.5.1
  * This release drops support for Python 3.8
  ## Enhancements
  * Exclude IPython code from computations (GH#7788) Miles
  * Drop Python 3.8 support (GH#7840) Thomas Grainger
  * Add storage_options to performance_report (GH#7636) ypogorelova
  * Don’t warn about mismatched msgpack (GH#7839) Irina Truong
  * Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
  * Dashboard: Fine Performance Metrics (GH#7725) Miles
  ## Bug Fixes
  * Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
    Hendrik Makait
  * Minimal change to work around (GH#7726) / support for UCX
    (GH#7851) Benjamin Zaitlen
  * Don’t end computations until cluster is truly idle (GH#7790)
    crusaderky
- Release 2023.5.0
  ## Enhancements
  * Client.upload_file send to both Workers and Scheduler and
    rename scratch directory (GH#7802) Miles
  * Allow dashboard to be used with bokeh prereleases (GH#7814)
    James Bourbeau
  ## Bug Fixes
  * Ensure log_event of non-msgpack serializable object do not kill
    servers (GH#7472) Florian Jetter
  * Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
    Thomas Grainger

OBS-URL: https://build.opensuse.org/request/show/1090796
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=70
2023-06-07 21:06:36 +00:00
Steve Kowalik
daf8ca9531 - Ratchet up bokeh to >= 3.1, since upstream supports it.
- Also BuildRequire sparse for Python 3.11.

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=143
2023-06-05 02:15:54 +00:00
Steve Kowalik
d925ca635c Accepting request 1090160 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2023.5.1
  * This release drops support for Python 3.8
  ## Enhancements
  * Exclude IPython code from computations (GH#7788) Miles
  * Drop Python 3.8 support (GH#7840) Thomas Grainger
  * Add storage_options to performance_report (GH#7636) ypogorelova
  * Don’t warn about mismatched msgpack (GH#7839) Irina Truong
  * Clean up sys.path on Server shutdown (GH#7838) James Bourbeau
  * Dashboard: Fine Performance Metrics (GH#7725) Miles
  ## Bug Fixes
  * Properly handle unknown chunk sizes in P2P rechunking (GH#7856)
    Hendrik Makait
  * Minimal change to work around (GH#7726) / support for UCX
    (GH#7851) Benjamin Zaitlen
  * Don’t end computations until cluster is truly idle (GH#7790)
    crusaderky
- Release 2023.5.0
  ## Enhancements
  * Client.upload_file send to both Workers and Scheduler and
    rename scratch directory (GH#7802) Miles
  * Allow dashboard to be used with bokeh prereleases (GH#7814)
    James Bourbeau
  ## Bug Fixes
  * Ensure log_event of non-msgpack serializable object do not kill
    servers (GH#7472) Florian Jetter
  * Fix test_nanny.py duplicated pytestmark definitions (GH#7819)
    Thomas Grainger
  * Fix flaky
    test_dask_worker.py::test_single_executable_deprecated
    (GH#7817) Thomas Grainger

OBS-URL: https://build.opensuse.org/request/show/1090160
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=142
2023-06-01 07:28:34 +00:00
Dominique Leuenberger
002e3360af Accepting request 1077429 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1077429
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=69
2023-04-05 19:27:46 +00:00
Steve Kowalik
854b851cfd Accepting request 1077366 from home:bnavigator:branches:devel:languages:python:numeric
- Drop python38 test flavor

OBS-URL: https://build.opensuse.org/request/show/1077366
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=140
2023-04-05 07:11:09 +00:00
Dominique Leuenberger
c434d4faff Accepting request 1074795 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1074795
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=68
2023-03-28 15:50:16 +00:00
b23a8cfe69 Accepting request 1074755 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2023.3.2
  ## Enhancements
  * Enhanced thread-safety in zict.File (GH#7691) crusaderky
  * Future deserialization without available client (GH#7580)
    Florian Jetter
  * Support adjusting GIL monitoring interval (GH#7650) Miles
  * Gracefully stop GIL monitoring if running (GH#7652) Miles
  * Fine performance metrics for execute, gather_dep, etc.
    (GH#7586) crusaderky
  * Add GIL metric to dashboard (GH#7646) Miles
  * Expose scheduler idle via RPC and HTTP API (GH#7642) Jacob
    Tomlinson
  * Add full dashboard link in scheduler logs (GH#7631) Miles
  ## Bug Fixes
  * Tell workers when their peers have left (so they don’t hang
    fetching data from them) (GH#7574) Thomas Grainger
  * Fix regression in dashboard after (GH#7586) (GH#7683)
    crusaderky
  * Fix OverflowError in Cluster._sync_cluster_info() (GH#7648)
    Hendrik Makait
  * Ensure that serialized data is measured correctly (GH#7593)
    Florian Jetter
  ## Maintenance
  * Avoid bool object has no attribute close in @gen_cluster
    (GH#7657) Thomas Grainger
  * Fix failing test_server_close_stops_gil_monitoring (GH#7659)
    James Bourbeau
  * Remove weakref finalizer for Offload Executor (GH#7644) Florian
    Jetter
- Enable python311 build and test: numba not a strict requirement

OBS-URL: https://build.opensuse.org/request/show/1074755
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=138
2023-03-27 23:03:00 +00:00
Dominique Leuenberger
fdf467c104 Accepting request 1071516 from devel:languages:python:numeric
Has to go together with sr#1071019!

- Skip more flaky tests
- Update to 2023.3.1
  ## Enhancements
  * Add Jupyter link to dashboard menu if --jupyter flag is set
    (GH#7638) Jacob Tomlinson
  * Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
  * Extend dask metapackage dependencies (GH#7630) James Bourbeau
  * Further improvements to Client.restart_workers (GH#7620) Miles
  * P2P offload get_output_partition (GH#7587) Florian Jetter
  * Initial integration of GIL contention metric (GH#7624) Miles
  * Add dashboard documentation links (GH#7610) Miles
  * Rename shuffle/rechunk config option/kwarg to method (GH#7623)
    Hendrik Makait
  * Return results in restart_workers (GH#7606) Miles
  * Ensure client key cancellation uses ordered messages (GH#7583)
    Florian Jetter
  ## Bug Fixes
  * Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
  * Don’t send client heartbeat without a scheduler_comm (GH#7612)
    James Bourbeau
  * Do not unspill on free-keys (GH#7607) crusaderky
  ## Documentation
  * Add notes to Client.submit, Client.map, and Client.scatter with
    the description of the current task graph resolution algorithm
    limitations (GH#7588) Eugene Druzhynin
  ## Maintenance
  * Use range with pickle protocol versions (GH#7635) jakirkham
  * Share thread pool among P2P shuffle runs (GH#7621) Hendrik
    Makait
  * Replace psutil suspend with BlockedGatherDep in
    test_failing_worker_with_additional_replicas_on_cluster
    (GH#7633) Thomas Grainger
  * Ignore pkg_resources DeprecationWarning for mindeps (GH#7626)
    Miles
  * Implement wait_for using asyncio.timeout() on 3.11 (GH#7571)
    Thomas Grainger
  * Use tmp_path fixture instead of outdated tmpdir fixture
    (GH#7582) ypogorelova
  * Only one crick callback (GH#7614) crusaderky
  * Add mindeps + numpy job to tests CI (GH#7609) Miles
  * Do not xfail whole tests due to (GH#6705) (GH#7611) crusaderky

OBS-URL: https://build.opensuse.org/request/show/1071516
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=67
2023-03-15 17:54:19 +00:00
88d5791a74 Accepting request 1071308 from home:bnavigator:branches:devel:languages:python:numeric
- Skip more flaky tests

- Update to 2023.3.1
  ## Enhancements
  * Add Jupyter link to dashboard menu if --jupyter flag is set
    (GH#7638) Jacob Tomlinson
  * Bump minimum click version from 7.0 to 8.0 (GH#7637) Miles
  * Extend dask metapackage dependencies (GH#7630) James Bourbeau
  * Further improvements to Client.restart_workers (GH#7620) Miles
  * P2P offload get_output_partition (GH#7587) Florian Jetter
  * Initial integration of GIL contention metric (GH#7624) Miles
  * Add dashboard documentation links (GH#7610) Miles
  * Rename shuffle/rechunk config option/kwarg to method (GH#7623)
    Hendrik Makait
  * Return results in restart_workers (GH#7606) Miles
  * Ensure client key cancellation uses ordered messages (GH#7583)
    Florian Jetter
  ## Bug Fixes
  * Fix undefined async_wait_for -> async_poll_for (GH#7627) Miles
  * Don’t send client heartbeat without a scheduler_comm (GH#7612)
    James Bourbeau
  * Do not unspill on free-keys (GH#7607) crusaderky
  ## Documentation
  * Add notes to Client.submit, Client.map, and Client.scatter with
    the description of the current task graph resolution algorithm
    limitations (GH#7588) Eugene Druzhynin
  ## Maintenance
  * Use range with pickle protocol versions (GH#7635) jakirkham
  * Share thread pool among P2P shuffle runs (GH#7621) Hendrik
    Makait

OBS-URL: https://build.opensuse.org/request/show/1071308
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=136
2023-03-14 13:13:04 +00:00
Dominique Leuenberger
976d68665a Accepting request 1070124 from devel:languages:python:numeric
- update to 2023.3.0:
  * Remove pyarrow dependency for rechunking
  * Update rechunk_transfer and rechunk_unpack errors
  * Remove dead code and document arguments to ShardBuffer
    constructors
  * Fix tests for p2p by default
  * Remove obsolete cast

OBS-URL: https://build.opensuse.org/request/show/1070124
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=66
2023-03-09 16:45:18 +00:00
fdc62d60d0 - update to 2023.3.0:
* Remove pyarrow dependency for rechunking
  * Update rechunk_transfer and rechunk_unpack errors
  * Remove dead code and document arguments to ShardBuffer
    constructors
  * Fix tests for p2p by default
  * Remove obsolete cast

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=134
2023-03-08 09:42:51 +00:00
Dominique Leuenberger
e31b5ca9fc Accepting request 1068133 from devel:languages:python:numeric
HAS TO TOGETHER WITH SR#1068132!

- Prepare test multiflavors for python311, but skip python311
  * Numba is not ready for python 3.11 yet gh#numba/numba#8304
- Update to 2023.2.0
  ## Enhancements
  * Rate limit the worker memory logs (GH#7529) Florian Jetter
  * Move P2P barrier logic to scheduler extension (GH#7519) Hendrik
    Makait

OBS-URL: https://build.opensuse.org/request/show/1068133
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=65
2023-02-28 11:49:37 +00:00
591396da62 Accepting request 1068088 from home:bnavigator:branches:devel:languages:python:numeric
- Prepare test multiflavors for python311, but skip python311
  * Numba is not ready for python 3.11 yet gh#numba/numba#8304
- Update to 2023.2.0
  ## Enhancements
  * Rate limit the worker memory logs (GH#7529) Florian Jetter
  * Move P2P barrier logic to scheduler extension (GH#7519) Hendrik
    Makait

OBS-URL: https://build.opensuse.org/request/show/1068088
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=132
2023-02-28 09:39:56 +00:00
Dominique Leuenberger
59710ba42e Accepting request 1063411 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1063411
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=64
2023-02-06 14:54:52 +00:00
0a98707589 Accepting request 1063268 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2023.1.1
  ## Enhancements
  * P2P shuffle deduplicates data and can be run several times
    (GH#7486) Hendrik Makait
  * Reverse order of get_logs() and get_worker_logs() (GH#7475)
    Nicholas R. Knezek
  * Add prometheus metric for time and memory used per task prefix
    (GH#7406) Thomas Grainger
  * Additive worker counts in Prometheus (GH#7468) crusaderky
  * Add help tool for taskstream (GH#7478) Florian Jetter
  ## Bug Fixes
  * Do not allow for a worker to reject a drop replica request
    (GH#7490) Hendrik Makait
  * Fix un/packing for namedtuples with custom constructors
    (GH#7465) antonymayi
  * Documentation
  * Remove timeout= from docstring example for worker_client
    (GH#7497) Florian Jetter
  ## Maintenance
  * Ignore get_default_shuffle_algorithm linting issue (GH#7506)
    Florian Jetter
  * Remove set_config when using default client (GH#7482) Florian
    Jetter
  * Update gpuCI RAPIDS_VER to 23.04 (GH#7501)
  * Fix test_balance_expensive_tasks and improve helper functions
    in test_steal.py (GH#7253) Hendrik Makait
  * Sign every compute task with run ID to correlate response
    (GH#7463) Hendrik Makait
- Release 2023.1.0
  ## New Features
  * Add local SubprocessCluster that runs workers in separate
    processes (GH#7431) Hendrik Makait
  ## Enhancements
  * Ensure client session is quiet after cluster.close() or
    client.shutdown() (GH#7429) James Bourbeau
  * Set lifetime-stagger default value to None (GH#7445)
    bstadlbauer
  * Memory thresholds should never be exactly 0.0 (GH#7458) Stuart
    Berg
  * Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B.
    Kristensen
  * Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait
  * Add support for packing namedtuple and add test for future
    resolution in submit (GH#7292) Andrew
  * Avoid deep copy on lz4 decompression (GH#7437) crusaderky
  * Avoid deep copy of numpy buffers on unspill (GH#7435)
    crusaderky
  * Don’t error when clicking on empty task stream plot (GH#7432)
    James Bourbeau
  * Do not count spilled memory when comparing vs. process memory
    (GH#7430) crusaderky
  * Stop Client periodic callbacks during shutdown() (GH#7428)
    James Bourbeau
  * Add dask spec CLI (GH#7427) Matthew Rocklin
  * Create new zstd (de)compressor for each compression call
    (GH#7404) Dylan Wragge
  * Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky
  * Warn users when sizeof() returns inflated output (GH#7419)
    crusaderky
  ## Bug Fixes
  * Ensure dicts are properly recognized as msgpack serializable
    (GH#7473) Florian Jetter
  * Reset state of ShuffleSchedulerExtension on restart (GH#7446)
    Hendrik Makait
  * Reject non-string column names in P2P shuffle (GH#7447) Hendrik
    Makait
  * Avoid int32 in dashboard (GH#7443) Matthew Rocklin
  * Fix P2PShuffle serialization for categorical data (GH#7410)
    Hendrik Makait
  * WorkerPorcess blocks on kill if still starting (GH#7424)
    Matthew Rocklin
  ## Documentation
  * Move Prometheus docs from dask/dask (GH#7405) crusaderky
  ## Maintenance
  * Various cleanups in semaphore (GH#5885) Florian Jetter
  * test_rlimit fails on MacOSX (GH#7457) crusaderky
  * Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464)
  * Remove conditional imports of psutil (GH#7462) crusaderky
  * Drop support for zict < 2.1.0 (GH#7456) crusaderky
  * Fix flaky test_digests (GH#7454) crusaderky
  * Add minimum dependency testing to CI (GH#7285) Charles
    Blackmon-Luca
  * Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin
  * Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin
  * Add missing skips for pyarrow (GH#7416) Elliott Sales de
    Andrade
  * Be more permissive about expected ciphers in tests (GH#7417)
    Elliott Sales de Andrade
  * Revert “TST: Fetch executables from build root (GH#2551)”
    (GH#7415) Elliott Sales de Andrade

OBS-URL: https://build.opensuse.org/request/show/1063268
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=130
2023-02-06 12:27:22 +00:00
Dominique Leuenberger
aa8632990e Accepting request 1056244 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1056244
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=63
2023-01-06 16:05:34 +00:00
229223a891 Accepting request 1056224 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2022.12.1
  ## Enhancements
  * SpillBuffer metrics (GH#7368) crusaderky
  * Prometheus: measure how much spilling blocks the event loop (GH#7370) crusaderky
  * Add transfer_outgoing_bytes_total metric (GH#7388) Gabe Joseph
  * Fail P2PShuffle gracefully upon worker failure (GH#7326) Hendrik Makait
  ## Bug Fixes
  * Select queued tasks in stimuli, not transitions (GH#7402) Gabe Joseph
  * Check ContextVar in default_client (GH#7369) Matthew Rocklin
  * Fix sending event messages to non-subscribers (GH#7014) Laurence Watts
  * Set sizing mode on Tabs to avoid layout collapse (GH#7365) Mateusz Paprocki
  ## Maintenance
  * Restructure P2PShuffle extensions (GH#7390) Hendrik Makait
  * Add Python 3.11 classifier (GH#7408) James Bourbeau
  * Add support for Python 3.11 (GH#7249) Thomas Grainger
  * Add test for using annotations with client.submit and client.map (GH#7399) James Bourbeau
  * Bump actions/checkout from 3.1.0 to 3.2.0 (GH#7393)
  * Remove superfluous ShuffleSchedulerExtension.barriers (GH#7389) Hendrik Makait
  * Remove ignore annotation-unchecked (GH#7379) crusaderky
  * Remove tornado max version from nightly recipe (GH#7376) Charles Blackmon-Luca
  * Remove the experimental feature warning for Semaphore (GH#7373) Florian Jetter
- Release 2022.12.0
  ## Enhancements
  * Expose event loop health metrics in Prometheus (GH#7360) Hendrik Makait
  * Allow log propagation by default (GH#5669) Florian Jetter
  * Clean up of unpack_remotedata() (GH#7322) Mads R. B. Kristensen
  * Upgrade to tornado 6.2 (GH#7286) Thomas Grainger
  * Introduce Server level comm counters (GH#7332) Florian Jetter
  * Prometheus debug log (GH#7302) Florian Jetter
  ## Bug Fixes
  * Catch BaseException s from user tasks (GH#5997) Gabe Joseph
  * Impossible use case of erred deps in transition to waiting (GH#7354) crusaderky
  * Fix a deadlock when queued tasks are resubmitted quickly in succession (GH#7348) Florian Jetter
  ## Maintenance
  * Fetch all artifacts (GH#7355) Enrico Minack
  * Delay fsspec and urllib3 import time (GH#6659) Florian Jetter
  * Bump mypy (GH#7349) crusaderky
  * Bump mypy and remove win specific run (GH#7344) Florian Jetter
  * Finish overhaul of SchedulerState annotations (GH#7333) crusaderky
  * Fix flaky test_pause_while_spilling (GH#7334) Gabe Joseph
  * Update gpuCI RAPIDS_VER to 23.02 (GH#7337)
- Drop distributed-pr7286-tornado-6-2.patch
- Move to PEP517 build

OBS-URL: https://build.opensuse.org/request/show/1056224
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=128
2023-01-05 17:47:22 +00:00
Dominique Leuenberger
28974f6f25 Accepting request 1037288 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1037288
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=62
2022-11-23 08:47:55 +00:00
Markéta Machová
40cce72467 Accepting request 1037173 from home:bnavigator:branches:devel:languages:python:numeric
- Remove allow-bokeh3.patch
  * gh#dask/distributed#7329, gh#dask/dask#9659
  * we provide a legacy bokeh2 instead

OBS-URL: https://build.opensuse.org/request/show/1037173
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=126
2022-11-22 12:29:28 +00:00
Dominique Leuenberger
95315268ee Accepting request 1036965 from devel:languages:python:numeric
OBS-URL: https://build.opensuse.org/request/show/1036965
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=61
2022-11-21 14:29:45 +00:00
87efa83d4a Accepting request 1036962 from home:bnavigator:branches:devel:languages:python:numeric
- Update to version 2022.11.1 
  ## Enhancements
  * Restrict bokeh=3 support (GH#7329) Gabe Joseph (ignored in rpm
    fixed by bokek 3.0.2, see gh#dask/dask#9659)
  * Respect death timeout when waiting for scheduler file (GH#7296)
    Florian Jetter
  * Always raise exception if P2PShuffle s send fails (GH#7317)
    Hendrik Makait
  ## Maintenance
  * Remove exception handling from transitions (GH#7316) crusaderky
  * Turn private functions into private SchedulerState methods
    (GH#7260) Hendrik Makait
  * Bump toolz minimum version to 0.10.0 (GH#7309) Sam Grayson
- Release 2022.11.0
  ## Note
  * This release changes the default scheduling mode to use
    queuing. This will significantly reduce cluster memory use in
    most cases, and generally improve stability and performance.
    Learn more here and please provide any feedback on this
    discussion.
  * In rare cases, this could make some workloads slower. See the
    documentation for more information, and how to switch back to
    the old mode.
  ## New Features
  * Add ForwardOutput worker plugin to forward stdout and stderr to
    client. (GH#7297) Hendrik Makait
  * Duration counters on prefix level (GH#7288) Florian Jetter
  * Include button for launching JupyterLab layout in repr
    (GH#7218) Ian Rose
  ## Enhancements
  * Support MIG parsing during CUDA context creation in UCX
    initialization (GH#6720) Peter Andreas Entschev
  * Handle /metrics endpoint without prometheus-client installed
    (GH#7234) Hendrik Makait
  * Add support for unpacking namedtuples in remote data (GH#7282)
    Andrew
  * Enable queuing by default (GH#7279) Florian Jetter
  * Fix exists->``exist`` typo in scheduler error messages
    (GH#7281) Matthew Plough
  * If there’s an exception in the Client async context manager
    body then close fast (GH#6920) Thomas Grainger
  ## Bug Fixes
  * Ensure category is optional when logging "warn" events
    (GH#7169) James Bourbeau
  * Edge and impossible transitions to memory (GH#7205) crusaderky
  ## Maintenance
  * Allow bokeh=3 (GH#5648) James Bourbeau
  * Fix typos in P2P shuffle code (GH#7304) Hendrik Makait
  * Reenable test_bad_disk (GH#7300) Florian Jetter
  * Reduce max-runs in test reports (GH#7299) Florian Jetter
  * Revert idle classification when worker-saturation is set
    (GH#7278) Florian Jetter
  * Fix flaky deadline_expiration (GH#7287) Florian Jetter
  * Rewrite of P2P control flow (GH#7268) Florian Jetter
  * Bump minimum bokeh version to 2.4.2 (GH#7271) James Bourbeau
  * Remove deprecated code calls to IOLoop.make_current() (GH#7240)
    Thomas Grainger
  * Improved test for balancing expensive tasks (GH#7272) Hendrik
    Makait
  * Refactor semaphore._Watch into general-purpose Deadline utility
    (GH#7238) Hendrik Makait
  * Require Click 7.0+ (GH#7226) jakirkham
  * Drop tests (GH#7269) Hendrik Makait
  * Replace test_(do_not_)steal_communication_heavy_tasks tests
    with more robust versions (GH#7243) Hendrik Makait
  * xfail test_bad_disk (GH#7265) crusaderky
  * Move transition_log from Scheduler to SchedulerState (GH#7254)
    crusaderky
  * Remove Scheduler.log (GH#7258) crusaderky
  * Use latest pickle (GH#5826) jakirkham
  * Polish parsing of worker-saturation from config (GH#7255)
    crusaderky
  * Avoid expensive occupancy calculation when unused (GH#7257)
    Gabe Joseph
  * Un-skip test_nested_compute (GH#7247) Gabe Joseph
  * Review test_do_not_steal_communication_heavy_tasks (GH#7250)
    crusaderky
  * Fix test_stress_creation_and_deletion (GH#7215) crusaderky
  * Raise exceptions in Server.handle_stream instead of
    swallowing/logging (GH#7162) Hendrik Makait
  * Fix _update_scheduler_info hanging failed tests (GH#7225) Gabe
    Joseph
  * Bump xarray-contrib/ci-trigger from 1.1 to 1.2 (GH#7232)
- Release 2022.10.2
  * Reverted a bug where Bokeh was accidentally made non-optional
    (GH#7230) Oliver Holworthy
  * Schedule a queued task when a task secedes (GH#7224) Gabe
    Joseph
  * This was a hotfix release
- Release 2022.10.1
  ## New Features
  * Add Client.restart_workers method (GH#7154) James Bourbeau
  * Implement PackageInstall plugin for pip and conda (GH#7126)
    Hendrik Makait
  ## Enhancements
  * Add prometheus collector for work-stealing (GH#7206) Hendrik
    Makait
  * Track reason of workers closing and restarting (GH#7166)
    Hendrik Makait
  * Show no-worker on task progress bar (GH#7171) Florian Jetter
  * Set OPENBLAS_NUM_THREADS by default (GH#7177) James Bourbeau
  * Optionally provide local directory to data constructor
    (GH#7153) Lawrence Mitchell
  * Introduce distributed.comm.ucx.environment config slot
    (GH#7164) Lawrence Mitchell
  * Log information about memory limit (GH#7160) Florian Jetter
  * Improve log messages on scheduler for restart (GH#7150) Florian
    Jetter
  * More comprehensive WorkerState task counters (GH#7167)
    crusaderky
  ## Bug Fixes
  * Update minimum bokeh version message (GH#7172) James Bourbeau
  * Revamped implementations of remote print() and warn(), fixing
    #7095 (GH#7129) Max Bane
  ## Maintenance
  * Temporarily restrict bokeh<3 (GH#7219) James Bourbeau
  * Make Scheduler.reschedule private (GH#7216) crusaderky
  * Fix decide_worker_rootish_queuing_disabled assert (GH#7065)
    Gabe Joseph
  * Fix flaky test_include_communication_in_occupancy (GH#7212)
    Gabe Joseph
  * Do not raise on leaked websockets (GH#7199) Florian Jetter
  * Update nightly recipes with CLI tests, dependency changes
    (GH#7201) Charles Blackmon-Luca
  * Make p2p shuffle submodules private (GH#7186) Florian Jetter
  * Backport tornado PeriodicCallback (GH#7165) Florian Jetter
  * Fix mypy failure on CI (GH#7198) Florian Jetter
  * User a layer for p2p shuffle (GH#7180) Florian Jetter
  * Type annotations for shuffle (GH#7185) Florian Jetter
  * Do not close worker on comm error in heartbeat (GH#7163)
    Hendrik Makait
  * Errors when setting TCP timeouts log as error (GH#7161) Florian
    Jetter
  * Remove incorrect advice from pre-commit config (GH#7159)
    crusaderky
  * Use functionalities network for codecov uploader (GH#7148)
    Florian Jetter
  * Use counter metric type where appropriate, incoming_count was
    reporting bytes (GH#7125) Nat Tabris
- Add allow-bokeh3.patch -- raise upper bokeh version, reverts part
  of gh#dask/distributed#7329, see also gh#dask/dask#9659
- Replace support-tornado-6-2.patch with
  distributed-pr7286-tornado-6-2.patch -- gh#dask/distributed#7286

OBS-URL: https://build.opensuse.org/request/show/1036962
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=124
2022-11-20 18:27:09 +00:00