From 0a98707589b0a63147e271812cf0bf37174a372de2956558ea5e668fd4ab13e3 Mon Sep 17 00:00:00 2001 From: Daniel Garcia Date: Mon, 6 Feb 2023 12:27:22 +0000 Subject: [PATCH] Accepting request 1063268 from home:bnavigator:branches:devel:languages:python:numeric MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - Update to 2023.1.1 ## Enhancements * P2P shuffle deduplicates data and can be run several times (GH#7486) Hendrik Makait * Reverse order of get_logs() and get_worker_logs() (GH#7475) Nicholas R. Knezek * Add prometheus metric for time and memory used per task prefix (GH#7406) Thomas Grainger * Additive worker counts in Prometheus (GH#7468) crusaderky * Add help tool for taskstream (GH#7478) Florian Jetter ## Bug Fixes * Do not allow for a worker to reject a drop replica request (GH#7490) Hendrik Makait * Fix un/packing for namedtuples with custom constructors (GH#7465) antonymayi * Documentation * Remove timeout= from docstring example for worker_client (GH#7497) Florian Jetter ## Maintenance * Ignore get_default_shuffle_algorithm linting issue (GH#7506) Florian Jetter * Remove set_config when using default client (GH#7482) Florian Jetter * Update gpuCI RAPIDS_VER to 23.04 (GH#7501) * Fix test_balance_expensive_tasks and improve helper functions in test_steal.py (GH#7253) Hendrik Makait * Sign every compute task with run ID to correlate response (GH#7463) Hendrik Makait - Release 2023.1.0 ## New Features * Add local SubprocessCluster that runs workers in separate processes (GH#7431) Hendrik Makait ## Enhancements * Ensure client session is quiet after cluster.close() or client.shutdown() (GH#7429) James Bourbeau * Set lifetime-stagger default value to None (GH#7445) bstadlbauer * Memory thresholds should never be exactly 0.0 (GH#7458) Stuart Berg * Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B. Kristensen * Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait * Add support for packing namedtuple and add test for future resolution in submit (GH#7292) Andrew * Avoid deep copy on lz4 decompression (GH#7437) crusaderky * Avoid deep copy of numpy buffers on unspill (GH#7435) crusaderky * Don’t error when clicking on empty task stream plot (GH#7432) James Bourbeau * Do not count spilled memory when comparing vs. process memory (GH#7430) crusaderky * Stop Client periodic callbacks during shutdown() (GH#7428) James Bourbeau * Add dask spec CLI (GH#7427) Matthew Rocklin * Create new zstd (de)compressor for each compression call (GH#7404) Dylan Wragge * Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky * Warn users when sizeof() returns inflated output (GH#7419) crusaderky ## Bug Fixes * Ensure dicts are properly recognized as msgpack serializable (GH#7473) Florian Jetter * Reset state of ShuffleSchedulerExtension on restart (GH#7446) Hendrik Makait * Reject non-string column names in P2P shuffle (GH#7447) Hendrik Makait * Avoid int32 in dashboard (GH#7443) Matthew Rocklin * Fix P2PShuffle serialization for categorical data (GH#7410) Hendrik Makait * WorkerPorcess blocks on kill if still starting (GH#7424) Matthew Rocklin ## Documentation * Move Prometheus docs from dask/dask (GH#7405) crusaderky ## Maintenance * Various cleanups in semaphore (GH#5885) Florian Jetter * test_rlimit fails on MacOSX (GH#7457) crusaderky * Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464) * Remove conditional imports of psutil (GH#7462) crusaderky * Drop support for zict < 2.1.0 (GH#7456) crusaderky * Fix flaky test_digests (GH#7454) crusaderky * Add minimum dependency testing to CI (GH#7285) Charles Blackmon-Luca * Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin * Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin * Add missing skips for pyarrow (GH#7416) Elliott Sales de Andrade * Be more permissive about expected ciphers in tests (GH#7417) Elliott Sales de Andrade * Revert “TST: Fetch executables from build root (GH#2551)” (GH#7415) Elliott Sales de Andrade OBS-URL: https://build.opensuse.org/request/show/1063268 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=130 --- distributed-2022.12.1-gh.tar.gz | 3 -- distributed-2023.1.1-gh.tar.gz | 3 ++ python-distributed-rpmlintrc | 1 - python-distributed.changes | 94 +++++++++++++++++++++++++++++++++ python-distributed.spec | 18 ++++--- 5 files changed, 107 insertions(+), 12 deletions(-) delete mode 100644 distributed-2022.12.1-gh.tar.gz create mode 100644 distributed-2023.1.1-gh.tar.gz diff --git a/distributed-2022.12.1-gh.tar.gz b/distributed-2022.12.1-gh.tar.gz deleted file mode 100644 index bda8ac7..0000000 --- a/distributed-2022.12.1-gh.tar.gz +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:9051cf8ea2a29e7737eb53a65f6689e3b20d7031f9eb326bb0aa66b48d7c18d2 -size 1796755 diff --git a/distributed-2023.1.1-gh.tar.gz b/distributed-2023.1.1-gh.tar.gz new file mode 100644 index 0000000..59552fb --- /dev/null +++ b/distributed-2023.1.1-gh.tar.gz @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2d6e489b6c3614d359bd562c69a9451ef07baf6aedc1cd1c83e2026424a3176f +size 1809809 diff --git a/python-distributed-rpmlintrc b/python-distributed-rpmlintrc index c0d7e1c..0b24d94 100644 --- a/python-distributed-rpmlintrc +++ b/python-distributed-rpmlintrc @@ -1,2 +1 @@ addFilter("explicit-lib-dependency python3.*-tblib") -addFilter("explicit-lib-dependency python3.*-urllib3") diff --git a/python-distributed.changes b/python-distributed.changes index ea98c66..23a5c2a 100644 --- a/python-distributed.changes +++ b/python-distributed.changes @@ -1,3 +1,97 @@ +------------------------------------------------------------------- +Sun Feb 5 13:22:38 UTC 2023 - Ben Greiner + +- Update to 2023.1.1 + ## Enhancements + * P2P shuffle deduplicates data and can be run several times + (GH#7486) Hendrik Makait + * Reverse order of get_logs() and get_worker_logs() (GH#7475) + Nicholas R. Knezek + * Add prometheus metric for time and memory used per task prefix + (GH#7406) Thomas Grainger + * Additive worker counts in Prometheus (GH#7468) crusaderky + * Add help tool for taskstream (GH#7478) Florian Jetter + ## Bug Fixes + * Do not allow for a worker to reject a drop replica request + (GH#7490) Hendrik Makait + * Fix un/packing for namedtuples with custom constructors + (GH#7465) antonymayi + * Documentation + * Remove timeout= from docstring example for worker_client + (GH#7497) Florian Jetter + ## Maintenance + * Ignore get_default_shuffle_algorithm linting issue (GH#7506) + Florian Jetter + * Remove set_config when using default client (GH#7482) Florian + Jetter + * Update gpuCI RAPIDS_VER to 23.04 (GH#7501) + * Fix test_balance_expensive_tasks and improve helper functions + in test_steal.py (GH#7253) Hendrik Makait + * Sign every compute task with run ID to correlate response + (GH#7463) Hendrik Makait +- Release 2023.1.0 + ## New Features + * Add local SubprocessCluster that runs workers in separate + processes (GH#7431) Hendrik Makait + ## Enhancements + * Ensure client session is quiet after cluster.close() or + client.shutdown() (GH#7429) James Bourbeau + * Set lifetime-stagger default value to None (GH#7445) + bstadlbauer + * Memory thresholds should never be exactly 0.0 (GH#7458) Stuart + Berg + * Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B. + Kristensen + * Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait + * Add support for packing namedtuple and add test for future + resolution in submit (GH#7292) Andrew + * Avoid deep copy on lz4 decompression (GH#7437) crusaderky + * Avoid deep copy of numpy buffers on unspill (GH#7435) + crusaderky + * Don’t error when clicking on empty task stream plot (GH#7432) + James Bourbeau + * Do not count spilled memory when comparing vs. process memory + (GH#7430) crusaderky + * Stop Client periodic callbacks during shutdown() (GH#7428) + James Bourbeau + * Add dask spec CLI (GH#7427) Matthew Rocklin + * Create new zstd (de)compressor for each compression call + (GH#7404) Dylan Wragge + * Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky + * Warn users when sizeof() returns inflated output (GH#7419) + crusaderky + ## Bug Fixes + * Ensure dicts are properly recognized as msgpack serializable + (GH#7473) Florian Jetter + * Reset state of ShuffleSchedulerExtension on restart (GH#7446) + Hendrik Makait + * Reject non-string column names in P2P shuffle (GH#7447) Hendrik + Makait + * Avoid int32 in dashboard (GH#7443) Matthew Rocklin + * Fix P2PShuffle serialization for categorical data (GH#7410) + Hendrik Makait + * WorkerPorcess blocks on kill if still starting (GH#7424) + Matthew Rocklin + ## Documentation + * Move Prometheus docs from dask/dask (GH#7405) crusaderky + ## Maintenance + * Various cleanups in semaphore (GH#5885) Florian Jetter + * test_rlimit fails on MacOSX (GH#7457) crusaderky + * Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464) + * Remove conditional imports of psutil (GH#7462) crusaderky + * Drop support for zict < 2.1.0 (GH#7456) crusaderky + * Fix flaky test_digests (GH#7454) crusaderky + * Add minimum dependency testing to CI (GH#7285) Charles + Blackmon-Luca + * Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin + * Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin + * Add missing skips for pyarrow (GH#7416) Elliott Sales de + Andrade + * Be more permissive about expected ciphers in tests (GH#7417) + Elliott Sales de Andrade + * Revert “TST: Fetch executables from build root (GH#2551)” + (GH#7415) Elliott Sales de Andrade + ------------------------------------------------------------------- Mon Jan 2 21:03:06 UTC 2023 - Ben Greiner diff --git a/python-distributed.spec b/python-distributed.spec index 05a2a49..e74f67f 100644 --- a/python-distributed.spec +++ b/python-distributed.spec @@ -44,7 +44,7 @@ Name: python-distributed%{psuffix} # ===> Note: python-dask MUST be updated in sync with python-distributed! <=== -Version: 2022.12.1 +Version: 2023.1.1 Release: 0 Summary: Library for distributed computing with Python License: BSD-3-Clause @@ -62,21 +62,21 @@ BuildRequires: %{python_module setuptools} BuildRequires: %{python_module wheel} BuildRequires: fdupes BuildRequires: python-rpm-macros -Requires: python-PyYAML -Requires: python-certifi +Requires: python-Jinja2 >= 2.10.3 +Requires: python-PyYAML >= 5.3.1 Requires: python-click >= 7.0 Requires: python-cloudpickle >= 1.5.0 Requires: python-dask = %{version} Requires: python-locket >= 1.0.0 -Requires: python-msgpack >= 0.6.0 +Requires: python-msgpack >= 1.0.0 Requires: python-packaging >= 20.0 -Requires: python-psutil >= 5.0 -Requires: python-sortedcontainers +Requires: python-psutil >= 5.7.0 +Requires: python-sortedcontainers >= 2.0.5 Requires: python-tblib Requires: python-toolz >= 0.10.0 Requires: python-tornado >= 6.0.3 -Requires: python-urllib3 -Requires: python-zict >= 0.1.3 +Requires: python-urllib3 >= 1.24.3 +Requires: python-zict >= 2.1.0 Requires(post): update-alternatives Requires(postun):update-alternatives BuildArch: noarch @@ -142,6 +142,8 @@ donttest="test_git_revision" donttest+=" or test_version_warning_in_cluster" # invalid task state donttest+=" or test_fail_to_pickle_execute_2" +# too slow for obs +donttest+=" or test_nanny_timeout" # Some tests randomly fail server-side -- too slow for obs (?) # see also https://github.com/dask/distributed/issues/5818