python-distributed/python-distributed.spec

179 lines
5.9 KiB
RPMSpec
Raw Normal View History

#
Accepting request 907354 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.0 * Fix Nbytes jitter - less expensive * Use native GH actions cancel feature * Don't require workers to report to scheduler if scheduler shuts down * Add pandas to the list of checked packages for client. get_versions() * Move worker preload before scheduler address is set * Fix flaky test_oversubscribing_leases * Update scheduling policy docs for #4967 * Add echo handler to Server class * Also include pngs when bundling package * Remove duplicated dashboard panes * Fix worker memory dashboard flickering * Tabs on bottom left corner on dashboard * Rename nbytes widgets * Co-assign root-ish tasks * OSError tweaks * Update imports to cudf.testing._utils * Ensure shuffle split default durations uses proper prefix * Follow up pyupgrade formatting * Rename plot dropdown * Pyupgrade * Misc Sphinx tweaks * No longer hold dependencies of erred tasks in memory * Add maximum shard size to config * Ensure shuffle split operations are blacklisted from work stealing * Add dropdown menu to access individual plots * Edited the path to scheduler.py * Task Group Graph Visualization * Remove more internal references to deprecated utilities * Restructure nbytes hover * Except more errors in pynvml.nvmlInit() * Add occupancy as individual plot * Deprecate utilities which have moved to dask * Ensure connectionpool does not leave comms if closed mid connect * Add support for registering scheduler plugins from Client * Stealing dashboard fixes * Allow requirements verification to be ignored when loading backends from entrypoints * Add Log and Logs to API docs * Support fixtures and pytest.mark.parametrize with gen_cluster - Release 2021.06.2 * Revert refactor to utils.Log[s] and Cluster.get_logs * Use deprecation utility from Dask * Add transition counter to Scheduler * Remove nbytes_in_memory - Release 2021.06.1 * Fix deadlock in handle_missing_dep if additional replicas are available * Add configuration to enable/disable NVML diagnostics * Add scheduler log tab to performance reports * Add HTML repr to scheduler_info and incorporate into client and cluster reprs * Fix error state typo * Allow actor exceptions to propagate * Remove importing apply from dask.compatibility * Use more informative default name for WorkerPlugin s * Removed unused utility functions * Locally rerun successfully completed futures * Forget erred tasks and fix deadlocks on worker * Handle HTTPClientError in websocket connector * Update dask_cuda usage in SSHCluster docstring * Remove tests for process_time and thread_time * Flake8 config cleanup * Don't strip scheduler protocol when determining host * Add more documentation on memory management * Add range_query tests to NVML test suite * No longer cancel result future in async process when using timeouts - Release 2021.06.0 * Multiple worker executors * Ensure PyNVML works correctly when installed with no GPUs * Show more in test summary * Move SystemMonitor s GPU initialization back to constructor * Mark test_server_comms_mark_active_handlers with pytest.mark.asyncio * Who has has what html reprs v2 * O(1) rebalance * Ensure repr and eq for cluster always works - Release 2021.05.1 * Drop usage of WhoHas & WhatHas from Client * Ensure adaptive scaling is properly awaited and closed * Fix WhoHas/ HasWhat async usage * Add HTML reprs for Client.who_has and Client.has_what * Prevent accidentally starting multiple Worker s in the same process * Add system tab to performance reports * Let servers close faster if there are no active handlers * Fix UCX scrub config logging * Ensure worker clients are closed * Fix warning for attribute error when deleting a client * Ensure exceptions are raised if workers are incorrectly started * Update handling of UCX exceptions on endpoint closing * Ensure busy workloads properly look up who_has * Check distributed.scheduler.pickle in Scheduler.run_function * Add performance_report to API docs * Use dict _workers_dv in unordered use cases * Bump pre-commit hook versions * Do not mindlessly spawn workers when no memory limit is set * test_memory to use gen_cluster * Increase timeout of gen_test to 30s - Work on the very flaky testsuite: * Add missing conftest.py not packaged on PyPI * Add distributed-pr5022-improve_ci.patch in the hope for better stability -- gh#dask/distributed#5022 * Do not use pytest-xdist - Add Cython as runtime dep because the scheduler checks the presence OBS-URL: https://build.opensuse.org/request/show/907354 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=98
2021-07-21 09:16:05 +00:00
# spec file
#
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
# Copyright (c) 2022 SUSE LLC
#
# All modifications and additions to the file contributed by third parties
# remain the property of their copyright owners, unless otherwise agreed
# upon. The license for this file, and modifications and additions to the
# file, is the same license as for the pristine package itself (unless the
# license for the pristine package is not an Open Source License, in which
# case the license is the MIT License). An "Open Source License" is a
# license that conforms to the Open Source Definition (Version 1.9)
# published by the Open Source Initiative.
# Please submit bugfixes or comments via https://bugs.opensuse.org/
#
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
%define psuffix %{nil}
%global flavor @BUILD_FLAVOR@%{nil}
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
%if "%{flavor}" == "test-py38"
%define psuffix -test-py38
%define skip_python39 1
%define skip_python310 1
%bcond_without test
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
%endif
%if "%{flavor}" == "test-py39"
%define psuffix -test-py39
%define skip_python38 1
%define skip_python310 1
%bcond_without test
%endif
%if "%{flavor}" == "test-py310"
# add to _multibuild when enabling python310 (see below)
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
%define psuffix -test-py310
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
%define skip_python38 1
%define skip_python39 1
%bcond_without test
%endif
%if "%{flavor}" == ""
# https://github.com/dask/distributed/issues/5350 -- NOT fixed by https://github.com/dask/distributed/pull/5353
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
# %%define skip_python310 1
%bcond_with test
%endif
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
Accepting request 907354 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.0 * Fix Nbytes jitter - less expensive * Use native GH actions cancel feature * Don't require workers to report to scheduler if scheduler shuts down * Add pandas to the list of checked packages for client. get_versions() * Move worker preload before scheduler address is set * Fix flaky test_oversubscribing_leases * Update scheduling policy docs for #4967 * Add echo handler to Server class * Also include pngs when bundling package * Remove duplicated dashboard panes * Fix worker memory dashboard flickering * Tabs on bottom left corner on dashboard * Rename nbytes widgets * Co-assign root-ish tasks * OSError tweaks * Update imports to cudf.testing._utils * Ensure shuffle split default durations uses proper prefix * Follow up pyupgrade formatting * Rename plot dropdown * Pyupgrade * Misc Sphinx tweaks * No longer hold dependencies of erred tasks in memory * Add maximum shard size to config * Ensure shuffle split operations are blacklisted from work stealing * Add dropdown menu to access individual plots * Edited the path to scheduler.py * Task Group Graph Visualization * Remove more internal references to deprecated utilities * Restructure nbytes hover * Except more errors in pynvml.nvmlInit() * Add occupancy as individual plot * Deprecate utilities which have moved to dask * Ensure connectionpool does not leave comms if closed mid connect * Add support for registering scheduler plugins from Client * Stealing dashboard fixes * Allow requirements verification to be ignored when loading backends from entrypoints * Add Log and Logs to API docs * Support fixtures and pytest.mark.parametrize with gen_cluster - Release 2021.06.2 * Revert refactor to utils.Log[s] and Cluster.get_logs * Use deprecation utility from Dask * Add transition counter to Scheduler * Remove nbytes_in_memory - Release 2021.06.1 * Fix deadlock in handle_missing_dep if additional replicas are available * Add configuration to enable/disable NVML diagnostics * Add scheduler log tab to performance reports * Add HTML repr to scheduler_info and incorporate into client and cluster reprs * Fix error state typo * Allow actor exceptions to propagate * Remove importing apply from dask.compatibility * Use more informative default name for WorkerPlugin s * Removed unused utility functions * Locally rerun successfully completed futures * Forget erred tasks and fix deadlocks on worker * Handle HTTPClientError in websocket connector * Update dask_cuda usage in SSHCluster docstring * Remove tests for process_time and thread_time * Flake8 config cleanup * Don't strip scheduler protocol when determining host * Add more documentation on memory management * Add range_query tests to NVML test suite * No longer cancel result future in async process when using timeouts - Release 2021.06.0 * Multiple worker executors * Ensure PyNVML works correctly when installed with no GPUs * Show more in test summary * Move SystemMonitor s GPU initialization back to constructor * Mark test_server_comms_mark_active_handlers with pytest.mark.asyncio * Who has has what html reprs v2 * O(1) rebalance * Ensure repr and eq for cluster always works - Release 2021.05.1 * Drop usage of WhoHas & WhatHas from Client * Ensure adaptive scaling is properly awaited and closed * Fix WhoHas/ HasWhat async usage * Add HTML reprs for Client.who_has and Client.has_what * Prevent accidentally starting multiple Worker s in the same process * Add system tab to performance reports * Let servers close faster if there are no active handlers * Fix UCX scrub config logging * Ensure worker clients are closed * Fix warning for attribute error when deleting a client * Ensure exceptions are raised if workers are incorrectly started * Update handling of UCX exceptions on endpoint closing * Ensure busy workloads properly look up who_has * Check distributed.scheduler.pickle in Scheduler.run_function * Add performance_report to API docs * Use dict _workers_dv in unordered use cases * Bump pre-commit hook versions * Do not mindlessly spawn workers when no memory limit is set * test_memory to use gen_cluster * Increase timeout of gen_test to 30s - Work on the very flaky testsuite: * Add missing conftest.py not packaged on PyPI * Add distributed-pr5022-improve_ci.patch in the hope for better stability -- gh#dask/distributed#5022 * Do not use pytest-xdist - Add Cython as runtime dep because the scheduler checks the presence OBS-URL: https://build.opensuse.org/request/show/907354 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=98
2021-07-21 09:16:05 +00:00
%ifarch %{ix86} %{arm}
# cython optimizations not supported on 32-bit: https://github.com/dask/dask/issues/7489
%bcond_with cythonize
%else
%bcond_without cythonize
%endif
%if %{with cythonize}
%define cythonize --with-cython
%endif
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
Accepting request 882449 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.1 * Add standalone dashboard page for GPU usage (GH#4556) Jacob Tomlinson * Handle stream is None case in TCP comm finalizer (GH#4631) James Bourbeau * Include LIST_PICKLE in NumPy array serialization (GH#4632) James Bourbeau * Rename annotation plugin in test_highlevelgraph.py (GH#4618) James Bourbeau * UCX use nbytes instead of len (GH#4621) Mads R. B. Kristensen * Skip NumPy and pandas tests if not importable (GH#4563) Ben Greiner * Remove utils.shutting_down in favor of sys.is_finalizing (GH#4624) James Bourbeau * Handle async clients when closing (GH#4623) Matthew Rocklin * Drop log from remove_key_from_stealable (GH#4609) jakirkham * Introduce events log length config option (GH#4615) Fabian Gebhart * Upstream config serialization and inheritance (GH#4372) Jacob Tomlinson * Add check to scheduler creation in SpecCluster (GH#4605) Jacob Tomlinson * Make length of events deque configurable (GH#4604) Fabian Gebhart * Add explicit fetch state to worker TaskState (GH#4470) Gil Forsyth * Update develop.rst (GH#4603) Florian Jetter * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B. Kristensen * Switch documentation builds for PRs to readthedocs (GH#4599) James Bourbeau * Track frame sizes along with frames (GH#4593) jakirkham * Add support for a list of keys when using batch_size in client. map (GH#4592) Sultan Orazbayev * If SpecCluster fails to start attempt to gracefully close out again (GH#4590) Jacob Tomlinson * Multi-lock extension (GH#4503) Mads R. B. Kristensen * Update PipInstall plugin command (GH#4584) James Bourbeau * IPython magics: remove deprecated ioloop workarounds (GH#4530) Min RK * Add GitHub actions workflow to cancel duplicate builds (GH#4581) James Bourbeau * Remove outdated macOS build badge from README (GH#4576) James Bourbeau * Dask master -> main (GH#4569) Julia Signell * Drop support for Python 3.6 (GH#4390) James Bourbeau * Add docstring for dashboard_link property (GH#4572) Doug Davis * Change default branch from master to main (GH#4495) Julia Signell * Msgpack handles extract serialize (GH#4531) Mads R. B. Kristensen - Drop importorskip-numpy-tests.patch merged upstream - Skip python36 build. Upstream dropped support for Python < 3.7 OBS-URL: https://build.opensuse.org/request/show/882449 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=92
2021-04-01 10:30:28 +00:00
%{?!python_module:%define python_module() python3-%{**}}
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
%define skip_python2 1
Name: python-distributed%{psuffix}
Accepting request 894365 from home:bnavigator:branches:devel:languages:python:numeric - update to version 2021.5.0 * Merge global annotations on the client (GH#4691) Mads R. B. Kristensen * Add support for click 8 (GH#4810) James Bourbeau * Add HTML reprs to some scheduler classes (GH#4795) James Bourbeau * Use JupyterLab theme variables (GH#4796) Ian Rose * Allow the dashboard to run on multiple ports (GH#4786) Jacob Tomlinson * Remove release_dep from WorkerPlugin API (GH#4791) James Bourbeau * Support for UCX 1.10+ (GH#4787) Peter Andreas Entschev * Reduce complexity of test_gather_allow_worker_reconnect (GH#4739) Florian Jetter * Fix doctests in utils.py (GH#4785) Jacob Tomlinson * Ensure deps are actually logged in worker (GH#4753) Florian Jetter * Add stacklevel keyword into performance_report() to allow for selecting calling code to be displayed (GH#4777) Nathan Danielsen * Unregister worker plugin (GH#4748) Naty Clementi * Fixes some pickling issues in the Cythonized Scheduler (GH#4768) jakirkham * Improve graceful shutdown if nanny is involved (GH#4725) Florian Jetter * Update cythonization in CI (GH#4764) James Bourbeau * Use contextlib.nullcontext (GH#4763) James Bourbeau * Cython fixes for MemoryState (GH#4761) jakirkham * Fix errors in check_thread_leak (GH#4747) James Bourbeau * Handle missing key case in report_on_key (GH#4755) jakirkham * Drop temporary set variables s (GH#4758) jakirkham - skip even more flaky tests - stress that upstream wants to use dask with a matching version number OBS-URL: https://build.opensuse.org/request/show/894365 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=96
2021-05-19 17:27:21 +00:00
# Note: please always update together with python-dask
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
Version: 2022.02.1
Release: 0
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
Summary: Library for distributed computing with Python
License: BSD-3-Clause
URL: https://distributed.readthedocs.io/en/latest/
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
Source: https://github.com/dask/distributed/archive/refs/tags//%{version}.tar.gz#/distributed-%{version}-gh.tar.gz
Source99: python-distributed-rpmlintrc
Accepting request 882449 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.1 * Add standalone dashboard page for GPU usage (GH#4556) Jacob Tomlinson * Handle stream is None case in TCP comm finalizer (GH#4631) James Bourbeau * Include LIST_PICKLE in NumPy array serialization (GH#4632) James Bourbeau * Rename annotation plugin in test_highlevelgraph.py (GH#4618) James Bourbeau * UCX use nbytes instead of len (GH#4621) Mads R. B. Kristensen * Skip NumPy and pandas tests if not importable (GH#4563) Ben Greiner * Remove utils.shutting_down in favor of sys.is_finalizing (GH#4624) James Bourbeau * Handle async clients when closing (GH#4623) Matthew Rocklin * Drop log from remove_key_from_stealable (GH#4609) jakirkham * Introduce events log length config option (GH#4615) Fabian Gebhart * Upstream config serialization and inheritance (GH#4372) Jacob Tomlinson * Add check to scheduler creation in SpecCluster (GH#4605) Jacob Tomlinson * Make length of events deque configurable (GH#4604) Fabian Gebhart * Add explicit fetch state to worker TaskState (GH#4470) Gil Forsyth * Update develop.rst (GH#4603) Florian Jetter * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B. Kristensen * Switch documentation builds for PRs to readthedocs (GH#4599) James Bourbeau * Track frame sizes along with frames (GH#4593) jakirkham * Add support for a list of keys when using batch_size in client. map (GH#4592) Sultan Orazbayev * If SpecCluster fails to start attempt to gracefully close out again (GH#4590) Jacob Tomlinson * Multi-lock extension (GH#4503) Mads R. B. Kristensen * Update PipInstall plugin command (GH#4584) James Bourbeau * IPython magics: remove deprecated ioloop workarounds (GH#4530) Min RK * Add GitHub actions workflow to cancel duplicate builds (GH#4581) James Bourbeau * Remove outdated macOS build badge from README (GH#4576) James Bourbeau * Dask master -> main (GH#4569) Julia Signell * Drop support for Python 3.6 (GH#4390) James Bourbeau * Add docstring for dashboard_link property (GH#4572) Doug Davis * Change default branch from master to main (GH#4495) Julia Signell * Msgpack handles extract serialize (GH#4531) Mads R. B. Kristensen - Drop importorskip-numpy-tests.patch merged upstream - Skip python36 build. Upstream dropped support for Python < 3.7 OBS-URL: https://build.opensuse.org/request/show/882449 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=92
2021-04-01 10:30:28 +00:00
BuildRequires: %{python_module base >= 3.7}
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
Requires: python-PyYAML
Requires: python-certifi
Requires: python-click >= 6.6
Requires: python-cloudpickle >= 1.5.0
Accepting request 894365 from home:bnavigator:branches:devel:languages:python:numeric - update to version 2021.5.0 * Merge global annotations on the client (GH#4691) Mads R. B. Kristensen * Add support for click 8 (GH#4810) James Bourbeau * Add HTML reprs to some scheduler classes (GH#4795) James Bourbeau * Use JupyterLab theme variables (GH#4796) Ian Rose * Allow the dashboard to run on multiple ports (GH#4786) Jacob Tomlinson * Remove release_dep from WorkerPlugin API (GH#4791) James Bourbeau * Support for UCX 1.10+ (GH#4787) Peter Andreas Entschev * Reduce complexity of test_gather_allow_worker_reconnect (GH#4739) Florian Jetter * Fix doctests in utils.py (GH#4785) Jacob Tomlinson * Ensure deps are actually logged in worker (GH#4753) Florian Jetter * Add stacklevel keyword into performance_report() to allow for selecting calling code to be displayed (GH#4777) Nathan Danielsen * Unregister worker plugin (GH#4748) Naty Clementi * Fixes some pickling issues in the Cythonized Scheduler (GH#4768) jakirkham * Improve graceful shutdown if nanny is involved (GH#4725) Florian Jetter * Update cythonization in CI (GH#4764) James Bourbeau * Use contextlib.nullcontext (GH#4763) James Bourbeau * Cython fixes for MemoryState (GH#4761) jakirkham * Fix errors in check_thread_leak (GH#4747) James Bourbeau * Handle missing key case in report_on_key (GH#4755) jakirkham * Drop temporary set variables s (GH#4758) jakirkham - skip even more flaky tests - stress that upstream wants to use dask with a matching version number OBS-URL: https://build.opensuse.org/request/show/894365 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=96
2021-05-19 17:27:21 +00:00
Requires: python-dask = %{version}
Requires: python-msgpack
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
Requires: python-packaging >= 20.0
Requires: python-psutil >= 5.0
Requires: python-sortedcontainers
Requires: python-tblib
Requires: python-toolz >= 0.8.2
Requires: python-tornado >= 6.0.3
Requires: python-zict >= 0.1.3
Accepting request 921004 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.9.1 * Revert AMM ReduceReplicas and parallel AMMs updates * Run multiple AMMs in parallel * AMM ReduceReplicas to iterate only on replicated tasks * Add type annotations to various functions within distributed.worker * Mark test_ucx_config_w_env_var flaky on UCX < 1.11 * Warn if CUDA context is created on incorrect device in UCX * Remove redundant timeouts from test_client * Allow Client to subscribe to events // Remote printing and warning * Test pickle protocols 4 & 5 * Fix-up test_pickle_empty * Increase timeout for test_worker_reconnects_mid_compute_multiple_states_on_scheduler * Add synced dict between cluster and scheduler to store cluster info * Update test_sub_submit_priority * Revert "Add test setup fixture * Fix flaky test_worker_reconnects_mid_compute * Use gen_test in test_adaptive * Increase worker.suspicious_counter threshold * Active Memory Manager framework + discard excess replicas * Add test setup fixture - Release version 2021.9.0 * Fix add_plugin warnings * Add list around iterator in handle_missing_dep * Jupyter-client 7 compatiblity * Replace atop with blockwise * Add pytest color to CI * Fix test_map and others * Use name argument with Scheduler.remove_plugin calls * Downgrade to jupyter_client 6 * Migrate Security HTML repr to Jinja2 * Migrate ProcessInterface HTML repr to Jinja2 * Add support for diskless machines to system monitor * Avoid during-iteration scheduler plugin changes * Remove GroupProgress scheduler plugin * Properly check for ipv6 availability * Improved IPv6 dask-worker support * Overwrite worker plugins * Refactor scheduler plugins; store in a dictionary * Fix "then" -> "than" typo in docs * Fix typo (remove extra verb "creates") in docs * Fix "fractiom" -> "fraction" typo in docstring * Fix "schedulers" -> "scheduler" typo in docs * Use non-histogram plots up to 100 workers - Release 2021.08.1 * Rename plots to fit in the labextension * Log messages for CommClosedError now includes information about remote address * Add target='_blank' for redirects of dashboard link * Update computation code retrieval logic * Minor polish on cfexecutor * Use development version of dask in gpuCI build * Use upstream dask.widgets * Fix flaky test_worker_reconnects_mid_compute * Update WorkerPlugin docstring about usage of TaskState objects * Worker Network Timeseries * Add HTML Repr for ProcessInterface class and all its subclasses * Fix an issue where a reconnecting worker could cause an invalid transition * Minor fixes for cfexecutor * Add HTML Repr for Security class * Fix performance report sizing issue * Drop RMM compatibility code from RAPIDS < 0.11 - Release 2021.08.0 * Include addresses in closed comm repr * Test nanny.environ precedence * Migrating HTML reprs to jinja2 * Fix test_process_executor_kills_process flakyness * Remove urllib3 as a dependency downloading preloads * Download preload urls in the Preload constructor * Avoid recursion error in profile.merge * Add text exceptions to the Scheduler * Use kwarg for Theme filename * Add a .git-ignore-revs file * Replace not not with bool() * Resolve deadlock cause by transition error after fetching dependency * Set z-index of data-table lower * Add no-worker - memory transition to scheduler * Deprecate worker plugin overwrite policy * Fix flaky tests in CI * Instructions for jemalloc with brew on macOS * Bump RAPIDS_VER to 21.10 * Tweak verbiage around async functions * Use Python 3 super() calls * Support asynchronous tasks * Rename total comm bytes and provide doc string * Add GPU executor if GPU is present * Fix RMM and UCX tests * Remove excessive timeout of test_steal_during_task_deserialization * Add gpuCI build script * Demote Worker.ensure_computing to function OBS-URL: https://build.opensuse.org/request/show/921004 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=100
2021-09-22 17:40:45 +00:00
Requires(post): update-alternatives
Requires(postun):update-alternatives
Accepting request 907354 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.0 * Fix Nbytes jitter - less expensive * Use native GH actions cancel feature * Don't require workers to report to scheduler if scheduler shuts down * Add pandas to the list of checked packages for client. get_versions() * Move worker preload before scheduler address is set * Fix flaky test_oversubscribing_leases * Update scheduling policy docs for #4967 * Add echo handler to Server class * Also include pngs when bundling package * Remove duplicated dashboard panes * Fix worker memory dashboard flickering * Tabs on bottom left corner on dashboard * Rename nbytes widgets * Co-assign root-ish tasks * OSError tweaks * Update imports to cudf.testing._utils * Ensure shuffle split default durations uses proper prefix * Follow up pyupgrade formatting * Rename plot dropdown * Pyupgrade * Misc Sphinx tweaks * No longer hold dependencies of erred tasks in memory * Add maximum shard size to config * Ensure shuffle split operations are blacklisted from work stealing * Add dropdown menu to access individual plots * Edited the path to scheduler.py * Task Group Graph Visualization * Remove more internal references to deprecated utilities * Restructure nbytes hover * Except more errors in pynvml.nvmlInit() * Add occupancy as individual plot * Deprecate utilities which have moved to dask * Ensure connectionpool does not leave comms if closed mid connect * Add support for registering scheduler plugins from Client * Stealing dashboard fixes * Allow requirements verification to be ignored when loading backends from entrypoints * Add Log and Logs to API docs * Support fixtures and pytest.mark.parametrize with gen_cluster - Release 2021.06.2 * Revert refactor to utils.Log[s] and Cluster.get_logs * Use deprecation utility from Dask * Add transition counter to Scheduler * Remove nbytes_in_memory - Release 2021.06.1 * Fix deadlock in handle_missing_dep if additional replicas are available * Add configuration to enable/disable NVML diagnostics * Add scheduler log tab to performance reports * Add HTML repr to scheduler_info and incorporate into client and cluster reprs * Fix error state typo * Allow actor exceptions to propagate * Remove importing apply from dask.compatibility * Use more informative default name for WorkerPlugin s * Removed unused utility functions * Locally rerun successfully completed futures * Forget erred tasks and fix deadlocks on worker * Handle HTTPClientError in websocket connector * Update dask_cuda usage in SSHCluster docstring * Remove tests for process_time and thread_time * Flake8 config cleanup * Don't strip scheduler protocol when determining host * Add more documentation on memory management * Add range_query tests to NVML test suite * No longer cancel result future in async process when using timeouts - Release 2021.06.0 * Multiple worker executors * Ensure PyNVML works correctly when installed with no GPUs * Show more in test summary * Move SystemMonitor s GPU initialization back to constructor * Mark test_server_comms_mark_active_handlers with pytest.mark.asyncio * Who has has what html reprs v2 * O(1) rebalance * Ensure repr and eq for cluster always works - Release 2021.05.1 * Drop usage of WhoHas & WhatHas from Client * Ensure adaptive scaling is properly awaited and closed * Fix WhoHas/ HasWhat async usage * Add HTML reprs for Client.who_has and Client.has_what * Prevent accidentally starting multiple Worker s in the same process * Add system tab to performance reports * Let servers close faster if there are no active handlers * Fix UCX scrub config logging * Ensure worker clients are closed * Fix warning for attribute error when deleting a client * Ensure exceptions are raised if workers are incorrectly started * Update handling of UCX exceptions on endpoint closing * Ensure busy workloads properly look up who_has * Check distributed.scheduler.pickle in Scheduler.run_function * Add performance_report to API docs * Use dict _workers_dv in unordered use cases * Bump pre-commit hook versions * Do not mindlessly spawn workers when no memory limit is set * test_memory to use gen_cluster * Increase timeout of gen_test to 30s - Work on the very flaky testsuite: * Add missing conftest.py not packaged on PyPI * Add distributed-pr5022-improve_ci.patch in the hope for better stability -- gh#dask/distributed#5022 * Do not use pytest-xdist - Add Cython as runtime dep because the scheduler checks the presence OBS-URL: https://build.opensuse.org/request/show/907354 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=98
2021-07-21 09:16:05 +00:00
%if %{with cythonize}
BuildRequires: %{python_module Cython}
# the cythonized scheduler needs Cython also as runtime dep for some checks
Requires: python-Cython
%endif
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
%if %{with test}
BuildRequires: %{python_module PyYAML}
BuildRequires: %{python_module bokeh}
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
BuildRequires: %{python_module certifi}
BuildRequires: %{python_module click >= 6.6}
BuildRequires: %{python_module cloudpickle >= 1.5.0}
Accepting request 894365 from home:bnavigator:branches:devel:languages:python:numeric - update to version 2021.5.0 * Merge global annotations on the client (GH#4691) Mads R. B. Kristensen * Add support for click 8 (GH#4810) James Bourbeau * Add HTML reprs to some scheduler classes (GH#4795) James Bourbeau * Use JupyterLab theme variables (GH#4796) Ian Rose * Allow the dashboard to run on multiple ports (GH#4786) Jacob Tomlinson * Remove release_dep from WorkerPlugin API (GH#4791) James Bourbeau * Support for UCX 1.10+ (GH#4787) Peter Andreas Entschev * Reduce complexity of test_gather_allow_worker_reconnect (GH#4739) Florian Jetter * Fix doctests in utils.py (GH#4785) Jacob Tomlinson * Ensure deps are actually logged in worker (GH#4753) Florian Jetter * Add stacklevel keyword into performance_report() to allow for selecting calling code to be displayed (GH#4777) Nathan Danielsen * Unregister worker plugin (GH#4748) Naty Clementi * Fixes some pickling issues in the Cythonized Scheduler (GH#4768) jakirkham * Improve graceful shutdown if nanny is involved (GH#4725) Florian Jetter * Update cythonization in CI (GH#4764) James Bourbeau * Use contextlib.nullcontext (GH#4763) James Bourbeau * Cython fixes for MemoryState (GH#4761) jakirkham * Fix errors in check_thread_leak (GH#4747) James Bourbeau * Handle missing key case in report_on_key (GH#4755) jakirkham * Drop temporary set variables s (GH#4758) jakirkham - skip even more flaky tests - stress that upstream wants to use dask with a matching version number OBS-URL: https://build.opensuse.org/request/show/894365 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=96
2021-05-19 17:27:21 +00:00
BuildRequires: %{python_module dask-all = %{version}}
BuildRequires: %{python_module ipykernel}
BuildRequires: %{python_module ipython}
BuildRequires: %{python_module jupyter_client}
BuildRequires: %{python_module msgpack}
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
BuildRequires: %{python_module psutil}
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
BuildRequires: %{python_module pytest-asyncio >= 0.17.2}
Accepting request 877788 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.0 * This is the first release with support for Python 3.9 and the last release with support for Python 3.6 * tcp.write(): cast memoryview to byte itemsize (#4555) Mads R. B. Kristensen * Refcount the thread_state.asynchronous flag (#4557) Mads R. B. Kristensen * Python 3.9 (#4460) crusaderky * Better bokeh defaults for dashboard (#4554) Benjamin Zaitlen * Expose system monitor dashboard as individual plot for lab extension (#4540) Jacob Tomlinson * Pass on original temp dir from nanny to worker (#4549) Martin Durant * Serialize and split (#4541) Mads R. B. Kristensen * Use the new HLG pack/unpack API in Dask (#4489) Mads R. B. Kristensen * Handle annotations for culled tasks (#4544) Tom Augspurger * Make sphinx autosummary and autoclass consistent (#4367) Casey Clements * Move _transition* to SchedulerState (#4545) jakirkham * Migrate from travis to GitHub actions (#4504) crusaderky * Move new_task to SchedulerState (#4527) jakirkham * Batch more Scheduler sends (#4526) jakirkham * transition_memory_released and get_nbytes() optimizations (#4516) jakirkham * Pin black pre-commit (#4533) James Bourbeau * Read & write all frames in one pass (#4506) jakirkham * Skip stream.write call for empty frames (#4507) jakirkham * Prepend frame metadata header (#4505) jakirkham * transition_processing_memory optimizations, etc. (#4487) jakirkham * Attempt to get client from worker in Queue and Variable (#4490) James Bourbeau * Use main branch for zict (#4499) jakirkham * Use a callback to close TCP Comms, rather than check every time (#4453) Matthew Rocklin OBS-URL: https://build.opensuse.org/request/show/877788 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=90
2021-03-08 22:22:37 +00:00
BuildRequires: %{python_module pytest-rerunfailures}
BuildRequires: %{python_module pytest-timeout}
BuildRequires: %{python_module pytest}
BuildRequires: %{python_module requests}
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
BuildRequires: %{python_module sortedcontainers}
Accepting request 882449 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.1 * Add standalone dashboard page for GPU usage (GH#4556) Jacob Tomlinson * Handle stream is None case in TCP comm finalizer (GH#4631) James Bourbeau * Include LIST_PICKLE in NumPy array serialization (GH#4632) James Bourbeau * Rename annotation plugin in test_highlevelgraph.py (GH#4618) James Bourbeau * UCX use nbytes instead of len (GH#4621) Mads R. B. Kristensen * Skip NumPy and pandas tests if not importable (GH#4563) Ben Greiner * Remove utils.shutting_down in favor of sys.is_finalizing (GH#4624) James Bourbeau * Handle async clients when closing (GH#4623) Matthew Rocklin * Drop log from remove_key_from_stealable (GH#4609) jakirkham * Introduce events log length config option (GH#4615) Fabian Gebhart * Upstream config serialization and inheritance (GH#4372) Jacob Tomlinson * Add check to scheduler creation in SpecCluster (GH#4605) Jacob Tomlinson * Make length of events deque configurable (GH#4604) Fabian Gebhart * Add explicit fetch state to worker TaskState (GH#4470) Gil Forsyth * Update develop.rst (GH#4603) Florian Jetter * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B. Kristensen * Switch documentation builds for PRs to readthedocs (GH#4599) James Bourbeau * Track frame sizes along with frames (GH#4593) jakirkham * Add support for a list of keys when using batch_size in client. map (GH#4592) Sultan Orazbayev * If SpecCluster fails to start attempt to gracefully close out again (GH#4590) Jacob Tomlinson * Multi-lock extension (GH#4503) Mads R. B. Kristensen * Update PipInstall plugin command (GH#4584) James Bourbeau * IPython magics: remove deprecated ioloop workarounds (GH#4530) Min RK * Add GitHub actions workflow to cancel duplicate builds (GH#4581) James Bourbeau * Remove outdated macOS build badge from README (GH#4576) James Bourbeau * Dask master -> main (GH#4569) Julia Signell * Drop support for Python 3.6 (GH#4390) James Bourbeau * Add docstring for dashboard_link property (GH#4572) Doug Davis * Change default branch from master to main (GH#4495) Julia Signell * Msgpack handles extract serialize (GH#4531) Mads R. B. Kristensen - Drop importorskip-numpy-tests.patch merged upstream - Skip python36 build. Upstream dropped support for Python < 3.7 OBS-URL: https://build.opensuse.org/request/show/882449 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=92
2021-04-01 10:30:28 +00:00
BuildRequires: %{python_module sparse}
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
BuildRequires: %{python_module tblib}
BuildRequires: %{python_module toolz >= 0.8.2}
Accepting request 882449 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.1 * Add standalone dashboard page for GPU usage (GH#4556) Jacob Tomlinson * Handle stream is None case in TCP comm finalizer (GH#4631) James Bourbeau * Include LIST_PICKLE in NumPy array serialization (GH#4632) James Bourbeau * Rename annotation plugin in test_highlevelgraph.py (GH#4618) James Bourbeau * UCX use nbytes instead of len (GH#4621) Mads R. B. Kristensen * Skip NumPy and pandas tests if not importable (GH#4563) Ben Greiner * Remove utils.shutting_down in favor of sys.is_finalizing (GH#4624) James Bourbeau * Handle async clients when closing (GH#4623) Matthew Rocklin * Drop log from remove_key_from_stealable (GH#4609) jakirkham * Introduce events log length config option (GH#4615) Fabian Gebhart * Upstream config serialization and inheritance (GH#4372) Jacob Tomlinson * Add check to scheduler creation in SpecCluster (GH#4605) Jacob Tomlinson * Make length of events deque configurable (GH#4604) Fabian Gebhart * Add explicit fetch state to worker TaskState (GH#4470) Gil Forsyth * Update develop.rst (GH#4603) Florian Jetter * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B. Kristensen * Switch documentation builds for PRs to readthedocs (GH#4599) James Bourbeau * Track frame sizes along with frames (GH#4593) jakirkham * Add support for a list of keys when using batch_size in client. map (GH#4592) Sultan Orazbayev * If SpecCluster fails to start attempt to gracefully close out again (GH#4590) Jacob Tomlinson * Multi-lock extension (GH#4503) Mads R. B. Kristensen * Update PipInstall plugin command (GH#4584) James Bourbeau * IPython magics: remove deprecated ioloop workarounds (GH#4530) Min RK * Add GitHub actions workflow to cancel duplicate builds (GH#4581) James Bourbeau * Remove outdated macOS build badge from README (GH#4576) James Bourbeau * Dask master -> main (GH#4569) Julia Signell * Drop support for Python 3.6 (GH#4390) James Bourbeau * Add docstring for dashboard_link property (GH#4572) Doug Davis * Change default branch from master to main (GH#4495) Julia Signell * Msgpack handles extract serialize (GH#4531) Mads R. B. Kristensen - Drop importorskip-numpy-tests.patch merged upstream - Skip python36 build. Upstream dropped support for Python < 3.7 OBS-URL: https://build.opensuse.org/request/show/882449 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=92
2021-04-01 10:30:28 +00:00
BuildRequires: %{python_module tornado >= 6.0.3}
BuildRequires: %{python_module zict >= 0.1.3}
%endif
%python_subpackages
%description
Accepting request 603175 from devel:languages:python - update to version 1.21.6: * Fix numeric environment variable configuration (GH#1885) Joseph Atkins-Kurkish * support bytearrays in older lz4 library (GH#1886) Matthew Rocklin * Remove started timeout in nanny (GH#1852) Matthew Rocklin * Don’t log errors in sync (GH#1894) Matthew Rocklin * downgrade stale lock warning to info logging level (GH#1890) Matthew Rocklin * Fix UnboundLocalError for key (GH#1900) John Kirkham * Resolve deployment issues in Python 2 (GH#1905) Matthew Rocklin * Support retries and priority in Client.get method (GH#1902) Matthew Rocklin * Add additional attributes to task page if applicable (GH#1901) Matthew Rocklin * Add count method to as_completed (GH#1897) Matthew Rocklin * Extend default timeout to 10s (GH#1904) Matthew Rocklin - changes from version 1.21.5: * Increase default allowable tick time to 3s (GH#1854) Matthew Rocklin * Handle errant workers when another worker has data (GH#1853) Matthew Rocklin * Close multiprocessing queue in Nanny to reduce open file descriptors (GH#1862) Matthew Rocklin * Extend nanny started timeout to 30s, make configurable (GH#1865) Matthew Rocklin * Comment out the default config file (GH#1871) Matthew Rocklin * Update to fix bokeh 0.12.15 update errors (GH#1872) Matthew Rocklin * Downgrade Event Loop unresponsive warning to INFO level (GH#1870) Matthew Rocklin * Add fifo timeout to control priority generation (GH#1828) Matthew Rocklin * Add retire_workers API to Client (GH#1876) Matthew Rocklin * Catch NoSuchProcess error in Nanny.memory_monitor (GH#1877) Matthew Rocklin * Add uid to nanny queue communitcations (GH#1880) Matthew Rocklin - changes from version 1.21.4: * Avoid passing bytearrays to snappy decompression (GH#1831) Matthew Rocklin * Specify IOLoop in Adaptive (GH#1841) Matthew Rocklin * Use connect-timeout config value throughout client (GH#1839) Matthew Rocklin * Support direct= keyword argument in Client.get (GH#1845) Matthew Rocklin - changes from version 1.21.3: * Add cluster superclass and improve adaptivity (GH#1813) Matthew Rocklin * Fixup tests and support Python 2 for Tornado 5.0 (GH#1818) Matthew Rocklin * Fix bug in recreate_error when dependencies are dropped (GH#1815) Matthew Rocklin * Add worker time to live in Scheduler (GH#1811) Matthew Rocklin * Scale adaptive based on total_occupancy (GH#1807) Matthew Rocklin * Support calling compute within worker_client (GH#1814) Matthew Rocklin * Add percentage to profile plot (GH#1817) Brett Naul * Overwrite option for remote python in dask-ssh (GH#1812) Sven Kreiss - changes from version 1.21.2: * Fix bug where we didn’t check idle/saturated when stealing (GH#1801) Matthew Rocklin * Fix bug where client was noisy when scheduler closed unexpectedly (GH#1806) Matthew Rocklin * Use string-based timedeltas (like '500 ms') everywhere (GH#1804) Matthew Rocklin * Keep logs in scheduler and worker even if silenced (GH#1803) Matthew Rocklin * Support minimum, maximum, wait_count keywords in Adaptive (GH#1797) Jacob Tomlinson and Matthew Rocklin * Support async protocols for LocalCluster, replace start= with asynchronous= (GH#1798) Matthew Rocklin * Avoid restarting workers when nanny waits on scheduler (GH#1793) Matthew Rocklin * Use IOStream.read_into() when available (GH#1477) Antoine Pitrou * Reduce LocalCluster logging threshold from CRITICAL to WARN (GH#1785) Andy Jones * Add futures_of to API docs (GH#1783) John Kirkham * Make diagnostics link in client configurable (GH#1810) Matthew Rocklin - changes from version 1.21.1: * Fixed an uncaught exception in distributed.joblib with a LocalCluster using only threads (GH#1775) Tom Augspurger * Format bytes in info worker page (GH#1752) Matthew Rocklin * Add pass-through arguments for scheduler/worker –preload modules. (GH#1634) Alexander Ford * Use new LZ4 API (GH#1757) Thrasibule * Replace dask.optimize with dask.optimization (GH#1754) Matthew Rocklin * Add graph layout engine and bokeh plot (GH#1756) Matthew Rocklin * Only expand name with –nprocs if name exists (GH#1776) Matthew Rocklin * specify IOLoop for stealing PeriodicCallback (GH#1777) Matthew Rocklin * Fixed distributed.joblib with no processes Tom Augspurger * Use set.discard to avoid KeyErrors in stealing (GH#1766) Matthew Rocklin * Avoid KeyError when task has been released during steal (GH#1765) Matthew Rocklin * Add versions routes to avoid the use of run in Client.get_versions (GH#1773) Matthew Rocklin * Add write_scheduler_file to Client (GH#1778) Joe Hamman * Default host to tls:// if tls information provided (GH#1780) Matthew Rocklin - Update descriptions. OBS-URL: https://build.opensuse.org/request/show/603175 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=2
2018-05-04 09:29:08 +00:00
Dask.distributed is a library for distributed computing in Python. It
extends both the concurrent.futures and dask APIs to moderate sized
clusters.
%prep
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
%autosetup -p1 -n distributed-%{version}
Accepting request 921004 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.9.1 * Revert AMM ReduceReplicas and parallel AMMs updates * Run multiple AMMs in parallel * AMM ReduceReplicas to iterate only on replicated tasks * Add type annotations to various functions within distributed.worker * Mark test_ucx_config_w_env_var flaky on UCX < 1.11 * Warn if CUDA context is created on incorrect device in UCX * Remove redundant timeouts from test_client * Allow Client to subscribe to events // Remote printing and warning * Test pickle protocols 4 & 5 * Fix-up test_pickle_empty * Increase timeout for test_worker_reconnects_mid_compute_multiple_states_on_scheduler * Add synced dict between cluster and scheduler to store cluster info * Update test_sub_submit_priority * Revert "Add test setup fixture * Fix flaky test_worker_reconnects_mid_compute * Use gen_test in test_adaptive * Increase worker.suspicious_counter threshold * Active Memory Manager framework + discard excess replicas * Add test setup fixture - Release version 2021.9.0 * Fix add_plugin warnings * Add list around iterator in handle_missing_dep * Jupyter-client 7 compatiblity * Replace atop with blockwise * Add pytest color to CI * Fix test_map and others * Use name argument with Scheduler.remove_plugin calls * Downgrade to jupyter_client 6 * Migrate Security HTML repr to Jinja2 * Migrate ProcessInterface HTML repr to Jinja2 * Add support for diskless machines to system monitor * Avoid during-iteration scheduler plugin changes * Remove GroupProgress scheduler plugin * Properly check for ipv6 availability * Improved IPv6 dask-worker support * Overwrite worker plugins * Refactor scheduler plugins; store in a dictionary * Fix "then" -> "than" typo in docs * Fix typo (remove extra verb "creates") in docs * Fix "fractiom" -> "fraction" typo in docstring * Fix "schedulers" -> "scheduler" typo in docs * Use non-histogram plots up to 100 workers - Release 2021.08.1 * Rename plots to fit in the labextension * Log messages for CommClosedError now includes information about remote address * Add target='_blank' for redirects of dashboard link * Update computation code retrieval logic * Minor polish on cfexecutor * Use development version of dask in gpuCI build * Use upstream dask.widgets * Fix flaky test_worker_reconnects_mid_compute * Update WorkerPlugin docstring about usage of TaskState objects * Worker Network Timeseries * Add HTML Repr for ProcessInterface class and all its subclasses * Fix an issue where a reconnecting worker could cause an invalid transition * Minor fixes for cfexecutor * Add HTML Repr for Security class * Fix performance report sizing issue * Drop RMM compatibility code from RAPIDS < 0.11 - Release 2021.08.0 * Include addresses in closed comm repr * Test nanny.environ precedence * Migrating HTML reprs to jinja2 * Fix test_process_executor_kills_process flakyness * Remove urllib3 as a dependency downloading preloads * Download preload urls in the Preload constructor * Avoid recursion error in profile.merge * Add text exceptions to the Scheduler * Use kwarg for Theme filename * Add a .git-ignore-revs file * Replace not not with bool() * Resolve deadlock cause by transition error after fetching dependency * Set z-index of data-table lower * Add no-worker - memory transition to scheduler * Deprecate worker plugin overwrite policy * Fix flaky tests in CI * Instructions for jemalloc with brew on macOS * Bump RAPIDS_VER to 21.10 * Tweak verbiage around async functions * Use Python 3 super() calls * Support asynchronous tasks * Rename total comm bytes and provide doc string * Add GPU executor if GPU is present * Fix RMM and UCX tests * Remove excessive timeout of test_steal_during_task_deserialization * Add gpuCI build script * Demote Worker.ensure_computing to function OBS-URL: https://build.opensuse.org/request/show/921004 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=100
2021-09-22 17:40:45 +00:00
sed -i '/addopts/ {s/--durations=20//; s/--color=yes//}' setup.cfg
%build
%if ! %{with test}
%python_build %{?cythonize}
%endif
%install
%if ! %{with test}
%python_install %{?cythonize}
%python_clone -a %{buildroot}%{_bindir}/dask-ssh
%python_clone -a %{buildroot}%{_bindir}/dask-scheduler
%python_clone -a %{buildroot}%{_bindir}/dask-worker
Accepting request 910741 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.2 * Fix a deadlock connected to task stealing and task deserialization * Include maximum shard size in second to_frames method * Minor dashboard style updates * Cap maximum shard size at the size of an integer * Document automatic MALLOC_TRIM_THRESHOLD_ environment variable * Mark ucx-py tests for GPU * Update individual profile plot sizing * Handle NVMLError_Unknown in NVML diagnostics * Unit tests to use a random port for the dashboard * Ensure worker reconnect registers existing tasks properly * Halve CI runtime! * Add NannyPlugins * Add WorkerNetworkBandwidth chart to dashboard * Set nanny environment variables in config * Read smaller frames to workaround OpenSSL bug * Move UCX/RMM config variables to Distributed namespace * Allow ws(s) messages greater than 10Mb * Short-circuit root-ish check for many deps -Release 2021.07.1 * Remove experimental feature warning from actors docs * Keep dependents in worker dependency if TS is still known * Add Scheduler.set_restrictions * Make Actor futures awaitable and work with as_completed * Simplify test_secede_balances * Computation class * Some light dashboard cleanup * Don't package tests * Add pytest marker for GPU tests * Actor: don't hold key references on workers * Collapse nav to hamburger sooner * Verify that actors survive pickling * Reenable UCX-Py tests that used to segfault * Better support ProcessPoolExecutors * Simplify test_worker_heartbeat_after_cancel * Avoid property validation in Bokeh * Reduce default websocket frame size and make configurable * Disable pytest-timeout SIGALARM on MacOS * rebalance() resilience to computations * Improve CI stability * Ensure heartbeats after cancelation do not raise KeyError s * Add more useful exception message on TLS cert mismatch * Add bokeh mode parameter to performance reports - Use the GitHub tarball because the PyPI sdist does to provide the tests anymore * Remove extra conftest.py source - Drop distributed-pr5022-improve_ci.patch merged upstream OBS-URL: https://build.opensuse.org/request/show/910741 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=99
2021-08-09 13:04:37 +00:00
%python_expand %fdupes %{buildroot}%{$python_sitearch}
%endif
%if %{with test}
%check
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
# randomly fail server-side -- too slow for obs (?)
Accepting request 882449 from home:bnavigator:branches:devel:languages:python:numeric - Update to 2021.3.1 * Add standalone dashboard page for GPU usage (GH#4556) Jacob Tomlinson * Handle stream is None case in TCP comm finalizer (GH#4631) James Bourbeau * Include LIST_PICKLE in NumPy array serialization (GH#4632) James Bourbeau * Rename annotation plugin in test_highlevelgraph.py (GH#4618) James Bourbeau * UCX use nbytes instead of len (GH#4621) Mads R. B. Kristensen * Skip NumPy and pandas tests if not importable (GH#4563) Ben Greiner * Remove utils.shutting_down in favor of sys.is_finalizing (GH#4624) James Bourbeau * Handle async clients when closing (GH#4623) Matthew Rocklin * Drop log from remove_key_from_stealable (GH#4609) jakirkham * Introduce events log length config option (GH#4615) Fabian Gebhart * Upstream config serialization and inheritance (GH#4372) Jacob Tomlinson * Add check to scheduler creation in SpecCluster (GH#4605) Jacob Tomlinson * Make length of events deque configurable (GH#4604) Fabian Gebhart * Add explicit fetch state to worker TaskState (GH#4470) Gil Forsyth * Update develop.rst (GH#4603) Florian Jetter * pickle_loads(): Handle empty memoryview (GH#4595) Mads R. B. Kristensen * Switch documentation builds for PRs to readthedocs (GH#4599) James Bourbeau * Track frame sizes along with frames (GH#4593) jakirkham * Add support for a list of keys when using batch_size in client. map (GH#4592) Sultan Orazbayev * If SpecCluster fails to start attempt to gracefully close out again (GH#4590) Jacob Tomlinson * Multi-lock extension (GH#4503) Mads R. B. Kristensen * Update PipInstall plugin command (GH#4584) James Bourbeau * IPython magics: remove deprecated ioloop workarounds (GH#4530) Min RK * Add GitHub actions workflow to cancel duplicate builds (GH#4581) James Bourbeau * Remove outdated macOS build badge from README (GH#4576) James Bourbeau * Dask master -> main (GH#4569) Julia Signell * Drop support for Python 3.6 (GH#4390) James Bourbeau * Add docstring for dashboard_link property (GH#4572) Doug Davis * Change default branch from master to main (GH#4495) Julia Signell * Msgpack handles extract serialize (GH#4531) Mads R. B. Kristensen - Drop importorskip-numpy-tests.patch merged upstream - Skip python36 build. Upstream dropped support for Python < 3.7 OBS-URL: https://build.opensuse.org/request/show/882449 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=92
2021-04-01 10:30:28 +00:00
donttest+=" or (test_asyncprocess and test_exit_callback)"
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
donttest+=" or (test_nanny and test_throttle_outgoing_connections)"
Accepting request 907354 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.0 * Fix Nbytes jitter - less expensive * Use native GH actions cancel feature * Don't require workers to report to scheduler if scheduler shuts down * Add pandas to the list of checked packages for client. get_versions() * Move worker preload before scheduler address is set * Fix flaky test_oversubscribing_leases * Update scheduling policy docs for #4967 * Add echo handler to Server class * Also include pngs when bundling package * Remove duplicated dashboard panes * Fix worker memory dashboard flickering * Tabs on bottom left corner on dashboard * Rename nbytes widgets * Co-assign root-ish tasks * OSError tweaks * Update imports to cudf.testing._utils * Ensure shuffle split default durations uses proper prefix * Follow up pyupgrade formatting * Rename plot dropdown * Pyupgrade * Misc Sphinx tweaks * No longer hold dependencies of erred tasks in memory * Add maximum shard size to config * Ensure shuffle split operations are blacklisted from work stealing * Add dropdown menu to access individual plots * Edited the path to scheduler.py * Task Group Graph Visualization * Remove more internal references to deprecated utilities * Restructure nbytes hover * Except more errors in pynvml.nvmlInit() * Add occupancy as individual plot * Deprecate utilities which have moved to dask * Ensure connectionpool does not leave comms if closed mid connect * Add support for registering scheduler plugins from Client * Stealing dashboard fixes * Allow requirements verification to be ignored when loading backends from entrypoints * Add Log and Logs to API docs * Support fixtures and pytest.mark.parametrize with gen_cluster - Release 2021.06.2 * Revert refactor to utils.Log[s] and Cluster.get_logs * Use deprecation utility from Dask * Add transition counter to Scheduler * Remove nbytes_in_memory - Release 2021.06.1 * Fix deadlock in handle_missing_dep if additional replicas are available * Add configuration to enable/disable NVML diagnostics * Add scheduler log tab to performance reports * Add HTML repr to scheduler_info and incorporate into client and cluster reprs * Fix error state typo * Allow actor exceptions to propagate * Remove importing apply from dask.compatibility * Use more informative default name for WorkerPlugin s * Removed unused utility functions * Locally rerun successfully completed futures * Forget erred tasks and fix deadlocks on worker * Handle HTTPClientError in websocket connector * Update dask_cuda usage in SSHCluster docstring * Remove tests for process_time and thread_time * Flake8 config cleanup * Don't strip scheduler protocol when determining host * Add more documentation on memory management * Add range_query tests to NVML test suite * No longer cancel result future in async process when using timeouts - Release 2021.06.0 * Multiple worker executors * Ensure PyNVML works correctly when installed with no GPUs * Show more in test summary * Move SystemMonitor s GPU initialization back to constructor * Mark test_server_comms_mark_active_handlers with pytest.mark.asyncio * Who has has what html reprs v2 * O(1) rebalance * Ensure repr and eq for cluster always works - Release 2021.05.1 * Drop usage of WhoHas & WhatHas from Client * Ensure adaptive scaling is properly awaited and closed * Fix WhoHas/ HasWhat async usage * Add HTML reprs for Client.who_has and Client.has_what * Prevent accidentally starting multiple Worker s in the same process * Add system tab to performance reports * Let servers close faster if there are no active handlers * Fix UCX scrub config logging * Ensure worker clients are closed * Fix warning for attribute error when deleting a client * Ensure exceptions are raised if workers are incorrectly started * Update handling of UCX exceptions on endpoint closing * Ensure busy workloads properly look up who_has * Check distributed.scheduler.pickle in Scheduler.run_function * Add performance_report to API docs * Use dict _workers_dv in unordered use cases * Bump pre-commit hook versions * Do not mindlessly spawn workers when no memory limit is set * test_memory to use gen_cluster * Increase timeout of gen_test to 30s - Work on the very flaky testsuite: * Add missing conftest.py not packaged on PyPI * Add distributed-pr5022-improve_ci.patch in the hope for better stability -- gh#dask/distributed#5022 * Do not use pytest-xdist - Add Cython as runtime dep because the scheduler checks the presence OBS-URL: https://build.opensuse.org/request/show/907354 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=98
2021-07-21 09:16:05 +00:00
donttest+=" or (test_scheduler and test_rebalance)"
donttest+=" or (test_tls_functional and test_rebalance)"
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
donttest+=" or (test_worker and test_fail_write_to_disk)"
Accepting request 950288 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.1 * P2P shuffle skeleton * Fix <Task pending name='...' coro=<Client._handle_report()> * Add distributed.client.security-loader config * Avoid Client._handle_report cancelling itself on Client._close * Paused workers shouldn't steal tasks * Add option for timestamps from output of Node.get_logs * Don't use time.time() or IOLoop.time() * Raise plugin exceptions on Worker.start() * Fixing docstrings * Fix typo in Client.run docstring * Update client.py docstrings * Skip shuffle tests if pandas / dask.dataframe not installed * Improve test coverage * Test report improvements * P2P shuffle: ignore row order in tests * Fix flaky test_no_reconnect[--no-nanny] * Pin coverage to 6.2 * Check for new name of timeouts artifact and be more fault tolerant * Revisit rebalance unit tests * Update comment in rearrange_by_column_p2p * Update gpuCI RAPIDS_VER to 22.04 * Fix groupby test after meta requirements got stricter in Dask PR#8563 * Fix flaky test_close_gracefully and test_lifetime * Fix flaky test_workspace_concurrency * Fix flaky test_shuffle_extension.py::test_get_partition * Fix flaky test_dump_cluster_unresponsive_remote_worker * Dump cluster state on all test failures * Update license format * Fix flaky test_drop_with_paused_workers_with_running_tasks_3_4 * Do not raise an exception if the GitHub token cannot be found (Resubmit for the noclean flag) OBS-URL: https://build.opensuse.org/request/show/950288 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=104
2022-02-01 06:33:50 +00:00
donttest+=" or (test_worker and test_multiple_transfers)"
Accepting request 948001 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2022.1.0 * full changelog at https://distributed.readthedocs.io/en/latest/changelog.html * New Features: - Task group stacked area chart (GH#5320) Ian Rose - Support configuring TLS min/max version (GH#5594) Jim Crist-Harif - Use asyncio for TCP/TLS comms (GH#5450) Jim Crist-Harif - Enhancement release notes for 2021.12.0 * Support pytest fixures and parametrize with gen_test (GH#5532) Fábio Rosado * Allow idempotent scheduler plugins to be registered via the RPC (GH#5545) Jacob Tomlinson * AMM logging (GH#5530) crusaderky * Raise error if asyncssh isn’t installed when using SSHCluster (GH#5535) Fábio Rosado * Allow None in UCX configuration schema (GH#5534) Fábio Rosado * Add distributed.comm.ucx.create-cuda-context config (GH#5526) Peter Andreas Entschev - Security release note for 2021.10.0: * This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.distributed.Client() (which defaults to using LocalCluster) would mistakenly configure their respective Dask workers to listen on external interfaces (typically with a randomly selected high port) rather than only on localhost. A Dask cluster created using this method AND running on a machine that has these ports exposed could be used by a sophisticated attacker to enable remote code execution. Users running on machines with standard firewalls in place should not be affected. This vulnerability is documented in CVE-2021-42343, and is fixed in this release (GH#5427). Thanks to Jean-Pierre van Riel for discovering and reporting the issue. - Skip python310: Not supported yet -- gh#dask/distributed#5350 OBS-URL: https://build.opensuse.org/request/show/948001 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=101
2022-01-21 23:34:26 +00:00
donttest+=" or (test_worker and test_remove_replicas_while_computing)"
donttest+=" or (test_worker and test_worker_reconnects_mid_compute)"
if [[ $(getconf LONG_BIT) -eq 32 ]]; then
# OverflowError
donttest+=" or (test_ensure_spilled_immediately)"
donttest+=" or (test_value_raises_during_spilling)"
fi
Accepting request 907354 from home:bnavigator:branches:devel:languages:python:numeric - Update to version 2021.7.0 * Fix Nbytes jitter - less expensive * Use native GH actions cancel feature * Don't require workers to report to scheduler if scheduler shuts down * Add pandas to the list of checked packages for client. get_versions() * Move worker preload before scheduler address is set * Fix flaky test_oversubscribing_leases * Update scheduling policy docs for #4967 * Add echo handler to Server class * Also include pngs when bundling package * Remove duplicated dashboard panes * Fix worker memory dashboard flickering * Tabs on bottom left corner on dashboard * Rename nbytes widgets * Co-assign root-ish tasks * OSError tweaks * Update imports to cudf.testing._utils * Ensure shuffle split default durations uses proper prefix * Follow up pyupgrade formatting * Rename plot dropdown * Pyupgrade * Misc Sphinx tweaks * No longer hold dependencies of erred tasks in memory * Add maximum shard size to config * Ensure shuffle split operations are blacklisted from work stealing * Add dropdown menu to access individual plots * Edited the path to scheduler.py * Task Group Graph Visualization * Remove more internal references to deprecated utilities * Restructure nbytes hover * Except more errors in pynvml.nvmlInit() * Add occupancy as individual plot * Deprecate utilities which have moved to dask * Ensure connectionpool does not leave comms if closed mid connect * Add support for registering scheduler plugins from Client * Stealing dashboard fixes * Allow requirements verification to be ignored when loading backends from entrypoints * Add Log and Logs to API docs * Support fixtures and pytest.mark.parametrize with gen_cluster - Release 2021.06.2 * Revert refactor to utils.Log[s] and Cluster.get_logs * Use deprecation utility from Dask * Add transition counter to Scheduler * Remove nbytes_in_memory - Release 2021.06.1 * Fix deadlock in handle_missing_dep if additional replicas are available * Add configuration to enable/disable NVML diagnostics * Add scheduler log tab to performance reports * Add HTML repr to scheduler_info and incorporate into client and cluster reprs * Fix error state typo * Allow actor exceptions to propagate * Remove importing apply from dask.compatibility * Use more informative default name for WorkerPlugin s * Removed unused utility functions * Locally rerun successfully completed futures * Forget erred tasks and fix deadlocks on worker * Handle HTTPClientError in websocket connector * Update dask_cuda usage in SSHCluster docstring * Remove tests for process_time and thread_time * Flake8 config cleanup * Don't strip scheduler protocol when determining host * Add more documentation on memory management * Add range_query tests to NVML test suite * No longer cancel result future in async process when using timeouts - Release 2021.06.0 * Multiple worker executors * Ensure PyNVML works correctly when installed with no GPUs * Show more in test summary * Move SystemMonitor s GPU initialization back to constructor * Mark test_server_comms_mark_active_handlers with pytest.mark.asyncio * Who has has what html reprs v2 * O(1) rebalance * Ensure repr and eq for cluster always works - Release 2021.05.1 * Drop usage of WhoHas & WhatHas from Client * Ensure adaptive scaling is properly awaited and closed * Fix WhoHas/ HasWhat async usage * Add HTML reprs for Client.who_has and Client.has_what * Prevent accidentally starting multiple Worker s in the same process * Add system tab to performance reports * Let servers close faster if there are no active handlers * Fix UCX scrub config logging * Ensure worker clients are closed * Fix warning for attribute error when deleting a client * Ensure exceptions are raised if workers are incorrectly started * Update handling of UCX exceptions on endpoint closing * Ensure busy workloads properly look up who_has * Check distributed.scheduler.pickle in Scheduler.run_function * Add performance_report to API docs * Use dict _workers_dv in unordered use cases * Bump pre-commit hook versions * Do not mindlessly spawn workers when no memory limit is set * test_memory to use gen_cluster * Increase timeout of gen_test to 30s - Work on the very flaky testsuite: * Add missing conftest.py not packaged on PyPI * Add distributed-pr5022-improve_ci.patch in the hope for better stability -- gh#dask/distributed#5022 * Do not use pytest-xdist - Add Cython as runtime dep because the scheduler checks the presence OBS-URL: https://build.opensuse.org/request/show/907354 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=98
2021-07-21 09:16:05 +00:00
%pytest_arch distributed/tests -r sfER -m "not avoid_ci" -k "not (${donttest:4})" --reruns 3 --reruns-delay 3
%endif
%if ! %{with test}
%post
%python_install_alternative dask-ssh dask-scheduler dask-worker
%postun
%python_uninstall_alternative dask-ssh
%files %{python_files}
%doc README.rst
%license LICENSE.txt
%python_alternative %{_bindir}/dask-ssh
%python_alternative %{_bindir}/dask-scheduler
%python_alternative %{_bindir}/dask-worker
%{python_sitearch}/distributed
Accepting request 960175 from home:mcepl:branches:devel:languages:python:numeric - Update to 2022.02.1: Add the ability for Client to run preload code Optionally use NumPy to allocate buffers Add git hash to distributed-impl version Immediately raise exception when trying to connect to a closed cluster Lazily get dask version information Remove the requirements to add comm to every handler Raise on unclosed comms in check_instances Constrained spill Remove redundant str() conversions Cluster dump now excludes run_spec by default Dump more objects with dump_cluster_state Do not connect to any sockets on import Avoid deadlock when two tasks are concurrently waiting for an unresolved ActorFuture Drop Python 3.7 Remove support for UCX < 1.11.1 Document and test spill->target hysteresis cycle Fix flaky test_remove_replicas_while_computing Fix time based test_assert_worker_story_malformed_story parameterize Remove xfail from test_no_unnecessary_imports_on_worker Start building pre-releases with cythonized scheduler Do not mark tests xfail if they don't come up in time Use gen_cluster where possible in test_dask_worker.py Generate junit report when pytest-timeout kills pytest Decrease timeout-minutes for GHA jobs Bump pre-release version to be greater than stable releases Do not run schedule jobs on forks Remove pillow<9 pin in CI Show scheduled test runs in report Add obvious exclusions with pragma statement OBS-URL: https://build.opensuse.org/request/show/960175 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=106
2022-03-08 10:24:12 +00:00
%{python_sitearch}/distributed-%(echo %{version}|sed -e 's/\.0/./')*-info
%endif
%changelog