From ae48c689d32814b1c7160495b68484dec87be2c4d3096737c10206280f37dece Mon Sep 17 00:00:00 2001 From: Todd R Date: Tue, 23 Jul 2019 18:16:14 +0000 Subject: [PATCH] Accepting request 717982 from home:TheBlackCat:branches:devel:languages:python:numeric - Update to 2.1.0 * Fix typo that prevented error message * Remove ``dask-mpi`` * Updates to use ``update_graph`` in task journey docs * Fix Client repr with ``memory_info=None`` * Fix case where key, rather than ``TaskState``, could end up in ``ts.waiting_on`` * Use Keyword-only arguments * Relax check for worker references in cluster context manager * Add HTTPS support for the dashboard * Use ``dask.utils.format_bytes`` - Update to 2.0.1 * Add python_requires entry to setup.py * Correctly manage tasks beyond deque limit in TaskStream plot * Fix diagnostics page for memory_limit=None - Update to 2.0.0 * **Drop support for Python 2** * Relax warnings before release * Deprecate --bokeh/--no-bokeh CLI * Typo in bokeh service_kwargs for dask-worker * Update command line cli options docs * Remove "experimental" from TLS docs * Add warnings around ncores= keywords * Add --version option to scheduler and worker CLI * Raise when workers initialization times out * Replace ncores with nthreads throughout codebase * Add unknown pytest markers * Delay lookup of allowed failures. * Change address -> worker in ColumnDataSource for nbytes plot * Remove module state in Prometheus Handlers * Add stress test for UCX * Add nanny logs * Move some of the adaptive logic into the scheduler * Add SpecCluster.new_worker_spec method * Worker dashboard fixes * Add async context managers to scheduler/worker classes * Fix the resource key representation before sending graphs * Allow user to configure whether workers are daemon. * Pin pytest >=4 with pip in appveyor and python 3.5 * Add Experimental UCX Comm * Close nannies gracefully * add kwargs to progressbars * Add back LocalCluster.__repr__. * Move bokeh module to dashboard * Close clusters at exit * Add SchedulerPlugin TaskState example * Add SpecificationCluster * Replace register_worker_callbacks with worker plugins * Proxy worker dashboards from scheduler dashboard * Add docstring to Scheduler.check_idle_saturated * Refer to LocalCluster in Client docstring * Remove special casing of Scikit-Learn BaseEstimator serialization * Fix two typos in Pub class docstring * Support uploading files with multiple modules * Change the main workers bokeh page to /status * Cleanly stop periodic callbacks in Client * Disable pan tool for the Progress, Byte Stored and Tasks Processing plot * Except errors in Nanny's memory monitor if process no longer exists * Handle heartbeat when worker has just left * Modify styling of histograms for many-worker dashboard plots * Add method to wait for n workers before continuing * Support computation on delayed(None) * Cleanup localcluster * Use 'temporary-directory' from dask.config for Worker's directory * Remove support for Iterators and Queues - Update to 1.28.1 * Use config accessor method for "scheduler-address" - Update to 1.28.0 * Add Type Attribute to TaskState * Add waiting task count to progress title bar * DOC: Clean up reference to cluster object * Allow scheduler to politely close workers as part of shutdown * Check direct_to_workers before using get_worker in Client * Fixed comment regarding keeping existing level if less verbose * Add idle timeout to scheduler * Avoid deprecation warnings * Use an LRU cache for deserialized functions * Rename Worker._close to Worker.close * Add Comm closed bookkeeping * Explain LocalCluster behavior in Client docstring * Add last worker into KilledWorker exception to help debug * Set working worker class for dask-ssh * Add as_completed methods to docs * Add timeout to Client._reconnect * Limit test_spill_by_default memory, reenable it * Use proper address in worker -> nanny comms * Fix deserialization of bytes chunks larger than 64MB - Update to 1.27.1 * Adaptive: recommend close workers when any are idle * Increase GC thresholds * Add interface= keyword to LocalCluster * Add worker_class argument to LocalCluster * Remove Python 2.7 from testing matrix * Add number of trials to diskutils test * Fix parameter name in LocalCluster docstring * Integrate stacktrace for low-level profiling * Apply Black to standardize code styling * added missing whitespace to start_worker cmd * Updated logging module doc links from docs.python.org/2 to docs.python.org/3. - Update to 1.27.0 * Add basic health endpoints to scheduler and worker bokeh. * Improved description accuracy of --memory-limit option. * Check self.dependencies when looking at dependent tasks in memory * Add RabbitMQ SchedulerPlugin example * add resources to scheduler update_graph plugin * Use ensure_bytes in serialize_error * Specify data storage explicitly from Worker constructor * Change bokeh port keywords to dashboard_address * .detach_() pytorch tensor to serialize data as numpy array. * Add warning if creating scratch directories takes a long time * Fix typo in pub-sub doc. * Allow return_when='FIRST_COMPLETED' in wait * Forward kwargs through Nanny to Worker * Use ensure_dict instead of dict * Specify protocol in LocalCluster - Update to 1.26.1 * Fix LocalCluster to not overallocate memory when overcommitting threads per worker * Make closing resilient to lacking an address * fix typo in comment * Fix double init of prometheus metrics * Skip test_duplicate_clients without bokeh. * Add blocked_handlers to servers * Always yield Server.handle_comm coroutine * Use yaml.safe_load * Fetch executables from build root. * Fix Torando 6 test failures * Fix test_sync_closed_loop - Update to 1.26.0 * Update style to fix recent flake8 update * Fix typo in gen_cluster log message * Allow KeyError when closing event loop * Avoid thread testing for TCP ThreadPoolExecutor * Find Futures inside SubgraphCallable * Avoid AttributeError when closing and sending a message * Add deprecation warning to dask_mpi.py * Relax statistical profiling test * Support alternative --remote-dask-worker SSHCluster() and dask-ssh CLI * Iterate over full list of plugins in transition * Create Prometheus Endpoint * Use pytest.importorskip for prometheus test * MAINT skip prometheus test when no installed * Fix intermittent testing failures * Avoid using nprocs keyword in dask-ssh if set to one * Bump minimum Tornado version to 5.0 OBS-URL: https://build.opensuse.org/request/show/717982 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=25 --- distributed-1.25.3.tar.gz | 3 - distributed-2.1.0.tar.gz | 3 + python-distributed.changes | 147 +++++++++++++++++++++++++++++++++++++ python-distributed.spec | 10 +-- 4 files changed, 152 insertions(+), 11 deletions(-) delete mode 100644 distributed-1.25.3.tar.gz create mode 100644 distributed-2.1.0.tar.gz diff --git a/distributed-1.25.3.tar.gz b/distributed-1.25.3.tar.gz deleted file mode 100644 index e4992b2..0000000 --- a/distributed-1.25.3.tar.gz +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:fa9dc4fde7523c4b791cb044424e02d2f8e38c71e6a00affcb84024b0ea7722f -size 523623 diff --git a/distributed-2.1.0.tar.gz b/distributed-2.1.0.tar.gz new file mode 100644 index 0000000..18e55f0 --- /dev/null +++ b/distributed-2.1.0.tar.gz @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4794cb1dddc8141bbf1a44e0bc8b3608750995f6b195bf8067bd76b064faf710 +size 540084 diff --git a/python-distributed.changes b/python-distributed.changes index b3da8bc..31a6c8a 100644 --- a/python-distributed.changes +++ b/python-distributed.changes @@ -1,3 +1,150 @@ +------------------------------------------------------------------- +Tue Jul 23 18:11:06 UTC 2019 - Todd R + +- Update to 2.1.0 + * Fix typo that prevented error message + * Remove ``dask-mpi`` + * Updates to use ``update_graph`` in task journey docs + * Fix Client repr with ``memory_info=None`` + * Fix case where key, rather than ``TaskState``, could end up in ``ts.waiting_on`` + * Use Keyword-only arguments + * Relax check for worker references in cluster context manager + * Add HTTPS support for the dashboard + * Use ``dask.utils.format_bytes`` +- Update to 2.0.1 + * Add python_requires entry to setup.py + * Correctly manage tasks beyond deque limit in TaskStream plot + * Fix diagnostics page for memory_limit=None +- Update to 2.0.0 + * **Drop support for Python 2** + * Relax warnings before release + * Deprecate --bokeh/--no-bokeh CLI + * Typo in bokeh service_kwargs for dask-worker + * Update command line cli options docs + * Remove "experimental" from TLS docs + * Add warnings around ncores= keywords + * Add --version option to scheduler and worker CLI + * Raise when workers initialization times out + * Replace ncores with nthreads throughout codebase + * Add unknown pytest markers + * Delay lookup of allowed failures. + * Change address -> worker in ColumnDataSource for nbytes plot + * Remove module state in Prometheus Handlers + * Add stress test for UCX + * Add nanny logs + * Move some of the adaptive logic into the scheduler + * Add SpecCluster.new_worker_spec method + * Worker dashboard fixes + * Add async context managers to scheduler/worker classes + * Fix the resource key representation before sending graphs + * Allow user to configure whether workers are daemon. + * Pin pytest >=4 with pip in appveyor and python 3.5 + * Add Experimental UCX Comm + * Close nannies gracefully + * add kwargs to progressbars + * Add back LocalCluster.__repr__. + * Move bokeh module to dashboard + * Close clusters at exit + * Add SchedulerPlugin TaskState example + * Add SpecificationCluster + * Replace register_worker_callbacks with worker plugins + * Proxy worker dashboards from scheduler dashboard + * Add docstring to Scheduler.check_idle_saturated + * Refer to LocalCluster in Client docstring + * Remove special casing of Scikit-Learn BaseEstimator serialization + * Fix two typos in Pub class docstring + * Support uploading files with multiple modules + * Change the main workers bokeh page to /status + * Cleanly stop periodic callbacks in Client + * Disable pan tool for the Progress, Byte Stored and Tasks Processing plot + * Except errors in Nanny's memory monitor if process no longer exists + * Handle heartbeat when worker has just left + * Modify styling of histograms for many-worker dashboard plots + * Add method to wait for n workers before continuing + * Support computation on delayed(None) + * Cleanup localcluster + * Use 'temporary-directory' from dask.config for Worker's directory + * Remove support for Iterators and Queues +- Update to 1.28.1 + * Use config accessor method for "scheduler-address" +- Update to 1.28.0 + * Add Type Attribute to TaskState + * Add waiting task count to progress title bar + * DOC: Clean up reference to cluster object + * Allow scheduler to politely close workers as part of shutdown + * Check direct_to_workers before using get_worker in Client + * Fixed comment regarding keeping existing level if less verbose + * Add idle timeout to scheduler + * Avoid deprecation warnings + * Use an LRU cache for deserialized functions + * Rename Worker._close to Worker.close + * Add Comm closed bookkeeping + * Explain LocalCluster behavior in Client docstring + * Add last worker into KilledWorker exception to help debug + * Set working worker class for dask-ssh + * Add as_completed methods to docs + * Add timeout to Client._reconnect + * Limit test_spill_by_default memory, reenable it + * Use proper address in worker -> nanny comms + * Fix deserialization of bytes chunks larger than 64MB +- Update to 1.27.1 + * Adaptive: recommend close workers when any are idle + * Increase GC thresholds + * Add interface= keyword to LocalCluster + * Add worker_class argument to LocalCluster + * Remove Python 2.7 from testing matrix + * Add number of trials to diskutils test + * Fix parameter name in LocalCluster docstring + * Integrate stacktrace for low-level profiling + * Apply Black to standardize code styling + * added missing whitespace to start_worker cmd + * Updated logging module doc links from docs.python.org/2 to docs.python.org/3. +- Update to 1.27.0 + * Add basic health endpoints to scheduler and worker bokeh. + * Improved description accuracy of --memory-limit option. + * Check self.dependencies when looking at dependent tasks in memory + * Add RabbitMQ SchedulerPlugin example + * add resources to scheduler update_graph plugin + * Use ensure_bytes in serialize_error + * Specify data storage explicitly from Worker constructor + * Change bokeh port keywords to dashboard_address + * .detach_() pytorch tensor to serialize data as numpy array. + * Add warning if creating scratch directories takes a long time + * Fix typo in pub-sub doc. + * Allow return_when='FIRST_COMPLETED' in wait + * Forward kwargs through Nanny to Worker + * Use ensure_dict instead of dict + * Specify protocol in LocalCluster +- Update to 1.26.1 + * Fix LocalCluster to not overallocate memory when overcommitting threads per worker + * Make closing resilient to lacking an address + * fix typo in comment + * Fix double init of prometheus metrics + * Skip test_duplicate_clients without bokeh. + * Add blocked_handlers to servers + * Always yield Server.handle_comm coroutine + * Use yaml.safe_load + * Fetch executables from build root. + * Fix Torando 6 test failures + * Fix test_sync_closed_loop +- Update to 1.26.0 + * Update style to fix recent flake8 update + * Fix typo in gen_cluster log message + * Allow KeyError when closing event loop + * Avoid thread testing for TCP ThreadPoolExecutor + * Find Futures inside SubgraphCallable + * Avoid AttributeError when closing and sending a message + * Add deprecation warning to dask_mpi.py + * Relax statistical profiling test + * Support alternative --remote-dask-worker SSHCluster() and dask-ssh CLI + * Iterate over full list of plugins in transition + * Create Prometheus Endpoint + * Use pytest.importorskip for prometheus test + * MAINT skip prometheus test when no installed + * Fix intermittent testing failures + * Avoid using nprocs keyword in dask-ssh if set to one + * Bump minimum Tornado version to 5.0 + ------------------------------------------------------------------- Sat Feb 2 17:10:13 UTC 2019 - Arun Persaud diff --git a/python-distributed.spec b/python-distributed.spec index 72cd7f1..7e97fdd 100644 --- a/python-distributed.spec +++ b/python-distributed.spec @@ -17,10 +17,11 @@ %{?!python_module:%define python_module() python-%{**} python3-%{**}} +%define skip_python2 1 # Test requires network connection %bcond_with test Name: python-distributed -Version: 1.25.3 +Version: 2.1.0 Release: 0 Summary: Library for distributed computing with Python License: BSD-3-Clause @@ -33,7 +34,6 @@ BuildRequires: %{python_module scikit-learn >= 0.17.1} BuildRequires: %{python_module setuptools} BuildRequires: fdupes BuildRequires: python-rpm-macros -BuildRequires: python2-futures Requires: python-PyYAML Requires: python-certifi Requires: python-click >= 6.6 @@ -65,11 +65,6 @@ BuildRequires: %{python_module tblib} BuildRequires: %{python_module toolz >= 0.7.4} BuildRequires: %{python_module tornado >= 4.5.1} BuildRequires: %{python_module zict >= 0.1.3} -BuildRequires: python2-mock -%endif -%ifpython2 -Requires: python-futures -Requires: python-singledispatch %endif %python_subpackages @@ -104,7 +99,6 @@ clusters. %python3_only %{_bindir}/dask-remote %python3_only %{_bindir}/dask-scheduler %python3_only %{_bindir}/dask-worker -%python3_only %{_bindir}/dask-mpi %{python_sitelib}/distributed* %changelog