forked from pool/python-distributed
05dda08b4c
4 Commits
Author | SHA256 | Message | Date | |
---|---|---|---|---|
0a98707589 |
Accepting request 1063268 from home:bnavigator:branches:devel:languages:python:numeric
- Update to 2023.1.1 ## Enhancements * P2P shuffle deduplicates data and can be run several times (GH#7486) Hendrik Makait * Reverse order of get_logs() and get_worker_logs() (GH#7475) Nicholas R. Knezek * Add prometheus metric for time and memory used per task prefix (GH#7406) Thomas Grainger * Additive worker counts in Prometheus (GH#7468) crusaderky * Add help tool for taskstream (GH#7478) Florian Jetter ## Bug Fixes * Do not allow for a worker to reject a drop replica request (GH#7490) Hendrik Makait * Fix un/packing for namedtuples with custom constructors (GH#7465) antonymayi * Documentation * Remove timeout= from docstring example for worker_client (GH#7497) Florian Jetter ## Maintenance * Ignore get_default_shuffle_algorithm linting issue (GH#7506) Florian Jetter * Remove set_config when using default client (GH#7482) Florian Jetter * Update gpuCI RAPIDS_VER to 23.04 (GH#7501) * Fix test_balance_expensive_tasks and improve helper functions in test_steal.py (GH#7253) Hendrik Makait * Sign every compute task with run ID to correlate response (GH#7463) Hendrik Makait - Release 2023.1.0 ## New Features * Add local SubprocessCluster that runs workers in separate processes (GH#7431) Hendrik Makait ## Enhancements * Ensure client session is quiet after cluster.close() or client.shutdown() (GH#7429) James Bourbeau * Set lifetime-stagger default value to None (GH#7445) bstadlbauer * Memory thresholds should never be exactly 0.0 (GH#7458) Stuart Berg * Remove the Incorrect-Sizeof-Warning (GH#7450) Mads R. B. Kristensen * Log exceptions in P2P shuffle tasks (GH#7442) Hendrik Makait * Add support for packing namedtuple and add test for future resolution in submit (GH#7292) Andrew * Avoid deep copy on lz4 decompression (GH#7437) crusaderky * Avoid deep copy of numpy buffers on unspill (GH#7435) crusaderky * Don’t error when clicking on empty task stream plot (GH#7432) James Bourbeau * Do not count spilled memory when comparing vs. process memory (GH#7430) crusaderky * Stop Client periodic callbacks during shutdown() (GH#7428) James Bourbeau * Add dask spec CLI (GH#7427) Matthew Rocklin * Create new zstd (de)compressor for each compression call (GH#7404) Dylan Wragge * Rename managed_in_memory etc. to match GUI (GH#7418) crusaderky * Warn users when sizeof() returns inflated output (GH#7419) crusaderky ## Bug Fixes * Ensure dicts are properly recognized as msgpack serializable (GH#7473) Florian Jetter * Reset state of ShuffleSchedulerExtension on restart (GH#7446) Hendrik Makait * Reject non-string column names in P2P shuffle (GH#7447) Hendrik Makait * Avoid int32 in dashboard (GH#7443) Matthew Rocklin * Fix P2PShuffle serialization for categorical data (GH#7410) Hendrik Makait * WorkerPorcess blocks on kill if still starting (GH#7424) Matthew Rocklin ## Documentation * Move Prometheus docs from dask/dask (GH#7405) crusaderky ## Maintenance * Various cleanups in semaphore (GH#5885) Florian Jetter * test_rlimit fails on MacOSX (GH#7457) crusaderky * Bump actions/checkout from 3.2.0 to 3.3.0 (GH#7464) * Remove conditional imports of psutil (GH#7462) crusaderky * Drop support for zict < 2.1.0 (GH#7456) crusaderky * Fix flaky test_digests (GH#7454) crusaderky * Add minimum dependency testing to CI (GH#7285) Charles Blackmon-Luca * Avoid overflow in statitics.mean (GH#7426) Matthew Rocklin * Ignore numpy bool8 deprecation (GH#7423) Matthew Rocklin * Add missing skips for pyarrow (GH#7416) Elliott Sales de Andrade * Be more permissive about expected ciphers in tests (GH#7417) Elliott Sales de Andrade * Revert “TST: Fetch executables from build root (GH#2551)” (GH#7415) Elliott Sales de Andrade OBS-URL: https://build.opensuse.org/request/show/1063268 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=130 |
|||
8e7fe3043e |
Accepting request 988726 from home:bnavigator:branches:devel:languages:python:numeric
- Fix runtime requirement with tornado <6.2 - Move one more test to notparallel - Skip failing test on Python 3.10 i586 gh#dask/distributed#6718 OBS-URL: https://build.opensuse.org/request/show/988726 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=113 |
|||
9d248fabbe |
Accepting request 921004 from home:bnavigator:branches:devel:languages:python:numeric
- Update to version 2021.9.1 * Revert AMM ReduceReplicas and parallel AMMs updates * Run multiple AMMs in parallel * AMM ReduceReplicas to iterate only on replicated tasks * Add type annotations to various functions within distributed.worker * Mark test_ucx_config_w_env_var flaky on UCX < 1.11 * Warn if CUDA context is created on incorrect device in UCX * Remove redundant timeouts from test_client * Allow Client to subscribe to events // Remote printing and warning * Test pickle protocols 4 & 5 * Fix-up test_pickle_empty * Increase timeout for test_worker_reconnects_mid_compute_multiple_states_on_scheduler * Add synced dict between cluster and scheduler to store cluster info * Update test_sub_submit_priority * Revert "Add test setup fixture * Fix flaky test_worker_reconnects_mid_compute * Use gen_test in test_adaptive * Increase worker.suspicious_counter threshold * Active Memory Manager framework + discard excess replicas * Add test setup fixture - Release version 2021.9.0 * Fix add_plugin warnings * Add list around iterator in handle_missing_dep * Jupyter-client 7 compatiblity * Replace atop with blockwise * Add pytest color to CI * Fix test_map and others * Use name argument with Scheduler.remove_plugin calls * Downgrade to jupyter_client 6 * Migrate Security HTML repr to Jinja2 * Migrate ProcessInterface HTML repr to Jinja2 * Add support for diskless machines to system monitor * Avoid during-iteration scheduler plugin changes * Remove GroupProgress scheduler plugin * Properly check for ipv6 availability * Improved IPv6 dask-worker support * Overwrite worker plugins * Refactor scheduler plugins; store in a dictionary * Fix "then" -> "than" typo in docs * Fix typo (remove extra verb "creates") in docs * Fix "fractiom" -> "fraction" typo in docstring * Fix "schedulers" -> "scheduler" typo in docs * Use non-histogram plots up to 100 workers - Release 2021.08.1 * Rename plots to fit in the labextension * Log messages for CommClosedError now includes information about remote address * Add target='_blank' for redirects of dashboard link * Update computation code retrieval logic * Minor polish on cfexecutor * Use development version of dask in gpuCI build * Use upstream dask.widgets * Fix flaky test_worker_reconnects_mid_compute * Update WorkerPlugin docstring about usage of TaskState objects * Worker Network Timeseries * Add HTML Repr for ProcessInterface class and all its subclasses * Fix an issue where a reconnecting worker could cause an invalid transition * Minor fixes for cfexecutor * Add HTML Repr for Security class * Fix performance report sizing issue * Drop RMM compatibility code from RAPIDS < 0.11 - Release 2021.08.0 * Include addresses in closed comm repr * Test nanny.environ precedence * Migrating HTML reprs to jinja2 * Fix test_process_executor_kills_process flakyness * Remove urllib3 as a dependency downloading preloads * Download preload urls in the Preload constructor * Avoid recursion error in profile.merge * Add text exceptions to the Scheduler * Use kwarg for Theme filename * Add a .git-ignore-revs file * Replace not not with bool() * Resolve deadlock cause by transition error after fetching dependency * Set z-index of data-table lower * Add no-worker - memory transition to scheduler * Deprecate worker plugin overwrite policy * Fix flaky tests in CI * Instructions for jemalloc with brew on macOS * Bump RAPIDS_VER to 21.10 * Tweak verbiage around async functions * Use Python 3 super() calls * Support asynchronous tasks * Rename total comm bytes and provide doc string * Add GPU executor if GPU is present * Fix RMM and UCX tests * Remove excessive timeout of test_steal_during_task_deserialization * Add gpuCI build script * Demote Worker.ensure_computing to function OBS-URL: https://build.opensuse.org/request/show/921004 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python:numeric/python-distributed?expand=0&rev=100 |
|||
Dominique Leuenberger
|
36097b69f7 |
Accepting request 589027 from devel:languages:python
OBS-URL: https://build.opensuse.org/request/show/589027 OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-distributed?expand=0&rev=1 |