14
0
forked from pool/python-joblib
Files
python-joblib/python-joblib.spec

84 lines
2.4 KiB
RPMSpec
Raw Normal View History

#
# spec file for package python-joblib
#
Accepting request 781865 from home:pgajdos:python - version update to 0.14.1 - Configure the loky workers' environment to mitigate oversubsription with nested multi-threaded code in the following case: - allow for a suitable number of threads for numba (``NUMBA_NUM_THREADS``); - enable Interprocess Communication for scheduler coordination when the nested code uses Threading Building Blocks (TBB) (``ENABLE_IPC=1``) https://github.com/joblib/joblib/pull/951 - Fix a regression where the loky backend was not reusing previously spawned workers. https://github.com/joblib/joblib/pull/968 - Revert https://github.com/joblib/joblib/pull/847 to avoid using `pkg_resources` that introduced a performance regression under Windows: https://github.com/joblib/joblib/issues/965 - Improved the load balancing between workers to avoid stranglers caused by an excessively large batch size when the task duration is varying significantly (because of the combined use of ``joblib.Parallel`` and ``joblib.Memory`` with a partially warmed cache for instance). https://github.com/joblib/joblib/pull/899 - Add official support for Python 3.8: fixed protocol number in `Hasher` and updated tests. - Fix a deadlock when using the dask backend (when scattering large numpy arrays). https://github.com/joblib/joblib/pull/914 - Warn users that they should never use `joblib.load` with files from untrusted sources. Fix security related API change introduced in numpy 1.6.3 that would prevent using joblib with recent numpy versions. https://github.com/joblib/joblib/pull/879 - Upgrade to cloudpickle 1.1.1 that add supports for the upcoming Python 3.8 release among other things. https://github.com/joblib/joblib/pull/878 OBS-URL: https://build.opensuse.org/request/show/781865 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-joblib?expand=0&rev=30
2020-03-05 14:02:18 +00:00
# Copyright (c) 2020 SUSE LLC
#
# All modifications and additions to the file contributed by third parties
# remain the property of their copyright owners, unless otherwise agreed
# upon. The license for this file, and modifications and additions to the
# file, is the same license as for the pristine package itself (unless the
# license for the pristine package is not an Open Source License, in which
# case the license is the MIT License). An "Open Source License" is a
# license that conforms to the Open Source Definition (Version 1.9)
# published by the Open Source Initiative.
# Please submit bugfixes or comments via https://bugs.opensuse.org/
#
%{?!python_module:%define python_module() python-%{**} python3-%{**}}
%global skip_python2 1
Name: python-joblib
Version: 0.16.0
Release: 0
Summary: Module for using Python functions as pipeline jobs
License: BSD-3-Clause
Group: Development/Languages/Python
URL: https://github.com/joblib/joblib
Source: https://files.pythonhosted.org/packages/source/j/joblib/joblib-%{version}.tar.gz
Patch1: disable_test_on_big_endian.patch
# PATCH-FIX-OPENSUSE - Disable tests failing often in OBS
Patch2: joblib-disable-unrelialble-tests.patch
BuildRequires: %{python_module lz4}
BuildRequires: %{python_module numpy}
Accepting request 663427 from home:TheBlackCat:branches:devel:languages:python - update to Release 0.13.0 * Include loky 2.4.2 with default serialization with ``cloudpickle``. This can be tweaked with the environment variable ``LOKY_PICKLER``. * Fix nested backend in SequentialBackend to avoid changing the default backend to Sequential. (#792) * Fix nested_backend behavior to avoid setting the default number of workers to -1 when the backend is not dask. (#784) - Update to Release 0.12.5 * Include loky 2.3.1 with better error reporting when a worker is abruptly terminated. Also fixes spurious debug output. * Include cloudpickle 0.5.6. Fix a bug with the handling of global variables by locally defined functions. - Update to Release 0.12.4 * Include loky 2.3.0 with many bugfixes, notably w.r.t. when setting non-default multiprocessing contexts. Also include improvement on memory management of long running worker processes and fixed issues when using the loky backend under PyPy. * Raises a more explicit exception when a corrupted MemorizedResult is loaded. * Loading a corrupted cached file with mmap mode enabled would recompute the results and return them without memmory mapping. - Update to Release 0.12.3 * Fix joblib import setting the global start_method for multiprocessing. * Fix MemorizedResult not picklable (#747). * Fix Memory, MemorizedFunc and MemorizedResult round-trip pickling + unpickling (#746). * Fixed a regression in Memory when positional arguments are called as kwargs several times with different values (#751). * Integration of loky 2.2.2 that fixes issues with the selection of the default start method and improve the reporting when calling functions with arguments that raise an exception when unpickling. * Prevent MemorizedFunc.call_and_shelve from loading cached results to RAM when not necessary. Results in big performance improvements - Update to Release 0.12.2 * Integrate loky 2.2.0 to fix regression with unpicklable arguments and functions reported by users (#723, #643). * Loky 2.2.0 also provides a protection against memory leaks long running applications when psutil is installed (reported as #721). * Joblib now includes the code for the dask backend which has been updated to properly handle nested parallelism and data scattering at the same time (#722). * Restored some private API attribute and arguments (`MemorizedResult.argument_hash` and `BatchedCalls.__init__`'s `pickle_cache`) for backward compat. (#716, #732). * Fix a deprecation warning message (for `Memory`'s `cachedir`) (#720). OBS-URL: https://build.opensuse.org/request/show/663427 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-joblib?expand=0&rev=20
2019-01-07 20:40:52 +00:00
BuildRequires: %{python_module psutil}
BuildRequires: %{python_module pytest}
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
Accepting request 781865 from home:pgajdos:python - version update to 0.14.1 - Configure the loky workers' environment to mitigate oversubsription with nested multi-threaded code in the following case: - allow for a suitable number of threads for numba (``NUMBA_NUM_THREADS``); - enable Interprocess Communication for scheduler coordination when the nested code uses Threading Building Blocks (TBB) (``ENABLE_IPC=1``) https://github.com/joblib/joblib/pull/951 - Fix a regression where the loky backend was not reusing previously spawned workers. https://github.com/joblib/joblib/pull/968 - Revert https://github.com/joblib/joblib/pull/847 to avoid using `pkg_resources` that introduced a performance regression under Windows: https://github.com/joblib/joblib/issues/965 - Improved the load balancing between workers to avoid stranglers caused by an excessively large batch size when the task duration is varying significantly (because of the combined use of ``joblib.Parallel`` and ``joblib.Memory`` with a partially warmed cache for instance). https://github.com/joblib/joblib/pull/899 - Add official support for Python 3.8: fixed protocol number in `Hasher` and updated tests. - Fix a deadlock when using the dask backend (when scattering large numpy arrays). https://github.com/joblib/joblib/pull/914 - Warn users that they should never use `joblib.load` with files from untrusted sources. Fix security related API change introduced in numpy 1.6.3 that would prevent using joblib with recent numpy versions. https://github.com/joblib/joblib/pull/879 - Upgrade to cloudpickle 1.1.1 that add supports for the upcoming Python 3.8 release among other things. https://github.com/joblib/joblib/pull/878 OBS-URL: https://build.opensuse.org/request/show/781865 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-joblib?expand=0&rev=30
2020-03-05 14:02:18 +00:00
BuildRequires: python3-threadpoolctl
Requires: python-lz4
Accepting request 663427 from home:TheBlackCat:branches:devel:languages:python - update to Release 0.13.0 * Include loky 2.4.2 with default serialization with ``cloudpickle``. This can be tweaked with the environment variable ``LOKY_PICKLER``. * Fix nested backend in SequentialBackend to avoid changing the default backend to Sequential. (#792) * Fix nested_backend behavior to avoid setting the default number of workers to -1 when the backend is not dask. (#784) - Update to Release 0.12.5 * Include loky 2.3.1 with better error reporting when a worker is abruptly terminated. Also fixes spurious debug output. * Include cloudpickle 0.5.6. Fix a bug with the handling of global variables by locally defined functions. - Update to Release 0.12.4 * Include loky 2.3.0 with many bugfixes, notably w.r.t. when setting non-default multiprocessing contexts. Also include improvement on memory management of long running worker processes and fixed issues when using the loky backend under PyPy. * Raises a more explicit exception when a corrupted MemorizedResult is loaded. * Loading a corrupted cached file with mmap mode enabled would recompute the results and return them without memmory mapping. - Update to Release 0.12.3 * Fix joblib import setting the global start_method for multiprocessing. * Fix MemorizedResult not picklable (#747). * Fix Memory, MemorizedFunc and MemorizedResult round-trip pickling + unpickling (#746). * Fixed a regression in Memory when positional arguments are called as kwargs several times with different values (#751). * Integration of loky 2.2.2 that fixes issues with the selection of the default start method and improve the reporting when calling functions with arguments that raise an exception when unpickling. * Prevent MemorizedFunc.call_and_shelve from loading cached results to RAM when not necessary. Results in big performance improvements - Update to Release 0.12.2 * Integrate loky 2.2.0 to fix regression with unpicklable arguments and functions reported by users (#723, #643). * Loky 2.2.0 also provides a protection against memory leaks long running applications when psutil is installed (reported as #721). * Joblib now includes the code for the dask backend which has been updated to properly handle nested parallelism and data scattering at the same time (#722). * Restored some private API attribute and arguments (`MemorizedResult.argument_hash` and `BatchedCalls.__init__`'s `pickle_cache`) for backward compat. (#716, #732). * Fix a deprecation warning message (for `Memory`'s `cachedir`) (#720). OBS-URL: https://build.opensuse.org/request/show/663427 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-joblib?expand=0&rev=20
2019-01-07 20:40:52 +00:00
Recommends: python-numpy
Recommends: python-psutil
BuildArch: noarch
%python_subpackages
%description
Joblib is a set of tools to provide lightweight pipelining in
Python. In particular, joblib offers:
1. transparent disk-caching of the output values and lazy re-evaluation
(memoize pattern)
2. parallel computing
3. logging and tracing of the execution
Joblib can handle large data and has specific optimizations for `numpy` arrays.
%prep
%setup -q -n joblib-%{version}
%patch1 -p1
%ifarch aarch64 %arm ppc64 %{ix86}
%patch2 -p1
%endif
%build
%python_build
%install
%python_install
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
Accepting request 663427 from home:TheBlackCat:branches:devel:languages:python - update to Release 0.13.0 * Include loky 2.4.2 with default serialization with ``cloudpickle``. This can be tweaked with the environment variable ``LOKY_PICKLER``. * Fix nested backend in SequentialBackend to avoid changing the default backend to Sequential. (#792) * Fix nested_backend behavior to avoid setting the default number of workers to -1 when the backend is not dask. (#784) - Update to Release 0.12.5 * Include loky 2.3.1 with better error reporting when a worker is abruptly terminated. Also fixes spurious debug output. * Include cloudpickle 0.5.6. Fix a bug with the handling of global variables by locally defined functions. - Update to Release 0.12.4 * Include loky 2.3.0 with many bugfixes, notably w.r.t. when setting non-default multiprocessing contexts. Also include improvement on memory management of long running worker processes and fixed issues when using the loky backend under PyPy. * Raises a more explicit exception when a corrupted MemorizedResult is loaded. * Loading a corrupted cached file with mmap mode enabled would recompute the results and return them without memmory mapping. - Update to Release 0.12.3 * Fix joblib import setting the global start_method for multiprocessing. * Fix MemorizedResult not picklable (#747). * Fix Memory, MemorizedFunc and MemorizedResult round-trip pickling + unpickling (#746). * Fixed a regression in Memory when positional arguments are called as kwargs several times with different values (#751). * Integration of loky 2.2.2 that fixes issues with the selection of the default start method and improve the reporting when calling functions with arguments that raise an exception when unpickling. * Prevent MemorizedFunc.call_and_shelve from loading cached results to RAM when not necessary. Results in big performance improvements - Update to Release 0.12.2 * Integrate loky 2.2.0 to fix regression with unpicklable arguments and functions reported by users (#723, #643). * Loky 2.2.0 also provides a protection against memory leaks long running applications when psutil is installed (reported as #721). * Joblib now includes the code for the dask backend which has been updated to properly handle nested parallelism and data scattering at the same time (#722). * Restored some private API attribute and arguments (`MemorizedResult.argument_hash` and `BatchedCalls.__init__`'s `pickle_cache`) for backward compat. (#716, #732). * Fix a deprecation warning message (for `Memory`'s `cachedir`) (#720). OBS-URL: https://build.opensuse.org/request/show/663427 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-joblib?expand=0&rev=20
2019-01-07 20:40:52 +00:00
export LANG=en_US.UTF-8
%pytest
%files %{python_files}
%license LICENSE.txt
%doc README.rst
%{python_sitelib}/joblib-%{version}-py*.egg-info
%{python_sitelib}/joblib/
%changelog