python/python-joblib
SHA256
14
0
Fork 0
forked from pool/python-joblib
Code Pull Requests Activity

Accepting request 624255 from devel:languages:python

Browse Source 
- Enable tests

- specfile:
  * remove devel requirement
- update to version 0.12.1:
  * Make sure that any exception triggered when serializing jobs in
    the queue will be wrapped as a PicklingError as in past versions
    of joblib.
  * Fix kwonlydefaults key error in filter_args (#715)
- changes from version 0.12:
  * Implement the 'loky' backend with @ogrisel. This backend relies on
    a robust implementation of concurrent.futures.ProcessPoolExecutor
    with spawned processes that can be reused accross the Parallel
    calls. This fixes the bad interation with third paty libraries
    relying on thread pools, described in
    https://pythonhosted.org/joblib/parallel.html#bad-interaction-of-multiprocessing-and-third-party-libraries
  * Limit the number of threads used in worker processes by
    C-libraries that relies on threadpools. This functionality works
    for MKL, OpenBLAS, OpenMP and Accelerated.
  * Prevent numpy arrays with the same shape and data from hashing to
    the same memmap, to prevent jobs with preallocated arrays from
    writing over each other.
  * Reduce overhead of automatic memmap by removing the need to hash
    the array.
  * Make Memory.cache robust to PermissionError (errno 13) under
    Windows when run in combination with Parallel.
  * The automatic array memory mapping feature of Parallel does no
    longer use /dev/shm if it is too small (less than 2 GB). In
    particular in docker containers /dev/shm is only 64 MB by default
    which would cause frequent failures when running joblib in Docker

OBS-URL: https://build.opensuse.org/request/show/624255
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-joblib?expand=0&rev=2
This commit is contained in:
Dominique Leuenberger
2018-07-22 21:04:18 +00:00
committed by Git OBS Bridge
parent 554f3e6732 067943c263
commit fd4b317ee3
4 changed files with 82 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
joblib-0.11.tar.gz
View File

@@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b8fd56df36d9731a83729395ccb85a3b401f62a96255deb1a77220c00ed4085
size 213136

3
joblib-0.12.1.tar.gz Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68e6128e4734196616a39e2d48830ec7d61551c7f5748849e4c91478d2444524
size 268415

70
python-joblib.changes
View File

@@ -1,3 +1,73 @@
-------------------------------------------------------------------
Fri Jul 20 11:48:47 UTC 2018 - tchvatal@suse.com
- Enable tests
-------------------------------------------------------------------
Wed Jul 18 03:03:33 UTC 2018 - arun@gmx.de
- specfile:
* remove devel requirement
- update to version 0.12.1:
* Make sure that any exception triggered when serializing jobs in
the queue will be wrapped as a PicklingError as in past versions
of joblib.
* Fix kwonlydefaults key error in filter_args (#715)
- changes from version 0.12:
* Implement the 'loky' backend with @ogrisel. This backend relies on
a robust implementation of concurrent.futures.ProcessPoolExecutor
with spawned processes that can be reused accross the Parallel
calls. This fixes the bad interation with third paty libraries
relying on thread pools, described in
https://pythonhosted.org/joblib/parallel.html#bad-interaction-of-multiprocessing-and-third-party-libraries
* Limit the number of threads used in worker processes by
C-libraries that relies on threadpools. This functionality works
for MKL, OpenBLAS, OpenMP and Accelerated.
* Prevent numpy arrays with the same shape and data from hashing to
the same memmap, to prevent jobs with preallocated arrays from
writing over each other.
* Reduce overhead of automatic memmap by removing the need to hash
the array.
* Make Memory.cache robust to PermissionError (errno 13) under
Windows when run in combination with Parallel.
* The automatic array memory mapping feature of Parallel does no
longer use /dev/shm if it is too small (less than 2 GB). In
particular in docker containers /dev/shm is only 64 MB by default
which would cause frequent failures when running joblib in Docker
containers.
* Make it possible to hint for thread-based parallelism with
prefer='threads' or enforce shared-memory semantics with
require='sharedmem'.
* Rely on the built-in exception nesting system of Python 3 to
preserve traceback information when an exception is raised on a
remote worker process. This avoid verbose and redundant exception
reports under Python 3.
* Preserve exception type information when doing nested Parallel
calls instead of mapping the exception to the generic
JoblibException type.
* Introduce the concept of 'store' and refactor the Memory internal
storage implementation to make it accept extra store backends for
caching results. backend and backend_options are the new options
added to Memory to specify and configure a store backend.
* Add the register_store_backend function to extend the store
backend used by default with Memory. This default store backend is
named 'local' and corresponds to the local filesystem.
* The store backend API is experimental and thus is subject to
change in the future without deprecation.
* The cachedir parameter of Memory is now marked as deprecated, use
location instead.
* Add support for LZ4 compression if lz4 package is installed.
* Add register_compressor function for extending available
compressors.
* Allow passing a string to compress parameter in dump funtion. This
string should correspond to the compressor used (e.g. zlib, gzip,
lz4, etc). The default compression level is used in this case.
* Allow parallel_backend to be used globally instead of only as a
context manager. Support lazy registration of external parallel
backends
-------------------------------------------------------------------
Thu Jan 11 22:12:57 UTC 2018 - jengelh@inai.de

25
python-joblib.spec
View File

@@ -16,28 +16,24 @@
#
%bcond_with test
%{?!python_module:%define python_module() python-%{**} python3-%{**}}
Name: python-joblib
Version: 0.11
Version: 0.12.1
Release: 0
Summary: Lightweight pipelining: using Python functions as pipeline jobs
License: BSD-3-Clause
Group: Development/Languages/Python
Url: https://github.com/joblib/joblib
URL: https://github.com/joblib/joblib
Source: https://files.pythonhosted.org/packages/source/j/joblib/joblib-%{version}.tar.gz
BuildRequires: %{python_module devel}
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
%if %{with test}
Recommends: python-numpy
BuildArch: noarch
BuildRequires: %{python_module lz4}
BuildRequires: %{python_module numpy}
BuildRequires: %{python_module pytest}
%endif
Recommends: python-numpy
BuildRoot: %{_tmppath}/%{name}-%{version}-build
BuildArch: noarch
Requires: python-lz4
%python_subpackages
%description
@@ -53,7 +49,6 @@ Python. In particular, joblib offers:
Joblib can handle large data and has specific optimizations for `numpy` arrays.
%prep
%setup -q -n joblib-%{version}
@@ -64,14 +59,12 @@ Joblib can handle large data and has specific optimizations for `numpy` arrays.
%python_install
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%if %{with test}
%check
%python_expand py.test-%{$python_bin_suffix} joblib
%endif
%python_expand PYTHONPATH=%{buildroot}%{$python_sitelib} py.test-%{$python_bin_suffix} joblib
%files %{python_files}
%defattr(-,root,root,-)
%doc LICENSE.txt README.rst
%license LICENSE.txt
%doc README.rst
%{python_sitelib}/joblib-%{version}-py*.egg-info
%{python_sitelib}/joblib/