From d58614f1e6e11ecf6cda3983bd66c3d02d2e701b4b7668bc48350cb35cc8434b Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Mark=C3=A9ta=20Machov=C3=A1?= Date: Fri, 16 Apr 2021 08:29:36 +0000 Subject: [PATCH 1/2] Accepting request 885674 from home:bnavigator:branches:devel:languages:python - Update to version 0.9 * avoid nested sync calls by copying code (#581, #586, docs #593) * release again for py36 (#564, #575) * logging in mmap cacher, explicitly close files (#559) * make LocalFileOpener an IOBase (#589) * better reference file system (#568, #582, #584, #585) * first-chunk cache (#580) * sftp listdir (#571) * http logging and fetch all (#551, #558) * doc: entry points (#548) * get_mapper for caching filesystems (#559) * fix cross-device file move (#547) * store paths without trailing "/" for DBFS (#557) * errors that happen on _initiate_upload when closing the AbstractBufferedFile will now be propagated (#587) * infer_compressions with upper case suffix ($595) * file initialiser errors (#587) * CI fix (#563) * local file commit cross-device (#547) - Version 0.8.7 * fix error with pyarrow metadata for some pythons (#546) - Version 0.8.6 * Add dbfs:// support (#504, #514) * don't import pyarrow (#503) * update entry points syntax (#515) * ci precommit hooks (#534) * random appending of a directory within the filesystems find() method (#507, 537) * fix git tests (#501) * fix recursive memfs operations (#502) * fix recorsive/maxdepth for cp (#508) * fix listings cache timeout (#513) * big endian bytes tests (#519) * docs syntax (#535, 524, 520, 542) * transactions and reads (#533) - Don't test with distributed on python36 -- not available anymore OBS-URL: https://build.opensuse.org/request/show/885674 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-fsspec?expand=0&rev=24 --- fsspec-0.8.5.tar.gz | 3 --- fsspec-0.9.0.tar.gz | 3 +++ python-fsspec.changes | 40 ++++++++++++++++++++++++++++++++++++++++ python-fsspec.spec | 20 +++++++++++++------- 4 files changed, 56 insertions(+), 10 deletions(-) delete mode 100644 fsspec-0.8.5.tar.gz create mode 100644 fsspec-0.9.0.tar.gz diff --git a/fsspec-0.8.5.tar.gz b/fsspec-0.8.5.tar.gz deleted file mode 100644 index 96a0988..0000000 --- a/fsspec-0.8.5.tar.gz +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:890c6ce9325030f03bd2eae81389ddcbcee53bdd475334ca064595e1e45f92a6 -size 247965 diff --git a/fsspec-0.9.0.tar.gz b/fsspec-0.9.0.tar.gz new file mode 100644 index 0000000..62bd637 --- /dev/null +++ b/fsspec-0.9.0.tar.gz @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ec2421a0d8775f4018d6541f1dedb8cad353771a00c9dfc438c44fd94c1d5533 +size 286634 diff --git a/python-fsspec.changes b/python-fsspec.changes index 9ccdaee..ef8ae83 100644 --- a/python-fsspec.changes +++ b/python-fsspec.changes @@ -1,3 +1,43 @@ +------------------------------------------------------------------- +Thu Apr 15 13:10:09 UTC 2021 - Ben Greiner + +- Update to version 0.9 + * avoid nested sync calls by copying code (#581, #586, docs #593) + * release again for py36 (#564, #575) + * logging in mmap cacher, explicitly close files (#559) + * make LocalFileOpener an IOBase (#589) + * better reference file system (#568, #582, #584, #585) + * first-chunk cache (#580) + * sftp listdir (#571) + * http logging and fetch all (#551, #558) + * doc: entry points (#548) + * get_mapper for caching filesystems (#559) + * fix cross-device file move (#547) + * store paths without trailing "/" for DBFS (#557) + * errors that happen on _initiate_upload when closing the + AbstractBufferedFile will now be propagated (#587) + * infer_compressions with upper case suffix ($595) + * file initialiser errors (#587) + * CI fix (#563) + * local file commit cross-device (#547) +- Version 0.8.7 + * fix error with pyarrow metadata for some pythons (#546) +- Version 0.8.6 + * Add dbfs:// support (#504, #514) + * don't import pyarrow (#503) + * update entry points syntax (#515) + * ci precommit hooks (#534) + * random appending of a directory within the filesystems find() + method (#507, 537) + * fix git tests (#501) + * fix recursive memfs operations (#502) + * fix recorsive/maxdepth for cp (#508) + * fix listings cache timeout (#513) + * big endian bytes tests (#519) + * docs syntax (#535, 524, 520, 542) + * transactions and reads (#533) +- Don't test with distributed on python36 -- not available anymore + ------------------------------------------------------------------- Mon Feb 22 16:55:37 UTC 2021 - Ben Greiner diff --git a/python-fsspec.spec b/python-fsspec.spec index f6e28fe..0de0235 100644 --- a/python-fsspec.spec +++ b/python-fsspec.spec @@ -1,5 +1,5 @@ # -# spec file for package python-fsspec +# spec file for package python-fsspec-test # # Copyright (c) 2021 SUSE LLC # @@ -27,12 +27,13 @@ %endif %define skip_python2 1 Name: python-fsspec%{psuffix} -Version: 0.8.5 +Version: 0.9.0 Release: 0 Summary: Filesystem specification package License: BSD-3-Clause URL: https://github.com/intake/filesystem_spec -Source: https://files.pythonhosted.org/packages/source/f/fsspec/fsspec-%{version}.tar.gz +# the tests are only in the GitHub archive +Source: %{url}/archive/%{version}.tar.gz#/fsspec-%{version}.tar.gz BuildRequires: %{python_module base >= 3.6} BuildRequires: %{python_module importlib_metadata if %python-base < 3.8} BuildRequires: %{python_module setuptools} @@ -43,7 +44,6 @@ Requires: python-importlib_metadata %endif Suggests: python-adlfs Suggests: python-aiohttp -Suggests: python-pyarrow Suggests: python-pygit2 Suggests: python-dropboxdrivefs Suggests: python-dropbox @@ -58,7 +58,6 @@ BuildArch: noarch %if %{with test} BuildRequires: %{python_module aiohttp} BuildRequires: %{python_module cloudpickle} -BuildRequires: %{python_module distributed} BuildRequires: %{python_module fusepy} BuildRequires: %{python_module gcsfs} BuildRequires: %{python_module notebook} @@ -70,6 +69,7 @@ BuildRequires: %{python_module requests} BuildRequires: %{python_module s3fs} BuildRequires: %{python_module smbprotocol} BuildRequires: %{python_module zstandard} +BuildRequires: %{python_module distributed if (%python-base without python36-base)} BuildRequires: %{python_module numpy if (%python-base without python36-base)} BuildRequires: %{python_module panel if (%python-base without python36-base)} # cannot test git and http in the same installation (?) @@ -82,7 +82,7 @@ BuildRequires: %{python_module panel if (%python-base without python36-base)} A specification for pythonic filesystems. %prep -%setup -q -n fsspec-%{version} +%setup -q -n filesystem_spec-%{version} # don't test nonexistent python36-numpy sed -i -e '/^import numpy as np/ d' -e '/^import pytest/ a np = pytest.importorskip("numpy")' fsspec/tests/test_spec.py @@ -98,8 +98,14 @@ sed -i -e '/^import numpy as np/ d' -e '/^import pytest/ a np = pytest.importors %if %{with test} %check # test_basic relies on speed of FS and timeouts in OBS +donttest="test_basic" # test_not_cached needs sockets -%pytest -rfEs -k 'not test_basic and not test_not_cached' +donttest+=" or test_not_cached" +# wants to open a socket connection to "my_instance.com" +donttest+=" or test_dbfs" +# wants to connect to ftp.fau.de +donttest+=" or test_find" +%pytest -rfEs -k "not ($donttest)" %endif %if ! %{with test} From d547ead3a67bbedc3e5647ed5339b5441f1329c5e90cc7691881c38ace080f46 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Mark=C3=A9ta=20Machov=C3=A1?= Date: Thu, 20 May 2021 17:20:50 +0000 Subject: [PATCH 2/2] Accepting request 894650 from home:bnavigator:branches:devel:languages:python - Update to 2021.05.0 * Enable listings cache for HTTP filesystem (#560) * Fold ZipFileSystem and LibArchiveFileSystem into a generic implementation and add new TarFileSystem (#561) * Use throttling for the ``get``/``put`` methods of ``AsyncFileSystem``. - Release 2021.04.0 * Major changes: calendar versioning * better link and size finding for HTTP (#610, %99) * link following in Local (#608) * ReferenceFileSystem dev (#606, #604, #602) * Fix: drop metadata dep (#605) OBS-URL: https://build.opensuse.org/request/show/894650 OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-fsspec?expand=0&rev=25 --- fsspec-0.9.0.tar.gz | 3 --- fsspec-2021.05.0.tar.gz | 3 +++ python-fsspec.changes | 16 ++++++++++++++++ python-fsspec.spec | 9 +++++---- 4 files changed, 24 insertions(+), 7 deletions(-) delete mode 100644 fsspec-0.9.0.tar.gz create mode 100644 fsspec-2021.05.0.tar.gz diff --git a/fsspec-0.9.0.tar.gz b/fsspec-0.9.0.tar.gz deleted file mode 100644 index 62bd637..0000000 --- a/fsspec-0.9.0.tar.gz +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:ec2421a0d8775f4018d6541f1dedb8cad353771a00c9dfc438c44fd94c1d5533 -size 286634 diff --git a/fsspec-2021.05.0.tar.gz b/fsspec-2021.05.0.tar.gz new file mode 100644 index 0000000..16021e8 --- /dev/null +++ b/fsspec-2021.05.0.tar.gz @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b538d075b08674195d990d0a8c743b79073250524a7e9e872834c8b952d8c1ed +size 292796 diff --git a/python-fsspec.changes b/python-fsspec.changes index ef8ae83..24022a1 100644 --- a/python-fsspec.changes +++ b/python-fsspec.changes @@ -1,3 +1,19 @@ +------------------------------------------------------------------- +Thu May 20 13:22:56 UTC 2021 - Ben Greiner + +- Update to 2021.05.0 + * Enable listings cache for HTTP filesystem (#560) + * Fold ZipFileSystem and LibArchiveFileSystem into a generic + implementation and add new TarFileSystem (#561) + * Use throttling for the ``get``/``put`` methods of + ``AsyncFileSystem``. +- Release 2021.04.0 + * Major changes: calendar versioning + * better link and size finding for HTTP (#610, %99) + * link following in Local (#608) + * ReferenceFileSystem dev (#606, #604, #602) + * Fix: drop metadata dep (#605) + ------------------------------------------------------------------- Thu Apr 15 13:10:09 UTC 2021 - Ben Greiner diff --git a/python-fsspec.spec b/python-fsspec.spec index 0de0235..393e9a8 100644 --- a/python-fsspec.spec +++ b/python-fsspec.spec @@ -1,5 +1,5 @@ # -# spec file for package python-fsspec-test +# spec file # # Copyright (c) 2021 SUSE LLC # @@ -26,14 +26,15 @@ %bcond_with test %endif %define skip_python2 1 +%define ghversion 2021.05.0 Name: python-fsspec%{psuffix} -Version: 0.9.0 +Version: 2021.5.0 Release: 0 Summary: Filesystem specification package License: BSD-3-Clause URL: https://github.com/intake/filesystem_spec # the tests are only in the GitHub archive -Source: %{url}/archive/%{version}.tar.gz#/fsspec-%{version}.tar.gz +Source: %{url}/archive/%{ghversion}.tar.gz#/fsspec-%{ghversion}.tar.gz BuildRequires: %{python_module base >= 3.6} BuildRequires: %{python_module importlib_metadata if %python-base < 3.8} BuildRequires: %{python_module setuptools} @@ -82,7 +83,7 @@ BuildRequires: %{python_module panel if (%python-base without python36-base)} A specification for pythonic filesystems. %prep -%setup -q -n filesystem_spec-%{version} +%setup -q -n filesystem_spec-%{ghversion} # don't test nonexistent python36-numpy sed -i -e '/^import numpy as np/ d' -e '/^import pytest/ a np = pytest.importorskip("numpy")' fsspec/tests/test_spec.py