f865817b6d
- Update to 2025.12.0: * Enhancements + fsspec.parquet to support filters and multiple files (#1945) + file system for GitHub gists (#1791) + LFS support in github: (#1810) + add pipe_file to HTTP (#1799, 1801) + add sync http for pyodide (#1177) + add open() to referenceFS (#1778) + “exclusive” mode for writing (#1762, 1756, 174+) + “tree” text display of filesystem contents (#1750) + async wrapper for sync FSs (#1745) + new known implementation: tosfs (#1739) + consilidate block fetch requests (#1733) + allow dicts (not just bytes) for referenceFS (#1616 + make filesystems JSON serializeable (#1612) + implement multifile cat() for github (#1620) + log hits/misses in bytes cachers (#1566) * Fixes + strip protocol for sftp (#1940) + use one-step mv in jupyterfs (#1937) + raise errors in jupyterfs, not return (#1936) + allow ls() on a single file for arrowFS (#1931) + accept all mode= types in memoryFS (#1922) + pass path list to put() in localtempfile for efficiency (#1920) + use st_birthtime in localFS, if available (#1883) + remove deprecated asyncio use (#1862) + create event loop if it doesn’t exist (#1857) + don’t make async open() in async-wrapper (#1769) + fix CI following dask-expr upstream change (#1781) + better webHDFS proxies
Steve Kowalik2025-12-19 03:00:15 +00:00
0e0484b800
- update to 2024.3.1: * allow override of expand in open() * root handling in local file paths, fix for windows * coroutines throttle to stream pool rather than batches * write transactions in simplecache * allow deep nested refs in referenceFS/parquet * Fixes bug (#1476) that made open_files ignore expand=False * remove extra calling mapper contains * connection retry for SMB * zip64 should be on is allowZip64 is
Dirk Mueller2024-03-25 17:27:43 +00:00
99986c88ec
Accepting request 1157039 from devel:languages:python
Ana Guerrero2024-03-13 21:17:46 +00:00
d17b00dab3
Accepting request 1156422 from home:bnavigator:branches:devel:languages:python
Matej Cepl2024-03-11 21:30:58 +00:00
0567fc3a18
Accepting request 1138849 from devel:languages:python
Ana Guerrero2024-01-15 21:21:02 +00:00
16cdcba341
- update to 2023.12.2: * top-level glob in ZIP (#1454) * append mode on local ZIP files/truncate (#1449) * restrict ":" as protocol marker to data: (#1452) * sftp relative paths (#1451) * http encoding in HTTP FS put_file (#1450)
Dirk Mueller2023-12-16 12:45:12 +00:00
ae466a8556
- update to 2023.12.1: * Remove trailing "/" from directory names in zipFS (#1445) * allow HTTP size guess in more circumstances (#1440) * allow kwargs passed to GUI to be dict (#1437) * transaction support for writing via a cache FS (#1434) * make cached FSs work better with async backends (#1429) * allow FSs to set their transaction implementation (#1424) * add dataFS (#1421, 1415) * allow basic auth in webHDFS (#1409) * in referenceFS, maintain order when some keys are omitted in cat (#1436) * nested subdirectory listing in referenceFS (#1433) * allow "=" in webHDF paths (#1428) * fix file mode to consistent "r+b" format (#1426) * pass on kwargs in HTTP glob (#1422) * allow Path in can_be_local and open_local (#1419, #1418) * fix parent for cachedFS (#1413) * "ends" list in _cat_ranges was incorrect (#1402)
Dirk Mueller2023-12-07 21:30:27 +00:00
953526ebb4
Accepting request 1126463 from devel:languages:python
Ana Guerrero2023-11-15 20:08:42 +00:00
31c3aa4cc8
Accepting request 1126460 from home:mimi_vx:branches:devel:languages:python
Ondřej Súkup2023-11-14 20:45:15 +00:00
1d8be9b148
Accepting request 1115766 from devel:languages:python
Ana Guerrero2023-10-12 21:44:06 +00:00
cd0832f953
- update to 2023.9.2: * revert #1358: auto_mkdir in open() (#1365) * code style updates (#1373, 1372, 1371, 1370, 1369, 1364) * update CI setup (#1386) - 2023.9.1 * #1353, save file cache metadata in JSON * #1352, remove some unnecessary list iterations * #1361, re-allow None for default port for SMB * #1360, initialising GUI widget FS with kwargs * #1358, pass auto_mkdir vi url_to_fs again * #1354, auto delete temp cache directory - 2023.9.0 * #1346, add ocilake protocol * #1345, implement async-sync and async-async generic cp and rsync * #1344, add lakefs protocol * #1337 add goatcounter to docs * #1323, 1328, add xethub protocol * #1320, in HTTP, check content-encoding when getting length * #1303, add on_error in walk * #1302, add dirfs attribute to mappers * #1293, configure port for smb * #1349, don't reorder paths in bulk ops if source and dest are both lists * #1333, allow mode="x" in get_fs_token_paths * #1324, allow generic to work with complex URLs * #1316, exclude bytes-cache kwargs in url_to_fs * #1314, remote utcnow/utcfromtimestamp * #1311, dirFS's protocol * #1305, use get_file rather than get in file caching
Dirk Mueller2023-10-05 09:00:06 +00:00
62da4a9b7b
Accepting request 1097061 from devel:languages:python
Fabian Vogt2023-07-07 13:47:31 +00:00
dcdce752dd
Accepting request 1096929 from home:bnavigator:branches:devel:languages:python
Daniel Garcia2023-07-06 07:32:04 +00:00
d88f1b4935
- update to 2023.5.0: * #1236, allow writing ReferenceFS references directly to parquet * #1255, copy of glob to single output directory * #1254, non-recursive copy of directory (no-op) * #1253, cleanup fix on close of ZIP FS * #1250, ignore dirs when copying list of files * #1249, don't error on register without clobber is registering same thing again * #1245, special case for other_files and relative path * Other * #1248, add test harness into released wheel package * #1247, docs and tests around common bulk file operations * 2023.4.0 * #1225, comprehensive docs of expected behaviour of cp/get/put and tests * #1216, test harness for any backend * #1224, small fixes in reference and dask FSs * #1218, mv is no-op when origin and destination are the same * #1217, await in AbstractStreamedFile * #1215, docbuild fixes * #1214, unneeded maxdepth manipulation in expand_path * #1213, pyarros and posixpath related test fixes * #1211, BackgroundBlockCache: keep a block longer if not yet used * #1210, webHDFS: location parameter * Other * #1241, add HfFileSystem to registry * #1237, register_implementation clobber default changes to False
Dirk Mueller2023-05-30 11:17:23 +00:00
1f9b1c9689
- Update to 0.6.0: * Fixed issues with filesystem instance caching. This was causing authorization errors in downstream libraries like gcsfs and s3fs in multi-threaded code (:pr:155, :pr:181) * Changed the default file caching strategy to :class:fsspec.caching.ReadAheadCache (:pr:193) * Moved file caches to the new fsspec.caching module. They're still available from their old location in fsspec.core, but we recommend using the new location for new code (:pr:195) * Added a new file caching strategy, :class:fsspec.caching.BlockCache for fetching and caching file reads in blocks (:pr:191). * Fixed equality checks for file system instance to return False when compared to objects other than file systems (:pr:192) * Fixed a bug in :meth:fsspec.FSMap.keys returning a generator, which was consumed upon iteration (:pr:189). * Removed the magic addition of aliases in AbstractFileSystem.__init__. Now alias methods are always present (:pr:177) * Deprecated passing trim to :class:fsspec.spec.AbstractBufferedFile. Pass it in storage_options instead (:pr:188) * Improved handling of requests for :class:fsspec.implementations.http.HTTPFileSystem when the HTTP server responds with an (incorrect) content-length of 0 (:pr:163) * Added a detail=True parameter to :meth:fsspec.spec.AbstractFileSystem.ls (:pr:168) * Fixed handling of UNC/DFS paths (:issue:154)
Tomáš Chvátal
2019-11-20 14:18:02 +00:00
Ana Guerrero
Steve Kowalik
Dominique Leuenberger
Dirk Mueller
Matej Cepl
Markéta Machová
Ondřej Súkup
Fabian Vogt
Daniel Garcia
Richard Brown
Tomáš Chvátal
Todd R