223889f950
- Update to 2025.12.0: * Enhancements + fsspec.parquet to support filters and multiple files (#1945) + file system for GitHub gists (#1791) + LFS support in github: (#1810) + add pipe_file to HTTP (#1799, 1801) + add sync http for pyodide (#1177) + add open() to referenceFS (#1778) + “exclusive” mode for writing (#1762, 1756, 174+) + “tree” text display of filesystem contents (#1750) + async wrapper for sync FSs (#1745) + new known implementation: tosfs (#1739) + consilidate block fetch requests (#1733) + allow dicts (not just bytes) for referenceFS (#1616 + make filesystems JSON serializeable (#1612) + implement multifile cat() for github (#1620) + log hits/misses in bytes cachers (#1566) * Fixes + strip protocol for sftp (#1940) + use one-step mv in jupyterfs (#1937) + raise errors in jupyterfs, not return (#1936) + allow ls() on a single file for arrowFS (#1931) + accept all mode= types in memoryFS (#1922) + pass path list to put() in localtempfile for efficiency (#1920) + use st_birthtime in localFS, if available (#1883) + remove deprecated asyncio use (#1862) + create event loop if it doesn’t exist (#1857) + don’t make async open() in async-wrapper (#1769) + fix CI following dask-expr upstream change (#1781) + better webHDFS proxies
Steve Kowalik2025-12-19 03:00:15 +00:00
9558e430ec
Accepting request 1165946 from devel:languages:python
Ana Guerrero2024-04-07 20:13:13 +00:00
0e0484b800
- update to 2024.3.1: * allow override of expand in open() * root handling in local file paths, fix for windows * coroutines throttle to stream pool rather than batches * write transactions in simplecache * allow deep nested refs in referenceFS/parquet * Fixes bug (#1476) that made open_files ignore expand=False * remove extra calling mapper contains * connection retry for SMB * zip64 should be on is allowZip64 is
Dirk Mueller2024-03-25 17:27:43 +00:00
56d3948e22
- update to 2024.3.1: * allow override of expand in open() * root handling in local file paths, fix for windows * coroutines throttle to stream pool rather than batches * write transactions in simplecache * allow deep nested refs in referenceFS/parquet * Fixes bug (#1476) that made open_files ignore expand=False * remove extra calling mapper contains * connection retry for SMB * zip64 should be on is allowZip64 is
Dirk Mueller2024-03-25 17:27:43 +00:00
99986c88ec
Accepting request 1157039 from devel:languages:python
Ana Guerrero2024-03-13 21:17:46 +00:00
61099eefa2
Accepting request 1157039 from devel:languages:python
Ana Guerrero2024-03-13 21:17:46 +00:00
d17b00dab3
Accepting request 1156422 from home:bnavigator:branches:devel:languages:python
Matej Cepl2024-03-11 21:30:58 +00:00
dd03bb4cd9
Accepting request 1156422 from home:bnavigator:branches:devel:languages:python
Matej Cepl2024-03-11 21:30:58 +00:00
0567fc3a18
Accepting request 1138849 from devel:languages:python
Ana Guerrero2024-01-15 21:21:02 +00:00
2e9a60481a
Accepting request 1138849 from devel:languages:python
Ana Guerrero2024-01-15 21:21:02 +00:00
16cdcba341
- update to 2023.12.2: * top-level glob in ZIP (#1454) * append mode on local ZIP files/truncate (#1449) * restrict ":" as protocol marker to data: (#1452) * sftp relative paths (#1451) * http encoding in HTTP FS put_file (#1450)
Dirk Mueller2023-12-16 12:45:12 +00:00
4be1991b6b
- update to 2023.12.2: * top-level glob in ZIP (#1454) * append mode on local ZIP files/truncate (#1449) * restrict ":" as protocol marker to data: (#1452) * sftp relative paths (#1451) * http encoding in HTTP FS put_file (#1450)
Dirk Mueller2023-12-16 12:45:12 +00:00
ae466a8556
- update to 2023.12.1: * Remove trailing "/" from directory names in zipFS (#1445) * allow HTTP size guess in more circumstances (#1440) * allow kwargs passed to GUI to be dict (#1437) * transaction support for writing via a cache FS (#1434) * make cached FSs work better with async backends (#1429) * allow FSs to set their transaction implementation (#1424) * add dataFS (#1421, 1415) * allow basic auth in webHDFS (#1409) * in referenceFS, maintain order when some keys are omitted in cat (#1436) * nested subdirectory listing in referenceFS (#1433) * allow "=" in webHDF paths (#1428) * fix file mode to consistent "r+b" format (#1426) * pass on kwargs in HTTP glob (#1422) * allow Path in can_be_local and open_local (#1419, #1418) * fix parent for cachedFS (#1413) * "ends" list in _cat_ranges was incorrect (#1402)
Dirk Mueller2023-12-07 21:30:27 +00:00
161d27999c
- update to 2023.12.1: * Remove trailing "/" from directory names in zipFS (#1445) * allow HTTP size guess in more circumstances (#1440) * allow kwargs passed to GUI to be dict (#1437) * transaction support for writing via a cache FS (#1434) * make cached FSs work better with async backends (#1429) * allow FSs to set their transaction implementation (#1424) * add dataFS (#1421, 1415) * allow basic auth in webHDFS (#1409) * in referenceFS, maintain order when some keys are omitted in cat (#1436) * nested subdirectory listing in referenceFS (#1433) * allow "=" in webHDF paths (#1428) * fix file mode to consistent "r+b" format (#1426) * pass on kwargs in HTTP glob (#1422) * allow Path in can_be_local and open_local (#1419, #1418) * fix parent for cachedFS (#1413) * "ends" list in _cat_ranges was incorrect (#1402)
Dirk Mueller2023-12-07 21:30:27 +00:00
953526ebb4
Accepting request 1126463 from devel:languages:python
Ana Guerrero2023-11-15 20:08:42 +00:00
c715e1cc22
Accepting request 1126463 from devel:languages:python
Ana Guerrero2023-11-15 20:08:42 +00:00
31c3aa4cc8
Accepting request 1126460 from home:mimi_vx:branches:devel:languages:python
Ondřej Súkup2023-11-14 20:45:15 +00:00
0b57347e9d
Accepting request 1126460 from home:mimi_vx:branches:devel:languages:python
Ondřej Súkup2023-11-14 20:45:15 +00:00
1d8be9b148
Accepting request 1115766 from devel:languages:python
Ana Guerrero2023-10-12 21:44:06 +00:00
e28ef92238
Accepting request 1115766 from devel:languages:python
Ana Guerrero2023-10-12 21:44:06 +00:00
cd0832f953
- update to 2023.9.2: * revert #1358: auto_mkdir in open() (#1365) * code style updates (#1373, 1372, 1371, 1370, 1369, 1364) * update CI setup (#1386) - 2023.9.1 * #1353, save file cache metadata in JSON * #1352, remove some unnecessary list iterations * #1361, re-allow None for default port for SMB * #1360, initialising GUI widget FS with kwargs * #1358, pass auto_mkdir vi url_to_fs again * #1354, auto delete temp cache directory - 2023.9.0 * #1346, add ocilake protocol * #1345, implement async-sync and async-async generic cp and rsync * #1344, add lakefs protocol * #1337 add goatcounter to docs * #1323, 1328, add xethub protocol * #1320, in HTTP, check content-encoding when getting length * #1303, add on_error in walk * #1302, add dirfs attribute to mappers * #1293, configure port for smb * #1349, don't reorder paths in bulk ops if source and dest are both lists * #1333, allow mode="x" in get_fs_token_paths * #1324, allow generic to work with complex URLs * #1316, exclude bytes-cache kwargs in url_to_fs * #1314, remote utcnow/utcfromtimestamp * #1311, dirFS's protocol * #1305, use get_file rather than get in file caching
Dirk Mueller2023-10-05 09:00:06 +00:00
692df96029
- update to 2023.9.2: * revert #1358: auto_mkdir in open() (#1365) * code style updates (#1373, 1372, 1371, 1370, 1369, 1364) * update CI setup (#1386) - 2023.9.1 * #1353, save file cache metadata in JSON * #1352, remove some unnecessary list iterations * #1361, re-allow None for default port for SMB * #1360, initialising GUI widget FS with kwargs * #1358, pass auto_mkdir vi url_to_fs again * #1354, auto delete temp cache directory - 2023.9.0 * #1346, add ocilake protocol * #1345, implement async-sync and async-async generic cp and rsync * #1344, add lakefs protocol * #1337 add goatcounter to docs * #1323, 1328, add xethub protocol * #1320, in HTTP, check content-encoding when getting length * #1303, add on_error in walk * #1302, add dirfs attribute to mappers * #1293, configure port for smb * #1349, don't reorder paths in bulk ops if source and dest are both lists * #1333, allow mode="x" in get_fs_token_paths * #1324, allow generic to work with complex URLs * #1316, exclude bytes-cache kwargs in url_to_fs * #1314, remote utcnow/utcfromtimestamp * #1311, dirFS's protocol * #1305, use get_file rather than get in file caching
Dirk Mueller2023-10-05 09:00:06 +00:00
62da4a9b7b
Accepting request 1097061 from devel:languages:python
Fabian Vogt2023-07-07 13:47:31 +00:00
52e48b8f04
Accepting request 1097061 from devel:languages:python
Fabian Vogt2023-07-07 13:47:31 +00:00
dcdce752dd
Accepting request 1096929 from home:bnavigator:branches:devel:languages:python
Daniel Garcia2023-07-06 07:32:04 +00:00
8c557e25d5
Accepting request 1096929 from home:bnavigator:branches:devel:languages:python
Daniel Garcia2023-07-06 07:32:04 +00:00
d88f1b4935
- update to 2023.5.0: * #1236, allow writing ReferenceFS references directly to parquet * #1255, copy of glob to single output directory * #1254, non-recursive copy of directory (no-op) * #1253, cleanup fix on close of ZIP FS * #1250, ignore dirs when copying list of files * #1249, don't error on register without clobber is registering same thing again * #1245, special case for other_files and relative path * Other * #1248, add test harness into released wheel package * #1247, docs and tests around common bulk file operations * 2023.4.0 * #1225, comprehensive docs of expected behaviour of cp/get/put and tests * #1216, test harness for any backend * #1224, small fixes in reference and dask FSs * #1218, mv is no-op when origin and destination are the same * #1217, await in AbstractStreamedFile * #1215, docbuild fixes * #1214, unneeded maxdepth manipulation in expand_path * #1213, pyarros and posixpath related test fixes * #1211, BackgroundBlockCache: keep a block longer if not yet used * #1210, webHDFS: location parameter * Other * #1241, add HfFileSystem to registry * #1237, register_implementation clobber default changes to False
Dirk Mueller2023-05-30 11:17:23 +00:00
93cdeb165d
- update to 2023.5.0: * #1236, allow writing ReferenceFS references directly to parquet * #1255, copy of glob to single output directory * #1254, non-recursive copy of directory (no-op) * #1253, cleanup fix on close of ZIP FS * #1250, ignore dirs when copying list of files * #1249, don't error on register without clobber is registering same thing again * #1245, special case for other_files and relative path * Other * #1248, add test harness into released wheel package * #1247, docs and tests around common bulk file operations * 2023.4.0 * #1225, comprehensive docs of expected behaviour of cp/get/put and tests * #1216, test harness for any backend * #1224, small fixes in reference and dask FSs * #1218, mv is no-op when origin and destination are the same * #1217, await in AbstractStreamedFile * #1215, docbuild fixes * #1214, unneeded maxdepth manipulation in expand_path * #1213, pyarros and posixpath related test fixes * #1211, BackgroundBlockCache: keep a block longer if not yet used * #1210, webHDFS: location parameter * Other * #1241, add HfFileSystem to registry * #1237, register_implementation clobber default changes to False
Dirk Mueller2023-05-30 11:17:23 +00:00
Ana Guerrero
Steve Kowalik
Dominique Leuenberger
Dirk Mueller
Matej Cepl
Markéta Machová
Ondřej Súkup
Fabian Vogt
Daniel Garcia
Richard Brown