8382 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nick Craig-Wood	70e8ad456f	serve nfs: implement on disk cache for file handles	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	55b9b3e33a	serve nfs: factor caching to its own file	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	ce7dfa075c	serve nfs: update github.com/willscott/go-nfs to latest ... This fixes various cache invalidation bugs	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	a697d27455	serve nfs: store billy FS in the Handler	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	cae22a7562	serve nfs: mask unimplemented error from chmod	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	877321c2fb	serve nfs: add tracing to filesystem calls	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	574378e871	serve nfs: rename types and methods which should be internal	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	50d42babd8	nfsmount: require --vfs-cache-mode writes or above in tests ... These tests fail for --vfs-cache-mode minimal on Linux for the same reason they don't work properly with --vfs-cache-mode off	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	13ea77dd71	nfsmount: allow tests to run on any unix where sudo mount/umount works	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	62b76b631c	nfsmount: make the --sudo flag work for umount as well as mount	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	96f92b7364	nfsmount: add tcp option to NFS mount options to fix mounting under Linux	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	7c02a63884	build: install NFS client libraries to allow nfsmount tests to run	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	67d4394a37	vfstest: fix crash if open failed	2024-08-14 21:55:26 +01:00
Nick Craig-Wood	c1a98768bc	Implement Gofile backend - fixes #4632	2024-08-14 21:15:37 +01:00
Nick Craig-Wood	bac9abebfb	lib/encoder: add Exclamation mark encoding	2024-08-14 21:15:37 +01:00
Nick Craig-Wood	27b281ef69	chunkedreader: add --vfs-read-chunk-streams to parallel read chunks ... This converts the ChunkedReader into an interface and provides two implementations one sequential and one parallel. This can be used to improve the performance of the VFS on high bandwidth or high latency links. Fixes #4760	2024-08-14 21:13:09 +01:00
Nick Craig-Wood	10270a4354	accounting: fix race detected by the race detector	2024-08-14 21:13:09 +01:00
Nick Craig-Wood	d08b49d723	pool: Add ability to wait for a write to RW	2024-08-14 21:13:09 +01:00
Nick Craig-Wood	cb2d2d72a0	pool: Make RW thread safe so can read and write at the same time	2024-08-14 21:13:09 +01:00
Nick Craig-Wood	e686e34f89	multipart: make pool buffer size public	2024-08-14 21:13:09 +01:00
Nick Craig-Wood	5f66350331	Add Fornax to contributors	2024-08-14 21:12:56 +01:00
Nick Craig-Wood	e1d935b854	build: use go1.23 for the linter ... This reverts commit 485aa90d13. As the upstream problem is now fixed by golangci-lint v1.60.1	2024-08-14 18:27:13 +01:00
Nick Craig-Wood	61b27cda80	build: fix govet lint errors with golangci-lint v1.60.1 ... There were a lot of instances of this lint error printf: non-constant format string in call to github.com/rclone/rclone/fs.Logf (govet) Which were fixed by re-arranging the arguments and adding "%s". There were quite a few genuine bugs which were found too.	2024-08-14 18:25:40 +01:00
Nick Craig-Wood	83613634f9	build: bisync: fix govet lint errors with golangci-lint v1.60.1 ... There were a lot of instances of this lint error printf: non-constant format string in call to github.com/rclone/rclone/fs.Logf (govet) Most of these could not easily be fixed so had nolint lines added. This should probably be done in a neater way perhaps by making LogColorf/ErrorColorf functions.	2024-08-14 18:21:31 +01:00
Nick Craig-Wood	1c80cbd13a	build: fix staticcheck lint errors with golangci-lint v1.60.1	2024-08-14 17:48:24 +01:00
Nick Craig-Wood	9d5315a944	build: fix gosimple lint errors with golangci-lint v1.60.1	2024-08-14 17:46:12 +01:00
Nick Craig-Wood	8d1d096c11	drive: fix copying Google Docs to a backend which only supports SHA1 ... When copying Google Docs to Backblaze B2 errors like this would happen ERROR : test.docx: Failed to calculate src hash: hash type not supported ERROR : test.docx: corrupted on transfer: sha1 hashes differ src This was due to an oversight in 8fd66daab6 drive: add support of SHA-1 and SHA-256 checksum Which omitted to change the base object (which includes Google Docs) so that it supported SHA-1 and SHA-256.	2024-08-12 20:27:12 +01:00
Nick Craig-Wood	4b922d86d7	drive: update docs on creating admin service accounts	2024-08-12 20:27:12 +01:00
Fornax	3b3625037c	Add pixeldrain backend ... This commit adds support for pixeldrain's experimental filesystem API.	2024-08-12 13:35:44 +01:00
kapitainsky	bfa3278f30	docs: add comment how to reduce rclone binary size (#8000) ... See #7998	2024-08-10 17:52:32 +01:00
albertony	e334366345	Make listremotes long output backwards compatible - fixes #7995 ... The format was changed to include the source attribute in #7404, but that is now reverted and the source information is only shown in json output.	2024-08-09 17:39:00 +01:00
Nick Craig-Wood	642d4082ac	test_backend_sizes.py calculates space in the binary each backend uses #7998	2024-08-09 12:13:24 +01:00
albertony	024ff6ed15	listremotes: added options for filtering, ordering and json output	2024-08-08 13:41:31 +01:00
albertony	d6b0743cf4	config: make getting config values more consistent	2024-08-08 13:41:31 +01:00
albertony	e4749cf0d0	config: make listing of remotes more consistent	2024-08-08 13:41:31 +01:00
albertony	8d2907d8f5	config: avoid remote with empty name from environment	2024-08-08 13:41:31 +01:00
albertony	1720d3e11c	help: global flags help command extended filtering	2024-08-08 13:41:31 +01:00
albertony	c6352231e4	help: global flags help command now takes glob filter	2024-08-08 13:41:31 +01:00
albertony	731947f3ca	filter: add options for glob to regexp without anchors and special path rules	2024-08-08 13:41:31 +01:00
albertony	16d642825d	docs: remove old genautocomplete command docs and add as alias from the newer completion command	2024-08-08 13:34:10 +01:00
albertony	50aebcf403	docs: replace references to genautocomplete with the new name completion	2024-08-08 13:34:10 +01:00
Nick Craig-Wood	c8555d1b16	serve s3: update to AWS SDKv2 by updating github.com/rclone/gofakes3 ... This is the last dependency for the SDKv1 and this commit removes it from go.mod also.	2024-08-07 16:35:39 +01:00
Nick Craig-Wood	3ec0ff5d8f	s3: fix SSE-C after SDKv2 change ... The new SDK apparently keeds the customer key to be base64 encoded where the old one did that for you automatically. See: https://github.com/aws/aws-sdk-go-v2/issues/2736 See: https://forum.rclone.org/t/new-s3-backend-help-testing-needed/47139/3	2024-08-07 12:13:13 +01:00
wiserain	746516511d	pikpak: update to using AWS SDK v2 #4989	2024-08-07 12:13:13 +01:00
Nick Craig-Wood	8aef1de695	s3: fix Cloudflare R2 integration tests after SDKv2 update #4989 ... Cloudflare will normally automatically decompress files with `Content-Encoding: gzip` when downloaded. This is not what AWS S3 does and it breaks the integration tests. This fudges the integration tests to upload the test file with `Cache-Control: no-transform` on Cloudflare R2 and puts a note in the docs about this problem.	2024-08-07 12:13:13 +01:00
Nick Craig-Wood	cb611b8330	s3: add --s3-sdk-log-mode to control SDK debugging	2024-08-07 12:13:13 +01:00
Nick Craig-Wood	66ae050a8b	s3: fix GCS provider after SDKv2 update #4989 ... This also adds GCS via S3 to the integration tester.	2024-08-07 12:13:13 +01:00
Nick Craig-Wood	fd9049c83d	s3: update to using AWS SDK v2 - fixes #4989 ... SDK v2 conversion Changes - `--s3-sts-endpoint` is no longer supported - `--s3-use-unsigned-payload` to control use of trailer checksums (needed for non AWS)	2024-08-07 12:13:13 +01:00
Nick Craig-Wood	a1f52bcf50	fstest: implement method to skip ChunkedCopy tests	2024-08-06 12:45:07 +01:00
Nick Craig-Wood	0470450583	build: disable wasm/js build due to go bug ... Rclone is too big for js/wasm until https://github.com/golang/go/issues/64856 is fixed	2024-08-04 12:18:34 +01:00