22 Commits

Author	SHA1	Message	Date
Nick Craig-Wood	39db8caff1	cache,chunker,combine,compress,crypt,hasher,union: implement MkdirMetadata and related Features	2024-02-28 16:09:04 +00:00
Nick Craig-Wood	b33140ddeb	union: add :writback to act as a simple cache ... This adds a :writeback tag to upstreams. If set on a single upstream then it writes back objects not found into that upstream. Fixes #6934	2023-09-04 12:03:26 +01:00
Roberto Ricci	45458f2cdb	union: use atomic types	2023-08-22 12:52:13 +01:00
albertony	555def2da7	build: add package comments to silence revive linter	2022-08-28 13:43:51 +02:00
r-ricci	67fd60275a	union: fix panic due to misalignment of struct field in 32 bit architectures ... `FS.cacheExpiry` is accessed through sync/atomic. According to the documentation, "On ARM, 386, and 32-bit MIPS, it is the caller's responsibility to arrange for 64-bit alignment of 64-bit words accessed atomically. The first word in a variable or in an allocated struct, array, or slice can be relied upon to be 64-bit aligned." Before commit 1d2fe0d856 this field was aligned, but then a new field was added to the structure, causing the test suite to panic on linux/386. No other field is used with sync/atomic, so `cacheExpiry` can just be placed at the beginning of the stuct to ensure it is always aligned.	2022-07-11 18:34:06 +01:00
albertony	3435bf7f34	staticcheck: no value of type int64 is greater than math.MaxInt64	2022-07-04 11:24:59 +02:00
albertony	0772cae314	staticcheck: use result of type assertion to simplify cases	2022-07-04 11:24:59 +02:00
Nick Craig-Wood	ed87ae51c0	union: support metadata	2022-06-29 17:30:37 +01:00
Nick Craig-Wood	1e1af46a12	union: fix get free space for remotes which don't support it #6071 ... Before this fix GetFreeSpace returned math.MaxInt64 for remotes which don't support reading free space, however this is used in various comparison routines as a too large value, meaning that remotes of size math.MaxInt64 were never being selected. This fixes GetFreeSpace to return math.MaxInt64 - 1 so then can be selected. It also fixes GetUsedSpace the same way however as the default for not supported was 0 this was very unlikely to have ever caused a problem.	2022-06-16 22:13:50 +01:00
Nick Craig-Wood	1d2fe0d856	union: enable passing of options to upstreams and policies #6071 ... This factors out the options into a sub package so they can be passed to upstreams and used in policies.	2022-06-16 22:13:50 +01:00
Nick Craig-Wood	f26abc89a6	union: fix treatment of remotes with // in ... See: https://forum.rclone.org/t/connection-string-with-union-backend-and-a-lot-of-quotes/27577	2021-11-23 17:41:12 +00:00
Nick Craig-Wood	e43b5ce5e5	Remove github.com/pkg/errors and replace with std library version ... This is possible now that we no longer support go1.12 and brings rclone into line with standard practices in the Go world. This also removes errors.New and errors.Errorf from lib/errors and prefers the stdlib errors package over lib/errors.	2021-11-07 11:53:30 +00:00
Nick Craig-Wood	b8c1cf7451	union: fix initialisation broken in refactor - fixes #5139 ... This commit broke the initialisation of the union backend f17d7c0012 union: refactor to use fspath.SplitFs instead of fs.ParseRemote #4996 This patch fixes it.	2021-03-24 09:47:38 +00:00
Nick Craig-Wood	f17d7c0012	union: refactor to use fspath.SplitFs instead of fs.ParseRemote #4996	2021-03-15 19:22:07 +00:00
Nick Craig-Wood	d809930e1d	union: fix mkdir at root with remote:/ ... Before the this fix if you specified remote:/ then the union backend would fail to notice the root directory existed. This was fixed by stripping the trailing / from the root. See: https://forum.rclone.org/t/upgraded-from-1-45-to-1-54-now-cant-create-new-directory-within-union-mount/22284/	2021-02-17 12:11:34 +00:00
Nick Craig-Wood	d846210978	fs: Add context to NewFs #3257 #4685 ... This adds a context.Context parameter to NewFs and related calls. This is necessary as part of reading config from the context - backends need to be able to read the global config.	2020-11-09 18:05:54 +00:00
Josh Soref	d0888edc0a	Spelling fixes ... Fix spelling of: above, already, anonymous, associated, authentication, bandwidth, because, between, blocks, calculate, candidates, cautious, changelog, cleaner, clipboard, command, completely, concurrently, considered, constructs, corrupt, current, daemon, dependencies, deprecated, directory, dispatcher, download, eligible, ellipsis, encrypter, endpoint, entrieslist, essentially, existing writers, existing, expires, filesystem, flushing, frequently, hierarchy, however, implementation, implements, inaccurate, individually, insensitive, longer, maximum, metadata, modified, multipart, namedirfirst, nextcloud, obscured, opened, optional, owncloud, pacific, passphrase, password, permanently, persimmon, positive, potato, protocol, quota, receiving, recommends, referring, requires, revisited, satisfied, satisfies, satisfy, semver, serialized, session, storage, strategies, stringlist, successful, supported, surprise, temporarily, temporary, transactions, unneeded, update, uploads, wrapped Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>	2020-10-14 15:21:31 +01:00
Nick Craig-Wood	70c8566cb8	fs: Pin created backends until parents are finalized ... This attempts to solve the backend lifecycle problem by - Pinning backends mentioned on the command line into the cache indefinitely - Unpinning backends when the containing structure (VFS, wrapping backend) is destroyed See: https://forum.rclone.org/t/rclone-rc-backend-command-not-working-as-expected/18834	2020-09-01 18:21:03 +01:00
Nick Craig-Wood	85f9bd1abf	union: fix tests by looking for fs.ErrorDirNotFound found in Purge and About ... Before this change we errored out if one upstream errored in Purge or About. This change checks for fs.ErrorDirNotFound and skips that backend in this case.	2020-08-19 18:04:16 +01:00
Martin Michlmayr	041b201abd	doc: fix typos throughout docs and code	2020-05-25 11:23:58 +01:00
Martin Michlmayr	4aee962233	doc: fix typos throughout docs and code	2020-05-20 15:54:51 +01:00
Max Sum	78a9e7440a	union: Implement multiple writable remotes	2020-03-21 18:11:24 +00:00