10 Commits

Author	SHA1	Message	Date
Nick Craig-Wood	b33140ddeb	union: add :writback to act as a simple cache ... This adds a :writeback tag to upstreams. If set on a single upstream then it writes back objects not found into that upstream. Fixes #6934	2023-09-04 12:03:26 +01:00
albertony	5d6b8141ec	Replace deprecated ioutil ... As of Go 1.16, the same functionality is now provided by package io or package os, and those implementations should be preferred in new code.	2022-11-07 11:41:47 +00:00
Nick Craig-Wood	ed87ae51c0	union: support metadata	2022-06-29 17:30:37 +01:00
Nick Craig-Wood	5dd51e6149	union: fix deadlock when one part of a multi-upload fails ... Before this fix, rclone would deadlock when uploading two files at once, if one errored. This caused the other file to block in the multi reader and never complete. This fix drains the input buffer on error which allows the other upload to complete. See: https://forum.rclone.org/t/union-with-create-policy-all-copy-stuck-when-first-union-fails/29601	2022-03-09 11:30:55 +00:00
Nick Craig-Wood	96e099d8e7	union: fix error handling broken by removal of github.com/pkg/errors ... There were instances of errors.Wrap being called with a nil error which the conversion didn't deal with correctly.	2021-11-09 13:43:45 +00:00
Nick Craig-Wood	e43b5ce5e5	Remove github.com/pkg/errors and replace with std library version ... This is possible now that we no longer support go1.12 and brings rclone into line with standard practices in the Go world. This also removes errors.New and errors.Errorf from lib/errors and prefers the stdlib errors package over lib/errors.	2021-11-07 11:53:30 +00:00
Nick Craig-Wood	ebd9462ea6	union: fix union attempting to update files on a read only file system ... Before this change, when using an all create method with one of the upstreams being read only, if there was an existing file on the read only remote, it was impossible to update it. This change detects that situation and creates the file on a read/write upstream. This file will shadow the file on the read/only upstream. If it is deleted the read only upstream file will be visible again. Fixes #4929	2021-03-15 19:22:07 +00:00
Nick Craig-Wood	23c826db52	union: fix writing with the all policy - fixes #4534 ... Before this change writing with the all policy deadlocked while uploading. This change fixes the problem by fixing the multi reader, closing the pipes at the correct time with the correct error. This is factored into a new function as it was used twice. This patch also adds a new test which tests the all policies.	2020-09-01 18:21:03 +01:00
Martin Michlmayr	041b201abd	doc: fix typos throughout docs and code	2020-05-25 11:23:58 +01:00
Max Sum	78a9e7440a	union: Implement multiple writable remotes	2020-03-21 18:11:24 +00:00