rclone/backend
Nick Craig-Wood ba11040d6b s3: detect looping when using gcs and versions
Apparently gcs doesn't return an S3 compatible result when using
versions.

In particular it doesn't return a NextKeyMarker - this means rclone
loops and fetches the same page over and over again.

This patch detects the problem and stops the infinite retries but it
doesn't fix the underlying problem.

See: https://forum.rclone.org/t/list-s3-versions-files-looping-bug/42974
See: https://issuetracker.google.com/u/0/issues/312292516
2023-11-23 09:50:28 +00:00
..
alias build: add package comments to silence revive linter 2022-08-28 13:43:51 +02:00
all backend: add Linkbox backend 2023-11-18 17:14:45 +00:00
amazonclouddrive build: reformat comments to pass go1.19 vet 2022-08-05 16:35:41 +01:00
azureblob azureblob: add support cold tier 2023-10-18 17:54:25 +01:00
azurefiles azurefiles: finish docs and implementation and add optional interfaces 2023-11-18 16:48:23 +00:00
b2 fs: add ChunkWriterDoesntSeek feature flag and set it for b2 2023-11-20 18:07:05 +00:00
box box: fix performance problem reading metadata for single files 2023-11-20 18:07:05 +00:00
cache cache: fix integration tests by adding missing OpenChunkWriter exclude 2023-09-04 19:26:14 +01:00
chunker features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
combine build: fix lint errors when re-enabling revive exported & package-comments 2023-08-29 13:03:13 +01:00
compress compress: fix ChangeNotify 2023-09-05 17:22:36 +01:00
crypt features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
drive drive: fix integration tests by enabling metadata support from the context 2023-11-19 12:48:27 +00:00
dropbox dropbox: fix missing encoding for rclone purge again 2023-11-21 12:23:28 +00:00
fichier fichier: fix error code parsing 2023-08-11 00:47:01 +09:00
filefabric filefabric: use atomic types 2023-08-22 12:52:13 +01:00
ftp ftp: fix 425 "TLS session of data connection not resumed" errors 2023-08-18 14:44:13 +01:00
googlecloudstorage gcs: fix 400 Bad request errors when using multi-thread copy 2023-11-20 18:07:05 +00:00
googlephotos googlephotos: implement batcher for uploads - fixes #6920 2023-10-03 18:01:34 +01:00
hasher features: add new interfaces OpenChunkWriter and ChunkWriter #7056 2023-08-12 17:55:01 +01:00
hdfs hdfs: added support for list of namenodes in hdfs remote config 2023-11-13 15:55:52 +00:00
hidrive hidrive: remove unused code (fixes issue reported by the unused linter) 2023-03-26 14:28:15 +02:00
http http: implement set backend command to update running backend 2023-11-20 18:07:05 +00:00
internetarchive fs: implement --metadata-mapper to transform metatadata with a user supplied program 2023-11-18 17:49:35 +00:00
jottacloud fs: implement --metadata-mapper to transform metatadata with a user supplied program 2023-11-18 17:49:35 +00:00
koofr rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
linkbox linkbox: pre-merge fixes 2023-11-18 17:14:45 +00:00
local fs: implement --metadata-mapper to transform metatadata with a user supplied program 2023-11-18 17:49:35 +00:00
mailru rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
mega docs: fix typos found by codespell in docs and code comments 2023-09-23 12:20:01 +01:00
memory Replace deprecated ioutil 2022-11-07 11:41:47 +00:00
netstorage rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
onedrive onedrive: implement ListR method which gives --fast-list support 2023-10-02 11:12:08 +01:00
opendrive opendrive: fix List on a just deleted and remade directory 2023-09-05 17:59:03 +01:00
oracleobjectstorage fs: implement --metadata-mapper to transform metatadata with a user supplied program 2023-11-18 17:49:35 +00:00
pcloud rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
pikpak docs: fix typos found by codespell in docs and code comments 2023-09-23 12:20:01 +01:00
premiumizeme rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
protondrive protondrive: make cached keys rclone style and not show with rclone config redacted 2023-09-11 15:57:08 +01:00
putio rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
qingstor rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
quatrix quatrix: overwrite files on conflict during server-side move 2023-11-16 17:14:00 +00:00
s3 s3: detect looping when using gcs and versions 2023-11-23 09:50:28 +00:00
seafile seafile: use atomic types 2023-08-22 12:52:13 +01:00
sftp sftp: implement --sftp-copy-is-hardlink to server side copy as hardlink 2023-10-16 12:08:22 +01:00
sharefile rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
sia rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
smb smb: use atomic types 2023-08-22 12:52:13 +01:00
storj storj: update storj.io/uplink to v1.12.0 2023-09-14 14:01:35 +01:00
sugarsync rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
swift swift: fix HEADing 0-length objects when --swift-no-large-objects set 2023-08-03 08:38:39 +01:00
union union: add :writback to act as a simple cache 2023-09-04 12:03:26 +01:00
uptobox rclone config redacted: implement support mechanism for showing redacted config 2023-07-07 16:25:14 +01:00
webdav webdav: added an rclone vendor to work with rclone serve webdav 2023-11-05 12:37:25 +00:00
yandex yandex: fix 400 Bad Request on transfer failure 2023-06-11 11:11:43 +01:00
zoho zoho: remove Range requests workarounds to fix integration tests 2023-09-05 18:21:15 +01:00