Nick Craig-Wood
5433021e8b
drive: fix server side copy of big files
...
Before this change rclone was sending a MimeType in the requests for
server side Move and Copy.
The conjecture is that if you attempt to set the MimeType to something
different in a Copy then Google Drive has to do an actual copy of the
file data. This takes a very long time (since it is large) and fails
after a 90s timeout.
After the change we no longer set the MimeType in Move or Copy and the
copies happen instantly and correctly.
Many thanks to @darthShadow for discovering that this was causing the
problem.
Fixes #3070
Fixes #3033
Fixes #3300
Fixes #3155
2019-07-05 10:49:19 +01:00
Nick Craig-Wood
c9f77719e4
b2: enable server side copy to copy between buckets - fixes #3303
2019-07-05 10:07:05 +01:00
Nick Craig-Wood
3cd63a00be
googlephotos: fix configuration walkthrough
2019-07-04 15:19:59 +01:00
Nick Craig-Wood
d7016866e0
googlephotos: fix creation of duplicated albums
...
Also make sure we don't list the albums twice
2019-07-04 13:45:52 +01:00
yparitcher
d72e4105fb
b2: Fix link sharing #3314
2019-07-04 11:53:59 +01:00
yparitcher
b4266da4eb
sync: fix SyncSuffix tests #3272
2019-07-03 17:36:22 +01:00
yparitcher
3f5767b94e
b2: Implement link sharing #2178
2019-07-03 14:10:25 +01:00
Nick Craig-Wood
1510e12659
build: move race test to go modules build
...
In an attempt to even out the build times.
2019-07-03 12:07:29 +01:00
Nick Craig-Wood
ede03258bc
build: use go modules proxy when building modules
2019-07-03 12:07:29 +01:00
Nick Craig-Wood
7fcbb47b1c
build: split other OS build into a separate builder
...
This is in order to make longest build (the Linux build) quicker
2019-07-03 12:07:29 +01:00
Nick Craig-Wood
9cafeeb4b6
dirtree: make tests more reliable
2019-07-02 16:29:40 +01:00
Nick Craig-Wood
a1cfe61ffd
googlephotos: Backend for accessing Google Photos #369
2019-07-02 15:26:55 +01:00
Nick Craig-Wood
5eebbaaac4
test_all: add tests
parameter to limit which tests to run for a backend
2019-07-02 15:26:55 +01:00
Nick Craig-Wood
bc70bff125
fs/dirtree: factor DirTree out of fs/walk and add tests
2019-07-02 15:26:55 +01:00
Nick Craig-Wood
cf15b88efa
build: make explicit which matrix items we will deploy
2019-07-02 14:13:46 +01:00
Nick Craig-Wood
dcaee0016a
build: add a builder for building with go modules
2019-07-02 12:33:03 +01:00
Nick Craig-Wood
387b496d1e
operations: fix tests TestMoveFileBackupDir and TestCopyFileBackupDir again
...
Commit 734f504d5f
wasn't tested properly and had a typo which
caused it not to build :-(
2019-07-02 12:22:29 +01:00
Nick Craig-Wood
734f504d5f
operations: fix tests TestMoveFileBackupDir and TestCopyFileBackupDir
...
..so they don't run on backends which can't move or copy.
2019-07-02 10:46:49 +01:00
Dan Dascalescu
7153909390
docs: fix typo in google drive docs
2019-07-02 10:10:08 +01:00
Russell Davis
ea35e807db
docs: clarify --update
and --use-server-mod-time
...
It's likely a mistake to use `--use-server-modtime` if you're not also using `--update`. It might even make sense to emit a warning in the code when doing this, but for now, I made it more clear in the docs.
I also clarified how `--use-server-modtime` can be useful in the `--update` section.
2019-07-02 10:09:03 +01:00
Nick Craig-Wood
5df5a3b78e
vendor: tidy go.mod and go.sum - fixes #3317
2019-07-02 09:47:00 +01:00
Nick Craig-Wood
37c1144b46
Add Russell Davis to contributors
2019-07-02 07:57:18 +01:00
Nick Craig-Wood
8d116ba0c9
Add Matti Niemenmaa to contributors
2019-07-02 07:57:18 +01:00
Russell Davis
6a3c3d9b89
Update docs on S3 policy to include ListAllMyBuckets permission
...
This permission is required for `rclone lsd`.
2019-07-02 07:56:54 +01:00
Matti Niemenmaa
a6dca4c13f
s3: Add INTELLIGENT_TIERING storage class
...
For Intelligent-Tiering:
https://aws.amazon.com/s3/storage-classes/#Unknown_or_changing_access
2019-07-01 18:17:48 +01:00
Aleksandar Jankovic
cc0800a72e
march: return errors when listing dirs
...
Partially fixes #3172
2019-07-01 15:32:46 +01:00
Nick Craig-Wood
1be1fc073e
Add AbelThar to contributors
2019-07-01 12:09:35 +01:00
AbelThar
70c6b01f54
fs: Higher units for ETA - fixes #3221
2019-07-01 12:09:19 +01:00
Aleksandar Jankovic
7b2b396d37
context: fix errgroup interaction with context
...
Fixes #3307
2019-07-01 11:51:51 +01:00
Nick Craig-Wood
af2596f98b
Add yparitcher to contributors
2019-07-01 11:13:53 +01:00
Nick Craig-Wood
61fb326a80
Add full name for Laura Hausmann
2019-07-01 10:53:47 +01:00
yparitcher
de14378734
Implement --suffix without --backup-dir for current dir
...
Fixes #2801
2019-07-01 10:46:26 +01:00
yparitcher
eea1b6de32
Abstract --Backup-dir checks so can be applied across Sync, Copy, Move
2019-07-01 10:46:26 +01:00
Nick Craig-Wood
6bae3595a8
Add Laura to contributors
2019-06-30 20:07:35 +01:00
Laura
dde4dd0198
fichier: 1fichier support - fixes #2908
...
This was started by Fionera, finished off by Laura with fixes and more
docs from Nick.
Co-authored-by: Fionera <fionera@fionera.de>
Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2019-06-30 18:35:01 +01:00
Laura
2d0e9885bd
vendor: add jzelinskie/whirlpool
2019-06-30 18:35:01 +01:00
Nick Craig-Wood
9ed81ac451
vfs: fix tests for backends which can't upload 0 length files
2019-06-30 18:35:01 +01:00
Nick Craig-Wood
3245c0ae0d
fstests: add integration test for uploading empty files
...
This tests a remote can upload empty files. If the remote can't
upload empty files it should return fs.ErrorCantUploadEmptyFiles.
2019-06-30 18:35:01 +01:00
Laura
6ff7b2eaab
fs: add fs.ErrorCantUploadEmptyFiles
...
Any backends which can't upload 0 length files should return this
errror.
2019-06-30 18:11:45 +01:00
Laura
38ebdf54be
sync/operations: don't use zero length files in tests
...
We now have a backend (fichier) which doesn't support 0 length
files. Therefore all 0 length files in the tests have been replaced
with length 1.
In a future commit we will implement a test for 0 length files.
2019-06-30 18:11:45 +01:00
Fionera
6cd7c3b774
lib/rest: Calculate correct Content-Length on MultiPart Uploads
...
This is used in the pcloud backend and in the upcoming 1fichier backend.
2019-06-30 17:57:22 +01:00
Nick Craig-Wood
07e2c3a50f
b2: fix nil pointer error introduced by context propagation patch
...
For some reason f78cd1e043
introduced an unrelated change -
perhaps a merge error. Removing this change fixes the nil pointer
problem.
2019-06-28 22:38:41 +01:00
Jon Fautley
cd762f04b8
sftp: Completely ignore all modtime checks if SetModTime=false
2019-06-28 10:33:14 +01:00
Sandeep
6907242cae
azureblob: Updated config help details to remove connection string references ( #3306 )
2019-06-27 18:53:33 -07:00
Nick Craig-Wood
d61ba7ef78
vendor: update all dependencies
2019-06-27 13:52:32 +01:00
Nick Craig-Wood
b221d79273
Add nguyenhuuluan434 to contributors
2019-06-27 13:28:52 +01:00
nguyenhuuluan434
940d88b695
refactor code
2019-06-27 13:28:35 +01:00
nguyenhuuluan434
ca324b5084
trying to capture segments info during upload to swift backend and
...
delete if there is error duing upload object.
2019-06-27 13:28:35 +01:00
Nick Craig-Wood
9f4589a997
gcs: reduce oauth scope requested as suggested by Google
...
As part of getting the rclone oauth consent screen approved by Google,
it came up that the scope in use by the gcs backend was too large.
This change reduces it to the minimum scope which still allows rclone
to work correctly.
Old scope: https://www.googleapis.com/auth/devstorage.full_control
New scope: https://www.googleapis.com/auth/devstorage.read_write
2019-06-27 12:05:49 +01:00
Sandeep
fc44eb4093
Azure Storage Emulator support ( #3285 )
...
* azureblob - Add support for Azure Storage Emulator to test things locally.
Testing - Verified changes by testing manually.
* docs: update azureblob docs to reflect support of storage emulator
2019-06-26 20:46:22 -07:00