Nick Craig-Wood
94950258a4
fs: allow backends to be named using their Name or Prefix #2449
...
This means that, for example Google Cloud Storage can be known as
`:gcs:bucket` on the command line, as well as `:google cloud
storage:bucket`.
2018-08-26 17:59:31 +01:00
Nick Craig-Wood
8656bd2bb0
fs: Allow on the fly remotes with :backend: syntax - fixes #2449
...
This change allows remotes to be created on the fly without a config
file by using the remote type prefixed with a : as the remote name, Eg
:s3: to make an s3 remote.
This assumes the user is supplying the backend config via command line
flags or environment variables.
2018-08-26 17:59:31 +01:00
Nick Craig-Wood
174ca22936
mount,cmount: clip the number of blocks to 2^32-1 on macOS
...
OSX FUSE only supports 32 bit number of blocks which means that block
counts have been wrapping. This causes f_bavail to be 0 which in turn
causes problems with programs like borg backup.
Fixes #2356
2018-08-26 17:32:59 +01:00
Nick Craig-Wood
4eefd05dcf
version: print the release and beta versions with --check - Fixes #2348
2018-08-26 17:28:28 +01:00
Nick Craig-Wood
1cccfa7331
cmd: Make --progress work on Windows
2018-08-26 17:20:38 +01:00
Nick Craig-Wood
18685e6b0b
vendor: add github.com/Azure/go-ansiterm for --progress on Windows support
2018-08-26 17:20:38 +01:00
Nick Craig-Wood
b6db90cc32
cmd: add --progress/-P flag to show progress
...
Fixes #2347
Fixes #1210
2018-08-26 17:20:38 +01:00
Nick Craig-Wood
b596ccdf0f
build: update to use go1.11 for the build
...
Also select latest patch release for go using 1.yy.x feature in travis
2018-08-26 15:26:44 +01:00
Nick Craig-Wood
a64e0922b9
vendor: update github.com/ncw/swift to fix server side copy bug
2018-08-26 15:03:19 +01:00
sandeepkru
3751ceebdd
azureblob: Added blob tier feature, a new configuration of azureblob-access-tier
...
is added to tier blobs between Hot, Cool and Archive. Addresses #2901
2018-08-21 21:52:45 +01:00
Nick Craig-Wood
9f671c5dd0
fs: fix tests for *SepList
2018-08-21 10:58:59 +01:00
Alex Chen
c6c74cb869
mountlib: fix mount --daemon not working with encrypted config - fixes #2473
...
This passes the configKey to the child process as an Obscured temporary file with an environment variable to the
2018-08-21 09:41:16 +01:00
Nick Craig-Wood
f9cf70e3aa
jottacloud: docs, fixes and tests for MD5 calculation
...
* Add docs for --jottacloud-md5-memory-limit
* Factor out readMD5 function and add tests
* Fix accounting
* Make sure temp file is deleted at the start (not Windows)
2018-08-21 08:57:53 +01:00
Oliver Heyme
ee4485a316
jottacloud: calculate missing MD5s - fixes #2462
...
If an MD5 can't be found on the source then this streams the object
into memory or on disk to calculate it.
2018-08-21 08:57:53 +01:00
Nick Craig-Wood
455219f501
crypt: fix accounting when checking hashes on upload
...
In e52ecba295
2018-08-21 08:57:53 +01:00
Nick Craig-Wood
1b8f4b616c
fs: move CommaSepList and SpaceSepList here from config
...
fs can't import config so having them there means they are not usable
by rclone core.
2018-08-20 17:52:05 +01:00
Fabian Möller
f818df52b8
config: add List type
2018-08-20 17:38:51 +01:00
Cnly
29fa840d3a
onedrive: Add back the check for DirMover interface
2018-08-20 17:31:28 +01:00
Nick Craig-Wood
7712a0e111
fs/asyncreader: skip some tests to work around race detector bug
...
The race detector currently detects a race with len(chan) against
close(chan).
See: https://github.com/golang/go/issues/27070
Skip the tests which trip this bug under the race detector.
2018-08-20 12:34:29 +01:00
Nick Craig-Wood
77806494c8
mount,cmount: adapt to sdnotify API change
2018-08-20 12:34:29 +01:00
Nick Craig-Wood
ff8de59d2b
vendor: update minimum number of packages so compile with go1.11 works
2018-08-20 12:34:29 +01:00
Nick Craig-Wood
c19d1ae9a5
build: fix whitespace changes due to go1.11 gofmt changes
2018-08-20 12:26:06 +01:00
Nick Craig-Wood
64ecc2f587
build: use go1.11rc1 to make the beta releases
2018-08-20 12:26:06 +01:00
Nick Craig-Wood
7c911bf2d6
b2: fix app key support on upload to a bucket - fixes #2428
2018-08-18 19:05:32 +01:00
Nick Craig-Wood
41f709e13b
yandex: fix listing/deleting files in the root - fixes #2471
...
Before this change `rclone ls yandex:hello.txt` would fail whereas
`rclone ls yandex:/hello.txt` would succeed. Now they both succeed.
2018-08-18 12:12:19 +01:00
Nick Craig-Wood
6c5ccf26b1
vendor: update github.com/t3rm1n4l/go-mega to fix failed logins - fixes #2443
2018-08-18 11:46:25 +01:00
Fabian Möller
6dc5aa7454
docs: clearify buffer-size is per transfer/filehandle
2018-08-17 18:11:40 +01:00
Fabian Möller
552eb8e06b
vfs: try to seek buffer on read only files
2018-08-17 18:10:28 +01:00
Nick Craig-Wood
7d35b14138
Add Martin Polden to contributors
2018-08-17 18:08:48 +01:00
Martin Polden
6199b95b61
jottacloud: Handle empty time values
2018-08-17 18:08:29 +01:00
Oliver Heyme
040768383b
jottacloud: fix MD5 error check
2018-08-17 18:05:04 +01:00
Nick Craig-Wood
6390dec7db
fs/accounting: add --stats-one-line flag for single line stats
2018-08-17 17:58:00 +01:00
Nick Craig-Wood
80a3db34a8
fs/accounting: show the total progress of the sync in the stats #379
2018-08-17 17:58:00 +01:00
Nick Craig-Wood
cb7a461287
sync: add a buffer for checks, uploads and renames #379
...
--max-backlog controls the queue length.
Add statistics for the check/upload/rename queues.
This means that checking can complete before the uploads which will
give rclone the ability to show exactly what is outstanding.
2018-08-17 17:58:00 +01:00
Nick Craig-Wood
eb84b58d3c
webdav: Attempt to remove failed uploads
...
Some webdav backends (eg rclone serve webdav) leave behind half
written files on error. This causes the integration tests to
fail. Here we remove the file if it exists.
2018-08-16 16:00:30 +01:00
Nick Craig-Wood
58339a5cb6
fstests: In TestFsPutError reliably provoke test failure
...
This change to go1.11 causes the TestFsPutError test to fail
https://go-review.googlesource.com/c/go/+/114316
This is because it now passes the half written file to the backend
whereas it didn't previously because of the buffering.
In this commit the size of the data written was increased to 5k from
50 bytes to provoke the test failure under go1.10 also.
2018-08-16 15:52:15 +01:00
Nick Craig-Wood
751bfd456f
box: make --box-commit-retries flag defaulting to 100 - Fixes #2054
...
Sometimes it takes many more commit retries than expected to commit a
multipart file, so split this number into its own config variable and
default it to 100 which should always be enough.
2018-08-11 16:33:55 +01:00
Andres Alvarez
990919f268
Add disclaimer about generated passwords being stored in an obscured format
2018-08-11 15:07:50 +01:00
Nick Craig-Wood
6301e15b79
Add Sebastian Bünger to contributors
2018-08-10 11:15:04 +01:00
Sebastian Bünger
007c7757d4
Add docs for Jottacloud
2018-08-10 11:14:34 +01:00
Sebastian Bünger
dd3e912731
fs/OpenOptions: Make FixRangeOption clamp range to filesize.
2018-08-10 11:14:34 +01:00
Sebastian Bünger
10ed455777
New backend: Jottacloud
2018-08-10 11:14:34 +01:00
Nick Craig-Wood
05bec70c3e
Add Matt Tucker to contributors
2018-08-10 10:28:41 +01:00
Matt Tucker
c54f5a781e
Fix typo in Box documentation
2018-08-10 10:28:16 +01:00
Nick Craig-Wood
6156bc5806
cache: fix nil pointer deref - fixes #2448
2018-08-07 21:33:13 +01:00
Nick Craig-Wood
e979cd62c1
rc: fix formatting in docs
2018-08-07 21:05:21 +01:00
Nick Craig-Wood
687477b34d
rc: add core/stats and vfs/refresh to the docs
2018-08-07 20:58:00 +01:00
Nick Craig-Wood
40d383e223
Add reddi1 to contributors
2018-08-07 20:56:55 +01:00
reddi1
6bfdabab6d
rc: added core/stats to return the stats - fixes #2405
2018-08-07 20:56:40 +01:00
Nick Craig-Wood
f7c1c61dda
Add Andres Alvarez to contributors
2018-08-07 20:52:04 +01:00
