Too Much IO
ca017980a3
Add support for server side move operations
...
Depends on pull request at https://github.com/ncw/go-acd/pull/1
2016-11-11 18:05:24 +00:00
Nick Craig-Wood
4105da206a
b2: reauth the account while doing uploads too #825
...
Originally it was thought the upload URL expiring would provide 401
errors so it was excluded from reauth when doing uploads, but on
re-reading the docs and looking at this issue it seems that 401 errors
are only caused by the account token expiring and not the upload token
expiring.
We will refresh both the upload token and account token on a 401 error
while uploading, and just the account token when we get a 401 at any
other time.
2016-11-07 13:30:51 +00:00
Nick Craig-Wood
34e7ca90fc
Update go-acd vendor to fix error message - fixes #860
2016-11-07 10:20:26 +00:00
Nick Craig-Wood
687abe7803
Fix godep update
2016-11-06 14:50:52 +00:00
Nick Craig-Wood
9b1820a7ad
Update go-acd dependency
2016-11-06 14:26:12 +00:00
Nick Craig-Wood
5f320cc540
Add missing vendor files
2016-11-06 10:40:40 +00:00
Nick Craig-Wood
23b8f008e0
Add missing docs changes
2016-11-06 10:40:11 +00:00
Nick Craig-Wood
d95288175f
Version v1.34
2016-11-06 10:18:30 +00:00
Nick Craig-Wood
b83f7ac06b
Update dependencies pre release
2016-11-05 18:35:34 +00:00
Nick Craig-Wood
f7af730b50
Use a vendor directory for repeatable builds - fixes #816
...
This is using godep to manage the vendor directory.
2016-11-05 18:18:08 +00:00
Nick Craig-Wood
01be5bff02
Fix ogier/pflag vs spf13/pflag
2016-11-05 18:18:08 +00:00
Nick Craig-Wood
e825df6448
Fix Check on crypted file systems
2016-11-05 18:17:21 +00:00
Nick Craig-Wood
ff41b0d435
Improve error message when source remote isn't found in sync #848
2016-11-05 18:03:55 +00:00
Nick Craig-Wood
e162377ca3
acd: Simplify the wait options into a single --acd-upload-wait-per-gb - fixes #262
...
This means the feature can be disabled by setting the time to 0.
This also logs the HTTP status for analysis purposes.
Thanks Felix Bünemann for extensive testing and data collection.
2016-11-05 13:57:03 +00:00
Nick Craig-Wood
d1080d5456
crypt: fix panic on close after failed seek
2016-11-05 10:01:33 +00:00
Nick Craig-Wood
64b5a76bec
mount: detect and deal with seeking beyond end of file - fixes #828
2016-11-05 09:59:36 +00:00
Nick Craig-Wood
7cfb1bdc70
fuse: tests: create the directory before starting tests
2016-11-05 09:57:45 +00:00
Nick Craig-Wood
441951a93b
Stop removing failed upload to cloud storage remotes - fixes #559
...
We do remove a partially written file on local so we don't have
corrupted files lying around.
2016-11-04 21:34:25 +00:00
Nick Craig-Wood
154e91bb23
crypt: Fix data corruption caused by seeking - #828
...
The corruption was caused when the file was read to the end thus
setting io.EOF and returning the buffers to the pool. Seek reset the
EOF and carried on using the buffers that had been returned to the
pool thus causing corruption when other goroutines claimed the buffers
simultaneously.
Fix by resetting the buffer pointers to nil when released and claiming
new ones when seek resets EOF. Also added locking for Read and Seek
which shouldn't be run concurrently.
2016-11-03 22:55:05 +00:00
Nick Craig-Wood
cb40511807
s3: Allow command line to override acl (Thanks Radek Senfeld)
2016-11-03 21:05:30 +00:00
Nick Craig-Wood
452c68115f
acd: Add 502 Bad Gateway to list of errors we retry
2016-11-03 18:56:21 +00:00
Nick Craig-Wood
b35123ba48
Make -x/--one-file-system compile under Windows and add docs
2016-11-03 11:53:49 +00:00
Nick Craig-Wood
978e06a623
Add Durval Menezes to contributors
2016-11-03 11:53:49 +00:00
Durval Menezes
15c9fed60f
local: Implement -x/--one-file-system to stay on a single file system
2016-11-03 11:52:40 +00:00
Nick Craig-Wood
2302179237
acd: Fix overwriting a file with a zero length file
2016-11-02 16:39:55 +00:00
Nick Craig-Wood
318e335137
Remove Authorization:
headers from --dump-headers
output
...
Add in `--dump-auth` flag to put it back.
2016-11-02 15:53:43 +00:00
Nick Craig-Wood
11301a64fb
Add Felix Bünemann to contributors
2016-11-02 13:18:26 +00:00
Felix Bünemann
1c912de9cc
Fix ACD file size warning limit
...
The previous value of 50 GiB was too high, we need to use 50,000 MiB.
For detailed discusssion see issue #215 .
2016-11-02 13:15:35 +00:00
Nick Craig-Wood
d1759fdfa9
Add request ID to HTTP debugging to make it easier to trace concurrent flows
2016-10-31 12:01:28 +00:00
Nick Craig-Wood
c102bf28e3
Add Marco Paganini to contributors
2016-10-31 12:01:03 +00:00
Nick Craig-Wood
e65059e431
Fix non-windows/non-unix builds for bwlimit/SIGUSR2 feature and add a mutex
...
The race detector complained whenever SIGUSR2 was sent to rclone so
this adds a mutex to prevent concurrent access.
2016-10-30 19:20:16 +00:00
Nick Craig-Wood
5454f2abd0
Fix race in checkServerTime
2016-10-30 19:16:27 +00:00
Marco Paganini
cc4f5ba7ba
Add support to toggle bandwidth limits via SIGUSR2.
...
Sending rclone a SIGUSR2 signal will toggle the limiter between off and
the limit set with the --bwlimit command-line option.
2016-10-30 17:46:59 +00:00
Nick Craig-Wood
062616e4dd
mount: update code comments
2016-10-30 17:46:00 +00:00
Nick Craig-Wood
6846a1cc11
Add Tomasz Mazur to contributors
2016-10-27 12:14:33 +01:00
Tomasz Mazur
6fd5ef2d99
Update B2 docs with Data usage, and Crypt section
2016-10-27 12:11:51 +01:00
Nick Craig-Wood
87107413f5
fuse: add missing locking on filehandle read #823 #802
2016-10-27 09:57:52 +01:00
Nick Craig-Wood
5986953317
acd: Reset the headers on tempurl redirect #802
2016-10-26 18:42:41 +01:00
Nick Craig-Wood
9d2dd2c49a
crypt: Fix data corruption on seek
...
This was caused by failing to reset the internal buffer on seek so old
data was read first before the new data.
The unit tests didn't detect this because they were reading to the end
of the file to check integrity and thus emptying the internal buffer.
Both code and unit tests were fixed up.
2016-10-25 15:15:44 +01:00
Nick Craig-Wood
54d99d6ab2
Add a link to the forum in the issue template
2016-10-24 12:34:18 +01:00
Nick Craig-Wood
77b975d16f
Note Amazon Drive doesn't support uploads via FUSE yet
2016-10-23 21:46:48 +01:00
Nick Craig-Wood
c464cc6376
mount: fix alignment of 64 bit counter on ARM #813
2016-10-23 17:36:35 +01:00
Nick Craig-Wood
93e84403bb
Remove io.SeekStart and replace with 0 as it is go 1.7 only
2016-10-22 12:07:51 +01:00
Nick Craig-Wood
5b8327038a
acd: make upload timeouts scale by file size
...
Fixes #712
Fixes #262
2016-10-22 11:53:06 +01:00
Nick Craig-Wood
eba0a3633b
crypt: speed up repeated seeking - fixes #804
2016-10-21 10:03:16 +01:00
Nick Craig-Wood
de73063977
Fix output of crypt objects in logs
2016-10-20 17:46:51 +01:00
Nick Craig-Wood
eca9e8eb70
Update go to 1.7.3
2016-10-20 11:00:15 +01:00
Nick Craig-Wood
a4a44a41ae
acd: document non .com login process - fixes #781
2016-10-18 17:33:41 +01:00
Nick Craig-Wood
a02edb9e69
Add rclone mount --dir-cache-time to control caching of directory entries - fixes #680
2016-10-18 17:23:57 +01:00
Nick Craig-Wood
368cce93ff
Ignore files with control characters in the names - fixes #689
2016-10-18 15:24:29 +01:00