Nick Craig-Wood
ae9f8304fa
Attempt to make async buffer test more reliable
2017-05-24 16:24:06 +01:00
Nick Craig-Wood
e0ba1a2cd2
ftp: fix bitrot
2017-05-18 20:49:36 +01:00
Antonio Messina
c72fca2711
Add ftp backend - fixes #540
2017-05-18 20:49:36 +01:00
Nick Craig-Wood
50e79bc087
fs: Implement fs.Trace for tracing entry and exit of functions
2017-05-15 16:56:45 +01:00
Nick Craig-Wood
17633f5460
Require go1.6 for building rclone
...
This is required because google.golang.org/grpc needs it.
2017-05-11 17:07:49 +01:00
Yoni Jah
cdeeff988e
Added RepetableReader to fs. used in OneDrive with io.LimitedReader to display accurate speed
2017-05-02 22:31:05 +01:00
Hraban Luyat
66e8c1600e
Print password prompts to stderr
...
This makes rclone with encrypted config better suited for use in
pipelines. E.g.:
$ rclone lsl mydrive:Some/Dir | sort -k 4
If the password prompt ("Enter configuration password") is printed to
stdout, it will be swallowed by sort. By printing it to stderr, you
still see the prompt, without sacrificing compatibility with the unix
pipeline.
2017-04-22 09:38:39 +01:00
Nick Craig-Wood
bc25190fc7
Fix misleading log message with --dry-run - fixes #1309
2017-04-10 16:07:22 +01:00
marvwatson
4810aa65a4
Update references from HTTP to HTTPS where possible
2017-03-29 05:38:34 -07:00
Nick Craig-Wood
503cd84919
Start v1.36-DEV development
2017-03-18 11:30:59 +00:00
Nick Craig-Wood
118e26f8e2
Version v1.36
2017-03-18 11:16:43 +00:00
Nick Craig-Wood
9b07d32c02
onedrive, drive, amazonclouddrive: make sure we find the root
...
This fixes copyto copying things to the wrong place - fixes #1231
2017-03-16 09:42:49 +00:00
Nick Craig-Wood
99f7fe736a
onedrive: implement Move #197
2017-03-15 14:01:08 +00:00
Nick Craig-Wood
320c53eab0
Start Cat tests from 2 as onedrive doesn't support ranging from 1
...
This has been reported here: https://github.com/OneDrive/onedrive-api-docs/issues/543
2017-03-12 14:24:33 +00:00
Nick Craig-Wood
4d5b73df85
Fix TestListDirSorted eventual consistency listing problems
2017-03-12 14:00:22 +00:00
Nick Craig-Wood
b2a4ea9304
fs/buffer: Fix panic on concurrent Read/Close - fixes #1213
2017-03-06 19:22:17 +00:00
Nick Craig-Wood
10e532bce9
Fix --files-from with an empty file copying everything - fixes #1196
2017-03-04 10:12:54 +00:00
Nick Craig-Wood
4ab7e05e02
Fix MimeType propagation
...
In fs.Copy, don't wrap objects if possible, and if not, then add a
MimeType method into the wrapped object.
2017-03-04 10:10:55 +00:00
Nick Craig-Wood
79e3c67bbd
local, yandex, dropbox: fix NewObject suceeding on a directory #1079
...
Add tests to make it consistent across all remotes
2017-02-25 11:09:57 +00:00
Nick Craig-Wood
e2f0feef3c
Add debugging to print hash values on failed hash comparison
2017-02-23 11:23:19 +00:00
Nick Craig-Wood
e59dc81658
Stop --track-renames deleting case folded source files - fixes #1094
...
What was happening is that when Move was implemented as Copy + Delete,
MoveFile was seeing the files didn't need transferring (because they
were identical) then deleted the source.
The fix uses Move instead and patches onedrive to disallow a case
folded identical copy (which errors with 500 error)
2017-02-22 19:28:22 +00:00
Nick Craig-Wood
6b0f2ef4bd
Fix --delete-before deleting files on copy - fixes #1166
2017-02-22 13:17:38 +00:00
Hisham Zarka
b3a526814e
fix --ignore-checksum
2017-02-18 13:13:53 +04:00
Nick Craig-Wood
033d1eb7af
Refactor Account interface
2017-02-17 09:15:24 +00:00
Nick Craig-Wood
ac62ef430d
Prevent double closes on async buffer
2017-02-17 08:55:24 +00:00
Nick Craig-Wood
928be0f1fd
mount: fix seek with buffering to use correct interface
...
Stop pre-cache before seeking which stops lots of excess data transfer
2017-02-17 08:55:24 +00:00
Nick Craig-Wood
6f75290678
Make async buffering start slowly to improve seek performance
2017-02-17 08:26:14 +00:00
Nick Craig-Wood
f3c5745468
Add srcRemote and dstRemote parameters to DirMove #954
2017-02-16 17:42:37 +00:00
Nick Craig-Wood
dac4bb22d3
mount: Make include and exclude filters apply to mount - fixes #1060
2017-02-15 23:28:53 +00:00
Nick Craig-Wood
b52c80e85c
sync: don't update mod times if --dry-run set - fixes #1100
2017-02-15 23:09:44 +00:00
Nick Craig-Wood
f15c6b68b6
Re-add the async buffer on seek - fixes #1137
2017-02-15 22:54:21 +00:00
Nick Craig-Wood
3f778d70f7
Add sync.Pool to async reader
2017-02-15 22:37:58 +00:00
Nick Craig-Wood
7fa687b3e1
fs: Async buffer: use ReadFill to fill the chunks and increase to 1MB
2017-02-14 22:36:37 +00:00
Nick Craig-Wood
493da54113
Add --buffer-size parameter to control buffer size for copy
2017-02-14 22:36:37 +00:00
Nick Craig-Wood
541929258b
check: Add --download flag to check all the data, not just hashes
2017-02-13 10:48:26 +00:00
Nick Craig-Wood
7047c67a5e
sync: Fix log message containing <nil>
2017-02-13 09:23:21 +00:00
Nick Craig-Wood
01c747e7db
Add cryptcheck command to check integrity of crypt remotes #1102
2017-02-12 16:30:18 +00:00
Nick Craig-Wood
666dae4229
Add --syslog flag to optionally log to syslog on capable platforms
2017-02-11 20:27:46 +00:00
Nick Craig-Wood
ac1c041377
Redo log level flags
...
* -vv or --log-level DEBUG
* -v or --log-level INFO
* --log-level NOTICE (default)
* -q --log-level ERROR
Replace Config.Verbose and Config.Quiet with Config.LogLevel
Fixes #739 Fixes #1108 Fixes #1000
2017-02-11 20:22:42 +00:00
Nick Craig-Wood
0366ea39c5
Reassign some logging levels
2017-02-11 17:56:05 +00:00
Nick Craig-Wood
80f53176d9
Rename log functions and factor into own file
2017-02-11 17:54:50 +00:00
Nick Craig-Wood
50e190ff54
cat: don't allocate buffers if not needed to reduce memory usage
2017-02-09 11:46:53 +00:00
Nick Craig-Wood
dd20a297d6
cat: Fix go routine leak
2017-02-09 11:25:36 +00:00
Nick Craig-Wood
c0ad29c06c
Clarify logging and docs for --no-traverse incompatibilities - fixes #1059
2017-02-08 22:35:12 +00:00
Nick Craig-Wood
d091d4a8bb
rclone cat: add --head, --tail, --offset, --count and --discard
...
Fixes #819
2017-02-08 08:09:41 +00:00
Nick Craig-Wood
48cdedc97b
Re-implement sync routine to work a directory at a time
...
Multiple directories (up to --checkers worth) are scanned at once.
This uses much less memory than the previous scheme - only the amount
of memory needed to hold an entire directory listing of objects.
For directory based remotes the speed is unchanged.
For bucket based remotes, instead of doing one API call to list the
whole bucket, it does multiple calls, one for each pseudo directory.
However these are done in parallel so in practice this seems to speed
up directory listings.
This replaces the existing sync method as it performs faster and uses
less memory.
The old sync method is available with the temporary --old-sync-method
flag.
Fixes #517
Fixes #439
Fixes #236
Fixes #1067
2017-02-04 10:30:25 +00:00
Nick Craig-Wood
7c6cd3a9e1
Make --delete-after the default and refactor --delete-{before,during,after} parsing
2017-02-04 10:30:25 +00:00
Nick Craig-Wood
bcdd73369f
Ignore --delete-before with --track-renames
2017-02-04 10:30:25 +00:00
Nick Craig-Wood
86bec20b56
sync: factor accumulating the rename checks
2017-02-04 10:30:25 +00:00
Nick Craig-Wood
c3b2b89473
Add ListDirSorted function to list a directory
...
* fix error return of readFilesFn also
2017-02-04 10:30:25 +00:00