wuyu
ee9f987234
qingstor: Support hash md5 for upload object
...
* Using single object to uploaded when files less than or equal to 67108864 bytes
* Using multi-part object to uploaded when files large than 67108864 bytes, and
calculate MD5SUMS in the upload process
* For Mkdir and Rmdir, Add block to wait qingstor service sync status to
handling extreme cases that try to create a just deleted bucket or delete
a just created bucket etc
2017-08-31 16:41:08 +01:00
Nick Craig-Wood
f407e3da55
Add bpicode to contributors
2017-08-31 16:35:35 +01:00
bpicode
f1f7e0e6f9
support for zsh auto-completion - #983
2017-08-31 16:21:28 +01:00
Stefan Breunig
b78ecb1568
docs: add optional feature "streaming uploads" to overview table
2017-08-19 14:35:17 +02:00
Stefan Breunig
034cf22d4d
Add Alex McGrath Kraak to contributors
2017-08-17 06:49:38 +02:00
Nick Craig-Wood
9c47b767b4
swift: Configure from environment vars and add endpoint_type - fixes #1542
2017-08-10 21:38:45 +01:00
Nick Craig-Wood
ec2ea37ad2
fs: Add --disable flag to disable optional features - fixes #1551
...
Eg to disable server side copy use `--disable copy`, to see a list of
what you can disable, `--disable help`.
2017-08-07 21:34:45 +01:00
Nick Craig-Wood
d025066fae
Add Christian Brüggemann to contributors
2017-08-06 11:50:20 +01:00
Christian Brüggemann
80ce569874
sftp: Add support for md5 and sha1 hashes where available
2017-08-06 11:49:52 +01:00
Nick Craig-Wood
38dabcf6b2
azure: correct docs on MD5 and chunked files
2017-08-04 23:54:57 +01:00
Nick Craig-Wood
92d2e1f8d7
azureblob: rework and complete #801
...
* Fixup bitrot (rclone and Azure library)
* Implement Copy
* Add modtime to metadata under mtime key as RFC3339Nano
* Make multipart upload work
* Make it pass the integration tests
* Fix uploading of zero length blobs
* Rename to azureblob as it seems likely we will do azurefile
* Add docs
2017-08-04 22:56:16 +01:00
Nick Craig-Wood
98d238daa4
Add Andrei Dragomir to contributors
2017-08-04 22:56:16 +01:00
Nick Craig-Wood
8a185deefa
qingstor: Fixes before merge
...
* use rclone's http.Client for bwlimit, logging, etc
* remove extraneous fmt.Sprintf from logging
* fix icon in docs
* add docs about --fast-list
* hoist md5 regexp compilation out of function
* create container if necessary on server side copy
* keep note of whether the container has been deleted
* build constraint not to compile for plan9
2017-08-04 19:37:53 +01:00
Nick Craig-Wood
7b9557df90
Add wuyu to contributors
2017-08-04 19:37:53 +01:00
wuyu
ec5b72f8d5
Add new QingStor remote
...
Add new package qingstor to support QingStor API.
Add new unit test for its and tested through; But I commented
on some tests case because of some of the features of QingStor.
Add new docs for it.
2017-08-04 17:25:47 +01:00
Nick Craig-Wood
eff10bbc1d
Add Oliver Heyme to contributors
2017-08-03 20:01:05 +01:00
Nick Craig-Wood
c3cd247d4b
Document --dump-bodies using lots of memory - fixes #1516
2017-07-30 10:02:14 +01:00
Nick Craig-Wood
a56d51c594
Add Andy Pilate to contributors
2017-07-27 21:18:37 +01:00
Andy Pilate
49e4cdb8b9
Added information about Drive server copies limits
2017-07-27 21:17:24 +01:00
Stefan Breunig
ee52365e88
doc: add FAQ entry for "tcp lookup no such host" - fixes #683
2017-07-27 18:20:25 +02:00
Nick Craig-Wood
9f24639568
Add --bind flag for choosing the local addr on outgoing connections - fixes #1087
...
Supported by all remotes except FTP.
2017-07-23 16:27:39 +01:00
Nick Craig-Wood
c507836617
Add Zhiming Wang to contributors
2017-07-23 15:02:19 +01:00
Zhiming Wang
6152bab28d
local: add --skip-links to suppress symlink warnings
...
Give users a way to explicitly acknowledge that symlinks are to be skipped
without warnings.
Fixes #1480 .
2017-07-23 15:02:02 +01:00
Nick Craig-Wood
859721f3cf
Add John Papandriopoulos to contributors
2017-07-23 13:05:02 +01:00
John Papandriopoulos
d134d78979
b2: add --b2-hard-delete to permanently delete instead of hide files - Fixes #1547
2017-07-23 13:02:42 +01:00
Nick Craig-Wood
7b81f12dad
box: add docs
...
* reorder remotes so they are in alphabetical order by full name everywhere
* update CONTRIBUTING doc
2017-07-23 11:32:34 +01:00
Nick Craig-Wood
a73ecec11f
Version v1.37
2017-07-22 20:04:29 +01:00
Nick Craig-Wood
39d09c04a2
drive: Make --drive-trashed-only show all directories - fixes #1524
...
Without showing all directories it doesn't show trashed files which
are in an untrashed directory.
This isn't an ideal fix, but it makes the feature useable.
2017-07-22 10:03:27 +01:00
Stefan Breunig
db5494b316
document SIGUSR2 to toggle bandwidth limiter ( fixes #1424 )
2017-07-22 10:49:45 +02:00
Stefan Breunig
c3dab09a94
add Yaroslav Halchenko to contributors
2017-07-22 10:28:12 +02:00
Yaroslav Halchenko
3ddcbce989
DOC: any empty directoryies -> empty directories ( fixes #1546 )
2017-07-22 10:24:41 +02:00
Nick Craig-Wood
78f33f5d6e
Add gdm85 to contributors
2017-07-18 15:16:17 +01:00
gdm85
209b7da3b2
gcs: Add ability to specify location and storage class via config and command line
...
* Add gcs-location and gcs-storage-class options for Google Cloud Storage
* Added config options (same as S3)
* Updated configuration example in documentation for Google Cloud Storage
2017-07-18 15:15:29 +01:00
Nick Craig-Wood
6f71260acf
Add --tpslimit and --tpslimit-burst to limit transactions per second for HTTP
...
This is useful if you are being rate limited or banned by your cloud
storage provider.
2017-07-16 17:25:39 +01:00
Nick Craig-Wood
b5002eb6a4
drive: document google docs sometimes fail to download
2017-07-10 23:15:30 +01:00
Nick Craig-Wood
ee5698b3a9
drive: Add docs on duplicated files, and re-copying
2017-07-09 23:32:34 +01:00
Nick Craig-Wood
92294a4a92
drive: Add --drive-trashed-only and remove obsolete --drive-full-list
...
* Add --drive-trashed-only to show only the contents of the trash
* Remove --drive-full-list as it is obsolete
* Tidy the docs for the drive options
2017-07-06 15:32:57 +01:00
sainaen
d7811f72ad
Clarify how 'move' may use server side copying
2017-06-26 22:54:14 +01:00
Nick Craig-Wood
aa20486485
Add --stats-log-level so can see --stats without -v - fixes #1180
...
The most common use for this flag is likely to be showing the stats
without using -v by using `--stats-log-level NOTICE`.
2017-06-26 22:50:37 +01:00
Nick Craig-Wood
33f302a06b
Document workaround for files/dirs with : in - fixes #1331
2017-06-26 16:13:12 +01:00
Nick Craig-Wood
24cb739d1f
b2: reduce minimum chunk size to 5MB - fixes #1289
2017-06-26 16:02:46 +01:00
Nick Craig-Wood
f0abd6173d
Add Harshavardhana and sainaen to contributors
2017-06-26 12:37:00 +01:00
sainaen
a308ad5bd7
Fix typos and punctuation in the 'docs.md'
...
* Add commas to introductory phrases ('However', 'First', 'For example')
* Consistently capitalize provider names
* Fix some typos ('bandwith', 'integriTIty', etc.)
2017-06-26 12:35:20 +01:00
Nick Craig-Wood
d55f8f0492
sftp: add support for using ssh key files #1494
...
Update docs about macOS and ssh-agent #1218
2017-06-23 16:25:35 +01:00
Nick Craig-Wood
d981456ddc
Add Vasiliy Tolstov to contributors
2017-06-20 21:27:14 +01:00
Nick Craig-Wood
b22c4c4307
http: fix, tidy and rework ready for release
...
* Fix remaining problems
* Refactor to make testing easier and add a test suite
* Make path parsing more robust.
* Add single file operations
* Add MimeType reading for objects
* Add documentation
* Note go1.7+ is required to build
2017-06-20 21:27:14 +01:00
Harshavardhana
8d77e48190
Minio supports ETags and metadata.
...
Current doc mentioned lack of ETag and metadata
support which since has been long fixed in many
upstream Minio releases.
Also cleanup the doc to show new startup banner etc.
2017-06-20 08:21:02 +01:00
Nick Craig-Wood
bbbc202ee6
Add ftp.md to docs builder and update docs
2017-06-15 20:12:26 +01:00
Edward Q. Bridges
9876ba53f8
Updated permissions
...
As it happens, after testing the `GetObject` permission is also required to do `HEAD` requests on a given object.
2017-06-14 17:29:21 +01:00
Nick Craig-Wood
50928a5027
Implement --fast-list flag.
...
This is supported remotes which can do a recursive listing. It will
use more memory.
This is related to #1277 but doesn't fix that issue yet.
2017-06-14 16:49:40 +01:00
Nick Craig-Wood
10d5377ed8
acd: remove revoked credentials, allow oauth proxy config and update docs
2017-06-10 12:02:34 +01:00
Nick Craig-Wood
a5cfdfd233
drive: add team drive support - fixes #885
2017-06-04 22:38:29 +01:00
Nick Craig-Wood
e92cc8fe2b
Add Edward Q. Bridges to contributors
2017-06-04 22:38:10 +01:00
Edward Q. Bridges
6ee4c62cae
Add section on required IAM permissions.
...
cf.: https://github.com/ncw/rclone/issues/1455
2017-06-04 22:37:17 +01:00
Nick Craig-Wood
7693cecd17
Add Fabian Möller to contributors
2017-06-01 16:23:48 +01:00
Nick Craig-Wood
48508cb5b7
Add Ruwbin to contributors
2017-06-01 09:03:56 +01:00
Ruwbin
44c98e8654
fix docs typos
2017-06-01 09:03:19 +01:00
Nick Craig-Wood
6381959850
dropbox: support Dropbox content hashing scheme - fixes #1302
...
* add support to hashing module
* add dbhashsum to list the hashes
* add support to dropbox module
This means objects up and downloaded to/from Dropbox will have their
hashes checked.
Note after this change local objects are calculating MD5, SHA1 and
DBHASH which is excessive and needs to be fixed.
2017-05-29 12:04:44 +01:00
Nick Craig-Wood
8e214e838e
dropbox: Update dropbox to use the v2 API #349
...
This is feature complete with the old version but now supports modification times.
2017-05-29 12:04:33 +01:00
Nick Craig-Wood
5455d34f8c
Fix ssh agent on Windows - fixes #1279
2017-05-26 10:21:07 +01:00
Sjur Fredriksen
ade61fa756
Updated FTP to follow SFTP standards, updated documentation
2017-05-25 09:30:15 +01:00
Nick Craig-Wood
55755a8e5b
Add Sjur Fredriksen to contributors
2017-05-24 15:59:49 +01:00
Sjur Fredriksen
080050fac2
Update ftp.md
...
Added information regarding non-standard FTP ports.
2017-05-24 15:59:18 +01:00
Nick Craig-Wood
e75db0b14d
Add Steven Lu to contributors
2017-05-24 08:44:42 +01:00
Nick Craig-Wood
be5b8b8dff
Add Bob Potter to contributors
2017-05-24 07:36:38 +01:00
Bob Potter
525220b14e
Add --local-no-unicode-normalization flag
...
Fixes #1411
2017-05-24 07:36:06 +01:00
Nick Craig-Wood
cdacf026e4
ftp: implement server side move and directory move
2017-05-18 20:49:36 +01:00
Nick Craig-Wood
9627a6142d
ftp: support --contimeout
2017-05-18 20:49:36 +01:00
Nick Craig-Wood
35c210d36f
ftp: fix remaining issues to make tests work
...
* fix root
* factor ftpConnection
* fix path munging
* fix recursive dir loops after update
* use fs.Trace and comment out debugs
* re-arrange and supplement docs
2017-05-18 20:49:36 +01:00
Antonio Messina
c72fca2711
Add ftp backend - fixes #540
2017-05-18 20:49:36 +01:00
Nick Craig-Wood
ae17d88518
Add Bill Zissimopoulos to contributors
2017-05-18 20:48:47 +01:00
Nick Craig-Wood
7ee3cfd7c9
Add Igor Kharin to contributors
2017-05-15 21:03:16 +01:00
Nick Craig-Wood
17633f5460
Require go1.6 for building rclone
...
This is required because google.golang.org/grpc needs it.
2017-05-11 17:07:49 +01:00
Nick Craig-Wood
d86ea8623b
Add Yoni Jah second email to contributors
2017-05-02 22:54:11 +01:00
Nick Craig-Wood
d5c0fe632f
Add Zahiar Ahmed to contributors
2017-05-02 22:16:16 +01:00
Nick Craig-Wood
1ccfea5aa9
Add Anisse Astier to contributors
2017-04-25 08:08:33 +01:00
Anisse Astier
7e858f4b8d
dropbox: typo
...
dropbix -> dropbox.
2017-04-25 08:07:37 +01:00
Nick Craig-Wood
a9a43144ca
Add Too Much IO to contributors
2017-04-24 20:33:51 +01:00
Nick Craig-Wood
7d9faffd4b
Add Martin Kristensen to contributors
2017-04-23 17:03:20 +01:00
Nick Craig-Wood
733d6fe56c
Add Michael Ledin to contributors
2017-04-22 10:24:33 +01:00
Nick Craig-Wood
6a63bc2788
Add Hraban Luyat to contributors
2017-04-22 09:39:46 +01:00
Nick Craig-Wood
b86bbcd67e
Add Jon Craton to contributors
2017-04-22 09:22:51 +01:00
Jon Craton
38b6d607aa
fixed typo
2017-04-22 09:21:44 +01:00
Nick Craig-Wood
2b8c461e04
Add Ihor Dvoretskyi to contributors
2017-03-29 18:12:13 +01:00
Ihor Dvoretskyi
a54692d165
OneDrive vs One Drive
...
It's better to call this service as it's officially named.
2017-03-29 18:11:33 +01:00
Nick Craig-Wood
81d688107e
Add Stephen Harris to contributors
2017-03-29 17:57:03 +01:00
Stephen Harris
6e003934fc
crypt: add an "obfuscate" option for filename encryption.
...
This is a simple "rotate" of the filename, with each file having a rot
distance based on the filename. We store the distance at the beginning
of the filename. So a file called "go" would become "37.KS".
This is not a strong encryption of filenames, but it should stop automated
scanning tools from picking up on filename patterns. As such it's an
intermediate between "off" and "standard". The advantage is that it
allows for longer path segment names.
We use the nameKey as an additional input to calculate the obfuscation
distance. This should mean that two different passwords will result
in two different keys
The obfuscation rotation works by splitting the ranges up and handle cases
0-9
A-Za-z
0xA0-0xFF
and anything greater in blocks of 256
2017-03-29 17:56:55 +01:00
Nick Craig-Wood
d1787b50fd
Yoni Jah to contributors
2017-03-29 17:38:14 +01:00
Nick Craig-Wood
9ab4c19945
Add Danny Tsai to contributors
2017-03-29 17:26:03 +01:00
Nick Craig-Wood
1fdf3e2aae
Add Marvin Watson to contributors
2017-03-29 17:12:17 +01:00
marvwatson
4810aa65a4
Update references from HTTP to HTTPS where possible
2017-03-29 05:38:34 -07:00
Nick Craig-Wood
f798552cf1
Update urls to https after site move
2017-03-29 10:06:22 +01:00
Nick Craig-Wood
216499d78b
Add Mike Tesch to authors
2017-03-19 08:26:41 +00:00
Mike Tesch
60f636ee15
Fix spelling of Unfortunately
2017-03-18 20:22:19 -04:00
Nick Craig-Wood
f0bf117a04
Add Jérôme Vizcaino to authors
2017-03-18 21:24:05 +00:00
Nick Craig-Wood
503cd84919
Start v1.36-DEV development
2017-03-18 11:30:59 +00:00
Nick Craig-Wood
118e26f8e2
Version v1.36
2017-03-18 11:16:43 +00:00
Nick Craig-Wood
99f7fe736a
onedrive: implement Move #197
2017-03-15 14:01:08 +00:00
Nick Craig-Wood
e80d8db417
Fix typo in option name
2017-03-13 12:51:01 +00:00
Nick Craig-Wood
e88623e3c8
Add cryptcheck and obscure to docs
2017-03-05 10:19:22 +00:00
Nick Craig-Wood
4652db34a4
Update config docs - fixes #1174
2017-03-05 10:14:57 +00:00
Nick Craig-Wood
0ce34be41d
Fix bulleted list doc formatting errors - fixes #1170
2017-03-02 15:07:25 +00:00
Nick Craig-Wood
6bad0ad9c4
Fix installation instructions to install in /usr/bin not /usr/sbin
2017-02-26 10:09:23 +00:00
Nick Craig-Wood
f40443359d
Fix exit code docs - fixes #1169
2017-02-22 18:00:56 +00:00
Nick Craig-Wood
ee70b99143
Add Hisham Zarka to contributors
2017-02-18 11:42:26 +00:00
Nick Craig-Wood
1d7f95da8e
Support MIPS big and little endian - fixes #849
2017-02-17 19:11:08 +00:00
Nick Craig-Wood
2b1695e09b
Add Dedsec1 to contributors
2017-02-16 22:22:47 +00:00
Dedsec1
6fc114d681
Create Ubuntu snap for rclone #1120
2017-02-15 09:56:55 +00:00
Nick Craig-Wood
493da54113
Add --buffer-size parameter to control buffer size for copy
2017-02-14 22:36:37 +00:00
Nick Craig-Wood
18c75a81f9
Add notes on cryptcheck and backups to crypt docs
2017-02-12 16:49:31 +00:00
Nick Craig-Wood
f87a694d10
Make donation page easier to find and add bitcoin address
2017-02-11 23:03:05 +00:00
Nick Craig-Wood
4d28b5ed22
Update list of commands in docs.
2017-02-11 20:27:46 +00:00
Nick Craig-Wood
666dae4229
Add --syslog flag to optionally log to syslog on capable platforms
2017-02-11 20:27:46 +00:00
Nick Craig-Wood
ac1c041377
Redo log level flags
...
* -vv or --log-level DEBUG
* -v or --log-level INFO
* --log-level NOTICE (default)
* -q --log-level ERROR
Replace Config.Verbose and Config.Quiet with Config.LogLevel
Fixes #739 Fixes #1108 Fixes #1000
2017-02-11 20:22:42 +00:00
Nick Craig-Wood
c0ad29c06c
Clarify logging and docs for --no-traverse incompatibilities - fixes #1059
2017-02-08 22:35:12 +00:00
Nick Craig-Wood
7c6cd3a9e1
Make --delete-after the default and refactor --delete-{before,during,after} parsing
2017-02-04 10:30:25 +00:00
Nick Craig-Wood
726cb43be9
Complete SFTP remote #521
...
* Add unit tests
* Fix up remote so it passes tests
* Add docs
2017-02-04 10:29:46 +00:00
Nick Craig-Wood
609671aabc
Add Jack Schmidt to contributors
2017-02-04 10:29:46 +00:00
Nick Craig-Wood
9d331ce04b
Implement --ignore-checksum flag
...
Fixes #793 Fixes #863 Fixes #981
2017-02-03 08:11:10 +00:00
Nick Craig-Wood
f11867d810
Add Jon Yergatian to contributors
2017-02-02 21:14:24 +00:00
Nick Craig-Wood
ff8f11d79c
Add Károly Oláh to contributors
2017-01-29 20:55:21 +00:00
okaresz
cbc113492a
Add Drive specific option: --drive-skip-gdocs - fixes #1035
2017-01-29 20:53:51 +00:00
Nick Craig-Wood
94947f2523
Implement -L, --copy-links flag to allow rclone to follow symlinks
...
Fixes #40
2017-01-29 13:43:20 +00:00
Nick Craig-Wood
390f3cf35b
crypt: Add --crypt-show-mapping to show encrypted file mapping
...
Fixes #1004
2017-01-29 10:14:17 +00:00
Nick Craig-Wood
8068ef96b6
Add Dario Giovannetti to contributors
2017-01-26 10:29:21 +00:00
Dario Giovannetti
9d36258923
Comply with XDG Base Directory specification
...
Fixes #868
2017-01-26 10:22:08 +00:00
Nick Craig-Wood
e2bf9eb8e9
Implement --suffix for use with --backup-dir only #98
...
This also makes sure we remove files we are about to override in the
--backup-dir properly.
2017-01-19 20:11:17 +00:00
Nick Craig-Wood
07ebf35987
Clarify what happens to files already in the --backup-dir DIR
2017-01-16 19:26:56 +00:00
ncw
3745c526f1
Implement --backup-dir - fixes #98
...
The parameter of backup-dir specifies a remote that all deleted or
overwritten files will be copied to.
2017-01-16 17:33:25 +00:00
Nick Craig-Wood
45862f4c16
Add Brandur to contributors
2017-01-12 10:08:40 +00:00
Nick Craig-Wood
a7d8ccd265
Add T.C. Ferguson to contributors
2017-01-10 13:22:51 +00:00
Nick Craig-Wood
e426cb1d1a
Add emyarod to contributors
2017-01-10 13:13:14 +00:00
emyarod
3c87a0d0dc
Update remote docs to show correct setup process
2017-01-10 13:09:52 +00:00
0xJAKE
499766f6ab
Update amazonclouddrive.md
...
Added details about Amazon Drive's latest trash retention policy.
See:
https://www.reddit.com/r/DataHoarder/comments/5dh96j/files_in_amazon_cloud_drive_trash_now_deleted/
https://www.amazon.com/gp/help/customer/display.html?nodeId=201376760
2017-01-08 10:24:03 -06:00
Nick Craig-Wood
341745d4d5
Update docs on server side copy
2017-01-05 21:11:46 +00:00
Nick Craig-Wood
e1a49ca426
Document environment variable usage
2017-01-04 21:38:54 +00:00
Marco Paganini
3b0f944e23
Add time-based bandwidth limits.
...
- Change the --bwlimit command line parameter to accept both a limit (as
before) or a full timetable (formatted as "hh:mm,limit
hh:mm,limit...")
- The timetable is checked once a minute by a ticker function. A new
tokenBucket is created every time a bandwidth change is necessary.
- This change is compatible with the SIGUSR2 change to toggle bandwidth
limits.
This resolves #221 .
2017-01-03 21:00:38 +00:00
Nick Craig-Wood
aaeab58ce6
Add Lukas Loesche to contributors
2017-01-03 20:49:04 +00:00
Lukas Loesche
5894c02a34
Typo: the the -> the in docs and comments
2017-01-03 20:48:26 +00:00
Nick Craig-Wood
f1221b510b
Change --track-renames to use the length,hash pair stored in a map
...
This makes it much faster in the case of many files and use less
memory.
This also detects use of --no-traverse and disables it.
2017-01-03 20:37:06 +00:00
Nick Craig-Wood
274ab349f4
sync: Only allow --track-renames if have a common hash
2017-01-03 20:35:05 +00:00
Nick Craig-Wood
86392fb800
Add Bjørn Erik Pedersen to contributors
2017-01-03 20:35:05 +00:00
Bjørn Erik Pedersen
adc156ab2a
docs: Document track-renames option
...
See #888
2017-01-03 20:35:05 +00:00
Nick Craig-Wood
5b8b379feb
Version v1.35
2017-01-02 15:33:06 +00:00
Nick Craig-Wood
43c530922a
Restore ability for any command to show stats by adding --stats flag
...
Make default for `mount` command not to show stats - this can be
re-enabled by adding a `--stats` parameter.
2016-12-15 17:40:17 +00:00
Nick Craig-Wood
4e809c951d
acd: Note that Move and DirMove are now supported - fixes #122
2016-12-14 17:45:20 +00:00
Nick Craig-Wood
7392cd1a1a
Add section on how to set RCLONE_CONFIG_PASS from a script
2016-12-12 12:33:43 +00:00
Nick Craig-Wood
d911bf3889
Add links to the forum in the main pages
2016-12-08 10:42:42 +00:00
Nick Craig-Wood
dcf53a1d12
Allows multiple --include/--exclude/--filter options - fixes #875
2016-12-07 13:37:40 +00:00
Nick Craig-Wood
651db36674
Add Scott McGillivray to authors
2016-11-28 12:18:30 +00:00