github-mirror/rclone
2
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-11-25 08:38:54 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
6,380 Commits 178 Branches 113 Tags 275 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
a875320e37
Go to file
Nick Craig-Wood a875320e37 sync,operations: optimise --copy-dest and --compare-dest 
Before this change --compare-dest and --copy-dest would check to see
if the compare/copy object existed first, before seeing if the
destination object was present.

This is inefficient, because in most --copy-dest syncs the destination
will be present and the compare/copy object need never be tested.
--compare-dest syncs may also be speeded up if they are done to the
same directory repeatedly.

This fixes the problem by re-arranging the logic so if the transfer is
not needed then the compare/copy object is never tested.

See: https://forum.rclone.org/t/union-with-copy-dest-enabled-is-slower-than-expected/32172
2022-08-03 17:44:47 +01:00
.github build: fix android build after GitHub actions change 2022-08-03 17:22:35 +01:00
backend dropbox: fix infinite loop on uploading a corrupted file 2022-07-29 17:40:05 +01:00
bin new backend: hidrive - fixes #1069 2022-07-08 18:24:54 +01:00
cmd sync: update docs and error messages to reflect fixes to overlap checks 2022-07-13 16:04:53 +01:00
cmdtest test: use T.TempDir to create temporary test directory 2022-02-01 11:47:04 +00:00
contrib serve/docker: build docker plugin for multiple platforms #5668 2021-10-21 13:01:23 +03:00
docs Add Jordi Gonzalez Muñoz to contributors 2022-07-20 23:07:02 +01:00
fs sync,operations: optimise --copy-dest and --compare-dest 2022-08-03 17:44:47 +01:00
fstest new backend: hidrive - fixes #1069 2022-07-08 18:24:54 +01:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib pacer: add ZeroDelayCalculator 2022-07-08 18:24:54 +01:00
librclone build: fix formatting after golangci-lint update 2022-08-03 10:11:16 +01:00
vfs vfs: add --vfs-disk-space-total-size option to manually set the total disk space 2022-07-08 17:26:54 +01:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore chunker: fix md5all test for no-meta test remotes 2021-10-18 18:04:07 +03:00
.golangci.yml Revert "build: disable revive linter pending a fix in golangci-lint" 2022-08-03 13:14:51 +01:00
CONTRIBUTING.md Remove github.com/pkg/errors and replace with std library version 2021-11-07 11:53:30 +00:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile build: add an rclone user to the Docker image but don't use it by default 2021-02-11 17:45:44 +00:00
go.mod go mod tidy: github.com/pkg/xattr should be direct 2022-07-04 11:24:59 +02:00
go.sum selfupdate: replace deprecated x/crypto/openpgp package with ProtonMail/go-crypto 2022-07-04 11:24:59 +02:00
MAINTAINERS.md storj: rename tardigrade backend to storj backend #5616 2022-02-11 11:04:15 +00:00
Makefile Configurable version suffix independent of version number 2022-05-17 12:10:01 +01:00
MANUAL.html Version v1.59.0 2022-07-09 18:09:25 +01:00
MANUAL.md Version v1.59.0 2022-07-09 18:09:25 +01:00
MANUAL.txt Version v1.59.0 2022-07-09 18:09:25 +01:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 Version v1.59.0 2022-07-09 18:09:25 +01:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md new backend: hidrive - fixes #1069 2022-07-08 18:24:54 +01:00
RELEASE.md build: more docs on upgrading dependencies 2021-11-10 10:34:56 +00:00
VERSION Start v1.60.0-DEV development 2022-07-09 20:43:17 +01:00

README.md

rclone logo
rclone logo

Website |
Documentation |
Download |
Contributing |
Changelog |
Installation |
Forum

Build Status
Go Report Card
GoDoc
Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDAV/FTP/SFTP/DLNA

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of the MIT license (check the
COPYING file included in this package).