2015-06-06 17:05:21 +08:00
|
|
|
---
|
|
|
|
|
title: "Bugs"
|
2015-06-06 21:33:08 +08:00
|
|
|
description: "Rclone Bugs and Limitations"
|
2015-06-06 17:05:21 +08:00
|
|
|
---
|
|
|
|
|
|
2019-08-04 18:43:10 +08:00
|
|
|
# Bugs and Limitations
|
2015-06-06 17:05:21 +08:00
|
|
|
|
2019-08-04 18:43:10 +08:00
|
|
|
## Limitations
|
2015-06-06 17:05:21 +08:00
|
|
|
|
2024-03-04 16:39:37 +08:00
|
|
|
### Directory timestamps aren't preserved on some backends
|
2015-06-06 17:05:21 +08:00
|
|
|
|
2024-03-04 16:39:37 +08:00
|
|
|
As of `v1.66`, rclone supports syncing directory modtimes, if the backend
|
|
|
|
|
supports it. Some backends do not support it -- see
|
|
|
|
|
[overview](https://rclone.org/overview/) for a complete list. Additionally, note
|
|
|
|
|
that empty directories are not synced by default (this can be enabled with
|
|
|
|
|
`--create-empty-src-dirs`.)
|
2015-06-06 21:33:08 +08:00
|
|
|
|
2020-08-04 04:51:52 +08:00
|
|
|
### Rclone struggles with millions of files in a directory/bucket
|
2015-06-06 21:33:08 +08:00
|
|
|
|
2020-08-04 04:51:52 +08:00
|
|
|
Currently rclone loads each directory/bucket entirely into memory before
|
|
|
|
|
using it. Since each rclone object takes 0.5k-1k of memory this can take
|
|
|
|
|
a very long time and use a large amount of memory.
|
2015-08-18 00:14:05 +08:00
|
|
|
|
2020-08-04 04:51:52 +08:00
|
|
|
Millions of files in a directory tends to occur on bucket-based remotes
|
|
|
|
|
(e.g. S3 buckets) since those remotes do not segregate subdirectories within
|
|
|
|
|
the bucket.
|
2019-08-04 18:43:10 +08:00
|
|
|
|
2021-11-04 19:50:43 +08:00
|
|
|
### Bucket-based remotes and folders
|
2019-08-04 18:43:10 +08:00
|
|
|
|
2021-11-04 19:50:43 +08:00
|
|
|
Bucket-based remotes (e.g. S3/GCS/Swift/B2) do not have a concept of
|
2019-08-04 18:43:10 +08:00
|
|
|
directories. Rclone therefore cannot create directories in them which
|
2021-11-04 19:50:43 +08:00
|
|
|
means that empty directories on a bucket-based remote will tend to
|
2019-08-04 18:43:10 +08:00
|
|
|
disappear.
|
|
|
|
|
|
|
|
|
|
Some software creates empty keys ending in `/` as directory markers.
|
|
|
|
|
Rclone doesn't do this as it potentially creates more objects and
|
2020-08-04 04:51:52 +08:00
|
|
|
costs more. This ability may be added in the future (probably via a
|
|
|
|
|
flag/option).
|
2019-08-04 18:43:10 +08:00
|
|
|
|
|
|
|
|
## Bugs
|
|
|
|
|
|
2019-09-14 01:39:23 +08:00
|
|
|
Bugs are stored in rclone's GitHub project:
|
2019-08-04 18:43:10 +08:00
|
|
|
|
|
|
|
|
* [Reported bugs](https://github.com/rclone/rclone/issues?q=is%3Aopen+is%3Aissue+label%3Abug)
|
|
|
|
|
* [Known issues](https://github.com/rclone/rclone/issues?q=is%3Aopen+is%3Aissue+milestone%3A%22Known+Problem%22)
|
2015-06-06 21:33:08 +08:00
|
|
|
|
