rclone/docs/content
edwardxml 127f48e8ad docs: Rewrite rclone filtering documentation
This is an attempt at rewriting the rclone filter documentation page.

I have drawn largely from what appears to be the strong original
structure of the page; existing text, and forum comments.

The term flag is used throughout rather than differentiating `--`
options with more complex arguments. That diverges from some standard
practice but is consistent with messages in the rclone binary and `go`
documentation.

The term directory not folder is used throughout.

I tried referring to objects more broadly rather than files and it
just did not seem to work. Apart from a note at the top the
explanations refer entirely to paths, directories and files. My
justification is that bucket store users understand the concept of
files. Not all users of directory aware storage are so familiar with
objects, keys and metadata.

Many of the changes I have made involve moving issues into what seemed
to me to be more relevant parts of the original page structure. I
still find the content repetitious and overly long but that may be
inevitable when users can only be expected to read the section of the
page they think most relevant.

I have eliminated the rsync section from the original structure. It is
hard enough explaining how rclone filters work without also setting
out how they do not. Comment on sync is instead relegated to a
paragraph in the directory filter section.

The structure of the page is intended to work with a hugo toc card
from html Header2 to Header3.

My original intention was to establish a separate examples section. I
have instead retained examples in each section, added to them and
tried to make clear what is documentation and what example.

The changes draw on Github and Forum issues too numerous to mention.
for instance:

https://forum.rclone.org/t/certain-exclusion-flags-seem-to-be-ignored/20049/2

I am **especially** grateful for
https://forum.rclone.org/t/object-key-remote-directory-filter-clarification/20386/2
for making sense of directory filters for me.

@ncw has a fun (and useful) online filter app at
https://filterdemo.rclone.org/ I have not referred to it at this stage
though I particularly like the fact that it is tied to the same
codebase as an rclone version.

I have added cautions about mixing the `--filter...` flags with
`--exclude...` or `--include...`. The same issues seem to arise as
already recognised between the latter two.

The formal summary of glob syntax introduced at the top of the page is
shamelessly stolen from https://godoc.org/github.com/gobwas/glob

I have tried not to alter too many header descriptions and thereby
break existing links to them.

The reference to 'lass' in the example has been retained to confuse
all those not of Scottish or Yorkshire heritage.

Some of my activity was to remove ambiguity and I anticipate
suggestions to roll that back where it has become overly complex.

I tried particularly to bring together and make clear material about
directory filters. It was previously scattered throughout the page and
I couldn't understand it. I am particularly grateful for the
explanations I received about directory filters though any remaining
errors are entirely my own.

Removed erroneous references to non existent `--filter...` flags.

In some ways the best person to write this page would be one with no
knowledge whatsoever of how rclone filters work. The further I got
into it the better qualified I found myself to be.

E&OE
2021-01-22 16:59:22 +00:00
..
commands Add a download flag to hashsum and related commands to force rclone to download and hash files locally 2020-12-27 15:40:44 +00:00
_index.md HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
alias.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
amazonclouddrive.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
authors.md Add Sơn Trần-Nguyễn to contributors 2021-01-21 18:35:04 +00:00
azureblob.md azure-blob-storage: utilize streaming capabilities - #1614 2021-01-10 17:02:42 +00:00
b2.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
box.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
bugs.md docs: Cleaned up and corrected bugs docs verbiage 2020-09-02 11:53:52 +01:00
cache.md docs: spelling: etc. 2020-10-28 18:16:23 +00:00
changelog.md Changelog updates from Version v1.53.4 2021-01-20 22:34:04 +00:00
chunker.md chunker: fix case-insensitive NewObject, test metadata detection #4902 2021-01-10 22:29:24 +03:00
compress.md docs/compress: but a warning at the top 2021-01-18 21:42:58 +01:00
contact.md docs: remove manually set dates and use git dates instead 2020-06-01 13:07:46 +01:00
crypt.md crypt: docs: extended description 2021-01-21 13:40:12 +00:00
docs.md ftp,sftp: Make --tpslimit apply - fixes #4906 2021-01-08 10:29:57 +00:00
donate.md docs: remove manually set dates and use git dates instead 2020-06-01 13:07:46 +01:00
downloads.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
drive.md docs: spelling: etc. 2020-10-28 18:16:23 +00:00
dropbox.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
faq.md docs: fix typo in FAQ 2020-12-27 12:43:30 +00:00
fichier.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
filefabric.md filefabric: Implement the Enterprise File Fabric backend 2020-11-25 21:11:29 +00:00
filtering.md docs: Rewrite rclone filtering documentation 2021-01-22 16:59:22 +00:00
flags.md docs: grammar: if, then 2020-10-28 18:16:23 +00:00
ftp.md docs: update ftp with note about active mode 2021-01-21 13:21:31 +00:00
googlecloudstorage.md gcs: Storage class object header support - fixes #3043 2020-12-10 20:06:49 +00:00
googlephotos.md Fixed verbal tense 2020-11-29 17:32:49 +03:00
gui.md docs: remove manually set dates and use git dates instead 2020-06-01 13:07:46 +01:00
hdfs.md HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
http.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
hubic.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
install.md build: raise minimum go version to go1.12 2021-01-08 12:17:09 +00:00
install.sh doc: fix typos throughout docs 2020-05-19 12:02:44 +01:00
jottacloud.md jottacloud: Add support for Telia Cloud (#4930) 2021-01-17 02:38:57 +01:00
koofr.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
licence.md docs: remove manually set dates and use git dates instead 2020-06-01 13:07:46 +01:00
local.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
mailru.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
mega.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
memory.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
onedrive.md docs: Update Onedrive max file size limit 2021-01-21 09:50:48 +00:00
opendrive.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
overview.md HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
pcloud.md pcloud: only use SHA1 hashes in EU region 2020-11-25 20:46:38 +00:00
premiumizeme.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
privacy.md docs: workaround and policy for Google Drive API 2020-07-15 23:14:39 +01:00
putio.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
qingstor.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
rc.md docs: add an extra paragraph with links to rclone rc and the HTTP API 2020-12-11 10:58:59 +00:00
remote_setup.md docs: spelling: etc. 2020-10-28 18:16:23 +00:00
s3.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
seafile.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
sftp.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
sharefile.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
sugarsync.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
swift.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
tardigrade.md docs: update rclone about docs 2020-11-27 14:08:52 +00:00
union.md docs: fix references to upstreams in union example 2021-01-21 13:33:16 +00:00
webdav.md webdav: updated docs to show streaming to nextcloud is working 2020-11-27 16:57:43 +00:00
yandex.md docs: spelling: e.g. 2020-10-28 18:16:23 +00:00
zoho.md new backend: zoho workdrive - fixes #4533 2020-12-30 17:56:08 +00:00