Nick Craig-Wood
dc247d21ff
s3: add in config for all the supported S3 providers #2140
...
These are AWS, Ceph, Dreamhost, IBM COS S3, Minio, Wasabi and Other.
This configures endpoints where known and makes sure config doesn't
appear where it isn't valid where possible.
2018-04-13 16:33:26 +01:00
Giri Badanahatti
acd5d4377e
config,s3: hierarchical configuration support #2140
...
This introduces a method of making provider specific configuration
within a remote. This is useful particularly in s3.
This commit does the basic configuration in S3 for IBM COS.
2018-04-13 16:05:35 +01:00
Craig Rachel
0e6faa2313
s3: add One Zone Infrequent Access storage class - fixes #2240
2018-04-13 13:36:25 +01:00
Peter Baumgartner
1db68571fd
s3,swift: Add --use-server-modtime
...
`--use-server-modtime` stops s3 and swift retrieving the modtime from metadata which enables a fast sync mode with the `--update` flag.
2018-04-13 13:32:17 +01:00
Nick Craig-Wood
92c5aa3786
s3: add --s3-chunk-size option - fixes #2203
2018-04-05 15:40:08 +01:00
gbadanahatti
e5aa5fe7d8
s3: docs: Minor format and URL changes to IBM COS Documentation content
2018-03-26 20:49:53 +01:00
Nick Craig-Wood
e62fe06763
s3: document --ignore-checksum workaround for KMS #1824
2018-03-17 10:51:45 +00:00
Giri Badanahatti
aba43cd3a4
Documention for IBM COS (S3) configuration.
2018-03-15 20:20:43 +00:00
Nick Craig-Wood
89748feaa5
s3: update docs to discourage use of v2 auth - fixes #2120
...
From testing it appears that CEPH no longer works properly with v2
auth and neither does Dreamhost, so update the docs anc configuration
to recommend v4 auth.
2018-03-13 20:47:29 +00:00
Chris Redekop
4dd1e507f4
s3: set/get the hash for multipart files - #523
2018-01-06 14:30:10 +00:00
David Minor
4c116af1d0
s3: add support for ECS task IAM roles
...
ECS container IAM metadata is in a different place than EC2 IAM metadata.
Use defaults' RemoteCredProvider function to query the standard locations
for the credentials.
Give the ECS role precedence over the role available from the underlying
EC2 instance.
2017-11-23 08:56:56 +00:00
Corban Raun
a8dfc5ce3b
Fix spelling in some documentation
2017-11-05 21:38:59 +00:00
Andrew Starr-Bochicchio
e6fb96cfd4
Initial docs for usage with DigitalOcean Spaces.
2017-10-26 21:34:42 +01:00
Nick Craig-Wood
3e9861eecf
docs: improve links to cloud providers
2017-09-30 09:28:49 +01:00
Nick Craig-Wood
1d994f7330
s3: add Wasabi instructions
2017-09-30 09:00:56 +01:00
Girish Ramakrishnan
2f0551074c
s3: set session token when using STS
2017-09-12 22:59:29 +01:00
Jan Varho
5a1351f141
s3: Document glacier transitions and behavior
2017-09-12 09:27:32 +01:00
Harshavardhana
8d77e48190
Minio supports ETags and metadata.
...
Current doc mentioned lack of ETag and metadata
support which since has been long fixed in many
upstream Minio releases.
Also cleanup the doc to show new startup banner etc.
2017-06-20 08:21:02 +01:00
Edward Q. Bridges
9876ba53f8
Updated permissions
...
As it happens, after testing the `GetObject` permission is also required to do `HEAD` requests on a given object.
2017-06-14 17:29:21 +01:00
Nick Craig-Wood
50928a5027
Implement --fast-list flag.
...
This is supported remotes which can do a recursive listing. It will
use more memory.
This is related to #1277 but doesn't fix that issue yet.
2017-06-14 16:49:40 +01:00
Edward Q. Bridges
6ee4c62cae
Add section on required IAM permissions.
...
cf.: https://github.com/ncw/rclone/issues/1455
2017-06-04 22:37:17 +01:00
marvwatson
4810aa65a4
Update references from HTTP to HTTPS where possible
2017-03-29 05:38:34 -07:00
Nick Craig-Wood
4652db34a4
Update config docs - fixes #1174
2017-03-05 10:14:57 +00:00
emyarod
3c87a0d0dc
Update remote docs to show correct setup process
2017-01-10 13:09:52 +00:00
Radek Šenfeld
bc414b698d
Command line argument for setting/overriding Amazon S3 ACL
2016-10-13 17:45:11 +01:00
Asko Tamm
61665ddd10
s3: add support for setting storage class in config and command line
2016-09-13 19:49:44 +01:00
Radek Šenfeld
2003ba356b
User-configurable Amazon S3 ACL
...
fixes #413
2016-08-23 12:25:08 +01:00
Nick Craig-Wood
56adb52a21
Rename Amazon Cloud Drive to Amazon Drive - fixes #532
2016-07-11 12:42:44 +01:00
Nick Craig-Wood
8c2fc6daf8
s3: Add instructions on how to use rclone with minio
2016-07-11 12:12:28 +01:00
Justin R. Wilson
6e35a3b3ce
Add AES256 server-side encryption for s3 - Fixes #491
...
Add a configuration key and support for AES256 server-side encryption.
2016-06-18 14:28:38 +01:00
Nick Craig-Wood
377986d599
Update config walk throughs with new style choice menu
2016-02-21 13:40:16 +00:00
Nick Craig-Wood
a0b9bd527e
Add both forms of env var to the docs
2016-02-09 17:19:13 +00:00
Brian Stengaard
ce05ef7110
Add IAM role and Env credentials
...
This will make the s3 provider authentaction logic
- Configured credentials if both key and secret available
- Anonymous if key and secret missing and env_auth not set
- if env_auth is set to truthy (https://golang.org/pkg/strconv/#ParseBool )
- AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY environment variables
- IAM role credentials as fallback
2016-02-09 16:32:36 +00:00
Nick Craig-Wood
0ab3f020ab
Fix Amazon icon in the docs
2015-11-06 15:26:58 +00:00
Nick Craig-Wood
9f1daabb2c
s3: allow anonymous access to public repositories - fixes #154
...
When setting up the remote, leave both the access key and secret key
blank.
2015-10-03 16:04:21 +01:00
Nick Craig-Wood
f8b7eaec93
s3: Document cross region bucket limitations - fixes #105
2015-08-25 20:15:50 +01:00
Nick Craig-Wood
8140869767
s3: Update documentation after transition to new SDK - also fixes #47
2015-08-16 15:51:38 +01:00
Nick Craig-Wood
bf4879f57f
Expand docs and remove duplicated information
2015-06-06 14:17:14 +01:00
Nick Craig-Wood
07f9a1a9f0
Update docs for Dropbox and Google Cloud Storage
2014-07-18 10:10:08 +01:00
Nick Craig-Wood
580fa3a5a7
Documentation updates
2014-04-26 17:43:41 +01:00
Nick Craig-Wood
40f755df20
Rename docs directory
2014-04-17 22:32:39 +01:00
