2012-12-29 19:35:41 +08:00
|
|
|
Todo
|
2013-01-19 01:01:47 +08:00
|
|
|
* Make a test suite which can run on all the given types of fs
|
2013-01-15 07:38:18 +08:00
|
|
|
* Copy should use the sync code as it is more efficient at directory listing
|
|
|
|
|
* Drive needs a modify window of 1ms
|
2013-01-09 02:53:35 +08:00
|
|
|
* Factor fses into own packages
|
|
|
|
|
* FIXME: ls without an argument for buckets/containers?
|
2013-01-01 01:31:19 +08:00
|
|
|
* FIXME: More -dry-run checks for object transfer
|
2013-01-09 06:31:16 +08:00
|
|
|
* Might be quicker to check md5sums first? for swift <-> swift certainly, and maybe for small files
|
2013-01-02 23:34:25 +08:00
|
|
|
* Ignoring the pseudo directories
|
|
|
|
|
* if object.PseudoDirectory {
|
|
|
|
|
* fmt.Printf("%9s %19s %s\n", "Directory", "-", fs.Remote())
|
2013-01-04 06:50:00 +08:00
|
|
|
* Make Account wrapper
|
|
|
|
|
* limit bandwidth for a pool of all individual connectinos
|
|
|
|
|
* do timeouts by setting a limit, seeing whether io has happened
|
|
|
|
|
and resetting it if it has
|
|
|
|
|
* make Account do progress meter
|
2013-01-01 00:40:34 +08:00
|
|
|
* Make logging controllable with flags (mostly done)
|
|
|
|
|
* -timeout: Make all timeouts be settable with command line parameters
|
2012-12-29 19:35:41 +08:00
|
|
|
* Check the locking in swift module!
|
|
|
|
|
* Windows paths? Do we need to translate / and \?
|
|
|
|
|
* Make a fs.Errorf and count errors and log them at a different level
|
2013-01-01 00:40:34 +08:00
|
|
|
* add -modify-window flag - fs should keep knowledge of resolution
|
2013-01-09 02:53:35 +08:00
|
|
|
* Add max object size to fs metadata - 5GB for swift, infinite for local, ? for s3
|
2012-12-29 19:35:41 +08:00
|
|
|
|
2013-01-15 07:38:18 +08:00
|
|
|
Drive
|
|
|
|
|
* Do we need the secrets or just the code? If just the code then
|
|
|
|
|
can make a web service which does the request on the clients
|
|
|
|
|
behalf so don't need to expose the client secrets
|
|
|
|
|
* Apparently we don't need -drive-client-id or -drive-client-secret once we have a token
|
|
|
|
|
* Make a cgi which we send the user to
|
|
|
|
|
* It has the client secrets
|
|
|
|
|
* It gets google to authenticate
|
|
|
|
|
* It receives the token back
|
|
|
|
|
* It displays the token to the user to paste in to the code
|
|
|
|
|
* Should be https really
|
|
|
|
|
|
2012-12-24 01:46:03 +08:00
|
|
|
Ideas
|
2013-01-09 02:53:35 +08:00
|
|
|
* could do encryption - put IV into metadata?
|
2012-12-29 19:35:41 +08:00
|
|
|
* optimise remote copy container to another container using remote
|
|
|
|
|
copy if local is same as remote
|
2012-12-24 01:46:03 +08:00
|
|
|
* Allow subpaths container:/sub/path
|
2012-12-29 19:35:41 +08:00
|
|
|
* look at auth from env in s3 module - add to swift?
|
2013-01-15 07:38:18 +08:00
|
|
|
* support
|
|
|
|
|
* sftp
|
|
|
|
|
* scp
|
|
|
|
|
* Google cloud storage: https://developers.google.com/storage/
|
|
|
|
|
* Google drive: https://developers.google.com/drive/
|
|
|
|
|
* rsync over ssh
|
|
|
|
|
* dropbox: https://github.com/nickoneill/go-dropbox (no MD5s)
|
2013-01-19 01:01:47 +08:00
|
|
|
* grive seems to have its secrets in the source code which would make things easier!
|
2013-01-15 07:38:18 +08:00
|
|
|
|
|
|
|
|
|
2012-11-30 06:13:58 +08:00
|
|
|
|
2012-12-01 16:18:58 +08:00
|
|
|
Need to make directory objects otherwise can't upload an empty directory
|
|
|
|
|
* Or could upload empty directories only?
|
2012-12-29 19:35:41 +08:00
|
|
|
* Can't purge a local filesystem because it leaves the directories behind
|
|
|
|
|
|
|
|
|
|
s3
|
2013-01-04 06:50:00 +08:00
|
|
|
* Can maybe set last modified?
|
|
|
|
|
* https://forums.aws.amazon.com/message.jspa?messageID=214062
|
|
|
|
|
* Otherwise can set metadata
|
|
|
|
|
* Returns etag and last modified in bucket list
|
2013-01-19 01:01:47 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
Bugs
|
|
|
|
|
|
|
|
|
|
local & drive need to delete directories
|
|
|
|
|
|
|
|
|
|
2013/01/18 16:31:32 Waiting for deletions to finish
|
|
|
|
|
2013/01/18 16:31:32 z3: FIXME Skipping directory
|
|
|
|
|
2013/01/18 16:31:32 z3/x: Deleted
|
|
|
|
|
2013/01/18 16:31:32 Deleting path
|
|
|
|
|
2013/01/18 16:31:32 Rmdir failed: remove z3: directory not empty
|
