Commit Graph

8416 Commits

Author SHA1 Message Date
Nick Craig-Wood
a34bf2ae5e Make imports absolute and use own copy of goamz pending patch inclusion 2013-07-11 17:37:33 +01:00
Nick Craig-Wood
90738f4081 More notes 2013-07-11 17:36:53 +01:00
Nick Craig-Wood
754c54b64f Fix differences print out on check 2013-07-02 08:33:17 +01:00
Nick Craig-Wood
7153b05342 Note that drive goroutine leak now fixed upstream (by my patch :-) 2013-06-29 21:13:30 +01:00
Nick Craig-Wood
43be26d1f8 Make local filesystem go last 2013-06-29 12:15:55 +01:00
Nick Craig-Wood
b98923a20f drive: Finish refactor 2013-06-29 12:15:31 +01:00
Nick Craig-Wood
025e5f3f0c Pass flags on to fs.Config 2013-06-29 10:43:52 +01:00
Nick Craig-Wood
37d59db94e Rename _junk directory so go build ./... doesn't see into it 2013-06-29 10:43:20 +01:00
Nick Craig-Wood
f1a08ad6bf Namespace the swift options 2013-06-28 18:24:06 +01:00
Nick Craig-Wood
b1f681b912 Rename fs.FsX to fs.X 2013-06-28 08:57:32 +01:00
Nick Craig-Wood
6085dc1b5a Refactor into sub filesystems 2013-06-27 22:17:51 +01:00
Nick Craig-Wood
2bca3a45bd Retire chtimes except for !go1.1 now it is in the standard library 2013-06-27 20:09:40 +01:00
Nick Craig-Wood
f5e60b6e37 Rename to rclone 2013-06-27 20:09:40 +01:00
Nick Craig-Wood
fce2af7934 go fmt 1.1 style 2013-06-27 20:06:44 +01:00
Nick Craig-Wood
b8c191b51c swift: Store root for later when we support directories 2013-06-27 19:49:35 +01:00
Nick Craig-Wood
717a0d268b Fix after goamz interface change 2013-06-27 19:46:31 +01:00
Nick Craig-Wood
4cda51b77a Update after API changes in goamz/s3 2013-02-06 23:31:42 +00:00
Nick Craig-Wood
4cce906f8b Implement fs.ListDir / lsd command 2013-01-23 22:43:20 +00:00
Nick Craig-Wood
8404290499 drive: add full directory listing option for speed
* Add -drive-full-list flag to choose between recursive and full directory list
  * Full list is the default - much quicker if there are lots of directories
2013-01-23 21:19:26 +00:00
Nick Craig-Wood
351829e9fe drive: refactor listDir to take a client function 2013-01-20 11:56:56 +00:00
Nick Craig-Wood
98108caac2 drive: remove files.Info from FsObjectDrive and copy data out to save memory 2013-01-19 10:16:51 +00:00
Nick Craig-Wood
f8246b5a7e Implement Precision interface in all filesystems
* drive: add mime type on upload
  * drive: correct info on upload to fix crash
  * local: measure time precision by making a local file and using Chtimes
  * swift: move snet parameter here
  * core: add -modify-window and compute the optimum one
  * core: use modify window when checking times
2013-01-19 10:16:51 +00:00
Nick Craig-Wood
b41367856b Update docs 2013-01-18 18:54:19 +00:00
Nick Craig-Wood
6e732f3dc0 Implement Purger interface and drive.Purge 2013-01-18 17:11:44 +00:00
Nick Craig-Wood
a0a789ff0f Fix after go vet 2013-01-18 17:11:44 +00:00
Nick Craig-Wood
fdb1ec4d53 Implement Google Drive interface
* needs writeup of rather complicated api key setup
  * not implemented yet
    * fix for slow directory listing
    * mimetypes for files
2013-01-18 17:11:22 +00:00
Nick Craig-Wood
90a397c533 Stop sync creating FsObjects unecessarily when they have been created by List already 2013-01-14 23:08:10 +00:00
Nick Craig-Wood
8b066ba77c Don't delete files if errors in copy phase of sync
Make check return errors on differences
2013-01-10 22:14:23 +00:00
Nick Craig-Wood
555ab5001e Factor Put() methods into generic Copy() function 2013-01-10 21:58:46 +00:00
Nick Craig-Wood
38ce4c3629 S3: Fix mkdir not to error if bucket exists and implement SetModTime 2013-01-08 22:31:16 +00:00
Nick Craig-Wood
b9e468ebbd Add initial S3 support
* Requires a patched goamz to enable metadata reading and writing
  * Still todo: updating metadata
  * EU region not working yet
2013-01-08 18:59:38 +00:00
Nick Craig-Wood
f7197c30d7 Implement stats counting and reporting and return errors in return code 2013-01-03 22:50:00 +00:00
Nick Craig-Wood
12015b0007 Run ls in parallel so can parallelise the slow ModTime operations 2013-01-02 15:34:25 +00:00
Nick Craig-Wood
ecb863dd4f Make ModTime fall back to LastModified header
Which means it no longer needs to report an error which simplifies the code
2013-01-02 15:21:55 +00:00
Nick Craig-Wood
90a2c86eb3 Implement check and help commands 2012-12-31 17:32:11 +00:00
Nick Craig-Wood
335667fdcb Implement sync, -dry-run and fix logging
* Implement sync command
  * Implement String() interface for Fs
  * Sort out logging of FsObject~s
  * Implement -dry-run, -verbose and -quiet
2012-12-31 16:40:34 +00:00
Nick Craig-Wood
c15ae179ee Detect Fs from path to make operations consistent everywhere 2012-12-29 11:35:41 +00:00
Nick Craig-Wood
4028a4192f Use swift.ObjectsWalk 2012-12-28 16:38:51 +00:00
Nick Craig-Wood
555e545b46 Fix after go vet 2012-12-26 12:27:26 +00:00
Nick Craig-Wood
3bf6348f57 Factor local filesystem and remote swift into Fs and FsObject interfaces
This will enable
  * local -> local and remote -> remote copies
  * a much more uniform style
  * could do s3 as well
2012-12-26 12:23:58 +00:00
Nick Craig-Wood
12658efef2 gofmt 2012-12-24 00:03:18 +00:00
Nick Craig-Wood
c3671907cb Update notes 2012-12-23 17:46:03 +00:00
Nick Craig-Wood
720d44f8e9 Delete many files at once with purge 2012-12-23 09:49:49 +00:00
Nick Craig-Wood
a5ecd66388 Remove commented out code 2012-12-23 09:34:29 +00:00
Nick Craig-Wood
9a066460f1 Make downloads work in parallel 2012-12-23 09:32:33 +00:00
Nick Craig-Wood
9fb8a1afa2 Implement purge and make upload make the container first 2012-12-04 00:09:22 +00:00
Nick Craig-Wood
664dbdc9e7 Make the commands data driven 2012-12-03 23:58:17 +00:00
Nick Craig-Wood
19668ac18f Fix loss of precision for setting timestamps so roundtrip happens properly 2012-12-01 12:05:17 +00:00
Nick Craig-Wood
25a1b96537 Make download work properly skipping not changed files
Reorganise FsObject and factor more stuff into methods

Note that os.Chtimes() isn't setting the same precision (us) as we are
reading from os.Lstat() (ns) so the modification times don't roundtrip
properly yet.
2012-12-01 10:53:48 +00:00
Nick Craig-Wood
a3e28e6b97 Fix downloads - missing is the modified check so it downloads everything 2012-12-01 08:18:58 +00:00