github-mirror/rclone
2
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2024-12-22 03:30:11 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
d8e07bfd8e
rclone/cmd/bisync/testdata/test_check_access/golden/test.log

117 lines
5.7 KiB
Plaintext
Raw Normal View History

bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(01) : test check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(02) : test initial bisync
(03) : bisync resync
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying unique Path2 files to Path1
bisync: optimize --resync performance -- partially addresses #5681 Before this change, --resync was handled in three steps, and needed to do a lot of unnecessary work to implement its own --ignore-existing logic, which also caused problems with unicode normalization, in addition to being pretty slow. After this change, it is refactored to produce the same result much more efficiently, by reducing the three steps to two and letting ci.IgnoreExisting do the work instead of reinventing the wheel. The behavior and sync order remain unchanged for now -- just faster (but see the ongoing lively discussions about potential future changes in #5681!)
2023-11-06 23:34:47 +08:00
INFO : - Path2 Resync is copying UNIQUE files to - Path1
INFO : - Path1 Resync is copying UNIQUE OR DIFFERING files to - Path2
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Resync updating listings
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(04) : test 1. see that check-access passes with the initial setup
(05) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: generate listings concurrently with march -- fixes #7332 Before this change, bisync needed to build a full listing for Path1, then a full listing for Path2, then compare them -- and each of those tasks needed to finish before the next one could start. In addition to being slow and inefficient, it also caused real problems if a file changed between the time bisync checked it on Path1 and the time it checked the corresponding file on Path2. This change solves these problems by listing both paths concurrently, using the same March infrastructure that check and sync use to traverse two directories in lock-step, optimized by Go's robust concurrency support. Listings should now be much faster, and any given path is now checked nearly-instantaneously on both sides, minimizing room for error. Further discussion: https://forum.rclone.org/t/bisync-bugs-and-feature-requests/37636#:~:text=4.%20Listings%20should%20alternate%20between%20paths%20to%20minimize%20errors
2023-10-07 18:33:43 +08:00
INFO : Building Path1 and Path2 listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1 checking for diffs
INFO : Path2 checking for diffs
INFO : Checking access health
INFO : Found 2 matching "RCLONE_TEST" files on both paths
INFO : No changes found
INFO : Updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(06) : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical.
(07) : delete-file {path2/}subdir/RCLONE_TEST
(08) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: generate listings concurrently with march -- fixes #7332 Before this change, bisync needed to build a full listing for Path1, then a full listing for Path2, then compare them -- and each of those tasks needed to finish before the next one could start. In addition to being slow and inefficient, it also caused real problems if a file changed between the time bisync checked it on Path1 and the time it checked the corresponding file on Path2. This change solves these problems by listing both paths concurrently, using the same March infrastructure that check and sync use to traverse two directories in lock-step, optimized by Go's robust concurrency support. Listings should now be much faster, and any given path is now checked nearly-instantaneously on both sides, minimizing room for error. Further discussion: https://forum.rclone.org/t/bisync-bugs-and-feature-requests/37636#:~:text=4.%20Listings%20should%20alternate%20between%20paths%20to%20minimize%20errors
2023-10-07 18:33:43 +08:00
INFO : Building Path1 and Path2 listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1 checking for diffs
INFO : Path2 checking for diffs
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : - Path2 File was deleted - subdir/RCLONE_TEST
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path2: 1 changes: 0 new, 0 newer, 0 older, 1 deleted
INFO : Checking access health
ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST
ERROR : Bisync critical error: check file check failed
ERROR : Bisync aborted. Must run --resync to recover.
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
Bisync error: bisync aborted
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(09) : copy-listings path2-missing
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(10) : test 3. put the path2 subdir RCLONE_TEST back, resync.
(11) : copy-file {path1/}subdir/RCLONE_TEST {path2/}
(12) : bisync resync
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying unique Path2 files to Path1
bisync: optimize --resync performance -- partially addresses #5681 Before this change, --resync was handled in three steps, and needed to do a lot of unnecessary work to implement its own --ignore-existing logic, which also caused problems with unicode normalization, in addition to being pretty slow. After this change, it is refactored to produce the same result much more efficiently, by reducing the three steps to two and letting ci.IgnoreExisting do the work instead of reinventing the wheel. The behavior and sync order remain unchanged for now -- just faster (but see the ongoing lively discussions about potential future changes in #5681!)
2023-11-06 23:34:47 +08:00
INFO : - Path2 Resync is copying UNIQUE files to - Path1
INFO : - Path1 Resync is copying UNIQUE OR DIFFERING files to - Path2
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Resync updating listings
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(13) : test 4. run sync with check-access. should pass.
(14) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: generate listings concurrently with march -- fixes #7332 Before this change, bisync needed to build a full listing for Path1, then a full listing for Path2, then compare them -- and each of those tasks needed to finish before the next one could start. In addition to being slow and inefficient, it also caused real problems if a file changed between the time bisync checked it on Path1 and the time it checked the corresponding file on Path2. This change solves these problems by listing both paths concurrently, using the same March infrastructure that check and sync use to traverse two directories in lock-step, optimized by Go's robust concurrency support. Listings should now be much faster, and any given path is now checked nearly-instantaneously on both sides, minimizing room for error. Further discussion: https://forum.rclone.org/t/bisync-bugs-and-feature-requests/37636#:~:text=4.%20Listings%20should%20alternate%20between%20paths%20to%20minimize%20errors
2023-10-07 18:33:43 +08:00
INFO : Building Path1 and Path2 listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1 checking for diffs
INFO : Path2 checking for diffs
INFO : Checking access health
INFO : Found 2 matching "RCLONE_TEST" files on both paths
INFO : No changes found
INFO : Updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(15) : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical.
(16) : delete-file {path1/}RCLONE_TEST
(17) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: generate listings concurrently with march -- fixes #7332 Before this change, bisync needed to build a full listing for Path1, then a full listing for Path2, then compare them -- and each of those tasks needed to finish before the next one could start. In addition to being slow and inefficient, it also caused real problems if a file changed between the time bisync checked it on Path1 and the time it checked the corresponding file on Path2. This change solves these problems by listing both paths concurrently, using the same March infrastructure that check and sync use to traverse two directories in lock-step, optimized by Go's robust concurrency support. Listings should now be much faster, and any given path is now checked nearly-instantaneously on both sides, minimizing room for error. Further discussion: https://forum.rclone.org/t/bisync-bugs-and-feature-requests/37636#:~:text=4.%20Listings%20should%20alternate%20between%20paths%20to%20minimize%20errors
2023-10-07 18:33:43 +08:00
INFO : Building Path1 and Path2 listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1 checking for diffs
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : - Path1 File was deleted - RCLONE_TEST
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1: 1 changes: 0 new, 0 newer, 0 older, 1 deleted
INFO : Path2 checking for diffs
INFO : Checking access health
ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
ERROR : -  Access test failed: Path2 file not found in Path1 - RCLONE_TEST
ERROR : Bisync critical error: check file check failed
ERROR : Bisync aborted. Must run --resync to recover.
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
Bisync error: bisync aborted
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(18) : copy-listings path1-missing
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(19) : test 6. run again. should fail critical due to missing listings.
(20) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: provide more info in critical error msgs
2023-11-11 13:34:41 +08:00
ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run
Tip: here are the filenames we were looking for. Do they exist?
Path1: {workdir/}{session}.path1.lst
Path2: {workdir/}{session}.path2.lst
Try running this command to inspect the work dir:
rclone lsl "{workdir}"
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
ERROR : Bisync aborted. Must run --resync to recover.
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
Bisync error: bisync aborted
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(21) : move-listings missing-listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(22) : test 7. run resync, which will copy the path2 top level back to path1.
(23) : bisync resync
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying unique Path2 files to Path1
bisync: optimize --resync performance -- partially addresses #5681 Before this change, --resync was handled in three steps, and needed to do a lot of unnecessary work to implement its own --ignore-existing logic, which also caused problems with unicode normalization, in addition to being pretty slow. After this change, it is refactored to produce the same result much more efficiently, by reducing the three steps to two and letting ci.IgnoreExisting do the work instead of reinventing the wheel. The behavior and sync order remain unchanged for now -- just faster (but see the ongoing lively discussions about potential future changes in #5681!)
2023-11-06 23:34:47 +08:00
INFO : - Path2 Resync is copying UNIQUE files to - Path1
INFO : - Path1 Resync is copying UNIQUE OR DIFFERING files to - Path2
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Resync updating listings
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
(24) : test 8. run sync with --check-access. should pass.
(25) : bisync check-access
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
bisync: generate listings concurrently with march -- fixes #7332 Before this change, bisync needed to build a full listing for Path1, then a full listing for Path2, then compare them -- and each of those tasks needed to finish before the next one could start. In addition to being slow and inefficient, it also caused real problems if a file changed between the time bisync checked it on Path1 and the time it checked the corresponding file on Path2. This change solves these problems by listing both paths concurrently, using the same March infrastructure that check and sync use to traverse two directories in lock-step, optimized by Go's robust concurrency support. Listings should now be much faster, and any given path is now checked nearly-instantaneously on both sides, minimizing room for error. Further discussion: https://forum.rclone.org/t/bisync-bugs-and-feature-requests/37636#:~:text=4.%20Listings%20should%20alternate%20between%20paths%20to%20minimize%20errors
2023-10-07 18:33:43 +08:00
INFO : Building Path1 and Path2 listings
bisync: test scenarios #5164 Co-authored-by: Chris Nelson <stuff@cjnaz.com>
2021-04-01 18:21:23 +08:00
INFO : Path1 checking for diffs
INFO : Path2 checking for diffs
INFO : Checking access health
INFO : Found 2 matching "RCLONE_TEST" files on both paths
INFO : No changes found
INFO : Updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
bisync: introduce terminal colors This introduces a few basic color codings to make the terminal output more readable (and more fun). Rclone's standard --color flag is supported. (AUTO|NEVER|ALWAYS) Only a few lines have colors right now -- more will probably be added in future versions.
2023-11-06 19:59:41 +08:00
INFO : Bisync successful
Reference in New Issue Copy Permalink