Sam Saffron
4f296608da
FEATURE: add uploads:s3_migration_status for looking at current status
...
Also a few minor cleanups and better progress reporting
2019-05-22 09:00:32 +10:00
Vinoth Kannan
338b927f95
DEV: include local uploads while finding missing uploads
...
in rake task 'posts:missing_uploads'
2019-05-21 22:07:08 +05:30
Sam Saffron
f4d4f7871e
FEATURE: make posts:missing_uploads multisite friendly
...
Previously this rake job would only run on a single site which is a bit
misleading
This also adds `VERBOSE=1 rake posts:missing_uploads` that will provide a
full report of missing uploads
2019-05-21 12:45:51 +10:00
Vinoth Kannan
9f43852609
FIX: remove the unwanted code.
2019-05-20 19:10:21 +05:30
Sam Saffron
30990006a9
DEV: enable frozen string literal on all files
...
This reduces chances of errors where consumers of strings mutate inputs
and reduces memory usage of the app.
Test suite passes now, but there may be some stuff left, so we will run
a few sites on a branch prior to merging
2019-05-13 09:31:32 +08:00
Vinoth Kannan
87cd4701b8
FEATURE: option to skip posts with ignored missing uploads
2019-05-09 05:11:15 +05:30
Vinoth Kannan
e8fafbc123
List and restore missing post uploads from S3 inventory.
2019-05-04 01:16:20 +05:30
Vinoth Kannan
c448e014fe
Recover missing old scheme uploads from tombstone directory too.
2019-04-29 11:33:57 +05:30
Vinoth Kannan
8698a10920
Don't raise error if a record already exists.
2019-04-25 21:48:39 +05:30
Vinoth Kannan
a65ce81e25
Don't check same upload url twice in the rake task
2019-04-25 20:06:10 +05:30
Vinoth Kannan
1724c27713
FIX: reload the 'post' model to retrive raw field value.
2019-04-25 02:09:27 +05:30
Vinoth Kannan
aed683390c
FIX: Don't treat 'upload_patterns' as constant to make the rake task compatible with multisite
2019-04-25 02:06:20 +05:30
Vinoth Kannan
b0bb1d95a5
trying to recover old scheme uploads on 'posts:missing_uploads' rake task
2019-04-25 01:16:18 +05:30
Vinoth Kannan
3dae12dec1
reduce unlinked count from missing post upload count
2019-04-19 21:53:00 +05:30
Vinoth Kannan
4fcefc3615
add unlinked missing post upload count in stat
2019-04-19 20:39:21 +05:30
Vinoth Kannan
ba6369edc5
Add more missing upload stats in rake task
2019-04-19 20:14:40 +05:30
Vinoth Kannan
48cedf3ebe
fix: retrieve posts in order by id.
...
so we can find starting and ending id of the batch.
2019-04-19 18:30:59 +05:30
Vinoth Kannan
ce8d30f667
PERF: use 'delete_all' method instead of 'destroy_all'
2019-04-19 18:00:01 +05:30
Vinoth Kannan
5de483a1b9
PERF: Very post upload's existence by preloaded upload sha1s array
2019-04-19 17:27:16 +05:30
Vinoth Kannan
8d5c900142
DEV: add unique missing uploads index in post custom fields
...
https://review.discourse.org/t/feature-send-missing-post-uploads-stat-to-prometheus/2609/6?u=vinothkannans
2019-04-10 18:09:35 +05:30
Vinoth Kannan
d0fe42e2ef
FIX: should look through posts for image markdown
...
Downloaded onebox images only included in the cooked HTML content. So we have to check 'post.cooked' instead of 'raw'. bfdd0fe64c
2019-04-10 13:52:35 +05:30
Vinoth Kannan
4878ee95e5
DEV: optimize sql query to narrow down the filtering of post with uploads
2019-04-10 12:58:10 +05:30
Vinoth Kannan
bfdd0fe64c
FIX: empty the missing list on each post loop
2019-04-10 11:20:26 +05:30
Vinoth Kannan
914ada1c74
DEV: convert scheduled job EnsurePostUploadsExistence into a rake task
2019-04-09 02:07:35 +05:30
Gerhard Schlager
341836eb42
Fix the rake task and importer instead
2018-10-17 16:48:09 +02:00
Gerhard Schlager
6588a45880
Make Rubocop happy
2018-08-23 15:09:20 +02:00
Gerhard Schlager
409ee66839
Add optional "ignore_case" parameter to posts:remap rake task
2018-08-23 14:49:17 +02:00
Arpit Jalan
536cef86f4
PERF: do not carry post ids in memory when rebaking all posts
2018-07-11 14:34:33 +05:30
Guo Xiang Tan
59a2767de8
Ensure that we restore the site setting in posts:rebake rake task.
2018-07-06 16:22:54 +08:00
Sam
cb824a6b33
DEV: remove all calls to SqlBuilder use DB.build instead
...
This is part of the migration to mini_sql, SqlBuilder.new is being
deprecated and replaced with DB.build
2018-06-20 17:53:49 +10:00
Sam
5f64fd0a21
DEV: remove exec_sql and replace with mini_sql
...
Introduce new patterns for direct sql that are safe and fast.
MiniSql is not prone to memory bloat that can happen with direct PG usage.
It also has an extremely fast materializer and very a convenient API
- DB.exec(sql, *params) => runs sql returns row count
- DB.query(sql, *params) => runs sql returns usable objects (not a hash)
- DB.query_hash(sql, *params) => runs sql returns an array of hashes
- DB.query_single(sql, *params) => runs sql and returns a flat one dimensional array
- DB.build(sql) => returns a sql builder
See more at: https://github.com/discourse/mini_sql
2018-06-19 16:13:36 +10:00
Gerhard Schlager
64f2086cca
rake task should allow reordering posts of single topic
2018-04-10 13:52:08 +02:00
Arpit Jalan
adb93716ca
FIX: rake task should rebake posts in descending ID order
2018-04-10 00:18:49 +05:30
Gerhard Schlager
cf9965fd54
Add rake task for reordering posts by creation_date
2018-03-29 14:42:41 +02:00
Gerhard Schlager
81427e26ea
Ignore errors when remapping posts
2017-12-28 15:13:01 +01:00
Gerhard Schlager
b15059418b
FIX: rake task for updating posts received by email should not crash
2017-12-13 22:03:31 +01:00
Kyle Zhao
82c18f6ca3
fix: undefined variable in post:rebake_match
2017-10-24 20:05:58 -04:00
Gerhard Schlager
1477a0e910
Adds a rake task for refreshing posts received via email
...
This is useful when the email_reply_trimmer gem was updated and you want to apply those changes to existing posts.
2017-10-06 14:29:11 +02:00
Kyle Zhao
0342324b47
FEATURE: support regex in rake post:remap ( #5201 )
2017-10-04 11:47:53 +11:00
Arpit Jalan
041ace5d3b
new rake task to defer all flags
2017-09-15 16:42:58 +05:30
Arpit Jalan
18142d8abf
new rake task to bake uncooked posts
2017-09-12 12:40:18 +05:30
Guo Xiang Tan
5012d46cbd
Add rubocop to our build. ( #5004 )
2017-07-28 10:20:09 +09:00
Arpit Jalan
fba9bbb18c
FIX: reset likes in user directory
...
Reset likes to 0 when `posts:delete_all_likes` task is ran
2017-06-26 11:22:41 +05:30
Arpit Jalan
03d7ec8777
FEATURE: new rake task to delete all likes
2017-06-23 22:30:01 +05:30
Arpit Jalan
061c3dd6c1
typo
2017-01-25 22:46:05 +05:30
Arpit Jalan
89d7ddd803
FEATURE: new rake task to delete a word/string from all the posts
2017-01-25 22:33:39 +05:30
Arpit Jalan
bc4f443fde
typo
2017-01-25 21:23:25 +05:30
Arpit Jalan
80e573e794
FIX: support removing all occurences of a word/string
2017-01-24 12:52:38 +05:30
Arpit Jalan
e27ca3019b
FEATURE: posts:remap task now supports removing all occurences of a word
2017-01-24 12:00:57 +05:30
Arpit Jalan
01c8974c36
typo
2017-01-18 20:10:49 +05:30
Arpit Jalan
13aff1f2f8
FEATURE: optionally delay the rebake_match task
2016-09-21 21:48:57 +05:30
Arpit Jalan
76857e3f77
do not create new revision when remapping posts
2016-09-03 23:21:56 +05:30
Guo Xiang Tan
5da768b4fe
FIX: find_each uses find_in_batches which uses the primary key as the order.
2016-08-25 16:11:28 +08:00
Arpit Jalan
6af4e6bd05
FEATURE: new rake task to remap posts matching a string
2016-08-17 14:08:46 +05:30
Arpit Jalan
dc4799dda2
handle posts:rebake_match task without type argument
2016-08-17 01:01:06 +05:30
Arpit Jalan
054ee4dc55
FEATURE: new rake task to rebake posts using regex matching
2016-08-17 00:01:19 +05:30
Régis Hanol
bda6b48ac1
new posts:fix_letter_avatars rake task
2015-09-23 22:44:53 +02:00
Régis Hanol
657ab84825
disable edit notifications when using the rebake rake task
2015-04-01 23:08:29 +02:00
Régis Hanol
e7f251c105
LOTS of changes to properly handle post/topic revisions
...
FIX: history revision can now properly be hidden
FIX: PostRevision serializer is now entirely dynamic to properly handle
hidden revisions
FIX: default history modal to "side by side" view on mobile
FIX: properly hiden which revision has been hidden
UX: inline category/user/wiki/post_type changes with the revision
details
FEATURE: new '/posts/:post_id/revisions/latest' endpoint to retrieve
latest revision
UX: do not show the hide/show revision button on mobile (no room for
them)
UX: remove CSS transitions on the buttons in the history modal
FIX: PostRevisor now handles all the changes that might create new
revisions
FIX: PostRevision.ensure_consistency! was wrong due to off by 1
mistake...
refactored topic's callbacks for better readability
extracted 'PostRevisionGuardian'
2014-10-27 22:06:43 +01:00
Régis Hanol
c9dea9ce5c
TRIVIAL: improve display of the rebake task
2014-09-09 19:25:20 +02:00
Sam
3767080f3b
Added rake task to normalize code
2014-06-06 14:08:39 +10:00
Sam
f6753d3d46
FEATURE: automatically rebake out-of-date posts
2014-05-28 12:30:57 +10:00
Neil Lalonde
d91a72a791
Allow rebaking posts for only one site in multisite. Use RAILS_DB.
2014-04-04 11:11:05 -04:00
Régis Hanol
7bb23c8ce8
FIX: better handle errors in youtube onebox
2013-12-06 12:01:30 +01:00
Régis Hanol
f65cde3cda
do not bump posts when rebaking
2013-11-22 01:52:26 +01:00
Sam
a1f1849392
getting weird exceptions after handling one, work around
2013-07-05 17:44:32 +10:00
Sam
1db9108c1b
add some error handling
2013-07-05 16:55:14 +10:00
Régis Hanol
40f93bda8b
make sure we trigger the post process when rebaking the posts
2013-06-21 18:30:57 +02:00
Chris Hunt
9565843d44
Create post:refresh_oneboxes rake task
2013-06-19 00:20:30 -07:00
Robin Ward
26a81b30c2
When rebaking, update the links even if the cooked content didn't change. Someone
...
might be linking to us even if we don't have a link.
2013-06-08 21:53:33 -04:00
Robin Ward
f268b882fd
The posts rebake task should regenerate links too.
2013-06-06 13:52:30 -04:00
Gosha Arinich
cafc75b238
remove trailing whitespaces ❤️
2013-02-26 07:31:35 +03:00
Robin Ward
21b5628528
Initial release of Discourse
2013-02-05 14:16:51 -05:00
