659 Commits

Author	SHA1	Message	Date
Neil Lalonde	6e8bf1271f	increase purge site settings for imports in case jobs like clean_up_uploads cause a mess	2018-04-09 12:44:59 -04:00
Gerhard Schlager	8412a96acb	Do not create empty files when pulling from Transifex	2018-04-06 14:47:25 +02:00
Gerhard Schlager	09c4491f73	Add remaining core plugins to Transifex	2018-04-06 14:15:47 +02:00
Neil Lalonde	17f9c5494d	add discourse-chronos to plugin-translations.rb	2018-04-05 16:41:29 -04:00
Gerhard Schlager	f2d00e5eff	FEATURE: Use Message-ID for detecting email replies to group ... Ignores the site setting "find_related_post_with_key" and always tries to honor the `In-Reply-To` and `References` header for emails sent to a group. The senders email address must be included in the `To` or `CC` header of a previous email sent to the group and the `Message-ID` of that email must be included in the current email's `In-Reply-To` or `References` header.	2018-04-05 11:00:38 +02:00
Miro Michalicka	8d283e78e7	Fix broken queries in Drupal 6 migration.	2018-03-31 17:53:40 +02:00
Gerhard Schlager	cf9965fd54	Add rake task for reordering posts by creation_date	2018-03-29 14:42:41 +02:00
Gerhard Schlager	37fa843efc	Allow pulling of Urdu translations from Transifex again ... The translations have been fixed.	2018-03-27 11:56:40 +02:00
Neil Lalonde	baba45a369	ur translations still break the build, so stop pulling them from Transifex for now	2018-03-26 11:03:14 -04:00
Gerhard Schlager	a0d5e243fd	Improve the import script for "Get Satisfaction" ... * Works with the current column layout exported as Excel file * Tries to fix invalid CSV when it wasn't exported from Excel * Imports categories * Imports topics into the correct category * Allows skipping archived topics * Allows skipping private topics * Makes use of the latest features from the base importer * Some minor fixes and documentation updates	2018-03-19 14:58:17 +01:00
Régis Hanol	dad1e4b17d	don't import data only available in a plugin in phpBB 3 importer	2018-03-17 00:36:12 +01:00
Gerhard Schlager	2834705bd1	Improve base import script ... * Make sure the category description is imported correctly (the about topic usually had the wrong excerpt). * Allow import scripts to mark topics as closed or archived. * Allow import scripts to store the topic's original id. It will be stored in topic_custom_fields as import_topic_id.	2018-03-16 22:39:06 +01:00
Régis Hanol	bb6ac51607	Update PHPBB3 importer ... - Extract name from profile_fields_data table - Use 'posts.poster_ip' to track topic views	2018-03-16 18:32:27 +01:00
Sam	cb7f3c6537	partial upload support for scss	2018-03-14 13:01:52 +11:00
Gerhard Schlager	9b651adadb	FIX: mbox importer should ignore emails without date	2018-03-13 13:42:57 +01:00
Sam	8ad7f8b44f	updates to theme watcher	2018-03-13 17:39:53 +11:00
Sam	8229cc2ff1	shuffle vars forward	2018-03-12 18:40:14 +11:00
Sam	758b9a7dda	FEATURE: prototype of local theme directory watcher ... (note this will be documented a bit late)	2018-03-12 18:36:06 +11:00
Neil Lalonde	7aa93b84c1	FIX: bulk importers shouldn't insert rows with id less than 1	2018-03-09 14:26:18 -05:00
Neil Lalonde	200c6673f1	FIX: bulk importers wiping all email addresses without warning or errors	2018-03-08 23:36:39 -05:00
Sam	ddcca1d5cc	lint	2018-03-08 15:16:12 +11:00
neerajmalve	4b8ff7a057	Update xenforo.rb (#5622) ... #Fix for the error: xenforo.rb: 160: in `gsub!': invalid byte sequence in UTF-8 (ArgumentError)	2018-03-07 22:57:38 -05:00
Régis Hanol	07bc52dc69	import topic views in phpbb3	2018-03-07 19:27:03 +01:00
Neil Lalonde	1093dacc03	FIX: bulk importers need to create category description topics	2018-03-07 12:10:22 -05:00
Gerhard Schlager	dc32ee5cbf	Improvements to mbox import script ... * Ignore errors during indexing and show information about the message causing the problem * Always activate imported users if they aren't staged	2018-03-06 11:32:12 +01:00
Régis Hanol	49400337b6	Improve IPBoard3 importer ... - fix encoding issues - close topics - don't import queued & not approved topics - don't import deleted posts	2018-03-05 10:24:42 +01:00
Neil Lalonde	d7bd69583f	fix vanilla bulk importer resume categories and private topics	2018-03-01 15:29:38 -05:00
Régis Hanol	ae9b1e8554	FEATURE: IP.Board 3 importer	2018-03-01 09:43:32 +01:00
Neil Lalonde	e997cc7b77	add more image extensions to downsize_uploads.rb	2018-02-27 22:05:35 -05:00
Neil Lalonde	931caa4335	add a script that can downsize uploads	2018-02-27 16:23:48 -05:00
Régis Hanol	82e68670bf	FIX: SimplePress importer wasn't handling increment imports properly	2018-02-24 00:42:17 +01:00
Sam	720e1965e3	FEATURE: add category suppress from latest ... In the past we used suppress_from_homepage, it had mixed semantics it would remove from category list if category list was on home and unconditionally remove from latest. New setting explicitly only removes from latest list but leaves the category list alond	2018-02-22 09:56:35 +11:00
Sam	73a492f721	minor changes to discourse bench ... Ruby master is not compatible with bootsnap atm	2018-02-20 14:41:21 +11:00
Sam	a3c7ee09b6	FIX: ruby bench not working properly ... - Remove thin which is no longer supported - Bypass admin api rate limiting in profile environment - Admin password was too short - Run by default in concurrency 1 mode - A skip bundle assets flag to speed up local testing	2018-02-19 11:37:16 +11:00
Sam	5faffeeb82	demo script for profiling middleware stack	2018-02-15 14:36:40 +11:00
Sam	c89b42c488	PERF: only require the rss library if used ... Before: Total allocated: 257909321 bytes (2514134 objects) Total retained: 39681579 bytes (343387 objects) allocated memory by gem ----------------------------------- 42875979 rss retained memory by gem ----------------------------------- 2080188 rss retained objects by gem ----------------------------------- 13052 rss After: Total allocated: 210562047 bytes (2252030 objects) Total retained: 37433816 bytes (328635 objects) ---- So, 2 less megabytes on boot and 13000 objects stuck in ruby heaps forever.	2018-02-15 13:11:33 +11:00
Gerhard Schlager	479f7ed18f	Ignore case when removing mailing list name from subject	2018-02-12 21:41:58 +01:00
Régis Hanol	31f5ca6180	improve simple press importer	2018-02-07 17:37:51 +01:00
Neil Lalonde	0edd386b48	FEATURE: Vanilla bulk importer	2018-02-02 16:28:51 -05:00
Arpit Jalan	25ec077eca	rename 'min_private_message_{post/title}_length' to 'min_personal_message_{post/title}_length'	2018-02-01 13:25:29 +05:30
Neil Lalonde	421713f1be	include saved-searches in plugin-translations.rb	2018-01-31 11:19:21 -05:00
Neil Lalonde	cc830f7119	sorry rubocop	2018-01-30 14:37:15 -05:00
Jay Pfaffman	db17c531d6	Feature: Invision Power Board Importer	2018-01-30 08:44:02 -08:00
Gerhard Schlager	192a0886e2	FIX: BBCode to Markdown conversion in phpBB3 importer was broken ... This fixes the conversion for quotes, code blocks and lists (except for nested lists). It also discourages the usage of the ruby-bbcode-to-md gem.	2018-01-30 12:50:42 +01:00
Gerhard Schlager	c26db2116c	FIX: phpBB3 importer imported some users as anonymous users	2018-01-30 12:50:42 +01:00
Neil Lalonde	a224459960	bulk importer shouldn't try to update primary key sequences to -1	2018-01-19 15:01:00 -05:00
Neil Lalonde	db287ad58e	FIX: invalid SQL in vanilla_mysql import script	2018-01-19 11:53:07 -05:00
Gerhard Schlager	6500343431	FIX: mbox importer didn't detected already indexed files	2018-01-17 17:03:53 +01:00
Gerhard Schlager	bb54eb1192	Improvements to mbox importer ... * store time it took to index message in DB (to find performance issues) * ignore listserv specific files * better examples for split_regex * first email in mbox shouldn't contain the split string * always lock the DB in exclusive mode * save email within transaction * messages can be grouped by subject and use original order (for Listserv) * adds option to index emails without running the import	2018-01-17 12:04:57 +01:00
Sam	fc05164667	demo script for demonizing using fork exec ... minor refinements to demon	2018-01-11 13:51:52 +11:00