26 Commits

Author	SHA1	Message	Date
Vinoth Kannan	2941c77abc	FIX: skip upload recovery if file not found in s3	2019-05-21 00:06:36 +05:30
Vinoth Kannan	2a7065c505	FIX: skip uploads without etag in s3 inventory check.	2019-05-20 00:09:52 +05:30
Vinoth Kannan	3172172b52	remove unused local variable ... ec84c87ddb	2019-05-16 15:39:13 +05:30
Vinoth Kannan	ec84c87ddb	FIX: skip validation while recovering uploads from s3 ... TODO: add tests	2019-05-16 15:37:11 +05:30
Vinoth Kannan	40328f055e	FIX: retrieve original filename from s3 object's content disposition header	2019-05-16 09:47:22 +05:30
Guo Xiang Tan	dd49be27d3	DEV: Fix undefined variable. ... Follow up to e8fafbc123.	2019-05-16 11:28:48 +08:00
Vinoth Kannan	f5a217be92	Fix typo in condition value.	2019-05-07 17:09:08 +05:30
Vinoth Kannan	e8fafbc123	List and restore missing post uploads from S3 inventory.	2019-05-04 01:16:20 +05:30
Vinoth Kannan	73418aaf73	DEV: Add bucket folder path to inventory id	2019-05-02 04:35:35 +05:30
Vinoth Kannan	a8f410a9c5	FEATURE: Create new helper method 'Discourse.stats' (#7388)	2019-04-17 12:45:04 +05:30
Vinoth Kannan	35431a8ddb	FIX: set missing count in redis even if zero	2019-04-04 20:05:57 +05:30
Vinoth Kannan	df6ef856e6	DEV: save missing s3 uploads count in redis	2019-04-04 19:05:57 +05:30
Guo Xiang Tan	243fb8d9ad	Fix the build.	2019-03-13 17:39:07 +08:00
Vinoth Kannan	da1ff2da2c	FIX: Create and consume temp table inside a transaction (#7030) ... To prevent access issue in pgbouncer which runs in transaction pooling	2019-02-20 13:52:40 +11:00
Vinoth Kannan	563b953224	DEV: Add 'backfill_etags_' to the method name since it also backfilling the etags	2019-02-19 21:54:35 +05:30
Vinoth Kannan	0472bd4adc	FIX: Remove 'backfill_etags' keyword argument from 'uploads:missing' rake task ... And etags backfilling code is optimized	2019-02-15 00:34:35 +05:30
Vinoth Kannan	b5fbd7385f	FIX: run the rake task only for uploads created before a day from inventory date	2019-02-14 17:53:08 +05:30
Vinoth Kannan	a9a8855739	DEV: Get only matching records to backfill etags	2019-02-14 06:27:18 +05:30
Vinoth Kannan	e2f7db5549	Fix typo	2019-02-14 05:56:30 +05:30
Vinoth Kannan	7b5931013a	Update rake task to backfill etags from s3 inventory	2019-02-14 05:18:06 +05:30
Vinoth Kannan	b8d2549922	FIX: OptimizedImage model doesn't have 'created_at' date column	2019-02-14 03:46:00 +05:30
Vinoth Kannan	426bd810f1	FIX: S3 inventory can have duplicate etags	2019-02-14 03:44:14 +05:30
Vinoth Kannan	1045bbc35b	FIX: S3 inventory data can be splitted into multiple csv files	2019-02-14 03:41:52 +05:30
Vinoth Kannan	ba9cc83d4c	FIX: Destination prefix in S3 inventory configuration is incorrect	2019-02-06 20:51:28 +05:30
Vinoth Kannan	ff12c4b2d4	FIX: Bucket name is missing in S3 inventory data path	2019-02-06 19:16:08 +05:30
Vinoth Kannan	b4f713ca52	FEATURE: Use amazon s3 inventory to manage upload stats (#6867)	2019-02-01 10:10:48 +05:30