David Taylor 9a36286920

FIX: Open file handles 'just in time' during s3 migration (#28806) ...

Previously we were opening the file handles, then putting them in a queue for upload. If that queue grows too large, we can hit a maximum open files limit.

This commit opens the file handle 'just in time', so the maximum number of open handles is equal to the upload concurrency (20).

2024-09-09 18:39:26 +01:00

..

base_store.rb

DEV: Update call sites using BaseStore#download but expecting exceptions (#21551)

2023-05-17 16:03:33 +08:00

local_store.rb

DEV: Prefer \A and \z over ^ and $ in regexes (#19936)

2023-01-20 12:52:49 -06:00

s3_store.rb

DEV: Add hidden s3_inventory_bucket_region site setting (#27786)

2024-07-09 12:03:43 +08:00

to_s3_migration.rb

FIX: Open file handles 'just in time' during s3 migration (#28806)

2024-09-09 18:39:26 +01:00