<div>I'm using proxy_store to act as a frontend mirror/cache to amazon s3 for my sites photos.</div><div></div><div> Response times are slow, iotop reports ~10-15MB/s being written to disk by nginx.</div><div></div><div>
The website implements a 'latest' feature, any new photos will requested by many users at the same time.</div><div></div><div>I'm thinking nginx is probably getting a request for a photo it doesn't already have, and while it is retrieving the file from s3, more requests come in for the same file, meaning more round trips and more temp files being created.</div>
<div></div><div>Does proxy_cache handle it differently? (ie, does it know that a url is currently being retrieved from the backed, and block other requests for that url until the file has been retrieved)</div>