<html><head><style type="text/css"><!-- DIV {margin:0px;} --></style></head><body><div style="font-family:times new roman,new york,times,serif;font-size:12pt"><div>the output of iotop<br>Total DISK READ: 15.67 M/s | Total DISK WRITE: 0.00 B/s<br><br>the output of vmstat 10 10<br>procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----<br> r b swpd free buff cache si so bi bo in cs us sy id wa<br> 0 1 31736 3518240 486048 2719488 0 1 646 321 70 39 1 4 88 7<br> 0 0 31736 3474616 489792 2763936 0 0 10909 96 12010 2568 1 5 76 17<br> 0 0 31736 3428900 492456 2797516
0 0 11062 152 12099 2546 1 6 78 15<br> 0 1 31736 3382620 494924 2833764 0 0 12728 136 12709 2580 1 7 76 16<br> 0 1 31696 3325956 497404 2872368 4 0 11678 244 12532 2571 2 6 77 15<br> 0 0 31696 3288048 500144 2906464 0 0 9947 178 12187 2539 1 6 80 13<br> 0 1 31684 3250064 503244 2947148 1 0 10628 166 12279 2613 1 7 78 15<br> 0 0 31680 3180800 507244 2995880 0 0 12200 186 12512 2680 1 7 73 19<br> 0 0 31680 3126368 510364 3047976 0 0 12083 149 12641 2738 2
6 70 21<br> 0 1 31680 3068704 513724 3093616 0 0 11916 176 12648 2799 1 7 74 18<br><br></div><div style="font-family: times new roman,new york,times,serif; font-size: 12pt;"><br><div style="font-family: arial,helvetica,sans-serif; font-size: 13px;"><font size="2" face="Tahoma"><hr size="1"><b><span style="font-weight: bold;">From:</span></b> Dennis Jacobfeuerborn <dennisml@conversis.de><br><b><span style="font-weight: bold;">To:</span></b> nginx@nginx.org<br><b><span style="font-weight: bold;">Sent:</span></b> Thu, October 14, 2010 9:57:26 PM<br><b><span style="font-weight: bold;">Subject:</span></b> Re: Image Hosting<br></font><br>Please re-run the vmstat as "vmstat 10 10". That should give a better <br>glimpse at what the system is doing.<br><br>On 10/14/2010 04:26 PM, Indo Php wrote:<br>> Here's the output of "iostat -d 60 2"<br>> Device: tps Blk_read/s
Blk_wrtn/s Blk_read Blk_wrtn<br>> sda 85.58 4947.94 2619.30 593632866 314252346<br>><br>> Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn<br>> sda 114.41 8395.93 339.01 503840 20344<br>><br>> here's the output of vmstat<br>> procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----<br>> r b swpd free buff cache si so bi bo in cs us sy id wa<br>> 0 1 332 63136 628344 6085040 0 0 617 324 17 27 1 4 88 6<br>><br>> ---------------------------------------------------------------------------<br>> *From:* Dennis Jacobfeuerborn <<a ymailto="mailto:dennisml@conversis.de" href="mailto:dennisml@conversis.de">dennisml@conversis.de</a>><br>> *To:* <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>> *Sent:* Thu, October 14, 2010 7:54:26 PM<br>> *Subject:* Re: Image Hosting<br>><br>> Ah, sorry I somehow didn't catch that last line with the actual HW
setup.<br>><br>> If my math skills don't fail me (and they very well might) the traffic and<br>> image size data mean that you serve about 300 images per second.<br>> Can you post a few lines of vmstat output and perhaps the output of "iostat<br>> -d 60 2"?<br>><br>> Also how are the hits distributed across the whole pool of images? Are<br>> these hits truly random or are some images hit significantly more often<br>> than others?<br>><br>> More ram would obviously take some pressure off the disks if they are<br>> really the problem.<br>><br>> Regards,<br>> Dennis<br>><br>> On 10/14/2010 02:26 PM, <a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a>> wrote:<br>> > Actually the image size is arround 100KB each. The server is running in<br>>
250Mbps traffic.<br>> > I already described the disk I'm using is scsi 15K RPM in raid 0<br>> ><br>> ><br>> > Sent from my BlackBerry®<br>> > powered by Sinyal Kuat INDOSAT<br>> ><br>> > -----Original Message-----<br>> > From: Dennis Jacobfeuerborn<<a ymailto="mailto:dennisml@conversis.de" href="mailto:dennisml@conversis.de">dennisml@conversis.de</a><br>> <mailto:<a ymailto="mailto:dennisml@conversis.de" href="mailto:dennisml@conversis.de">dennisml@conversis.de</a>>><br>> > Date: Thu, 14 Oct 2010 14:23:26<br>> > To:<<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>>><br>> > Reply-To: <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>
<mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><br>> > Subject: Re: Image Hosting<br>> ><br>> > But if those 5,000 req/s each hit a different 1mb image then you need to<br>> > read 5gb of data from you storage which if your storage is just a plain old<br>> > sata disk is going to be a huge problem.<br>> ><br>> > Unfortunately Indo Php is not providing nearly enough information to give<br>> > any sort of advice. If he is lucky then putting lots of ram in the machine<br>> > for pagecache can help here if the cache hit ratio is good but if it is not<br>> > then he probably has to distribute the I/O across more spindles and go for<br>> > a raid with lots of disks.<br>> ><br>> > Regards,<br>> > Dennis<br>> ><br>> > On
10/14/2010 10:33 AM, SplitIce wrote:<br>> >> Hmm well talking from experience nginx can serve upwards of 5,000 req/s for<br>> >> static files if configured right. Ill leave this for Igor or someone more<br>> >> expericed to reply to.<br>> >><br>> >> On Thu, Oct 14, 2010 at 7:28 PM, Indo Php<<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a><br>> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a>><br>> >> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a>>>> wrote:<br>> >><br>> >> i tried to use AIO, but it seems my server is getting slower<br>>
>><br>> >> ---------------------------------------------------------------------------<br>> >> *From:* SplitIce<<a ymailto="mailto:mat999@gmail.com" href="mailto:mat999@gmail.com">mat999@gmail.com</a><br>> <mailto:<a ymailto="mailto:mat999@gmail.com" href="mailto:mat999@gmail.com">mat999@gmail.com</a>><mailto:<a ymailto="mailto:mat999@gmail.com" href="mailto:mat999@gmail.com">mat999@gmail.com</a> <mailto:<a ymailto="mailto:mat999@gmail.com" href="mailto:mat999@gmail.com">mat999@gmail.com</a>>>><br>> >> *To:* <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>> <mailto:<a ymailto="mailto:nginx@nginx.org"
href="mailto:nginx@nginx.org">nginx@nginx.org</a>>><br>> >> *Sent:* Thu, October 14, 2010 2:47:55 PM<br>> >> *Subject:* Re: Image Hosting<br>> >><br>> >> Try any of these:<br>> >> 1) Compile nginx with AIO support<br>> >> 2) Try directio option<br>> >> 3) Try sendfile option<br>> >><br>> >> On Thu, Oct 14, 2010 at 6:36 PM, Indo Php<<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a><br>> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a>><br>> >> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a> <mailto:<a ymailto="mailto:iptablez@yahoo.com" href="mailto:iptablez@yahoo.com">iptablez@yahoo.com</a>>>> wrote:<br>>
>><br>> >> hi there,<br>> >><br>> >> we have an image hosting, and of course we're using Nginx!<br>> >><br>> >> Now on we're having problem with disk i/o. With 200GB of images.<br>> >> Is there any recommendation for this matter? Nginx configuration or<br>> >> Hardware/other software configuration?<br>> >><br>> >> We already used Dual Quad Core 3Ghz, 8 GB RAM, 6x73GB 15k SCSI server<br>> >><br>> >><br>> >><br>> >><br>> >> _______________________________________________<br>> >> nginx mailing list<br>> >> <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><mailto:<a
ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>>><br>>> > <a href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>> >><br>> >><br>> >><br>> >><br>> >> _______________________________________________<br>> >> nginx mailing list<br>> >> <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>>><br>>
>> <a href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>> >><br>> >><br>> >><br>> >><br>> >> --<br>>> > Warez Scene<<a href="http://thewarezscene.org" target="_blank">http://thewarezscene.org</a>> Free Rapidshare Downloads<br>>> > <<a href="http://www.nexusddl.com" target="_blank">http://www.nexusddl.com</a>><br>> >><br>> >><br>> >><br>> >> _______________________________________________<br>> >> nginx mailing list<br>> >> <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><br>> >> <a href="http://nginx.org/mailman/listinfo/nginx"
target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>> ><br>> ><br>> > _______________________________________________<br>> > nginx mailing list<br>> > <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><br>> > <a href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>> > _______________________________________________<br>> > nginx mailing list<br>> > <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><br>> > <a href="http://nginx.org/mailman/listinfo/nginx"
target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>><br>><br>> _______________________________________________<br>> nginx mailing list<br>> <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a> <mailto:<a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a>><br>> <a href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br>><br>><br>><br>> _______________________________________________<br>> nginx mailing list<br>> <a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>> <a href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br><br><br>_______________________________________________<br>nginx mailing list<br><a ymailto="mailto:nginx@nginx.org" href="mailto:nginx@nginx.org">nginx@nginx.org</a><br><a
href="http://nginx.org/mailman/listinfo/nginx" target="_blank">http://nginx.org/mailman/listinfo/nginx</a><br></div></div>
</div><br>
</body></html>