High Server Load :(

[nokiainfo]

Hello i am having huge problem from more than 3-4 month my serverload shows load average: 445.05, 491.65, 562.1 . my site runs normal but due to high server load mysql stops working sometime and ftp never connects i have to wait late night for the the server to come down and upload contents or change any thing in page etc... and my cPanel also the same open late night .

I have used nginx also but that also didnt helped me site always opens very slow ,download speed gives 3-4 kbps and maximum times site give "Gateway Timeout" so i am not gonna use nginx.

here is a screenshot of TOP

i hope any body will help me !!!

[something else]

dont know if this will help you but i have over 1000 daily users and was getting similar problems i change my mysql connection a persistent connection and that has helped me

mysql_pconnect () 

[nokiainfo]

dont know if this will help you but i have over 1000 daily users and was getting similar problems i change my mysql connection a persistent connection and that has helped me

mysql_pconnect () 

yup i am using this only from last month and mysql error is minimum but not totally solved due heavy..... load

[stolen_moment]

may be grabbers of your site are responsible for that if exists

[nokiainfo]

may be grabbers of your site are responsible for that if exists

Ya bro i know it is posted on every coding forum

[morency]

1000 daily online I guess . ?!
//
nokiainfo what script do you use ??
Save the results from mysql queries in xml files or whatever text files and make the script to read from that files.
Delete inutilles queries .
Add an index to mysql .
New /or upgrade server .

:-? This is what I made ..



400+ is new record , :D most I have 200
now is under 1 .

PS:funny , I got VB database error just now

[nokiainfo]

i am saving result mysql queries in memcached and removed useless staffs from sea script even download count

[something else]

1000 daily online I guess . ?!

Yeah thats ment to be online lol

[nokiainfo]

i have 1100 - 1500 user online and daily page views 650k-700k

My server config

Dual xeon 5410 (16 cores)
16 gb memory
1.5 tb * 2 HDD (RAID 1 hardware)
Bandwidth 100mbps unmetered (25 TB used this month)

[something else]

if its grabbers messing you up then do something about it:

http://coding-talk.com/f60/discussion-about-ways-to-avoid-grabbers-from-your-site-10310/

[nokiainfo]

yup i read that before but certainly it didnt help me cause all the ways will decrease my vsitors also (no one likes registration for only file download which they can get from other sites without headache , many mobiles doesnt send referer and and much more)

BTW i dont think only grabber can do this thing.

[morency]

from what I read if you use memcached you need to make some changes to be useful ... Not just "Plug and Play"

[nokiainfo]

from what I read if you use memcached you need to make some changes to be useful ... Not just "Plug and Play"

i have totally modded the sea script to store results in memcached for particular period of time
BTW just now have done some changes hopefully stop stop grabbers

[firemax]

try with Squid cache. (squid : Optimising Web Delivery) may be good for you.