Question

I have a PHP script that in every run, inserts a new row to a Mysql db (with a relative small amount of data..)
I have more than 20 requests per second, and this is causing my CPU to scream for help..

I’m using the sql INSERT DELAYED method with a MyISAM engine (although I just notice that INSERT DELAYED is not working with MyISAM).

My main concern is my CPU load and I started to look for ways to store this data with more CPU friendly solutions.

My first idea was to write this data to an hourly log files and once an hour to retrieve the data from the logs and insert it to the DB at once.

Maybe a better idea is to use NoSQL DB instead of log files and then once an hour to insert the data from the NoSQL to the Mysql..

I didn’t test yet any of these ideas, so I don’t really know if this will manage to decrease my CPU load or not. I wanted to ask if someone can help me find the right solution that will have the lowest affect over my CPU.

Answer 1

Ok guys, I manage to lower the CPU load dramatically with APC-cache

I’m doing it like so:

storing the data in memory with APC-cache, with TTL of 70 seconds:

apc_store('prfx_SOME_UNIQUE_STRING', $data, 70);

once a minute I’m looping over all the records in the cache:

$apc_list=apc_cache_info('user');

foreach($apc_list['cache_list'] as $apc){
    if((substr($apc['info'],0,5)=='prfx_') && ($val=apc_fetch($apc['info']))){
        $values[]=$val;
        apc_delete($apc['info']);
    }
}

inserting the $values to the DB

and the CPU continues to smile..

enjoy