Question

What I have:

(take a look or fire on localhost if required: http://pastebin.com/virLR7dF)

(take a look on image presenting my case: http://iv.pl/images/47143498348127804676.png)

I have a PHP script that crawles given websites, and extracts data as varibles:

$ID = "data"; //this is just an example
$name = "data";
$price = "data";
$image = "data";

Script will put this data in a MySQL DB.

What is wrong?

I can automate it with a for loop so I will get more data at once. But if I loop it 1,000,000 times my script will freeze at some point, and starting over (finding where it broke and starting from that point) is problematic.

How with PHP/JS make it to:

1. gather 10 portions of data

2. stop and display information about gathered data

3. gather next 10 portions of data

4. stop and add new information to previosly displayed information

* have a PAUSE function to stop after next portion gathered

* have a RESUME funcion to start after last portion gathered

Answer 1

Output Buffering might be helping you in PHP

Try ob_start & ob_flush

ob_start This function will turn output buffering on. While output
buffering is active no output is sent from the script (other than
headers), instead the output is stored in an internal buffer.

ob_flush This function will send the contents of the output buffer (if
any)