Server side forking and optimization

[nirrud]

Hi I am presently writing a code which does the following steps given a site

1) get some keywords (written a function for it)

2) search google for these keywords (I have used curl and getURL functions for these)

3) perform keyword search in the first page of googles results.

 

Presently I have used curl and curl_multi_getcontent but when i run the code it consumes 100% of my server.

My server will not respond in this case if someone else pings.

 

I have been trying to do pcntl_fork, but could you let me know how to optimize this code by threading and forking.

 

I am a newbe in PHP please let me know the structure of how to invoke multiple threads and process the same.

If you have someother suggestions please let me know that too.

 

 

 

[nafetski]

What kind of server are you running?

 

Also, what kind of load are you expecting?  Are you doing 100 curl requests, or 5? 

[nirrud]

I am using a apache2, mysql, php server.

 

I would be requesting about 100 + searches at a time when given one url.

 

 

[BlueSkyIS]

be forewarned: unless you are using proxy servers or you can distribute the queries among various ip addresses or locations, google will block you with that kind of traffic.

[nirrud]

Thank you for letting me know about it. but this just a home server and tying it as a project. So could you let me know what I could do ?