Want open source for crawling website with PHP

Snowby · May 29th, 2008, 05:59 AM

Hi Friends,

I am looking for open source for crawling website with PHP. If there is no sites in PHP, then .Net is also welcome.

Thanking you,

Snowby Dave

sdi126 · June 3rd, 2008, 05:00 PM

Depending on what you want to do? PHP has built in functions for grabbing data from another page...one is file_get_contents()

free wifi | http://localwifisearch.com
web dev | http://mynameissteve.com

snowbydave1 · June 5th, 2008, 05:13 AM

Hi Friend,

I know this function, but how to check that how many internal & external links are in a page ?

Also how to continously check that where is ftp:// is there & how many times in a page ?

Quote:

quote:Originally posted by sdi126
Depending on what you want to do? PHP has built in functions for grabbing data from another page...one is file_get_contents()

free wifi | http://localwifisearch.com
web dev | http://mynameissteve.com

sdi126 · June 5th, 2008, 01:57 PM

Well that function is returning a string so just check for how many occurences are there using substr_count.

free wifi | http://localwifisearch.com
web dev | http://mynameissteve.com