I'm new so forgive my stupidity. I'm trying to write a scraper program in PHP and I think one way is to use fopen() to get a URL.

Every time I try to feed it a web address I get the error message:

Warning: fopen(http://www.Whatever-I-Use.com/): failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/virtual/site3/fst/var/www/html/scrape.php on line 10

It lets me get pages on my server but, anytime I try to go outside I get that error message. What's up? Anyone?

Hi,
    It'd help if you could post some code to go along with this.

    Have you made sure to open for read-only?
    $handle = fopen("http://www.example.com/", "r");

: )
Rich


::::::::::::::::::::::::::::::::::::::::::
The Spicy Peanut Project
http://www.spicypeanut.net
::::::::::::::::::::::::::::::::::::::::::

If you have a newer version of PHP, you can use file_get_contents instead, and not have to deal with getting a file handle and using fread() and fclose()

 http://www.php.net/file_get_contents

This should also work for HTTP URLs.


Take care,

Nik
http://www.bigaction.org/

Also, check the value of "allow_url_fopen" in php.ini (you can check this in phpinfo() output).


Take care,

Nik
http://www.bigaction.org/

Thanks everyone, I'll try it all and tell you how it works out. Much appreciated.

Dadio