Wrox Home  
Search P2P Archive for: Go

  Return to Index  

servlets thread: Re: do you think it's useful to run a spider application as a servlet?


Message #1 by "Keith Davis" <kdavis@b...> on Thu, 26 Jul 2001 16:41:09
> a spider is a web crawler.
>  it goes through the web and grabs lot's of urls
> recursively and performs actions on the html files
> that it finds. 
> 
> stephen
> --- Vikas Gandhi <gandhi@d...> wrote:
> > What is a spider application
> > 
> > Vikas
> > 
> > stephen sutherland wrote:
> > > 
> > > do you think it's useful to run a spider
> > application as a servlet?
> > > 
> > > or do you think not ?
> > > 
> > > stephen
> > 
> 
Sure, the beauty of Java is that you can implement whatever you want to do 
any way you want.  You will need to use java.net.* to write you spider.  I 
have done it before and it works great.  Simply open a Satagram Socket and 
go from there.  Remember that what you are getting back in your stream is 
going to be html and will not appear the way that your browser interprets 
it...  Bust it out!

  Return to Index