servlets thread: Re: do you think it's useful to run a spider application as a servlet?
> a spider is a web crawler.
> it goes through the web and grabs lot's of urls
> recursively and performs actions on the html files
> that it finds.
>
> stephen
> --- Vikas Gandhi <gandhi@d...> wrote:
> > What is a spider application
> >
> > Vikas
> >
> > stephen sutherland wrote:
> > >
> > > do you think it's useful to run a spider
> > application as a servlet?
> > >
> > > or do you think not ?
> > >
> > > stephen
> >
>
Sure, the beauty of Java is that you can implement whatever you want to do
any way you want. You will need to use java.net.* to write you spider. I
have done it before and it works great. Simply open a Satagram Socket and
go from there. Remember that what you are getting back in your stream is
going to be html and will not appear the way that your browser interprets
it... Bust it out!