View dynamic content with MS Index Server?
I've been playing around with MS Index Server 3.0 (well, the one that comes with Windows 2000 Professional!) and my client has a website that generates dynamic content based on ASP code. I unfortunately require the use of Index Server because the IFilter allows support for PDF files.
My problem is that while all of the static content pages and PDF files are detected, indexed and catalogued fine, none of any dynamic pages are. I can clearly see why this is, since I assume Index Server doesn't have a webcrawler of any sort!
I was wondering then, how people generally get around this problem, working with it? What is a quick way to get dynamic content integrated into the search? Should I find/write a webcrawler then put it into my search program or is there something better out there that will let me do all of this?
I'm not fussed for paying for any software either , as long as a) I can try it out/evaluate it beforehand so I know I'm not wasting my money and b) It does everything I want, i.e. PDF searching on top of dynamic content generation.
Thanks a lot,