Dear all,

My project is to 'screenscrape' data from a a set of results pages based on a search form on that site.

Using MSXML2.XMLHTTP40 I have so far managed to POST a request to the site and receive the first of the results pages. At the bottom of the page are the standard "1, 2, 3, 4... Next" type of links to futher pages of results.

Using my parser I find the link to page "2" and send a GET with that URL. Instead of receiving the next page of results I get a page showing zero results. The same happens for any of the results pages.

I think the problem has something to do with my HTTP session, and the fact that this database requires a log-in for access. Should I be sending a cookie with each of my "GET"s so that server knows who I am? If so where can I find this cookie or how can I make it?

Many thanks,
Oscar