Getting google to index asp.net site

scottlucas58 · December 10th, 2009, 03:17 PM

Does anybody have any suggestions on handling googles insistence that i am redirecting every page? When run my link through Rex Swain's header viewer is I get a 200 response. See below:

HTTP/1.1Â·200Â·OK
Cache-Control:Â·no-cache,Â·no-store
Pragma:Â·no-cacheContent-Type:Â·text/html;Â·charset=utf-8
Expires:Â·-1
Server:Â·Microsoft-IIS/7.0
X-Powered-By:Â·UrlRewriter.NETÂ·2.0.0
Set-Cookie:Â·.ASPXANONYMOUS=CRf5_lSwygEkAAAAY2Q0N2ZkZj YtYjMyMC00Y2Q2LWJjMWUtYzQ4ZmQ2NmNkMjViChwv1ybfpXSM czQXnU6onHCLwG41;Â·expires=Thu,Â·18-Feb-2010Â·04:44:03Â·GMT;Â·path=/;Â·HttpOnly
Set-Cookie:Â·ASP.NET_SessionId=xi2ylumwyclu2155mpep424 5;Â·path=/;Â·HttpOnly-AspNet-Version:Â·2.0.50727
Set-Cookie:Â·lastsearch=wheredata=Osseo,Â·MNÂ·55369;Â· expires=Tue,Â·10-Dec-2019Â·18:04:03Â·GMT;Â·path=/
X-Powered-By:Â·ASP.NET
Date:Â·Thu,Â·10Â·DecÂ·2009Â·18:04:03Â·GMT
Connection:Â·close
Content-Length:Â·38500

Google's fetch reports this:
HTTP/1.1 302 FoundContent-Type: text/html; charset=utf-8Location: /(A(U7vZ11SwygEkAAAAMTRjZjI4MTAtMjc1YS00M2RhLTkyNjU tNDgzYWU5NjBkM2VmEH0pa4lKoYjKR8_2hJvzsjKqExI1))/showbusiness.aspx?id=6331511Server: Microsoft-IIS/7.0X-Powered-By: UrlRewriter.NET 2.0.0,ASP.NETDate: Thu, 10 Dec 2009 18:02:57 GMTContent-Length: 252<html><head><title>Object moved</title></head><body><h2>Object moved to <a href="%2f(A(U7vZ11SwygEkAAAAMTRjZjI4MTAtMjc1YS00M2 RhLTkyNjUtNDgzYWU5NjBkM2VmEH0pa4lKoYjKR8_2hJvzsjKq ExI1))%2fshowbusiness.aspx%3fid%3d6331511">here</a>.</h2></body></html>
This long string is obviously caused by asp.net or IIS7.
Surely, after all these years someone has a solution.
I am all ears. The pages work as designed as far as our users.

Lee Dumond · December 10th, 2009, 03:53 PM

I'd try disabling URLRewriter.NET and see if it still happens.

scottlucas58 · December 10th, 2009, 05:24 PM

Quote:

Originally Posted by Lee Dumond

I'd try disabling URLRewriter.NET and see if it still happens.

Lee thanks for the idea, but no go. Every head viewer online reports 200.
I smell anti-microsoft consipracy.

Dang.

Lee Dumond · December 10th, 2009, 05:40 PM

Well, 200 is what you want, right?

What I meant was to disable the URL Rewiter and then check the response from Google fetch (pretty sure you can use Webmaster Tools for that).

Not sure why you're getting a 302 from Google, but it appears that your rewriter is encoding the URL. That'd be your first clue.

/showbusiness.aspx?id=6331511 ==> ))%2fshowbusiness.aspx%3fid%3d6331511

scottlucas58 · December 11th, 2009, 09:57 AM

I did remove urlrewriter.net. So far, of all of the tools I could find only google complains.
I ran fiddler with and without urlrewriter (including the few pages i actually rewrite) and got 200 OK responses for every pages, webservice, image, etc. Everything I have read say fiddler is the tool. One header viewer i used actually lets you select the bot engine. I of course pickked googlebot and the pages came out 200 OK. Any other debug tools?
IIS7 config tricks? I have used the web.config settings of the original TBH, the added AJAX and my own app setteings. Messed around with cookieless options. I'm lost. I am not redirecting my pages.

scottlucas58 · February 9th, 2010, 12:25 AM

Just want to update this old post with what worked for me in case any has the same issue. I had "UseDeviceProfile" for sessionsate, form auth,etc. Changed it to "UseCookies" and the 302 redirect went away. Site still works. If someone doesn't allow cookies, too bad.