This might be a problem with page caching. If the browser or any upstream software/hardware is caching the page, then the browser request won't hit the server which would know the page can't be accessed and refuse access to it.
You might have to play around with cache settings to solve this.
-
Peter