# robots.txt to stop spidering of ad links User-agent: * Disallow: /go.asp