User-agent: * Disallow: /404.asp Disallow: /register.asp Disallow: /login.asp /sitemap.asp