# robots.txt --- index my site for search but don't archive it User-agent: * Disallow: # Tell Alexa Internet not to keep a copy User-agent: ia_archiver Disallow: /