#this file tells the search engines where not to look. Remember, anyone can view this file so dont put anything you dont want the world to see User-agent: * Disallow: /intranet/ Disallow: /internal/ Disallow: /sitemap.cfm Disallow: /southern/sitemap.cfm Disallow: /intranet/cropnpest/ Disallow: /public/news.cfm Disallow: /transferForum.cfm Disallow: /pmcprojects/pmcprojects.cfm Disallow: /cropprofiles/getcropprofiles.cfm Disallow: /cropprofiles/search.cfm Disallow: /datasources/nass/outputNASS.cfm