# robots.txt for site http://www.mrbig.com # # Note: if you don't know what this file does, # don't mess with it!!! # # Its purpose is to keep search engines focused # on pages with content we want to advertise and # keep them away from stuff that is of no consequence # to anyone else. # # # Ben Goldfarb - 6/3/07 # goldfarb@mrbig.com User-agent: * Disallow: /Connections/ # Dreamweaver MySQL crap Disallow: /css/ # cascading style shit Disallow: /js/ # JavaScript Disallow: /Library/ # Dreamweaver stuff Disallow: /oldies/ # old, obsolete pages Disallow: /Templates/ # Dreamweaver Stuff Disallow: /404error.html # Error page Disallow: /surgery/ # Nobody's business