User-agent: * # SEARCH ENGINE SITEMAP # Big Medium builds a sitemap that tells search engines # the location of all of the pages on your site. # If your site's homepage directory is in your web root: # http://www.example.com # # ...then your sitemap is located here: # http://www.example.com/bm~sitemap_index.xml # # ...and the entry should be: Sitemap: http://www.defransekroon.be/bm~sitemap_index.xml Sitemap: http://www.defransekroon.be/uk/bm~sitemap_index.xml #block Webalizer directories ------------------ Disallow: /stats/ #block directories ------------------ Disallow: /cgi-bin/ Disallow: /ical/ Disallow: /assets/ #block page-directory support files ------------ #these examples assume that your page directory #is located at: http://www.example.com/bm Disallow: /bm~comments/ Disallow: /bm~theme/ Disallow: /bm~assets/ Disallow: /fr/bm~comments/ Disallow: /fr/bm~theme/ Disallow: /fr/bm~assets/ Disallow: /uk/bm~comments/ Disallow: /uk/bm~theme/ Disallow: /uk/bm~assets/ #block indexing of email and print pages ------- Disallow: /*~email.shtml Disallow: /*~print.shtml Disallow: /uk/*~email.shtml Disallow: /uk/*~print.shtml Disallow: /fr/*~email.shtml Disallow: /fr/*~print.shtml