# exclude some directories from robots # est-ce utile pour Spip ? User-agent: * Disallow: /CACHE/ Disallow: /dist/ Disallow: /ecrire/ Disallow: /IMG/ Disallow: /old-outils/ Disallow: /z-outils/ # but allow htdig to index our doc-tree #User-agent: susedig #Disallow: # disallow stress test #user-agent: stress-agent #Disallow: /