# file: robots.txt , V1.0 2010/07/12 Created by lianghuang # www.easysk.com # 按照robots.txt的标准写法,规定一些不允许爬虫爬的页面或目录。 # robots.txt 的写法参照 # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Disallow: /admins/ Disallow: /uploadfile/ Disallow: /images/ Disallow: /css/ Disallow: /fckeditor/ Disallow: /eweb/ Disallow: /editor/ Disallow: /bbs/admin/ Disallow: /bbs/api/ Disallow: /bbs/attachments/ Disallow: /bbs/codebase/ Disallow: /bbs/forumdata/ Disallow: /bbs/flash/ Disallow: /bbs/include/ Disallow: /bbs/install/ Disallow: /bbs/ipdata/ Disallow: /bbs/old/ Disallow: /bbs/payphp/ Disallow: /bbs/review/ Disallow: /bbs/soft/ Disallow: /bbs/softsite/ Disallow: /bbs/templates/ Disallow: /bbs/ttt/ Disallow: /bbs/uc_client/ Disallow: /bbs/uc_server/