User-agent: ConveraCrawler Gigabot NextGenSearchBot ShopWiki twiceler Disallow: / User-agent: * Disallow: /download/ Disallow: /misc/ Disallow: /wallofmouths/account/ Disallow: /wallofmouths/feed/ Disallow: /wallofmouths/signin/