# /robots.txt file for http://aalokkarnik.info User-agent: * # these are the FTP user accounts which a robot should not crawl Disallow: /cs480 Disallow: /ebay Disallow: /like Disallow: /rohit Disallow: /piktor # various folders Disallow: /piktor/db Disallow: /common Disallow: /tests