Reid is a simple tool for crawling web pages and throttling requests
Dan Breczinski
MIT (http://opensource.org/licenses/MIT)