Dezi::Bot 0.002 has been released to CPAN.
Dezi::Bot is a web crawler based on SWISH::Prog::Aggregator::Spider, optimized for running parallel crawls across multiple machines, using a shared DBI-based queue and caching framework.
The Dezi::Bot can be used to create and update Dezi-ready indexes, mirror websites, or anything else you would expect a web spider to do.