DeDuplicator (Heritrix Add-on)

DeDuplicator (Heritrix Add-on)
All Links

Share this:

Details of DeDuplicator (Heritrix Add-on)

About DeDuplicator (Heritrix Add-on)
DeDuplicator (Heritrix Add-on)- An add-on module (plug-in) for the web crawler Heritrix. It offers a means to reduce the amount of duplicate data collected in a series of snapshot crawls.
WML