[Netarchivesuite-devel] troubleshooting deduplication

[aponb at gmx.at]

> 1) Could you tell us what is the configuration of your index server (CPU,
> RAM, local disk space vs. nfs partition) and how long did your
> deduplication process last for how much data?
Our Index Server is running on a 2x Intel(R) Core(TM)2 Duo CPU,  E4500  
@ 2.20GHz, 4 GB RAM machine, 500GB disk space.
We just finished the 1st stage of our current domain crawl and we are 
going to start the 2nd stage soon. I will have a look on the duration of 
the deduplication process and let you know afterwards.
> 2) Is it possible (have you ever tested) to generate a deduplication index
> in a test environment and use it in your production environment?
No, we never tried that.

Regards
a.