[Netarchivesuite-users] Running out of disk space

[Bjarne Andersen]

If you could mount exstra diskspace on that machine (from another server, SAN, ...) you could pause the job, move arc files to the new mount and then pink then back in the arcs dit of the crawl. This would free space and at the same time ensure the arcs directory at all times contains all arc files of the job
Best
Bjarne 
________________________________________
Fra: netarchivesuite-users-bounces at lists.gforge.statsbiblioteket.dk [netarchivesuite-users-bounces at lists.gforge.statsbiblioteket.dk] På vegne af aponb at gmx.at [aponb at gmx.at]
Sendt: 6. september 2010 14:41
Til: NetarchiveSuite-users
Emne: [Netarchivesuite-users] Running out of disk space

Currently I am running a job which was defined with too high
configuration limits for the maximum number of bytes for each included
domain (or too many domains for that job). Now the disk space on that
crawler machine is getting close. Does anybody have a clue how I could
prevent this job from failing?
I could move the oldest arc files out of the job crawling directory (in
my case ./8802harvester/3666_1283259960121/arcs) to an other location,
so that I can get more free space. But than I will get a problem later,
when all collected arc-Files get processed after completion of that job
and some are missing.
What can I do or what would you suggest to do in that case?
Thanks for reading
a.


_______________________________________________
NetarchiveSuite-users mailing list
NetarchiveSuite-users at lists.gforge.statsbiblioteket.dk
https://lists.gforge.statsbiblioteket.dk/mailman/listinfo/netarchivesuite-users