[Netarchivesuite-users] store files in different directories

Kåre Fiedler Christiansen kfc at statsbiblioteket.dk
Thu Jun 12 09:44:38 CEST 2008


On Tue, 2008-06-10 at 16:42 +0200, aponb at gmx.at wrote:
> I would like to store arc-files of JobDefinition A in directory A and 
> files of JobDefinition B in directory B and so on. How can I do that? Is 
> that possible?

Hi.

That is currently not possible. However, all archiving is completely
pluggable, if you are capable of implementing a Java interface. You need
to implement the interface
  dk.netarkivet.common.distribute.arcrepository.ArcRepositoryClient

There are currently two working implementations
  dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient
and
  dk.netarkivet.common.distribute.arcrepository.LocalArcRepositoryClient


The first one is the one we initialise by default, which will talk to
our replicated distributed arc repository. It would probably require
some work to extend this implementation to use different directories,
you would need to look at the class
  dk.netarkivet.archive.bitarchive.BitarchiveAdmin
if you wish to try to change the directories used.


The second one will simply store files in the local file system. It
should be possible to extend it to have more logic in where it stores
the files.

You could build some class, and put it in the java class path, and
modify the setting
  settings.common.arcrepositoryClient.class
to point to your new class.


Unfrotunately, the name of the harvest definition isn't readily
available at the time of storing files. I'm not sure what the best
solution is for that. A quick brain storm says the needed information is
available in the database (you have the job number, and should be able
to relate it to the harvest definition name through link tables), or in
the metadata-file for the job.


Alternatviely you may submit this as a feature request on
https://gforge.statsbiblioteket.dk/projects/netarchivesuite/ and we will
see what we can do.


Best,
  Kåre




More information about the NetarchiveSuite-users mailing list