[Netarchivesuite-devel] Problem running new Batch Job

Colin Rosenthal csr at statsbiblioteket.dk
Tue Jul 7 10:40:39 CEST 2009


Hi,

I'm testing a new ArcBatchJob class and I don't understand why I'm 
getting a NoClassDefFoundError for org.archive.net.UURIFactory. I've 
tried both with and without specifically adding the heritrix jar as 
batch dependency but it doesn't seem to make any difference. Here is
my command line and the output:

java -Ddk.netarkivet.settings.file=../settings_wayback_8080.xml   
-Dsettings.common.applicationInstanceId=CDXIndexer8080  -cp 
lib/dk.netarkivet.archive.jar   dk.netarkivet.archive.tools.RunBatch  
-Ndk.netarkivet.wayback.ExtractWaybackCDXBatchJob  -R'.*'  
-J/home/netarkiv/csr/batch/lib/dk.netarkivet.wayback.jar,/home/netarkiv/csr/batch/lib/wayback-core-1.4.0.jar,/home/netarkiv/csr/batch/lib/heritrix/lib/heritrix-1.14.3.jar
Jul 7, 2009 10:35:12 AM 
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepositoryClient will retry a store 3 times and timeout on 
each try after 3600000 milliseconds, and timeout on each getrequest 
after 60000 milliseconds.
Jul 7, 2009 10:35:12 AM 
dk.netarkivet.common.distribute.JMSConnectionSunMQ <init>
INFO: Creating instance of 
dk.netarkivet.common.distribute.JMSConnectionSunMQ
Jul 7, 2009 10:35:12 AM dk.netarkivet.common.distribute.JMSConnection 
initConnection
INFO: Initializing a JMS connection of type 'class 
dk.netarkivet.common.distribute.JMSConnectionSunMQ' to Broker at 
kb-test-adm-001.kb.dk:7676.
Jul 7, 2009 10:35:13 AM 
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepository listens for replies on channel '[Queue 
'PLIGT_COMMON_THIS_REPOS_CLIENT_130_225_27_142_NA_CDXINDEXER8080']'
Jul 7, 2009 10:35:13 AM 
dk.netarkivet.common.utils.batch.LoadableJarBatchJob <init>
INFO: Loading loadableJarBatchJob using jarfiles: 
dk.netarkivet.wayback.jarwayback-core-1.4.0.jarheritrix-1.14.3.jar and 
jobclass 'dk.netarkivet.wayback.ExtractWaybackCDXBatchJob
Running batch job 'dk.netarkivet.wayback.ExtractWaybackCDXBatchJob from 
jar-file 
'/home/netarkiv/csr/batch/lib/dk.netarkivet.wayback.jar,/home/netarkiv/csr/batch/lib/wayback-core-1.4.0.jar,/home/netarkiv/csr/batch/lib/heritrix/lib/heritrix-1.14.3.jar' 
on files matching '.*' on replica 'SBN', output written to stdout errors 
written to stderr
Jul 7, 2009 10:35:15 AM 
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient batch
WARNING: The batch job 
'ID:15-130.225.27.142(ff:40:86:d7:73:db)-55674-1246955713422: To 
PLIGT_COMMON_THE_REPOS ReplyTo 
PLIGT_COMMON_THIS_REPOS_CLIENT_130_225_27_142_NA_CDXINDEXER8080 OK Job: 
dk.netarkivet.common.utils.batch.LoadableJarBatchJob processing 
dk.netarkivet.wayback.ExtractWaybackCDXBatchJob from 
dk.netarkivet.common.utils.batch.LoadableJarBatchJob$ByteJarLoader at ba6c83' 
resulted in the following error: java.lang.NoClassDefFoundError: Could 
not initialize class org.archive.net.UURIFactory
java.lang.NoClassDefFoundError: Could not initialize class 
org.archive.net.UURIFactory
    at 
org.archive.wayback.util.url.AggressiveUrlCanonicalizer.urlStringToKey(AggressiveUrlCanonicalizer.java:234)
    at 
org.archive.wayback.resourcestore.indexer.ARCRecordToSearchResultAdapter.adaptInner(ARCRecordToSearchResultAdapter.java:140)
    at 
org.archive.wayback.resourcestore.indexer.ARCRecordToSearchResultAdapter.adapt(ARCRecordToSearchResultAdapter.java:65)
    at 
dk.netarkivet.wayback.ExtractWaybackCDXBatchJob.processRecord(ExtractWaybackCDXBatchJob.java:64)
    at 
dk.netarkivet.common.utils.arc.ARCBatchJob.processFile(ARCBatchJob.java:142)
    at 
dk.netarkivet.common.utils.batch.LoadableJarBatchJob.processFile(LoadableJarBatchJob.java:213)
    at 
dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:115)
    at 
dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:82)
    at 
dk.netarkivet.archive.bitarchive.Bitarchive.batch(Bitarchive.java:240)
    at 
dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer$1.run(BitarchiveServer.java:396)

Processed 0 files with 0 failures
Cleaning up dk.netarkivet.common.distribute.JMSConnectionSunMQ
Cleaned up dk.netarkivet.common.distribute.JMSConnectionSunMQ

--
Colin



More information about the Netarchivesuite-devel mailing list