[Netarchivesuite-devel] Problem running new Batch Job
Colin Rosenthal
csr at statsbiblioteket.dk
Tue Jul 7 10:40:39 CEST 2009
Hi,
I'm testing a new ArcBatchJob class and I don't understand why I'm
getting a NoClassDefFoundError for org.archive.net.UURIFactory. I've
tried both with and without specifically adding the heritrix jar as
batch dependency but it doesn't seem to make any difference. Here is
my command line and the output:
java -Ddk.netarkivet.settings.file=../settings_wayback_8080.xml
-Dsettings.common.applicationInstanceId=CDXIndexer8080 -cp
lib/dk.netarkivet.archive.jar dk.netarkivet.archive.tools.RunBatch
-Ndk.netarkivet.wayback.ExtractWaybackCDXBatchJob -R'.*'
-J/home/netarkiv/csr/batch/lib/dk.netarkivet.wayback.jar,/home/netarkiv/csr/batch/lib/wayback-core-1.4.0.jar,/home/netarkiv/csr/batch/lib/heritrix/lib/heritrix-1.14.3.jar
Jul 7, 2009 10:35:12 AM
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepositoryClient will retry a store 3 times and timeout on
each try after 3600000 milliseconds, and timeout on each getrequest
after 60000 milliseconds.
Jul 7, 2009 10:35:12 AM
dk.netarkivet.common.distribute.JMSConnectionSunMQ <init>
INFO: Creating instance of
dk.netarkivet.common.distribute.JMSConnectionSunMQ
Jul 7, 2009 10:35:12 AM dk.netarkivet.common.distribute.JMSConnection
initConnection
INFO: Initializing a JMS connection of type 'class
dk.netarkivet.common.distribute.JMSConnectionSunMQ' to Broker at
kb-test-adm-001.kb.dk:7676.
Jul 7, 2009 10:35:13 AM
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepository listens for replies on channel '[Queue
'PLIGT_COMMON_THIS_REPOS_CLIENT_130_225_27_142_NA_CDXINDEXER8080']'
Jul 7, 2009 10:35:13 AM
dk.netarkivet.common.utils.batch.LoadableJarBatchJob <init>
INFO: Loading loadableJarBatchJob using jarfiles:
dk.netarkivet.wayback.jarwayback-core-1.4.0.jarheritrix-1.14.3.jar and
jobclass 'dk.netarkivet.wayback.ExtractWaybackCDXBatchJob
Running batch job 'dk.netarkivet.wayback.ExtractWaybackCDXBatchJob from
jar-file
'/home/netarkiv/csr/batch/lib/dk.netarkivet.wayback.jar,/home/netarkiv/csr/batch/lib/wayback-core-1.4.0.jar,/home/netarkiv/csr/batch/lib/heritrix/lib/heritrix-1.14.3.jar'
on files matching '.*' on replica 'SBN', output written to stdout errors
written to stderr
Jul 7, 2009 10:35:15 AM
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient batch
WARNING: The batch job
'ID:15-130.225.27.142(ff:40:86:d7:73:db)-55674-1246955713422: To
PLIGT_COMMON_THE_REPOS ReplyTo
PLIGT_COMMON_THIS_REPOS_CLIENT_130_225_27_142_NA_CDXINDEXER8080 OK Job:
dk.netarkivet.common.utils.batch.LoadableJarBatchJob processing
dk.netarkivet.wayback.ExtractWaybackCDXBatchJob from
dk.netarkivet.common.utils.batch.LoadableJarBatchJob$ByteJarLoader at ba6c83'
resulted in the following error: java.lang.NoClassDefFoundError: Could
not initialize class org.archive.net.UURIFactory
java.lang.NoClassDefFoundError: Could not initialize class
org.archive.net.UURIFactory
at
org.archive.wayback.util.url.AggressiveUrlCanonicalizer.urlStringToKey(AggressiveUrlCanonicalizer.java:234)
at
org.archive.wayback.resourcestore.indexer.ARCRecordToSearchResultAdapter.adaptInner(ARCRecordToSearchResultAdapter.java:140)
at
org.archive.wayback.resourcestore.indexer.ARCRecordToSearchResultAdapter.adapt(ARCRecordToSearchResultAdapter.java:65)
at
dk.netarkivet.wayback.ExtractWaybackCDXBatchJob.processRecord(ExtractWaybackCDXBatchJob.java:64)
at
dk.netarkivet.common.utils.arc.ARCBatchJob.processFile(ARCBatchJob.java:142)
at
dk.netarkivet.common.utils.batch.LoadableJarBatchJob.processFile(LoadableJarBatchJob.java:213)
at
dk.netarkivet.common.utils.batch.BatchLocalFiles.processFile(BatchLocalFiles.java:115)
at
dk.netarkivet.common.utils.batch.BatchLocalFiles.run(BatchLocalFiles.java:82)
at
dk.netarkivet.archive.bitarchive.Bitarchive.batch(Bitarchive.java:240)
at
dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer$1.run(BitarchiveServer.java:396)
Processed 0 files with 0 failures
Cleaning up dk.netarkivet.common.distribute.JMSConnectionSunMQ
Cleaned up dk.netarkivet.common.distribute.JMSConnectionSunMQ
--
Colin
More information about the Netarchivesuite-devel
mailing list