[Netarchivesuite-users] Jobs fail

[Bjarne Andersen]

This look like bug#1336. This has been noticed by others as well. A fixing attempt has been done it the latest release. Its a hard to solve bug because it appears because heritrix stops responding for a short (or longer) period of time and thus NS thinks the job is dead. It seems to could have something to do with the load of the hardware crawling so HW loaded 100% on CPU will have a bigger chance of getting this. Hopefullly the attempted fix will actually fix this. Or maybe an upgrade of heritrix from 1.12.1b to 1.14.1 could potentially help
_
bjarne

Sent fra min HTC Touch Pro

----- Oprindelig meddelelse -----
Fra: aponb at gmx.at <aponb at gmx.at>
Sendt: 4. maj 2009 06:17
Til: netarchivesuite-users at lists.gforge.statsbiblioteket.dk <netarchivesuite-users at lists.gforge.statsbiblioteket.dk>
Emne: [Netarchivesuite-users] Jobs fail


Since a few days most of all my jobs fail, although all arc-Files were uploaded to the archiv.
The error appended appears. Then I tried to recover the job by following the posted instructions. But that also doesn't work because no more arc were found to upload (they are already in the archive location).
Do you have any idea what can be wrong? I am doing a full-crawl for a while with these machines and there were no problems till now.


dk.netarkivet.common.exceptions.IOFailure: Failed to connect to URL service:jmx:rmi:///jndi/rmi://localhost:7067/jmxrmi after 0 attempts
        at dk.netarkivet.common.utils.JMXUtils.getJMXConnector(JMXUtils.java:366)
        at dk.netarkivet.harvester.harvesting.JMXHeritrixController.getHeritrixJMXConnector(JMXHeritrixController.java:858)
        at dk.netarkivet.harvester.harvesting.JMXHeritrixController.executeHeritrixCommand(JMXHeritrixController.java:782)
        at dk.netarkivet.harvester.harvesting.JMXHeritrixController.crawlIsEnded(JMXHeritrixController.java:393)
        at dk.netarkivet.harvester.harvesting.HeritrixLauncher.doCrawlLoop(HeritrixLauncher.java:214)
        at dk.netarkivet.harvester.harvesting.HeritrixLauncher.doCrawl(HeritrixLauncher.java:196)
        at dk.netarkivet.harvester.harvesting.HarvestController.runHarvest(HarvestController.java:220)
        at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer$HarvesterThread.run(HarvestControllerServer.java:632)
Caused by: java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.CommunicationException [Root exception is java.rmi.ConnectIOException: error during JRMP connection establishment; nested exception is:
        java.net.SocketTimeoutException: Read timed out]
        at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:323)
        at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:248)
        at dk.netarkivet.common.utils.JMXUtils.getJMXConnector(JMXUtils.java:353)
        ... 7 more
Caused by: javax.naming.CommunicationException [Root exception is java.rmi.ConnectIOException: error during JRMP connection establishment; nested exception is:
        java.net.SocketTimeoutException: Read timed out]
        at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:101)
        at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:185)
        at javax.naming.InitialContext.lookup(InitialContext.java:392)
        at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1871)
        at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1841)
        at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:257)
        ... 9 more
Caused by: java.rmi.ConnectIOException: error during JRMP connection establishment; nested exception is:
        java.net.SocketTimeoutException: Read timed out
        at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:286)
        at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
        at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:97)
        ... 14 more
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:129)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        at java.io.DataInputStream.readByte(DataInputStream.java:248)
        at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:228)
        ... 18 more




_______________________________________________
NetarchiveSuite-users mailing list
NetarchiveSuite-users at lists.gforge.statsbiblioteket.dk
https://lists.gforge.statsbiblioteket.dk/mailman/listinfo/netarchivesuite-users