[Netarchivesuite-users] more upload errors
Bjarne Andersen
netarkivet at statsbiblioteket.dk
Mon Jul 28 14:47:33 CEST 2008
Thanks. This seems to show the problem:
the JMS-queue: DEV_COMMON_THIS_HACO_127_0_1_1_8081 has registered 2 consumers so another harvester-instance is also running and eating the
"Store OK" Messages sent from your ARCRepository.
You should check that you do not have running processes from old installations - e.g. use "ps fax | grep java"
The other errors looks like som startup / shutdown problems with NetarchiveSuite and the JMS-broker. Make sure that the JMS-broker is
running (and cleaned up) before starting any applications. And make sure that the JMS-broker is running when you try to stop applications
since they will do a clean disconnect from the JMS broker.
best
Bjarne Andersen
Martin Bella wrote:
> Hi Bjarne,
>
> here is the output of the "mq/bin/imqcmd list dst -u admin -passfile
> $PASSFILE" command:
>
> ----------------------------------------------------------------------------------------------------
> Name Type State Producers Consumers
> Msgs
> Total
> Count UnAck Avg Size
> ----------------------------------------------------------------------------------------------------
> DEV_COMMON_ANY_HIGHPRIORITY_HACO Queue RUNNING 1 0 0
> 0 0.0
> DEV_COMMON_INDEX_CLIENT_127_0_1_1_8081 Queue RUNNING 1 1 0
> 0 0.0
> DEV_COMMON_INDEX_SERVER Queue RUNNING 1 1 0
> 0 0.0
> DEV_COMMON_MONITOR Queue RUNNING 8 1 0
> 0 0.0
> DEV_COMMON_THE_ARCREPOS Queue RUNNING 3 1 0
> 0 0.0
> DEV_COMMON_THE_SCHED Queue RUNNING 1 1 0
> 0 0.0
> DEV_COMMON_THIS_HACO_127_0_1_1_8076 Queue RUNNING 0 1 0
> 0 0.0
> DEV_COMMON_THIS_HACO_127_0_1_1_8081 Queue RUNNING 1 2 0
> 0 0.0
> DEV_sos_ALL_BA Topic RUNNING 1 1 0
> 0 0.0
> DEV_sos_ANY_BA Queue RUNNING 1 1 0
> 0 0.0
> DEV_sos_THE_BAMON Queue RUNNING 2 1 0
> 0 0.0
> mq.sys.dmq Queue RUNNING 0 0 0
> 0 0.0
>
> At present my installation of Netarchive Suite uses only one harvester
> instance. It did the same thing again - uploaded both arc and metadata.arc
> file, but reported failure while uploading the arc file.
>
> Very fresh installation of Netarchive Suite also produced another error
> message:
>
> Cleaned up dk.netarkivet.common.distribute.HTTPRemoteFileRegistry
> Cleaning up dk.netarkivet.common.distribute.monitorregistry.JMSMonitorRegistryClient
> Cleaned up dk.netarkivet.common.distribute.monitorregistry.JMSMonitorRegistryClient
> Cleaning up dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
> Error while cleaning up dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
> java.lang.NullPointerException
> at dk.netarkivet.common.distribute.JMSConnection.removeListener(JMSConnection.java:640)
> at dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient.close(JMSArcRepositoryClient.java:124)
> at dk.netarkivet.harvester.harvesting.HarvestController.cleanup(HarvestController.java:114)
> at dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer.cleanup(HarvestControllerServer.java:254)
> at dk.netarkivet.common.utils.CleanupHook.run(CleanupHook.java:70)
> Cleaned up dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
> Jul 28, 2008 2:10:49 PM ClientCommunicatorAdmin restart
> WARNING: Failed to restart: java.io.IOException: Failed to get a RMI stub:
> javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: ubuntu804desktop.localdomain; nested exception is:
> java.net.ConnectException: Connection refused]
> Jul 28, 2008 2:10:49 PM RMIConnector RMIClientCommunicatorAdmin-doStop
> WARNING: Failed to call the method close():java.rmi.ConnectException:
> Connection refused to host: 127.0.1.1; nested exception is:
> java.net.ConnectException: Connection refused
> Jul 28, 2008 2:10:49 PM ClientCommunicatorAdmin Checker-run
> WARNING: Failed to check connection: java.net.ConnectException: Connection
> refused
> Jul 28, 2008 2:10:49 PM ClientCommunicatorAdmin Checker-run
> WARNING: stopping
>
> Best,
> Martin Bella
> University Library in Bratislava
>
>
>>For me it looks like the ARCRepository does the right thing - uploads the
>>files AND sends "Store OK" back to the harvester. It seems that
>>the harvester does not get that "Store OK" JMS-message - so it times out and
>>tries the same file again (3 times)
>>
>>While uploading could you check how many applications is connected to the
>>JMS-broker on each JMS-queue. This is done with:
>>/opt/sun/mq/bin/imqcmd list dst -u admin -passfile $PASSFILE
>>
>>where the file pointed at by $PASSFILE should contain one line:
>>imq.imqcmd.password=WHAT_EVER_YOUR_PASSWORD_IS_SET_TO
>>
>>the default password should be: admin - meaning that your $PASSFILE will
>>have the following line:
>>imq.imqcmd.password=admin
>>
>>The output from imqcmd command should state if the harvester and the
>>ARCRepository are connected in the right way to the JMS-broker
>>
>>best
>>--
>>Bjarne Andersen
>>Daily Manager - netarchive.dk
>>
>>State & University Library
>>Universitetsparken
>>DK-8000 Aarhus C
>>T: +45 89462165 - C: +45 25662353
>>CVR/SE 10100682 - EAN 5798000791084
>>http://netarchive.dk
>>
>>Martin Bella wrote:
>>
>>>Hi Eld,
>>>
>>>sorry for creating another thread. I did not get the answer in email form, but
>>>I can see it in the "Netarchive-users archives".
>>>
>>>Concerning the wrong checksum, you were right, now it works. Thanks.
>>>Conserning the second problem, I always start JMS as described in the
>>>Installation manual and I use the latest version of JMS, but the problem
>>>resists. Is there anything else (logs,...) I can send you to solve
>>>this?
>>>
>>>Best,
>>>Martin Bella
>>>University Library in Bratislava
>>>_______________________________________________
>>>NetarchiveSuite-users mailing list
>>>NetarchiveSuite-users at lists.gforge.statsbiblioteket.dk
>>>https://lists.gforge.statsbiblioteket.dk/mailman/listinfo/netarchivesuite-users
>>
> _______________________________________________
> NetarchiveSuite-users mailing list
> NetarchiveSuite-users at lists.gforge.statsbiblioteket.dk
> https://lists.gforge.statsbiblioteket.dk/mailman/listinfo/netarchivesuite-users
--
Bjarne Andersen
Driftsleder - netarkivet.dk
Statsbiblioteket
Universitetsparken
8000 Århus C
Tlf. 89462165 - Mobil 25662353
CVR/SE 10100682 - EAN 5798000791084
http://netarkivet.dk
-------------- next part --------------
A non-text attachment was scrubbed...
Name: netarkivet.vcf
Type: text/x-vcard
Size: 312 bytes
Desc: not available
URL: <http://ml.sbforge.org/pipermail/netarchivesuite-users/attachments/20080728/e4e56510/attachment-0002.vcf>
More information about the NetarchiveSuite-users
mailing list