[Netarchivesuite-users] Uploading files

Jonas Lindberg Frellesen jolf at kb.dk
Fri Oct 9 15:47:19 CEST 2009 

Hi

There is absolutely no problem in using the settings file for a harvester.

I cannot see from these error messages, why the upload has failed.
It might say more in the log files for the ArcRepository.
Could you send the one which contains the entries for the time of your upload attempt?

The problem could also be in the configuration file, so could you also send it?


Best Regards
Jonas

-----Oprindelig meddelelse-----
Fra: netarchivesuite-users-bounces at lists.gforge.statsbiblioteket.dk [mailto:netarchivesuite-users-bounces at lists.gforge.statsbiblioteket.dk] På vegne af aponb at gmx.at
Sendt: 8. oktober 2009 16:31
Til: NetarchiveSuite-users
Emne: [Netarchivesuite-users] Uploading files

Dear all!

It happend now that for some reasons one file could not be uploaded. I
was used to do it with the upload tool.
Due to the DeploymentApplication we have now generated settings.xml files.
I called the upload application with the setting-file of an not used
HarvesterController (was that right?):
java
"-Ddk.netarkivet.settings.file=$NETARCHIVEDIR/conf/settings_HarvestControllerApplication_8801harvester.xml"
dk.netarkivet.archive.tools.Upload
/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz
and got following response. What can be the reason for it? There was an
issue  time ago with the http-port, which was not unique, but that
should be fixed, am I right?
Do you have any suggestions?

Regards
a.


Connecting to ArcRepository
08.10.2009 16:10:28
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepositoryClient will retry a store 3 times and timeout on
each try after 3600000 milliseconds, and timeout on each getrequest
after 60000 milliseconds.
08.10.2009 16:10:28 dk.netarkivet.common.distribute.JMSConnectionSunMQ
<init>
INFO: Creating instance of
dk.netarkivet.common.distribute.JMSConnectionSunMQ
08.10.2009 16:10:28 dk.netarkivet.common.distribute.JMSConnection
initConnection
INFO: Initializing a JMS connection of type 'class
dk.netarkivet.common.distribute.JMSConnectionSunMQ' to Broker at wc01:7676.
08.10.2009 16:10:28
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepository listens for replies on channel '[Queue
'ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER']'
Uploading file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'...
08.10.2009 16:10:38
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:48
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:58
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:58
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'

Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'

Error while storing file: dk.netarkivet.common.exceptions.IOFailure:
Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'

dk.netarkivet.common.exceptions.IOFailure: Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'

        at
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient.store(JMSArcRepositoryClient.java:330)
        at
dk.netarkivet.archive.tools.Upload.uploadSingleFile(Upload.java:122)
        at dk.netarkivet.archive.tools.Upload.main(Upload.java:71)
Uploading file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
failed
All files processed, closing connection to ArcRepository
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection
removeListener
INFO: Removing listener from channel
'ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER'
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection cleanup
INFO: Starting cleanup
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection cleanup
INFO: Cleanup finished
Cleaning up dk.netarkivet.common.distribute.JMSConnectionSunMQ
Cleaned up dk.netarkivet.common.distribute.JMSConnectionSunMQ



_______________________________________________
NetarchiveSuite-users mailing list
NetarchiveSuite-users at lists.gforge.statsbiblioteket.dk
https://lists.gforge.statsbiblioteket.dk/mailman/listinfo/netarchivesuite-users

More information about the NetarchiveSuite-users mailing list