[Netarchivesuite-users] Uploading files
aponb at gmx.at
aponb at gmx.at
Thu Oct 8 16:30:41 CEST 2009
Dear all!
It happend now that for some reasons one file could not be uploaded. I
was used to do it with the upload tool.
Due to the DeploymentApplication we have now generated settings.xml files.
I called the upload application with the setting-file of an not used
HarvesterController (was that right?):
java
"-Ddk.netarkivet.settings.file=$NETARCHIVEDIR/conf/settings_HarvestControllerApplication_8801harvester.xml"
dk.netarkivet.archive.tools.Upload
/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz
and got following response. What can be the reason for it? There was an
issue time ago with the http-port, which was not unique, but that
should be fixed, am I right?
Do you have any suggestions?
Regards
a.
Connecting to ArcRepository
08.10.2009 16:10:28
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepositoryClient will retry a store 3 times and timeout on
each try after 3600000 milliseconds, and timeout on each getrequest
after 60000 milliseconds.
08.10.2009 16:10:28 dk.netarkivet.common.distribute.JMSConnectionSunMQ
<init>
INFO: Creating instance of
dk.netarkivet.common.distribute.JMSConnectionSunMQ
08.10.2009 16:10:28 dk.netarkivet.common.distribute.JMSConnection
initConnection
INFO: Initializing a JMS connection of type 'class
dk.netarkivet.common.distribute.JMSConnectionSunMQ' to Broker at wc01:7676.
08.10.2009 16:10:28
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient <init>
INFO: JMSArcRepository listens for replies on channel '[Queue
'ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER']'
Uploading file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'...
08.10.2009 16:10:38
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:48
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:58
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
08.10.2009 16:10:58
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient store
WARNUNG: Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
Error while storing file: dk.netarkivet.common.exceptions.IOFailure:
Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
dk.netarkivet.common.exceptions.IOFailure: Could not store
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
after 3 attempts. Giving up.
The returned message
'ID:15-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011037309: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 1 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:18-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011047151: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 2 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
The returned message
'ID:21-172.16.14.149(a7:f4:2c:68:2a:96)-48675-1255011056983: To
ONB_COMMON_THE_REPOS ReplyTo
ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER Error:
Failure while trying to store ARC file:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz Arcfile:
2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz' was not ok
while waiting for reply on store of file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
on attempt number 3 of 3. Error message was 'Failure while trying to
store ARC file: 2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
at
dk.netarkivet.archive.arcrepository.distribute.JMSArcRepositoryClient.store(JMSArcRepositoryClient.java:330)
at
dk.netarkivet.archive.tools.Upload.uploadSingleFile(Upload.java:122)
at dk.netarkivet.archive.tools.Upload.main(Upload.java:71)
Uploading file
'/home/netarchive/data/netarchivesuite/oldjobs/2832_1254191275544/arcs/2832-10-20090929075126-00033-webcrawler06.onb.ac.at.arc.gz'
failed
All files processed, closing connection to ArcRepository
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection
removeListener
INFO: Removing listener from channel
'ONB_COMMON_THIS_REPOS_CLIENT_172_16_14_149_HCA_8801HARVESTER'
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection cleanup
INFO: Starting cleanup
08.10.2009 16:10:58 dk.netarkivet.common.distribute.JMSConnection cleanup
INFO: Cleanup finished
Cleaning up dk.netarkivet.common.distribute.JMSConnectionSunMQ
Cleaned up dk.netarkivet.common.distribute.JMSConnectionSunMQ
More information about the NetarchiveSuite-users
mailing list