[Netarchivesuite-users] NetarchiveSuite Version: 4.4.0 does not run jobs
Meelis Mihhailov
meelis at nlib.ee
Wed Oct 29 16:24:54 CET 2014
Hi Mikis
Cleared all the logs and started with a fresh files in order to get the
newest data.
While starting with startall script I can now see lines telling me that
channel "FOCUSED" is invalid:
---
Oct 29, 2014 5:09:48 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
---
From the log file I see no conflict lines. Seems that all is OK and
everything seems to work as it should. As far as I understand :)
I'll add result from the startup and logfile content below.
Meelis
------------------------------------------------------------------------------------------------------------------------------
crawler at veebiarhiiv:~/BASE$ ./startall_veebiarhiiv_digar_ee.sh
--------------------------------------------
STARTING MACHINE: crawler at localhost
crawler at localhost's password:
Starting all applications on: localhost
Starting linux application: GUIApplication_testcrawler
Starting linux application: ArcRepositoryApplication_testcrawler
Starting linux application: BitarchiveMonitorApplication_testcrawler
Starting linux application: BitarchiveApplication_testcrawler
Starting linux application: HarvestControllerApplication_low
Starting linux application: HarvestControllerApplication_high_1
Starting linux application: HarvestControllerApplication_high_2
Starting linux application: HarvestControllerApplication_high_3
Starting linux application: HarvestControllerApplication_high_4
Starting linux application: HarvestControllerApplication_high_5
Starting linux application: HarvestControllerApplication_high_6
Starting linux application: HarvestControllerApplication_high_7
Starting linux application: HarvestControllerApplication_high_8
Starting linux application: HarvestControllerApplication_high_9
Starting linux application: HarvestControllerApplication_high_10
Starting linux application: HarvestControllerApplication_high_11
Starting linux application: HarvestControllerApplication_high_12
Starting linux application: HarvestControllerApplication_high_13
Starting linux application: HarvestControllerApplication_high_14
Starting linux application: HarvestControllerApplication_high_15
Starting linux application: HarvestControllerApplication_high_16
Starting linux application: HarvestControllerApplication_high_17
Starting linux application: HarvestControllerApplication_high_18
Starting linux application: HarvestControllerApplication_high_19
Starting linux application: HarvestControllerApplication_high_20
Starting linux application: IndexServerApplication_testcrawler
Starting linux application: ViewerProxyApplication_testcrawler
Starting linux application: HarvestJobManagerApplication_testcrawler
Starting dk.netarkivet.archive.arcrepository.ArcRepository
Version: 4.4.0 status RELEASE
dk.netarkivet.archive.arcrepository.ArcRepository Running
log4j:WARN No appenders could be found for logger (com.mchange.v2.log.MLog).
log4j:WARN Please initialize the log4j system properly.
Starting dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer
Version: 4.4.0 status RELEASE
dk.netarkivet.archive.bitarchive.distribute.BitarchiveServer Running
Starting dk.netarkivet.archive.bitarchive.distribute.BitarchiveMonitorServer
Version: 4.4.0 status RELEASE
dk.netarkivet.archive.bitarchive.distribute.BitarchiveMonitorServer Running
Starting dk.netarkivet.common.webinterface.GUIWebServer
Version: 4.4.0 status RELEASE
dk.netarkivet.common.webinterface.GUIWebServer Running
log4j:WARN No appenders could be found for logger (org.mortbay.log).
log4j:WARN Please initialize the log4j system properly.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:48 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:47 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:48 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'FOCUSED' is invalid. Will
stop.
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Starting
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Version: 4.4.0 status RELEASE
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer
Running
Oct 29, 2014 5:09:46 PM
dk.netarkivet.harvester.harvesting.distribute.HarvestControllerServer visit
SEVERE: Received message stating that channel 'SNAPSHOT' is invalid.
Will stop.
Starting dk.netarkivet.harvester.indexserver.IndexServer
Version: 4.4.0 status RELEASE
Starting dk.netarkivet.viewerproxy.ViewerProxy
Version: 4.4.0 status RELEASE
----------------------------------------------------------------------------------------------------------------------------------------------------------------
* HarvestJobManagerApplication_testcrawler0.log.0
----------------------------------------------------------------------------------------------------------------------------------------------------------------
Oct 29, 2014 5:09:46 PM dk.netarkivet.common.utils.Settings getAll
FINE: Searching for a setting for key:
settings.common.replicas.replica.replicaId
Oct 29, 2014 5:09:47 PM dk.netarkivet.common.utils.Settings getAll
FINE: Value found in loaded data: A
Oct 29, 2014 5:09:46 PM
dk.netarkivet.common.distribute.JMSConnectionSunMQ <init>
INFO: Creating instance of
dk.netarkivet.common.distribute.JMSConnectionSunMQ
Oct 29, 2014 5:09:49 PM
dk.netarkivet.common.distribute.JMSConnectionSunMQ getConnectionFactory
INFO: Establishing SunMQ JMS Connection to 'localhost:7676'
Oct 29, 2014 5:09:49 PM
dk.netarkivet.harvester.datamodel.HarvestDBConnection initDataSource
INFO: Connection pool initialized with the following values:
- minPoolSize=5
- maxPoolSize=10
- acquireIncrement=5
- maxStatements=0
- maxStatementsPerConnection=0
- idleConnTestPeriod=0
- idleConnTestQuery='null'
- idleConnTestOnCheckin=false
Oct 29, 2014 5:09:50 PM dk.netarkivet.harvester.scheduler.JobDispatcher
<init>
INFO: Creating JobDispatcher
Oct 29, 2014 5:09:50 PM dk.netarkivet.common.utils.ApplicationUtils
logAndPrint
INFO: Starting dk.netarkivet.harvester.scheduler.HarvestJobManager
Version: 4.4.0 status RELEASE
Oct 29, 2014 5:09:50 PM dk.netarkivet.common.utils.ApplicationUtils startApp
INFO: Using settings files
'/arhiiv/testcrawler/TESTCRAWLER/conf/settings_HarvestJobManagerApplication_testcrawler.xml'
Oct 29, 2014 5:09:50 PM
dk.netarkivet.monitor.distribute.JMSMonitorRegistryClient register
INFO: Registering this client for monitoring every 1 minutes, using
hostname 'veebiarhiiv.nlib.ee' and JMX/RMI ports 8118/8218
Oct 29, 2014 5:09:50 PM
dk.netarkivet.common.management.MBeanConnectorCreator exposeJMXMBeanServer
INFO: Registered mbean server in registry on port 8118 communicating on
port 8218 using password file 'conf/jmxremote.password'.
Service URL is
service:jmx:rmi://veebiarhiiv.nlib.ee:8218/jndi/rmi://veebiarhiiv.nlib.ee:8118/jmxrmi
Oct 29, 2014 5:09:50 PM
dk.netarkivet.common.lifecycle.LifeCycleComponent start
FINE: Starting dk.netarkivet.harvester.scheduler.HarvestJobManager at 3ab99c20
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester low registered on channel SNAPSHOT
Oct 29, 2014 5:09:50 PM dk.netarkivet.common.utils.ApplicationUtils
logAndPrint
INFO: dk.netarkivet.harvester.scheduler.HarvestJobManager Running
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
Oct 29, 2014 5:09:50 PM dk.netarkivet.harvester.scheduler.JobSupervisor
rescheduleLeftOverJobs
INFO: 0 jobs has been resubmitted.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'SNAPSHOT' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_1 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_2 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_4 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2, high_4 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_6 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2, high_4, high_6 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_3 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2, high_3, high_4, high_6 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_5 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2, high_3, high_4, high_5, high_6 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_7 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_2, high_3, high_4, high_5, high_6,
high_7 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_10 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_2, high_3, high_4, high_5,
high_6, high_7 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_9 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_2, high_3, high_4, high_5,
high_6, high_7, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_11 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_2, high_3, high_4,
high_5, high_6, high_7, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_8 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_2, high_3, high_4,
high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_12 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_2, high_3,
high_4, high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_13 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13, high_2,
high_3, high_4, high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_14 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_2, high_3, high_4, high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_16 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_16, high_2, high_3, high_4, high_5, high_6, high_7,
high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_15 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_15, high_16, high_2, high_3, high_4, high_5, high_6,
high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_18 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_15, high_16, high_18, high_2, high_3, high_4, high_5,
high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_19 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_15, high_16, high_18, high_19, high_2, high_3, high_4,
high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_17 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_15, high_16, high_17, high_18, high_19, high_2, high_3,
high_4, high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry register
INFO: Harvester high_20 registered on channel FOCUSED
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvestChannelRegistry logStatus
INFO: HarvestChannelRegistry status:
- SNAPSHOT { low }
- FOCUSED { high_1, high_10, high_11, high_12, high_13,
high_14, high_15, high_16, high_17, high_18, high_19, high_2, high_20,
high_3, high_4, high_5, high_6, high_7, high_8, high_9 }
Oct 29, 2014 5:09:50 PM
dk.netarkivet.harvester.scheduler.HarvesterStatusReceiver visit
INFO: Sent a message to notify that harvest channel 'FOCUSED' is valid.
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO read
FINE: Reading harvestdefinition w/ id 1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO read
FINE: Partialharvest found w/ id 1
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.ScheduleDBDAO read
FINE: Creating frequency for (timeunit,anytime,numtimeunits,hour,
minute, dayofweek,dayofmonth) = (4, true,12,null,null,null,null,)
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.Frequency
getNewInstance
FINE: Creating a MONTHLY frequency.
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.ScheduleDBDAO read
FINE: Creating frequency for (timeunit,anytime,numtimeunits,hour,
minute, dayofweek,dayofmonth) = (4, true,12,null,null,null,null,)
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.Frequency
getNewInstance
FINE: Creating a MONTHLY frequency.
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask
generateJobs
INFO: Starting to create jobs for harvest definition #1(MEELIS)
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator generateJobs
INFO: Generating jobs for harvestdefinition # 1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator
processDomainConfigurationSubset
FINE: Adding domainconfigs with the same order.xml for harvest # 1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator getNewJob
INFO: No channel mapping registered for harvest id 1, will use default.
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.datamodel.HeritrixTemplate
editOrderXML_ArchiveFormat
FINE: WARC format selected to be used by Heritrix
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.JobDBDAO create
FINE: Creating Job 1 (state = NEW, HD = 1, channel = FOCUSED, snapshot =
false, forcemaxcount = -1, forcemaxbytes = 1000000000,
forcemaxrunningtime = 0, orderxml = default_orderxml, numconfigs = 1,
created = Wed Oct 29 17:20:20 EET 2014)
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.Job
getHarvestFilenamePrefix
WARNING: HarvestnamePrefix not yet set for job 1. Set it by using the
naming scheme. This should only happen for old jobs being read
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.Job
setDefaultHarvestNamePrefix
FINE: Applying the default ArchiveFileNaming class
'dk.netarkivet.harvester.harvesting.LegacyNamingConvention'.
Oct 29, 2014 5:20:20 PM dk.netarkivet.harvester.datamodel.Job
setDefaultHarvestNamePrefix
FINE: The harvestPrefix of this job is: 1-1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.jobgen.DefaultJobGenerator
processDomainConfigurationSubset
FINE: Created # 1 jobs for harvest # 1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.jobgen.AbstractJobGenerator generateJobs
INFO: Finished generating 1 jobs for harvestdefinition # 1
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask$1 run
INFO: Created 1 jobs for harvest definition (MEELIS)
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.datamodel.HarvestDefinitionDBDAO update
FINE: 1 partialharvests records updated
Oct 29, 2014 5:20:20 PM
dk.netarkivet.harvester.scheduler.HarvestJobGenerator$JobGeneratorTask$1 run
FINE: Removed HD #1(MEELIS) from list of harvestdefinitions to be
scheduled. Harvestdefinitions still to be scheduled: []
----------------------------------------------------------------------------------------------------------------------------------------------------------------
On 29.10.2014 16:58, Mikis Seth Sørensen wrote:
> Sounds weird, it looks like the channel registered by the
> HarvestControlServer and the HarvestJobManagers harvestchannel table agree
> on the exists of a FOCUSED channel.
>
> Does the HarvestJobManager log contain any relevant information about the
> FOCUSED channel conflict?
>
> Best
> Mikis
>
> On 10/29/14, 11:17 AM, "Meelis Mihhailov" <meelis at nlib.ee> wrote:
>
>> Hi Nicholas
>>
>> Checked it and there are two values present :)
>>
>>
>> crawler=# SELECT * from harvestchannel;
>> id | name | issnapshot | isdefault | comments
>> ----+----------+------------+-----------+--------------------------------
>> 2 | FOCUSED | f | t | Channel for selective harvests
>> 1 | SNAPSHOT | t | t | Channel for snapshot harvests
>> (2 rows)
>>
>>
>>
>> -----------------------------------------------------
>> Meelis Mihhailov
>> Süsteemiadministraator / Systemadministrator
>> Eesti Rahvusraamatukogu / National Library Of Estonia
>>
>> Telefon: 630 7178 / Phone: +372 630 7178
>> E-post: meelis at nlib.ee / E-mail: meelis at nlib.ee
>>
>> Tõnismägi 2, 15189 Tallinn, ESTONIA
>>
>> www.eestirahvusraamatukogu.ee
>> -----------------------------------------------------
>>
>>
More information about the NetarchiveSuite-users
mailing list