[Netarchivesuite-users] NAS 4.2 harvest template update/add problem

Meelis Mihhailov meelis at nlib.ee
Mon Sep 2 13:24:52 CEST 2013


Thanks Colin,

That did the trick :)

I looked into it a little more and found out that 
HarvestdatabaseUpdateApplication program did not update the template 
correctly. I did give the new template for the program but it managed to 
"bundle" the old and new together resulting a ... thing I call my 
template :)

Strange ...

But it's working now. Had to replace a little more than "newObject"  :)

Thank you!


Tervitades,

Meelis Mihhailov
----------------
Eesti Rahvusraamatukogu
Süsteemiadministraator

Telefon : 6307 178
E-post : meelis at nlib.ee

On 2.09.2013 14:09, Colin Rosenthal wrote:
> Hi Meelis,
>
> I think the problem is that you have "newobject" in some places where
> you should have "newObject".
>
> regards,
> Colin
>
> On 09/02/2013 12:50 PM, Colin Rosenthal wrote:
>> Thanks. I can see now that it complains, although I get a slightly
>> different error message:
>>
>>           dk.netarkivet.common.exceptions.ArgumentNotValid: Template
>> error: Missing node:
>> /crawl-order/controller/map[@name='pre-fetch-processors']/newObject[@name='QuotaEnforcer']/long[@name='group-max-all-kb']
>>
>>
>> I will look into it.
>>
>> /Colin
>>
>> On 09/02/2013 12:27 PM, Meelis Mihhailov wrote:
>>> XML added as an attachment :)
>>>
>>>
>>> Tervitades,
>>>
>>> Meelis Mihhailov
>>> ----------------
>>> Eesti Rahvusraamatukogu
>>> Süsteemiadministraator
>>>
>>> Telefon : 6307 178
>>> E-post : meelis at nlib.ee
>>>
>>> On 2.09.2013 12:36, Colin Rosenthal wrote:
>>>> Hi Meelis,
>>>> I haven't been able to reproduce the problem yet. Can you send the
>>>> order
>>>> template file you are having trouble with as an attachment?
>>>> regards,
>>>> Colin
>>>>
>>>> On 09/02/2013 11:10 AM, Meelis Mihhailov wrote:
>>>>> Hi Colin and Bjarne,
>>>>>
>>>>> I used the order_xml that came with the update (at least I think so
>>>>> as I
>>>>> did copy them over). After that I used this
>>>>> HarvestdatabaseUpdateApplication program to update harvest template in
>>>>> the database (returned no errors)
>>>>>
>>>>> I check the xml and I do have
>>>>>
>>>>> <long name="queue-total-budget">-1</long>
>>>>>
>>>>> in the file right where it should be. :)
>>>>>
>>>>> To be sure I downloaded the original from the database and tried to
>>>>> add
>>>>> it again without doing any changes and it also returned the same
>>>>> error.
>>>>>
>>>>> Tervitades,
>>>>>
>>>>> Meelis Mihhailov
>>>>> ----------------
>>>>> Eesti Rahvusraamatukogu
>>>>> Süsteemiadministraator
>>>>>
>>>>> Telefon : 6307 178
>>>>> E-post : meelis at nlib.ee
>>>>>
>>>>> On 2.09.2013 11:42, Bjarne Andersen wrote:
>>>>>> I have tried adding a new template to our 4.2 test-system - this goes
>>>>>> allright.
>>>>>> The error looks like the xml-file is missing a vital part ? - could
>>>>>> there be an XML-error ?
>>>>>>
>>>>>> Missing node:
>>>>>> /crawl-order/controller/newObject[@name='frontier']/long[@name='queue-total-budget']
>>>>>>
>>>>>>
>>>>>>
>>>>>> -
>>>>>> Bjarne
>>>>>> ________________________________________
>>>>>> Fra: netarchivesuite-users-bounces at ml.sbforge.org
>>>>>> [netarchivesuite-users-bounces at ml.sbforge.org] På vegne af
>>>>>> Meelis Mihhailov [meelis at nlib.ee]
>>>>>> Sendt: 2. september 2013 10:16
>>>>>> Til: Netarchive Suite Users
>>>>>> Emne: [Netarchivesuite-users] NAS 4.2 harvest template update/add
>>>>>> problem
>>>>>>
>>>>>> Hi all!
>>>>>>
>>>>>> I managed to update NAS to version 4.2 but cannot add or update
>>>>>> harvest
>>>>>> templates. Using postgreSQL database.
>>>>>>
>>>>>> Tried to create a new harvest template (using the default as a
>>>>>> base) but
>>>>>> no luck :(
>>>>>>
>>>>>> Can anyone help me with this problem?
>>>>>>
>>>>>> The error I get:
>>>>>>
>>>>>> -----------------------------------------------------------------------
>>>>>>
>>>>>>        dk.netarkivet.common.exceptions.ArgumentNotValid: Template
>>>>>> error:
>>>>>> Missing node:
>>>>>> /crawl-order/controller/newObject[@name='frontier']/long[@name='queue-total-budget']
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> dk.netarkivet.common.exceptions.ArgumentNotValid.checkTrue(ArgumentNotValid.java:166)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> dk.netarkivet.harvester.datamodel.HeritrixTemplate.(HeritrixTemplate.java:281)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> dk.netarkivet.harvester.datamodel.HeritrixTemplate.(HeritrixTemplate.java:340)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.apache.jsp.Definitions_002dupload_002dharvest_002dtemplate_jsp._jspService(org.apache.jsp.Definitions_002dupload_002dharvest_002dtemplate_jsp:178)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:109)
>>>>>>             at
>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>>>>>>             at
>>>>>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:389)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:486)
>>>>>>
>>>>>>             at
>>>>>> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:380)
>>>>>>             at
>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>>>>>>             at
>>>>>> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>>>>>>             at
>>>>>> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>>>>>>
>>>>>>             at org.mortbay.jetty.Server.handle(Server.java:322)
>>>>>>             at
>>>>>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>>>>>>             at
>>>>>> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>>>>>>             at
>>>>>> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>>>>>>             at
>>>>>> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>>>>>>
>>>>>>
>>>>>>             at
>>>>>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>>>>>>
>>>>>>
>>>>>>
>>>>>> I did check the permissions for the directory and everything seems
>>>>>> to be
>>>>>> OK.
>>>>>>
>>>>>> -----------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>>
>>>>>> Meelis Mihhailov
>>>>>> ----------------
>>>>>> National Library Of Estonia
>>>>>> meelis at nlib.ee
>>>>>> _______________________________________________
>>>>>> NetarchiveSuite-users mailing list
>>>>>> NetarchiveSuite-users at ml.sbforge.org
>>>>>> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users
>>>>>>
>>>>>> _______________________________________________
>>>>>> NetarchiveSuite-users mailing list
>>>>>> NetarchiveSuite-users at ml.sbforge.org
>>>>>> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users
>>>>>>
>>>>> _______________________________________________
>>>>> NetarchiveSuite-users mailing list
>>>>> NetarchiveSuite-users at ml.sbforge.org
>>>>> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users
>>>> _______________________________________________
>>>> NetarchiveSuite-users mailing list
>>>> NetarchiveSuite-users at ml.sbforge.org
>>>> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users
>> _______________________________________________
>> NetarchiveSuite-users mailing list
>> NetarchiveSuite-users at ml.sbforge.org
>> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users
>
> _______________________________________________
> NetarchiveSuite-users mailing list
> NetarchiveSuite-users at ml.sbforge.org
> http://ml.sbforge.org/mailman/listinfo/netarchivesuite-users


More information about the NetarchiveSuite-users mailing list