<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div dir="ltr"><span></span></div>
<div dir="ltr">
<div>Hello again!</div>
<div><br>
</div>
<div>Spurred by your previous problem-solving answers, I continue.</div>
<div><br>
</div>
<div>Strange Heritrix behavior: Do dns lookup, which fails. Report that with an -6 line. Then 10 minutes pause. Then a new dns lookup and so on.</div>
<div><br>
</div>
<div>What happens during the pause? Waiting for dns lookup in 600 seconds? Trying the request despite the failed lookup?</div>
<div><br>
</div>
<div>(Maybe one of the bugs fixed in 5.5?)</div>
<div><br>
</div>
<div>Log and template below.</div>
<div><br>
</div>
<div><span style="background-color: rgba(255, 255, 255, 0);">Best regards,</span></div>
<div>
<div><span style="background-color: rgba(255, 255, 255, 0);"><span lang="EN-GB">-----<br>
<br>
</span><span lang="EN-GB">Peter Svanberg</span><span lang="EN-GB"><br>
</span><span lang="EN-GB">Technical officer<br>
Digital Collections Department, Newspapers, Radio and Television Division</span><span lang="EN-GB"> <br>
<br>
</span><span lang="EN-GB">National Library of Sweden</span><span lang="EN-GB"><br>
</span><span lang="EN-GB"><a href="x-apple-data-detectors://1/1" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="1/1" style="-webkit-text-decoration-color: rgba(31, 73, 125, 0.258824);"></a><a href="x-apple-data-detectors://1/1" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="1/1" style="-webkit-text-decoration-color: rgba(0, 122, 255, 0.258824);">PO
 Box 5039</a> <br>
<a href="x-apple-data-detectors://1/1" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="1/1" style="-webkit-text-decoration-color: rgba(0, 0, 0, 0.258824);">SE-104 51 Stockholm</a><br>
Visits: <a href="x-apple-data-detectors://2" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="2" style="-webkit-text-decoration-color: rgba(31, 73, 125, 0.258824);"></a><a href="x-apple-data-detectors://2" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="2" style="-webkit-text-decoration-color: rgba(0, 122, 255, 0.258824);">Karlav├Ągen
 100, Stockholm </a><br>
<a href="x-apple-data-detectors://2" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="address" x-apple-data-detectors-result="2" style="-webkit-text-decoration-color: rgba(0, 0, 0, 0.258824);">Phone</a>: +46 10 709 </span><span lang="EN-GB">32
 78</span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB">E-mail</span><span lang="EN-GB">: </span><span lang="EN-GB"><a href="mailto:peter.svanberg@kb.se" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="link" x-apple-data-detectors-result="3">peter.svanberg@kb.se</a></span><span lang="EN-GB"><br>
</span><span lang="EN-GB">Web</span><span lang="EN-GB">: </span><span lang="EN-GB"><a href="http://www.kb.se/" dir="ltr" x-apple-data-detectors="true" x-apple-data-detectors-type="link" x-apple-data-detectors-result="4">www.kb.se</a></span><span lang="EN-GB"><br>
</span></span></div>
</div>
<div><span style="background-color: rgba(255, 255, 255, 0);"><br>
</span></div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>crawl log:</div>
<div><br>
</div>
<div>2019-03-20T21:48:42.119Z    -6          - <a href="http://lookbackvideo7-a.akamaihd.net/">
http://lookbackvideo7-a.akamaihd.net/</a> RRX <a href="https://www.facebook.com/">
https://www.facebook.com/</a> unknown #033 - - <a href="http://www.fbcdn.net">http://www.fbcdn.net</a> 2t</div>
<div>2019-03-20T21:48:41.164Z    -1          - dns:lookbackvideo7-<a href="http://a.akamaihd.net">a.akamaihd.net</a> RRXP
<a href="http://lookbackvideo7-a.akamaihd.net/">http://lookbackvideo7-a.akamaihd.net/</a> text/dns #047 20190320214841119+45 -
<a href="http://www.fbcdn.net">http://www.fbcdn.net</a> 3t</div>
<div>2019-03-20T21:38:41.006Z    -6          - <a href="http://lookbackvideo6-a.akamaihd.net/">
http://lookbackvideo6-a.akamaihd.net/</a> RRX <a href="https://www.facebook.com/">
https://www.facebook.com/</a> unknown #024 - - <a href="http://www.fbcdn.net">http://www.fbcdn.net</a> 2t</div>
<div>2019-03-20T21:38:40.063Z    -1          - dns:lookbackvideo6-<a href="http://a.akamaihd.net">a.akamaihd.net</a> RRXP
<a href="http://lookbackvideo6-a.akamaihd.net/">http://lookbackvideo6-a.akamaihd.net/</a> text/dns #026 20190320213840006+56 -
<a href="http://www.fbcdn.net">http://www.fbcdn.net</a> 3t</div>
<div>2019-03-20T21:28:39.896Z    -6          - <a href="http://lookbackvideo5-a.akamaihd.net/">
http://lookbackvideo5-a.akamaihd.net/</a> RRX <a href="https://www.facebook.com/">
https://www.facebook.com/</a> unknown #045 - - <a href="http://www.fbcdn.net">http://www.fbcdn.net</a> 2t</div>
<div>2019-03-20T21:28:38.942Z    -1          - dns:lookbackvideo5-<a href="http://a.akamaihd.net">a.akamaihd.net</a> RRXP
<a href="http://lookbackvideo5-a.a">http://lookbackvideo5-a.a</a></div>
<div><br>
</div>
<div>template:</div>
<div><br>
</div>
<div>
<div>fetchDns.enabled=true</div>
<div>fetchDns.acceptNonDnsResolves=false</div>
<div>fetchDns.digestContent=true</div>
<div>fetchDns.digestAlgorithm=sha1</div>
<div><br>
</div>
<div>fetchHttp.enabled=true</div>
<div>fetchHttp.timeoutSeconds=1200</div>
<div>fetchHttp.soTimeoutMs=20000</div>
<div>fetchHttp.maxFetchKBSec=0</div>
<div>fetchHttp.maxLengthBytes=0</div>
<div>fetchHttp.ignoreCookies=false</div>
<div>fetchHttp.sslTrustLevel=OPEN</div>
<div>fetchHttp.defaultEncoding=UTF-8</div>
<div>fetchHttp.digestContent=true</div>
<div>fetchHttp.digestAlgorithm=sha1</div>
<div>fetchHttp.sendIfModifiedSince=true</div>
<div>fetchHttp.sendIfNoneMatch=true</div>
<div>fetchHttp.sendConnectionClose=true</div>
<div>fetchHttp.sendReferer=true</div>
<div>fetchHttp.sendRange=false</div>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</body>
</html>