[Netarchivesuite-curator] KB/SB NAS update for January

[Sabine Schostag]

Dear all,

Hereby the January update from Netarkivet:



·         Our full text index passed 10.000.000.000 objects. We estimate to be up to date within 125 days with the existing hardware-setup.



·         Our monthly updates can be read on Netarkivet’s home page: http://netarkivet.dk/in-english/news-from-the-archive/



·         We made an effort to spread informations on the access to Netarkivet (wayback and cultural heritage cluster) with a presentation for journalist researchers.



·         We stopped our event harvest on the Danish opt out referendum.



·         The refugee event harvest is still ongoing. Recently we focused again on foreign media reactions on the development of the crisis in Denmark, mainly in English, German, French and the Scandinavian languages. This is not a willful choice, but a choice due to our language competences. So, if you find articles in any other languages, please send us a link ☺



·         We are preparing our annual statistic to match the ISO standard.



·         We are analyzing our collection strategy and will probably adjust the strategy due to coming new harvest methods (Heritrix3), the budget situation and better options for giving broader access to the archive.



·         We have started our first broad crawl for 2016; we expect it to be finished by the beginning of March.



·         Web colleagues at SB are experimenting with ”exact digital match”  within image search: when uploading an image you will find all matches in the archive.

On behalf of the KB/SB curator team

Best,
Sabine



Sabine Schostag
Web curator
THE NETARCHIVE
[cid:image001.png at 01CFE4A6.C9C92360]STATE AND UNIVERSITY LIBRARY
Victor Albecks Vej 1
8000 AARHUS C
DENMARK
VAT NO. 1010 0682
___________________________________________
http://netarkivet.dk/in-english/

From: Netarchivesuite-curator [mailto:netarchivesuite-curator-bounces at ml.sbforge.org] On Behalf Of peter.stirling at bnf.fr
Sent: Thursday, January 21, 2016 9:44 AM
To: netarchivesuite-curator at ml.sbforge.org
Subject: [Netarchivesuite-curator] BnF NAS update for January

Hello all,

First of all, a very happy new year and all best wishes for 2016!

As we mentioned in the November update, our last planned crawl of the year aimed to collect websites relating to the French regional elections of 2015. As with previous election crawls, the selection was performed by the Bibliothèque nationale de France's collection librarians in partnership with regional legal deposit libraries. This time 20 partner libraries took part.

This collaborative selection reached a total of 3,708 seed URLs. The seed list is more extensive for this year than for the previous regional elections in 2010, which contained 1,774 selections, but it's much less than the 10,726 websites archived during the 2012 parliamentary and presidential elections. Despite the increase compared to 2010, the librarians reported a general feeling of a lack of dynamism in the campaign in terms of online publications and reactions, partially due to the unusual period of the year (French elections are usually in the Spring or Summer) and the tragic events of November in Paris. More related to the specificities of the web, the second main impression of the campaign, first noted 2010 but still increasing, is the shift of local online campaigns from traditional candidate or party websites to bigger social media platforms such as Facebook and Twitter. In this context, 900 Facebook pages and 870 Twitter accounts or hashtags were selected.

A total of 115 million URLs have been collected for a total volume of 5.8TB. The quality assurance is not completely finished yet but we are already aware of various problems collecting some type of domains. For example, the new widespread use of captcha by Facebook limited our crawl, and some issues have been encountered in the NAS and Heritrix setups for Twitter jobs. As in other years, the seed lists extracted from BCWeb selection tool will be available in the French public Open Data hub data.gouv.fr and all captures are already available in BnF reading rooms.

We are already beginning to look ahead to the next parlimentary and presidential elections in 2017.

Best regards,
The BnF digital legal deposit team
________________________________

Expositions :
Anselm Kiefer, l’alchimie du livre <http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.kiefer_alchimie.html?seance=1223922305530> - jusqu'au 7 février 2016 - BnF - François-Mitterrand
Images du Grand Siècle, l'estampe française au temps de Louis XIV, 1660-1715 <http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.images_grand_siecle.html> - jusqu'au 31 janvier 2016 - BnF - François-Mitterrand

Avant d'imprimer, pensez à l'environnement.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20160202/1caafbc4/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 584 bytes
Desc: image001.png
URL: <http://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20160202/1caafbc4/attachment-0001.png>