[Netarchivesuite-curator] BnF NAS update for November

[Pérez Morillo, Mar]

Dear all,
                Many thanks to the French team for your update. Congratulations! Very useful information.
                Trying to follow your example, we plan to send a monthly update, starting by the end of the year. But I try to summarize now what we’ve been doing recently.
                Thanks to the agreement with the public entity Red.es, the BNE purchased new servers what allowed us to install a new NAS environment.
                As many of you probably know, the BnF shared with the BNE its BCWeb software (we call it CWeb), that we have been adapting to our system, needs and language. We have been testing it in a pilot environment. It’s ready now to start working with the collection of General Elections of December 20th.
Our team of web curators from the regional libraries attended a conference at the BNE for training on the management of web collections in CWeb and on QA. We plan to give them access to a development environment of CWeb for them to test the system, by the end of January 2016. As we want to preserve so far our brand new CWeb and NAS installation to run the General Elections crawl, the regional web curators are sending their proposals of seeds for this purpose on an Excel file shared through Google Drive.
                We are sending you some screenshots of CWeb and more data about the results of the crawl with our next update.
                The BNE wants to thank the BnF most warmly for sharing this application that is going to be so important in the development of our web archiving project, as part of the non-print legal deposit in Spain.
                Best,

Mar Pérez Morillo
Jefe del Área de Gestión del Depósito de las Publicaciones en Línea
Dirección de Biblioteca Digital y Sistemas de Información
Tfno.: 91 516 89 92
Biblioteca Nacional de España

De: Netarchivesuite-curator [mailto:netarchivesuite-curator-bounces at ml.sbforge.org] En nombre de peter.stirling at bnf.fr
Enviado el: viernes, 27 de noviembre de 2015 9:18
Para: netarchivesuite-curator at ml.sbforge.org
Asunto: [Netarchivesuite-curator] BnF NAS update for November

Hello all,

Following the attacks of November 13th, the digital legal deposit team  decided to launch an event crawl to capture a sample of reactions on the web (tributes, support, analysis, reactions). As well as our usual harvest of free and subscription-based news sites, which have been covering the events, we have also crawled 18 new sites (such as https://www.facebook.com/PoliceNationale/or http://www.defense.gouv.fr) and 43 Twitter accounts or hashtags (such as https://twitter.com/Place_Beauvauor http://twitter.com/hashtag/attackparis), from November 16th to November 20th. Capturing Twitter four times a day and other sites once a day during a week gave 1.5 million URLs for a volume of 34.7 GB.

We have other planned crawls in November and December. This electoral year in France is somewhat special, for two reasons: French citizens are called upon to vote at an unusual period of the year, December, and for the first regional elections which involve a major change in the organisation of the regions, with a reduction from 26 to 17. However, the need to preserve ephemeral born-digital electoral content and the way the BnF’s digital legal deposit handles this crawl stay the same year after year.

Therefore, we are once again working with external partners for the selection of sites. Since the end of September, librarians from the BnF collection departments and from 21 regional libraries in France have started selecting websites to archive. Each library’s curator team makes its selections at the scale of its local electoral campaign, using a common framework of selection and the BnF’s selection tool “BCWeb”. This system has been in place for each election since 2010 and allows great continuity in the nature of the electoral collections in the web archives. The seed lists will be crawled from 1st to 31st of December, on a daily basis.  We will be sure to send you all the detailed results of the crawl in a future update.

As you probably are aware, France will host and chair the 21st Conference of Parties of the United Nations Framework Convention on Climate Change (COP21 / CMP11), from November 30 to December 11. The BnF will organize different actions and conferences to show its implication in this debate. It was therefore decided to contribute with an event crawl with an allocated budget of 0.5 TB. Our team will ask BnF librarians and partners to send seeds and we will crawl them twice (before and after this period).

Finally, our broad crawl for 2015 has finished - it took only six weeks, much less than we were expecting. We will send more details in our December update.

Best regards,
The BnF Digital Legal Deposit team
________________________________

Expositions :
Anselm Kiefer, l’alchimie du livre <http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.kiefer_alchimie.html?seance=1223922305530> - jusqu'au 7 février 2016 - BnF - François-Mitterrand
Images du Grand Siècle, l'estampe française au temps de Louis XIV, 1660-1715 <http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.images_grand_siecle.html> - jusqu'au 31 janvier 2016 - BnF - François-Mitterrand

Avant d'imprimer, pensez à l'environnement.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20151127/c6a998a6/attachment.html>