project:mutilingual_data_search

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
project:mutilingual_data_search [2018/10/27 06:36] – [User Interface] lproject:mutilingual_data_search [2018/11/20 08:25] (current) – liowalter
Line 1: Line 1:
-[[http://example.com|External Link]] +===== Wikidata-based multilingual library search ===== 
-===== Multilingual Data Search based on Wikidata =====+ 
 + 
 +{{ :project:poster.jpg?600 |}}
  
 In Switzerland each linguistic region is working with different authority files for authors and organizations, situation which brings difficulties for the end user when he is doing a search. In Switzerland each linguistic region is working with different authority files for authors and organizations, situation which brings difficulties for the end user when he is doing a search.
 +
 +{{ :project:capture_d_ecran_2018-10-27_a_10.03.18.png?300 |}}
  
 **Goal of the Hackathon**: work on a innovative solution as the library landscape search platforms will change in next years. **Goal of the Hackathon**: work on a innovative solution as the library landscape search platforms will change in next years.
 Possible solution: [[https://mef.test.rero.ch|Multilingual Entity File]] which links to GND, BnF, ICCU Authority files and Wikidata to bring end user information about authors in the language he wants. Possible solution: [[https://mef.test.rero.ch|Multilingual Entity File]] which links to GND, BnF, ICCU Authority files and Wikidata to bring end user information about authors in the language he wants.
 +
 +{{ :project:search_model_oct.2018.jpeg?300 |}}
  
 Steps:  Steps: 
Line 15: Line 21:
   - create a multilingual search prototype (based on Swissbib model)   - create a multilingual search prototype (based on Swissbib model)
  
- 
-Add sections below if you need more room. Include links to your demo and/or source code, relevant documentation, tools, etc. 
  
 ===== Data ===== ===== Data =====
  
-Number of RERO id in VIAF : 255779+{{:project:stats.jpg?nolink&300|}}
  
-Number of GND id in VIAF : 8922043+Number of ID in VIAF 
 +  * BNF: 4847978 
 +  * GND: 8922043 
 +  * RERO: 255779
  
-Number of BNF id in VIAF : 4847978+Number of ID in Wikidata from 
 +  * BNF: 432273 
 +  * GND: 693381 
 +  * RERO: 2145 
 +  * ICCU: 30047 
 +  * VIAF: 1319031 (many duplicates: a WD-entity can have more than one VIAF ID)
  
  
Line 52: Line 64:
 </code> </code>
  
 +Email from the GND :
  
  
 +<code>
 +There is currently no process that guarantees 100% coverage of GND entities in wikibase. The existing links between wikibase and GND entries come mostly from manually edited Wikipedia entries.
 +</code>
  
  
-Number of GND id in Wikidata: 693381 
- 
-Number of VIAF id in Wikidata: 1319031  
  
-Number of BNF id in Wikidata: 432273 
  
-Number of ICCU id (SBN ID) in Wikidata: 30047 
  
  
Line 68: Line 79:
  
 ===== User Interface ===== ===== User Interface =====
-The model for the multilingual user interface is SwissBib, the "catalog of Swiss univerity libraries, the Swiss national library, several cantonal libraries and other institutions". The objective is to keep the look and functionalities of the existing website, which includes multilingual display of labels in English, French, German and Italian. **What changes is the source of information about the author** which will in the future be taken from the BNF for French, the GNB for German, and the LCCN for English. + 
 +**There are several different target users:** the librarians who currently use all kinds of different systems and the end user, who wants to search for information or to locate a book in a nearby library. 
 + 
 +**Librarian**: The question of process is the key challenge concerning the librarian user. At present some Swiss librarians create authority records and some don't.  New rules and processes for creating authority files in GND , BNF, etc will change their work methods.  The process of creating local Swiss authority files will be entirely revamped. Fragmented Swiss regional authority files will disappear, and be replaced by either the German, French, Italian, American etc national authority files or by direct creation in Wikidata by the local librarian. (Wikidata will serve as central repository for all autority IDs). 
 + 
 + 
 + 
 +**End User** 
 +The model for the multilingual user interface is **SwissBib**, the "catalog of Swiss univerity libraries, the Swiss national library, several cantonal libraries and other institutions". **The objective is to keep the look and functionalities of the existing website**, which includes multilingual display of labels in English, French, German and Italian.  
 + 
 +**What changes is the source of information about the author** which will in the future be taken from the BNF for French, the GNB for German, and LCCN for English. (In the proof of concept pilot, only the author name will be concerned.)  
 The list of books and libraries will continue to function as before, with no changes. The list of books and libraries will continue to function as before, with no changes.
-(In the proof of concept pilot, only the author name will be concerned.)  + 
-The issue of key words remains open (at present they are from DNB, which works for German and English, but does not work for French)+
  
 In the full project, several pages must be modified: In the full project, several pages must be modified:
Line 82: Line 104:
  
 The Proof on Concept project will focus exclusively on the basic search page. The Proof on Concept project will focus exclusively on the basic search page.
 +
 +**Open issues**
 +The issue of key words remains open (at present they are from DNB, which works for German and English, but does not work for French)
  
 The question of an author photo and a bio is open. At present very few authors have a short bio paragraph associated with their names. Should each author have a photo and bio? If so, where to put it on the page? The question of an author photo and a bio is open. At present very few authors have a short bio paragraph associated with their names. Should each author have a photo and bio? If so, where to put it on the page?
Line 87: Line 112:
 Other design question: Should the selection of the language of the book be moved up on the page? Other design question: Should the selection of the language of the book be moved up on the page?
  
-Screenshots of Swissbib at present+=====Prototype=====
  
 +(Translations from Wikidata into French)
  
 +1. **Schweizerisches Landesmuseum**
  
 +http://feature.swissbib.ch/Record/110393589
  
 +{{ :project:fr_landesmuseum.jpg?nolink |}}
  
  
 +2. **Wikimedia Foundation**
  
 +http://feature.swissbib.ch/Record/070092974
 +
 +{{ :project:fr_wikimedia_foundation.jpg?nolink |}}
 +
 +
 +3. **Chocoladefabriken Lindt & Sprüngli AG**
 +
 +http://feature.swissbib.ch/Record/279360789
 +
 +ATTENTION: **Multiple authors**
 +
 +{{ :project:fr_chocolate_multiple_authors.jpg?nolink&300 |}}
 +
 +
 +4. **Verband schweizerischer Antiquare und Kunsthändler**
 +
 +ATTENTION: **NO French label in Wikidata**
 +
 +http://feature.swissbib.ch/Record/107734591
 +
 +{{ :project:fr_verband.jpg?nolink |}}
 +
 +
 +
 +
 +
 +
 +
 +
 +==== Methods ====
 +Way of getting BNF records via SRU from Wikidata
 +<code>
 +http://catalogue.bnf.fr/api/SRU?version=1.2&operation=searchRetrieve&query=aut.ark%20all%20%22ark:/12148/cb118806093%22&recordSchema=unimarcxchange&maximumRecords=20&startRecord=1
 +</code>
 +Instruction: add prefix "ark:/12148/cb" to BNF ID in order to obtain the ARK ID
 +
 +
 +
 +Lookup Qcode from GND ID
 +<code>
 +SELECT DISTINCT ?item ?itemLabel  WHERE {
 +  ?item wdt:P227 "1027690041".
 +  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
 +}
 +</code>
 +===== Integration of RERO person/organisation data into Wikidata =====
 +
 +==== Methodology ====
 +
 +4 cases
 +
 +1. **RERO authorities are in Wikidata** with RERO ID
 +
 +  * 2145 items
 +
 +2. **RERO authorities are in Wikidata** without RERO ID but with VIAF ID
 +
 +  * 1316347 items (without deduplication)
 +  * add only ID possibles (PetScan)
 +
 +3. **RERO authorities are in Wikidata** without RERO or VIAF ID
 +
 +  * reconcialiation with OpenRefine
 +
 +4. **RERO authorities are not in Wikidata**
 +
 +  * Quickstatements or mass import
 +
 +
 +===== Demo / Code / Final presentation =====
 +
 +  * Demo http://feature.swissbib.ch/Record/317008587 and you can search other records
 +  * Code https://github.com/swissbib/vufind/tree/feature/wikidata-based-multilingual
 +  * Final presentation : {{ :project:presentation.pdf |}}
  
 ===== Team ===== ===== Team =====
Line 102: Line 206:
   * Lionel Walter   * Lionel Walter
   * Laurel Zuckerman   * Laurel Zuckerman
 +  * Jacqueline Martinelli
      
 {{tag>status:concept needs:dev needs:design needs:data needs:expert glam}} {{tag>status:concept needs:dev needs:design needs:data needs:expert glam}}
 +
 +
 +
 +
  
  • project/mutilingual_data_search.1540614972.txt.gz
  • Last modified: 2018/10/27 06:36
  • by l