project:virtual_3d_exhibition

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
project:virtual_3d_exhibition [2018/10/27 11:42]
silvanheller [First Impressions]
project:virtual_3d_exhibition [2019/05/08 17:15] (current)
silvanheller [Technical Information]
Line 1: Line 1:
 ===== Walking Around the Globe - a VR Picture Expedition ===== ===== Walking Around the Globe - a VR Picture Expedition =====
  
-As the collective global body of art grows in size and becomes increasingly digital, museum curators are faced with the challenge of showcasing this art with the limited space and time available to them. +Watch our Video:
-Additionally,​ since art is often not about the medium itself but rather about the experience it invokes, capturing the essential aspects to reproduce this experience might in many cases be sufficient, if not equivalent from the point of view of the audience.+
  
-Curation itself is difficult to both teach and study, given that the full experience of an exposition traditionally requires actually doing the whole work of physically arranging and displaying the selected works of art. If said art would need to be transported from other museums, this is not feasible.+{{:​project:​intro.mp4|}}
  
-With our hackathon ​prototypewe unveil a window into a future where you can create, curate and experience virtual 3D expositions in VR.  +With our Hackathon ​prototype ​for a virtual 3D exhibition in VR we tackle several challenges. 
-We showcase a first exposition with a 3D-Model of the globe as a centerpiece and works of art from various collections ​surrounding it. Users can experience our curated exposition using a state-of-the-Art VR headset, the HTC Vive.+ 
 +• The challenge of exhibition space: 
 +many collections,​ especially small ones – like the Collection of Astronomical Instruments of ETH Zurich – have only a small or no physical space at all to exhibit their objects to the public 
 + 
 +• The challenge of exhibiting light-sensitive artworks:  
 +some artworks – especially art on paper – are very sensitive to the light and are in danger of serious damaged when they are permanently exposed. That’s why the Graphische Sammlung ETH Zurich can’t present their treasures in a permanent exhibition to the public 
 + 
 +• The challenge of involving the public: 
 +nowadays the visitors do not want to be reduced to be passive consumers, they want and appreciate active involvement 
 + 
 +• The challenge of the scale: 
 +in usual 2D digital presentations the user does not get information about the real scale of the artworks and gets wrong ideas about the dimensions 
 + 
 +• The challenge of showing 3D objects in the digital space: 
 +many museum databases show only one or two digital images of their 3D objects, so the user gets only a very limited impression  
 + 
 +Our Hackathon prototype for a virtual 3D exhibition in VR  
 + 
 +• offers unlimited exhibition space in the virtual reality 
 + 
 +• makes it possible to exhibit light sensitive artworks permanently using their digital reproductions 
 + 
 +• involves the public inviting them to slip into the role of the curator 
 + 
 +• shows the artwork in the correct scale 
 + 
 +• and gives the users the opportunity to walk around the 3D objects in the virtual space 
 + 
 +A representative screenshot:​ 
 + 
 +{{:​project:​globe.jpg?​nolink&​800|}} 
 + 
 +We unveil a window into a future where you can create, curate and experience virtual 3D expositions in VR.  
 +We showcase a first exposition with a 3D-Model of globe like in the Collection of Astronomical Instruments of ETH Zurich ​as a centerpiece and works of art from the Graphische Sammlung ETH Zurich ​surrounding it. Users can experience our curated exposition using a state-of-the-Art VR headset, the HTC Vive.
  
 Our vision has massive value for practitioners,​ educators and students and also opens up the experience of curation to a broader audience. It enables art to truly transcend borders, cultures and economic boundaries. ​ Our vision has massive value for practitioners,​ educators and students and also opens up the experience of curation to a broader audience. It enables art to truly transcend borders, cultures and economic boundaries. ​
 +==== Project Presentation ===
  
-==== First Impressions ====+You can download the presentation slides: {{:​project:​20181028_glamhack_presentation.pdf|}}.
  
-first version ​of our VR Environment:​ {{ :​project:​screen_pres2.jpg?​direct&​800 |}}+==== Project Impressions ==== 
 + 
 +On the very first day, we create our data model on paper by ensuring everybody got a chance to present their use cases, stories and needs. {{ :​project:​er_v1.jpg?​direct&​400 |}} 
 + 
 +On Friday evening, we had a first prototype ​of our VR Environment:​ {{ :​project:​screen_pres2.jpg?direct |}} 
 + 
 +On Saturday, we created our interim presentation,​ improved our prototype, curated our exposition, and tried and ditched many ideas. 
 + 
 +Saturday evening saw our prototype almost finished! Below a screenshot of two rooms, one curated by experts and the other one containing artificially generated art. {{ :​project:​styleroom1.jpg?​direct&​800 ​|}} 
 +{{ :​project:​curated_room.jpg?​direct&​800 |}} 
 + 
 +Our final project status involves a polished prototype with an example exhibition consisting of two rooms: 
 + 
 +Walking Around The Globe: A room 
 +curated by art experts, exhibiting a selection of old  
 +masterpieces (15th 
 +century to today). 
 + 
 +{{:​project:​globe.jpg?​nolink&​800|}} 
 + 
 +Style transfer: A room designed by laymen 
 +showing famous paintings & derivates generated by  
 +an //​artificial intelligence (AI)// via a technique called 
 +style transfer. 
 + 
 +{{:​project:​biglisa.jpg?​nolink&​800|}} 
 + 
 +In the end we even created a mockup of the possible backend ui, the following images are some impressions for it: 
 + 
 +{{:​project:​bui-entry.jpg?​nolink&​300|}} 
 +{{:​project:​bui-room.jpg?​nolink&​300|}} 
 +{{:​project:​bui-exhib.jpg?​nolink&​300|}}
  
  
 ==== Technical Information ==== ==== Technical Information ====
  
-Our code is on [[https://​github.com/​sauterl/glamhack2018|Github]] and will be made public on sunday.+Our code is on Github, both the [[https://​github.com/​dbisUnibas/virtual-exhibition-presenter|Frontend]] and the [[https://​github.com/​dbisUnibas/​virtual-exhibition-manager|Backend]].
  
-We are using [[https://​unity3d.com|Unity]] with the [[https://​assetstore.unity.com/​packages/​tools/​integration/​steamvr-plugin-32647|SteamVR Plugin]] to deploy on the [[https://​www.vive.com/​eu/​|HTC Vive]].+We are using [[https://​unity3d.com|Unity]] with the [[https://​assetstore.unity.com/​packages/​tools/​integration/​steamvr-plugin-32647|SteamVR Plugin]] to deploy on the [[https://​www.vive.com/​eu/​|HTC Vive]]. This combination means we had to use combinations of C# Scripting (We recommend the excellent [[https://​www.jetbrains.com/​rider/​ | Rider Editor]]), design using the Unity Editor, custom modifications to the SteamVR plugin, do 3d model imports using FastObjImporter and other fun stuff.
  
-Our backend is written in [[http://​openjdk.java.net|Java]] and uses [[https://​www.mongodb.com|MongoDB]]+Our backend is written in [[http://​openjdk.java.net|Java]] and uses [[https://​www.mongodb.com|MongoDB]].
  
 +For the style transfer images, we used a open source python code which is available on [[https://​github.com/​anishathalye/​neural-style|Github]].
 ==== Acknowledgments ==== ==== Acknowledgments ====
 The [[https://​dbis.dmi.unibas.ch|Databases and Information Systems Group]] at the University of Basel is the home of a majority of our project members. Our hardware was borrowed for the weekend from the [[https://​gravis.dmi.unibas.ch|Gravis Group]] from Prof. Vetter. The [[https://​dbis.dmi.unibas.ch|Databases and Information Systems Group]] at the University of Basel is the home of a majority of our project members. Our hardware was borrowed for the weekend from the [[https://​gravis.dmi.unibas.ch|Gravis Group]] from Prof. Vetter.
 ===== Data ===== ===== Data =====
  
-  * List and link your actual ​and ideal data sources.+  * Dataset with digital images (jpg) and metadata (xml) from the Collection of Astronomical Instruments of ETH Zurich 
 + 
 +  * Graphische Sammlung ETH Zurich, Collection Online, four sample datasets with focus on bodies in the air, portraits, an artist (Rembrandt) ​and different techniques (printmaking and drawing)
  
 ===== Team ===== ===== Team =====
Line 36: Line 103:
   * Silvan Heller, PhD Student @ [[https://​dbis.dmi.unibas.ch|Databases and Information Systems Group]]   * Silvan Heller, PhD Student @ [[https://​dbis.dmi.unibas.ch|Databases and Information Systems Group]]
   * Loris Sauter, MsC Student @ [[https://​dmi.unibas.ch/​de/​forschung/​informatik/​|Computer Science Uni Basel]]   * Loris Sauter, MsC Student @ [[https://​dmi.unibas.ch/​de/​forschung/​informatik/​|Computer Science Uni Basel]]
-  * Ann-Kathrin ​Seyffert ​@ [[https://​gs.ethz.ch/​en/​ | Graphische Sammlung ETH Zürich ]]+  * Ann-Kathrin ​Seyffer ​@ [[https://​gs.ethz.ch/​en/​ | Graphische Sammlung ETH Zürich ]]
   * Susanne Pollack @ [[https://​gs.ethz.ch/​en/​ | Graphische Sammlung ETH Zürich ]]   * Susanne Pollack @ [[https://​gs.ethz.ch/​en/​ | Graphische Sammlung ETH Zürich ]]
   * Agnese Quadri @ [[https://​www.library.ethz.ch/​en/​ | ETH Library]]   * Agnese Quadri @ [[https://​www.library.ethz.ch/​en/​ | ETH Library]]
 +  * Donatella Gavrilovich @ [[http://​dip.studiletterari.uniroma2.it/​ | University of Rome "Tor Vergata"​]]
   ​   ​
 {{tag>​status:​concept needs:dev needs:​design needs:data needs:​expert glam}} {{tag>​status:​concept needs:dev needs:​design needs:data needs:​expert glam}}
  • project/virtual_3d_exhibition.1540633362.txt.gz
  • Last modified: 2018/10/27 11:42
  • by silvanheller