| Both sides previous revision Previous revision Next revision | Previous revision |
| project:covimas [2019/09/08 14:23] – [Day One] eunomya | project:covimas [2019/09/08 15:17] (current) – eunomya |
|---|
| ===== CoViMAS===== | ===== CoViMAS===== |
| |
| | {{ :project:covimas.mp4| }} |
| Collaborative Virtual Museum for All Senses (CoViMAS) is an extended virtual museum which engages all senses of visitors. It is a substantial upgrade and expansion of our award-winning Glamhack 2018 project "Walking around the Globe" [[http://make.opendata.ch/wiki/project:virtual_3d_exhibition]] which had the DBIS Group from the University of Basel team up with the ETH Library to introduce a prototype of an exhibition in Virtual Reality. | Collaborative Virtual Museum for All Senses (CoViMAS) is an extended virtual museum which engages all senses of visitors. It is a substantial upgrade and expansion of our award-winning Glamhack 2018 project "Walking around the Globe" [[http://make.opendata.ch/wiki/project:virtual_3d_exhibition]] which had the DBIS Group from the University of Basel team up with the ETH Library to introduce a prototype of an exhibition in Virtual Reality. |
| |
| The project aims to provide a collaborative environment for multiple visitors in the virtual museum. This feature allows them to have a shared experience through different virtual reality devices. | CoViMAS aims to provide a collaborative environment for multiple visitors in the virtual museum. This feature allows them to have a shared experience through different virtual reality devices. |
| |
| Additionally, CoViMAS enriches the user experience in virtual space by providing physical objects which can be manipulated by the user in virtual space. Thanks to the mix'n'hack organizers and FabLab ([[https://fablab-sion.ch/]]), the user will be able to touch postcards, view them closely, and feel their texture. | Additionally, CoViMAS enriches the user experience in virtual space by providing physical objects which can be manipulated by the user in virtual space. Thanks to the mix'n'hack organizers and FabLab ([[https://fablab-sion.ch/]]), the user will be able to touch postcards, view them closely, and feel their texture. |
| To integrate the modern methods of Image manipulation through artificial Intelligence, we tried using Deep Learning method to colorize the gray-scale images of the "otografien aus dem Wallis von Charles Rieder". The colored images allow the visitor get a more sensible feeling of the pictures he/she is viewing. The initial implementation of the algorithm showed the challenges we face, for example the faded parts of the pictures or scratched images could not very well be colorized. | To integrate the modern methods of Image manipulation through artificial Intelligence, we tried using Deep Learning method to colorize the gray-scale images of the "otografien aus dem Wallis von Charles Rieder". The colored images allow the visitor get a more sensible feeling of the pictures he/she is viewing. The initial implementation of the algorithm showed the challenges we face, for example the faded parts of the pictures or scratched images could not very well be colorized. |
| |
| {{:project:img_20190908_112033_1_.jpg?500 |}} {{:project:test.png?376|}} | {{project:img_20190908_112033_1_.jpg?500}} {{project:test.png?376 }} |
| |
| |
| ==== Day Two ==== | ==== Day Two ==== |
| The second day is the coding day. Although the VR exhebition is mostly taken from our previous participation in Glamhack2018, the exhebition needed to be adjusted to the new content. We have desined the rooms to showcase the dataset "Postkarten aus dem Wallis (1890-1950)". at this point, the selected postcards to be enriched with additional senses are sent to the Fablab, to create a haptic postcard and a feather pallet which is going to be used alongside one postcard which represent a goose. | Although the VR exhibition is taken from our previous participation in Glamhack2018, the exhibition needed to be adjusted to the new content. We have designed the rooms to showcase the dataset "Postkarten aus dem Wallis (1890-1950)". at this point, the selected postcards to be enriched with additional senses are sent to the Fablab, to create a haptic card and a feather pallet which is needed to be used alongside one postcard which represent a goose. |
| |
| | {{:project:img_20190907_174307.jpg?280 |}} {{:project:img_20190907_174005.jpg?500|}} |
| | |
| | the fabricated elements of our exhibition get attached to a tracker which can be seen through VR glasses and this allows the user to be aware of location of the object, and sense it. |
| | |
| | The Colorization improved through the day, by some alteration in training setup and the parameters used to tune the images. The results at this stage are relatively good. |
| | |
| | {{:project:111.png?300|}}{{:project:2.png?300|}}{{:project:055ph-00073.jpg_out.png?300|}} |
| | |
| | And the VR exhibition hall is adjusted to be automatically load images from postcards and also the colorized images alongside their original color. |
| | |
| | |
| | And late night, when finalizing the works for the next day, most of our stickers have changed status from "Implementation" phase to "Done" Phase! |
| |
| {{ :project:img_20190907_174307.jpg?280 |}} | |
| {{ :project:img_20190907_201637.jpg?500 |}} | {{ :project:img_20190907_201637.jpg?500 |}} |
| |
| Since | ==== Day Three ==== |
| | |
| | CoViMAS is getting to the final stage in the last day. The Room design is finished and the location of the images on the wall are determined. The tracker location is updated in the VR environment to represent the real location of the object. With this improvement the postcard can be touched while being viewed simultaneously. |
| | |
| | {{:project:ce0da5f3-16e6-411c-aee1-86aba5827ee3.jpeg?500|}} {{:project:feather.jpeg?360|}} |
| | |
| |
| |