/Gemaldegalerie-AR-Unity

An Augmented Reality toolkit for young audience art explorers, revealing paintings' hidden stories through intuitive interactions

Primary LanguageC#MIT LicenseMIT

Gemäldegalerie AR (Unity)

Project Member

Vince Nguyen and Yitian Xu

Demo Video

https://vimeo.com/490130098

Overview

Gemaldegalerie AR is a technical prototype developed in partnership with museum4punkt0 and Gemäldegalerie (Berlin State Museums) investigating the use of AR for content contextualization in a museum setting. Targeted towards young audience, the application invites museum-goers to see the sides of a painting they never get to see: what is behind the layers of paint, what is the story behind each character, what it feels like to live in the era behind the frame? Its interactive features describe, but not prescribe; it does not tell museum-goers “how to look”, but “where to look”- it’s up to them to draw their conclusions. We believe that all knowledge backgrounds deserve their own piece of memory at Gemäldegalerie.

Technicality

The prototype was developed using Unity 2020.1.13f1.
It was targeted and tested for iPad Pro 10.5" 2017 (iPad OS version 14 or higher).

Application Nagivation Flow

  1. The audience picks up the tablet from the assembly points at the museum

  2. The audience sees the Welcome screen where they can choose the language

  1. The audience sees a short Instruction screen on how to use the app on paintings of interest

  1. The audience approaches a painting of interest and scans it with the tablet

  2. As the painting is successfully scanned, buttons for different interactions will pop up

  1. The audience chooses an option and sees instruction for how to carry out that interaction. For example, peel off the painting to reveal hidden layers

  2. As the audience carries out such interaction, the augmented object will change accordingly and additional information will be displayed

  3. The audience can go back to Main screen and then explore other options

Screenshots

Topic: Artistic History – Similar paintings from the same artist
Left: augmented paintings in a 3D camera space | Right: paintings in traditional 2D UI



Topic: Provenance – Back of the painting


Topic: Science – Hidden Layers (X-Ray)

Acknowledgement

The project adopts some visual identities provided by museum4punkt0 organization here.
The project also utilizes paintings scans exclusively provided by Gemäldegalerie.

Licensing

MIT license

Copyright © 2020, museum4punkt0 - Staatliche Museen zu Berlin

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above credit information and this permission notice shall be included in all copies or substantial portions of the Software.

The portions of the project that were developed by NEEEU Spaces GmbH, 2018 as part of the project are provided under the MIT license.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.