Storytelling of a Coin Collection by Means of RTI Images: the Case of the Simoneschi Collection in Palazzo Blu

Demonstration
Gianpaolo Palma, Italy , Monica Baldassarri, Italy, Maria Chiara Favilla, Italy, Roberto Scopigno, Italy

Keywords: Reflectance Transformation Imaging, interactive kiosk, coin collection, WebGL

I. Introduction

Reflectance Transformation Imaging (RTI) (Malzbender, 2001; Mudge, 2008) is a computation photography technique that captures a subject’s surface shape and color and enables the interactive re-lighting of the subject from any light direction. Starting from a set of photographs acquired with a fixed camera under varying lighting conditions, RTI encodes the acquired data in a compact way, using view-dependent per-pixel reflectance functions, which allows the generation of new images using any light direction in the hemisphere around the camera position.

In the last years, RTIs have been employed in several projects (Mudge, 2008): for the study of high relief fossils and ancient stone tools; in the analysis of the surface textures of oil paintings; in the study of Cuneiform tablets; in the documentation of large numismatic collection; in the study of the Antikythera mechanism. At the same time, different solutions have been proposed for the acquisition of different kind of objects: computer controlled dome of lights; methods based or an acquisition plane or on the tracking of the highlights on a glossy sphere by manually moving the light around the object (Mudge, 2008).
Although until now this technique is being used to aid Cultural Heritage specialists in the virtual inspection and interpretation process, recent advances in 3D Web visualization are increasing our capability to open this new visual manipulation method of the artifact to the ordinary public.

In this context, the ancient coins are a very interesting kind of artifact to acquire and virtually explore by means of RTI images. Typically, a coin is a very small artwork, which in a standard museum exposition is presented to the public from a distance and only from one side. This distance does not allow to the visitors to note some small and interesting details on its surface. Furthermore, coins have a lot of hidden knowledge that is difficult to transfer to the visitors in an easy and effective manner.

In this paper, we present the use of RTI images for the digitalization and virtual presentation of the coin collection of the Museum Palazzo Blu (Pisa, Italy), named “Ottavio Simoneschi Collection” from the name of the original collector. The main goal was to provide an improved access of ordinary people (visitors of the museum or Web surfers) to the exposed numismatic materials. The result is an interactive kiosk that, integrated with the existing traditional museum exhibition, allows the visitors to interact and virtually explore every coin, taking advantage of the possibility to change the light direction in real- time and to appreciate all the details on its surface. The kiosk is currently installed inside the Museum Palazzo Blu in Pisa and it is available online (http://vcg.isti.cnr.it/PalazzoBlu/).

The Simoneschi Collection

The numismatic collection of Ottavio Simoneschi (1890-1960) (Burresi, 1989) was acquired by Fondazione Pisa in 2007, but the study of its materials began in 2012. First, an accurate inventory of the pieces was drawn up and accompanied by digital photographs for effective identification. The exemplars of greatest numismatic, historical and artistic interest were then identified and those pieces in most urgent need of restoration were set aside for attention. This preliminary work was necessary and useful for the preparation of the permanent exhibit, realized in 2013.

The Simoneschi Collection comprises more than 3,300 pieces ranging from coins to medallions. It is not clear through what channels – acquisitions, inheritance, gifts or finds – he was able to assemble such a vast number of pieces, although some of the more valuable can be retraced through their labels and the catalogues in his library to auctions held by prestigious coin traders of the time.

The greater part of the collection is devoted to coins from Antiquity: ancient Greece, Magna Grecia and Etruria. The main body of the collection, however, consists of a vast selection of pieces from Republican and Imperial Rome, including medallions of great rarity and beauty. Also of interest are some examples of counterfeiters’ art produced in recent centuries. The coins from medieval and modern Italy are also of significant interest, in particular various series issued by the mints of Florence and Milan. Beautiful exemplars produced by the Republic of Venice during the course of her history from the Middle Ages to the early modern era stand out, including the splendid oselle commissioned by the doges in the 16th century. The Simoneschi Collection therefore offers not only an overview of the history of coin making, but also a window on the history and art in Italy and in the Mediterranean from the 6th century BC to the end of the 19th century.

For these reasons, those coins and medallions chosen for permanent display have been arranged to illustrate the principal chapters in the history of coinage in Italy and the Mediterranean between Antiquity and the beginning of the contemporary era, while at the same time retaining the unique characteristics of the original collection which reflect the tastes of Ottavio Simoneschi.

Because his principal interest was in the coins and medallions of Rome and those produced by the mint of Venice, considerable space is therefore devoted, both in the display cases and in the kiosk, to this part of the collection arranged in the two main sections, Roman coins and medallions and Coins, oselle and medals of Venice.
Alongside his comprehensive collections of ancient Roman and republican Venetian coins, Simoneschi acquired pieces produced by the principal mints of antiquity located around the Mediterranean and those active between the Middle Ages and the modern era on the Italian peninsula. An ample selection has been chosen to illustrate the variety and aesthetic range of the coin maker’s art and the eloquent testimony they can provide on the history and culture of Europe. They are organized in other two sections: Coins of the Mediterranean in Antiquity and Italian coins, medieval to modern.

In order to give the public the opportunity to view as much of this collection as possible, alongside the permanent display rotating temporary exhibits have been arranged, for both the exposition and the kiosk, beginning with Animals on coins, from the real to the fantastical. All the coins illustrated within the kiosk (40 specimens, divided into four thematic and chronological permanent sections, plus one for temporary exhibitions) have been selected for better illustration and explanation for particularities either in their type (iconography and legends) or in their blanks (type of minting, trace of use) and, more in generally, for their historical background.

RTI Processing

The first step of the project was the acquisition and the generation of the RTI images of the selected coins of the Simoneschi collection. The digitalization was done with a dome of lights (Figure 1). The dome is composed of four aluminium shells that can easily assembled and disassembled to simplify transport. It has 116 cold white LEDs (6 Watt, 750 lumen) and an overhead high-resolution reflex camera (Nikon D5200, 24Mpixel). The dome is computer controlled to allow a completely automatic acquisition by synchronizing the switching on of each LED with the shutter of the camera. For each coin, the acquisition takes about 10 minutes to shot and store 232 photos (116 photos for each side). The coins were digitized in two days at the museum.

Figure 1. The dome designed by CNR-ISTI and used for the RTI acquisition in the Palazzo Blu Museum.

Figure 1. The dome designed by CNR-ISTI and used for the RTI acquisition in the Palazzo Blu Museum.

The photos acquired were processed in two steps to create the final RTI images. We generated an RTI images for each coin side using the Hemispherical Harmonics (HSH) format, which guarantees a better reproduction of material with specular reflection like gold and silver. We used the tools provided by Cultural Heritage Imaging Corporation (Cultural Heritage Imaging, 2014). Then the RTI images were used to generate a multiresolution Web format that permits efficient and asynchronous loading of the image. In particular, it subdivides the RTI image into nine layers, one layer for each HSH coefficient (Figure 2), where the i-th layer contains the i-th coefficient of the three RGB colour channels. Then for each layer it creates a multiresolution quad-tree and produces a tile for each node of the tree (Figure 3). Finally, it saves each tile as a different JPG image. With this format to visualize a specific pixel, we need to load the nine JPG images that contain its HSH coefficients. The main advantage is the out-of-core loading of the node of the quad-tree, making immediately available the interaction with the coin without awaiting the complete loading of the data. This means that at the beginning, the user interacts with a low-resolution version of the coin, which is progressively refined as soon as the higher resolution data are loaded. The loading of the tiles at the different resolutions is guided by the zoom and pan operation of the user. The generation of the RTI images took about 7 hours of automatic processing.

Figure 2. Hemispherical Harmonics layer decomposition of a RTI image

Figure 2. Hemispherical Harmonics layer decomposition of a RTI image

Figure 3. Multiresolution quad-tree encoding of a RTI image

Figure 3. Multiresolution quad-tree encoding of a RTI image

The Interactive Kiosk

The main features of the developed system are the possibility to organize the coin into several subsets and to inspect each coin virtually by RTI manipulation.  For this purpose, the kiosk is composed of two parts: a presentation section of the collection, and the interactive viewer of RTI images. It was developed in HTML5, using the HTML and JavaScript languages for the general structure and WebGL (Khronos Group, 2009) for the RTI visualization, and it was designed to be deployed either by a museum kiosk or by a website.

The first part contains a general presentation of the project and the organization of the coins into different subsets, using historical and thematic criteria, to provide a better and easy presentation of the coins to the public. All the content is stored in XML files that are loaded via JavaScript in the HTML template of the kiosk, making the system completely customizable.

Starting from the first page, the user can read the credits or see a video on the kiosk that shows the main features of the interactive system (Figure 4, top-left). The user can also access information with the menu on the left (Figure 4, top-right). From the top, we have: the presentation of the project; the presentation of the figure of Ottavio Simoneschi; access to the four historical subsets of coins and to the temporary exhibitions of the coins with a specific theme; and finally, the possibility to explore all the coins in the kiosk directly in the RTI viewer. For each section, the content is distributed in several pages that the user can browse. Furthermore, for each coin subset the user can navigate its coins, organized in the scrollable bar on the left (Figure 4, bottom-right). By clicking on a coin in this bar, the user can open the visualization of the relative RTI image.

The interactive viewer shows the RTI image in the middle and a description of the coin on the left (Figure 5). This description contains information including the name, the issue date, the metal, the weight, the size, the number of the place of the coin in the showcase of the exhibition and a general description of the two sides. The viewer allows the virtual manipulation of the image using the toolbar in the bottom. The user can change the direction of light in real time (Figure 6, top) to navigate the coin with basic operations like pan and zoom, to flip the coin to interact with the reverse and to enable the visualization of the hotspot to explore small areas of interest on the surface of the coin. By clicking on a hot-spot, the user displays the multimedia content associated with it, which provide additional information about the most interesting and important technical, historical and artistic features of the coin (Figure 6, bottom-right). The visualization of the hot-spot’s content is preceded by an automatic zoom animation to better highlight the detail associated to it. The user can also read a glossary definition for the technical term used in the text by clicking on the relative word (Figure 6, bottom-left).

Figure 4. Few snapshots from the presentation section of the kiosk

Figure 4. Few snapshots from the presentation section of the kiosk

Figure 5. RTI interactive viewer

Figure 5. RTI interactive viewer

Figure 6. RTI interactive viewer, showing some details of a navigation/inspection phase

Figure 6. RTI interactive viewer, showing some details of a navigation/inspection phase

Conclusion

We have presented a new interactive system for the Simoneschi’s coin collection of the Museum Palazzo Blu in Pisa using multimedia content and RTI images. The kiosk is designed to be easy and intuitive to use for the ordinary public of the museum and to transfer a part of the knowledge of the coins using multimedia data, with a combination of text, images and videos. The interaction is complete by the RTI manipulation of each coin, where the user can take advantage of the possibility to change the light direction in real- time in order to appreciate all the most interesting details depicted on the engrave decoration. The interactive kiosk is installed in the permanent exhibition of the museum, inside the room of the Simoneschi’s Collection. The installation setup is composed of a 27-inch multi-touch screen, used for user input and visualization, paired with a bigger screen set on the top that shows the same content of the touch screen, allowing a clean vision for the other visitors that do not interact directly with the kiosk. The kiosk is also available on the Web (http://vcg.isti.cnr.it/PalazzoBlu/).

Acknowledgements

The kiosk was commissioned and funded by the Fondazione Palazzo Blu. The research work for the Web viewer of RTI images was partly funded by the EU Community FP7 ICT under the V-MUST.net project (Grant Agreement 270404).

References

Burresi M. (1989) and G. Paolucci. “Tra Otto e Novecento. La collezione di Ottavio Simoneschi”, Chianciano Terme.

Cultural Heritage Imaging (2014). “RTI Software.” 2014. Available http://culturalheritageimaging.org/What_We_Offer/Downloads/index.html

Khronos Group (2009). “WebGL – OpenGL ES 2.0 for the Web.” 2009. Available http://www.khronos.org/webgl/

Malzbender, T. (2001) and D. Gelb and H. Wolters. “Polynomial Texture Maps.” Proceedings of SIGGRAPH 2001. 519–528.

Mudge, M (2008) and T. Malzbender and A. Chalmers and R. Scopigno and J. Davis and O. Wang and P. Gunawardane and M. Ashley and M. Doerr and A. Proenca and J. Barbosa. “Image-Based Empirical Information Acquisition, Scientific Reliability , and Long-Term Digital Preservation for the Natural Sciences and Cultural Heritage.” In M. Roussou and J. Leigh (eds),  Eurographics 2008 – Tutorials


Cite as:
G. Palma, M. Baldassarri, M. Favilla and R. Scopigno, Storytelling of a Coin Collection by Means of RTI Images: the Case of the Simoneschi Collection in Palazzo Blu. In Museums and the Web 2013, N. Proctor & R. Cherry (eds). Silver Spring, MD: Museums and the Web. Published May 28, 2014. Consulted .
https://mwf2014.museumsandtheweb.com/paper/storytelling-of-a-coin-collection-by-means-of-rti-images-the-case-of-the-simoneschi-collection-in-palazzo-blu/


Leave a Reply