Filed under: Conferences, Grants, Guest Blogger, Technology | Tags: 3D data, CHI, conservation, Digital Imaging, Digital Preservation, Open Source, RTI, symposium
Our guest blogger, Emily B. Frank, is currently pursuing a Joint MS in Conservation of Historic and Artistic Works and MA in History of Art at New York University, Institute of Fine Arts. Thank you, Emily!
With the National Endowment for the Humanities (NEH) back on the chopping block in the most recent federal budget proposal, I feel particularly privileged to have taken part in the NEH-funded symposium, Illumination of Material Culture, earlier this month.
Co-hosted by The Metropolitan Museum of Art and Cultural Heritage Imaging (CHI), the symposium brought together conservators, curators, archaeologists, imaging specialists, cultural heritage and museum photographers, and the gamut of engineers to discuss and debate uses, innovations, and limitations of computational imaging tools. This interdisciplinary audience fostered an environment for collaboration and progress, and a few themes emerged.
The sold-out crowd at the symposium at The Met
(1) The emphasis among practitioners seems to have shifted from isolated techniques to integrating a range of data types.
E. Keats Webb, Digital Imaging Specialist at the Smithsonian’s Museum Conservation Institute, presented “Practical Applications for Integrating Spectral and 3D Imaging,” the focus of which was capturing and processing broadband 3D data. Holly Rushmeier, Professor of Computer Science at Yale University, gave a talk entitled “Analyzing and Sharing Heterogeneous Data for Cultural Heritage Sites and Objects,” which focused on CHER-Ob, an open source platform developed at Yale to enhance the analysis, integration, and sharing of textual, 2D, 3D, and scientific data. CHI’s Mark Mudge presented a technique for the integrated capture of RTI and photogrammetric data. The theme of integration propagated through the panelists’ presentations and the lightning talks, including but not limited to presentations by Kathryn Piquette, Senior Research Consultant and Imaging Specialist at University College London, on the integration of broadband multispectral and RTI data; Nathan Matsuda, PhD Candidate and National Science Foundation Graduate Fellow at Northwestern University, on work at NU-ACCESS with photometric stereo and photogrammetry; as well as a lightning talk by Chantal Stein, in collaboration with Sebastian Heath, Professor of Digital Humanities at the Institute for the Study of the Ancient World; and myself, about the integration of photogrammetry, RTI, and multiband data into a single, interactive file in Blender, a free, open source 3D graphics and animation software.
(2) There is an emerging emphasis on big data and the possibilities of machine learning.
Paul Messier, art conservator and head of the Lens Media Lab at the Institute for the Preservation of Cultural Heritage, Yale University
The notion of machine learning and the possibilities it might unlock were addressed in multiple presentations, perhaps most notably in the “RTI: Beyond Relighting,” a panel discussion moderated by Paul Messier, Head of the Lens Media Lab, Institute for the Preservation of Cultural Heritage (IPCH), Yale University. Dale Kronkright presented work in progress at the Georgia O’Keeffe Museum in collaboration with NU-ACCESS that utilizes algorithms to track change to the surfaces of paintings, focusing on the dimensional change of metal soaps. Paul Messier briefly described the work being done at Yale to explore the possibilities for machine learning to work iteratively with connoisseurs to push data-driven research forward.
Mark Mudge, President of CHI, participates in a panel discussion
(3) The development of open tools for sharing and presenting computational data via the web and social media is catching up.
Graeme Earl, Director of Enterprise and Impact (Humanities) and Professor of Digital Humanities at the University of Southampton, UK, gave a keynote entitled “Open Scholarship, RTI-style: Museological and Archaeological Potential of Open Tools, Training, and Data,” which kicked off the discussion about open tools and where the future is heading. Szymon Rusinkiewicz, Professor of Computer Science at Princeton University, presented “Modeling the Past for Scholars and the Public,” a case study of a cross-listed Archaeology-Computer Science course given at Princeton in which students generated teaching tools and web content that provided curatorial narrative for visitors to the museum. CHI’s Carla Schroer presented new tools for collecting and managing metadata for computational photography. Roberto Scopigno, Research Director of the Visual Computing Lab, Consiglio Nazionale delle Richerche (CNR), Istituto di Scienza e Tecnologie dell’Informazione (ISTI), Pisa, Italy, delivered the keynote on the second day of the symposium about 3DHOP, a new web presentation and collaboration tools for computational data.
We had the privilege of hearing from Tom Malzbender, without whose work at HP Labs in the early 2000s this symposium would never have happened.
The keynotes at the symposium were streamed through The Met’s Facebook page. The other talks were recorded and will be available in three to four weeks. Enjoy!
Tom Malzbender, the inventor of RTI, at the podium
Filed under: Commentary, Guest Blogger | Tags: Digital Imaging, Digital Preservation, Preservation, threats to heritage, world history
Our guest blogger, Matt Hinson, is a junior at the School of Foreign Service at Georgetown University in Washington, D.C. He spent the summer as an intern at CHI. Thanks, Matt!
Screen shot from ISIS video of the destruction of Nimrud, April 2015
During my summer internship at Cultural Heritage Imaging (CHI), I learned a great deal about the danger facing many of the world’s treasures as well as the efforts to save them. My background in international history leads me to believe that international law and policy can help to address many of the dangers. I have also learned how CHI is contributing to the revolution in how we interact with information and deal with these cultural heritage threats.
The variety of projects that CHI undertakes demonstrates the wide range of threats facing cultural heritage. Although some of CHI’s most recent projects have dealt with weathering and natural deterioration, it is important to understand the other risks to humanity’s greatest treasures. One can categorize tangible cultural heritage sites into natural formations, historic structures, including cities and sculptures, and inscriptions. Complex rock formations, the cities built by ancient cultures, works of art, and monuments are all included. It is also important to recognize cultural heritage sites that hold symbolic value to a specific community or group. Many of these are protected by national parks and museums, but only to a certain extent. Multiple forces continue to threaten this material.
Threats can be divided into man-made and natural. The man-made category encompasses destruction from conflict, construction, and development. Human neglect can also be included as a potential danger to the survival of important sites. War has become one of the most widely observed man-made threats to cultural heritage, particularly in ongoing conflicts in Africa and the Middle East. Groups fighting for ideological reasons, such as religious fundamentalists, have attempted to destroy artifacts that contradict their beliefs. The recent destruction of the ancient city of Nimrud by the Islamic State is one prominent example. Conflict areas tend to encourage looting of historic sites, leading to sales of antiquities on the black market. Often the lure of financial gain from the development of sites that contain important heritage outweighs the cultural value that is at risk. One example is the impending destruction of an ancient Turkish cave city after the completion of a dam that will put it under water.
In most parts of the world, environmental threats to cultural heritage are more prevalent than man-made ones. For monuments, statues, and other structures made of stone, weathering is a common means of loss. Precipitation, especially acid rain, and other kinds of exposure to water can lead to the gradual erosion of stone, rotting of wood, and general deterioration of sites and monuments.
National Park Service (NPS) map of the 105 US parks vulnerable to sea level rise. From “Strategies for Coastal Park Adaptation to Climate Change”: http://marineprotectedareas.noaa.gov/pdf/helpful-resources/webinar_beavers_schupp_nps_coastalcasestudies_111413.pdf
Environmental damage caused by climate change is accelerating the destruction. Rising sea levels are predicted to have a particularly devastating impact on many cultural sites. A recent study shows that predicted sea level rise over the next years will put 80% of Icelandic cultural sites at risk. According to the National Park Service (NPS), natural heritage sites in the US are also at risk. The NPS reports 105 parks as “vulnerable to sea level rise.” The effect on weather patterns due to climate change, particularly the increase in severe weather events, could pose major threats to cultural heritage sites beyond normal historical weathering.
How can these various threats be addressed? Archaeological preservation is one common method of physically excavating and preserving important historical artifacts. Moving objects to museums has successfully preserved different forms of cultural heritage throughout time. Digital imaging, practiced here at CHI, is a powerful tool to be used alongside archaeological methods to provide additional, more detailed information for the historical record. Digital representations of cultural heritage sites can be used to monitor the rates of change at these sites as well as preserve their shape and cultural significance. The re-creation of cultural heritage with digital methods also impacts how information is shared: an artifact that may be thousands of miles away can be viewed by anyone anywhere in an accurate digital form. This also allows objects and sites to stay in their original locations while providing access to their digital representations.
From my perspective, a crucial element in furthering the protection of cultural heritage is the legal and political protection of these sites. International law has developed to protect the things that have been identified as most sacred to communities around the world, including human dignity, life, and freedoms. Cultural heritage must be worthy of the same kind of protection every day as well as in wartime. Although some institutions already exist to defend cultural heritage, UNESCO, for example, I believe we must govern the protection of artifacts and sites with laws just as we do in cases of war crimes and sovereignty.
Another lesson I take away from my time at CHI concerns the changes in our interactions with information and knowledge. I am familiar with the usual media in our repositories of knowledge: text, photographs, video, and audio. While these media convey interpretations and descriptions of their subject matter, they rarely can stand as accurate representations of sites and objects. The potential that three-dimensional imaging brings to human interaction with information can be enormous. Many historical and cultural wonders previously limited to a particular geographical area could be made accessible to others, leading to progress in historical and interpretive research. Expanding research on these 3D methods, such as the ongoing work at CHI, can lead to highly effective ways of contributing to this revolution in information.
The Sennedjem Lintel from the Phoebe A. Hearst Museum of Anthropology at the University of California, Berkeley. Lower left left shows the surface color and shape. Upper right shows an enhanced surface shape.
CHI has exposed me to a lot of these problems facing world heritage sites but has also introduced me to the preservation and information successes that are possible with different methods and technologies.
Filed under: Commentary, Guest Blogger, On Location | Tags: AIST, Archaeological Research, Archaeology, argon, Digital Preservation, guest blogger, Lake Jackson, Reflectance Transformation Imaging, RTI, virtual archaeology
This is a Guest Blog by Photographer Joseph Gamble.
As an affiliate with the University of South Florida’s Alliance for Integrated Spatial Technologies, I traveled with a team of archaeologists doing imaging research and 3D laser scanning of artifacts to Tallahassee last year to work in the Florida State Bureau of Archaeological Research (BAR) and experiment with RTI on a number of Native American artifacts from Lake Jackson, Florida. AIST Directors, Drs. Travis Doering and Lori Collins along with AIST archaeologist Dr. Jeff DuVernay, helped me to manage a challenging RTI of a Native American copper breastplate as well as other copper and metal objects from Lake Jackson and several other Florida sites.
Native American copper breastplate from Lake Jackson, Florida
The artifacts were from the ancient Lake Jackson settlement, a civic-ceremonial center of a Mississippian chiefdom that flourished across parts of northern Florida between c. 900-1500 A.D. The breastplate (23 X 54 cm) was cold-hammered from a sheet of native copper and contains extensive iconographic and symbolic that today are faint and difficult to discern. In the 1970s, the piece was encased in a clear Plexiglas, cube-like chamber that had been infused with argon gas as a conservation measure to halt corrosion of the artifact. The reflective polymer barrier that enclosed and protected breastplate seemed to pose an insurmountable obstacle for its accurate high resolution documentation. To stabilize the breastplate it had also been pressed into a plaster base to prevent further fragmentation and distortion leaving the piece with a cracked or crenelated surface texture. This condition was an additional for the documentation because of the shadowing that further limited the usability of the image set.
To acquire an inclusive data set that would contain sufficient usable images to build an RTI, we placed the case on black velvet, mounted the black balls and commenced to shoot. The total image count came to 156 raw files of which 57 were used to build the RTI file and, much to our delight, it worked well.
View the Final RTI File by clicking here (you tube video).
Joseph Gamble is a previous 4-Day RTI Training graduate. You can learn more about Joseph Gamble Photography at: http://www.jcgamble.com/
You can learn more about the Alliance For Integrated Spatial Technologies at: http://aist.usf.edu/
Filed under: Technology, Training | Tags: Digital Conservation, Digital Imaging, Digital Preservation, MoMA, Museum of Modern Art, photo paper, Reflectance Transformation Imaging, RTI, texture, visualization
CHI Executive Director Debra Dooley recently conducted an email interview with James (Jim) Coddington (JC), Chief Conservator at the Museum of Modern Art (MoMA) in New York. CHI is building a custom light array for MoMA’a Conservation Department to help with capturing reflectance transformation imaging (RTI) media of objects in the museum’s collection.
1. How long have you been at the MoMA?
JC: 23 years
2. As Chief Conservator at MoMA, are you constantly searching for new techniques to preserve and restore art?
JC: It is a necessity when conserving contemporary art in particular.
3. What are you doing to digitally document, analyze, and preserve the MoMA collection at present?
JC: We are using standard RGB imaging as well as multi-spectral imaging via a spectral estimation technique using a standard RGB camera with filters. We also maintain written digital documentation of treatments and other reporting.
4. Why have you decided to expand from what you are doing now into reflectance transformation imaging (RTI) techniques?
JC: The importance of 3D information in documenting works of art has been long recognized, mostly in the form of raking light photos. RTI gives us the means to collect substantially more 3D information in a standardized way that also provides data for scientific analysis of surface structure and topography.
4. Why did RTI interest you?
JC: I think mostly the demonstrated ease of use.
5. How will you use RTI?
JC: We will be using it initially to document texture on printed out photo papers but we expect to use it on many different types of objects in our collection.
6. A custom light array is being built for the MoMA. What objects will you capture first?
JC: See Answer #5.
Filed under: Commentary, Technology, Training, Workshops | Tags: Digital Conservation, Digital Preservation, Preservation, reflectance imaging, Reflectance Transformation Imaging, RTI, Technology, virtual archaeology
By Guest Blogger E. Keats Webb
Over the past three months I have been interning with Senior Conservator, Melvin Wachowiak, at the Smithsonian’s Museum Conservation Institute (MCI) exploring advanced imaging techniques for research and preservation of the collections focusing mostly on the Reflectance Transformation Imaging (RTI) method. We started in September with an African leather shoulder bag, the RTI enhancing the faint tooling and degradation on the surface. In October we imaged a writing slate from the 1600s found in an archeological excavation of a well at the site of Jamestown, Virginia. RTI proved an excellent tool in interpreting the drawings and writings that are found on both surfaces of the slate and at all orientations. Other types of objects that we have explored include paper “squeezes” (molds taken from stone inscriptions), oil paintings, a jawbone, ebony and ivory inlaid cabinet doors and a daguerreotype. We work alongside scientists and conservators on a daily basis at the Museum Conservation Institute, and RTI complements the studies happening within our labs along with other advanced imaging techniques used for research and preservation.
Set-up for the RTI of the Jamestown Slate.
E. Keats Webb left, Melvin Wachowiak right; Photo: Charles Durfor
Filed under: On Location | Tags: Digital Conservation, Digital Preservation, FAMSF, Fine Arts Museums of San Francisco, partners, reflectance imaging, Reflectance Transformation Imaging, RTI, Technology, virtual archaeology
Susan Grinols and her RTI capture team document an Anthropoid Coffin
In October 2009, Susan Grinols – Director of Photo Services and Imaging for Fine Arts Museums of San Francisco (FAMSF), assembled a team of scholars and imaging professionals to document an Anthropoid Coffin with the highlight RTI technique.
Sue and her team members were thrilled with the final results. Using the RTI Viewer, suddenly, hard to decipher glyphs were clearer and easier to view. The curators, interpreters and conservators were shocked at how the RTI technology delivered so much detail, in a completely nondestructive manner.
For a brief look into the RTI capture session be sure to view the flickr gallery.
Filed under: Technology, Workshops | Tags: Digital Conservation, Digital Imaging, Digital Preservation, News, NMAI, Reflectance Transformation Imaging, virtual archaeology
By Carla Schroer
The National Park Service’s National Center For Preservation Technology and Training (NCPTT) workshop was a great opportunity for the instructors as well as the participants. First, Mark and I got to spend a couple of days with Tom Noble and Neffra Matthews (from the Bureau of Land Management) prior to the workshop.
Tom and Neffra are extremely knowledgeable photogrammetry experts with lots of field experience. They also keep up with what’s going on in that field in terms of new products, and new features in existing products. They are a tremendous resource, and happy to share their knowledge. CHI welcomes any future opportunities to work with them again.
The next opportunity for me as an instructor was to hear from folks that participated about their own experiences in the field. A few had tried reflectance transformation imaging (RTI), others photogrammetry, others laser scanning, and all had done photographs and drawings (or been part of projects that did that).
The workshop afforded opportunities to discuss practical issues in the field, as well as get an understanding of some of the challenges people face, and what they are willing to do to overcome the challenges. The group worked well together, shared ideas readily, and asked good questions. I think we all got a lot out of the interaction. It wasn’t just instructors passing knowledge to students, and I really appreciated that aspect of it.
It was also fantastic that we had a range of people with a wide variety of experiences participating. Having Professor James Davis from the University of California, Santa Cruz attend the full workshop was really valuable, because he could hear directly the issues people face, and share his perspectives as a computer scientist.
James has worked with RTI for some years, and is also well versed in a range of computer graphics techniques, including laser scanning, structured light scanning, and other forms of capturing 3D geometry. He was really interested in the challenges in the field, and what takes the most time and is the most painful about the capture process, always thinking about ways he might be able to remove some of the time consuming parts.
Overall the experience was lively, interactive, open, and fun, but we made serious progress, too. I think it added a lot to have folks staying at the Presidio and getting to know each other in the evenings. Several people mentioned how the opportunity for them was in not only getting access to the technical information, but interacting with other participants.
I think that no matter how good we get at training people with web- based materials, there will always be a place for human interaction and sharing. It was a rich experience, and I truly thank everyone involved for participating fully.
Filed under: Technology, Workshops | Tags: Digital Preservation, NMAI, Reflectance Transformation Imaging, RTI
–Mark Christal, NMAI Multimedia Coordinator
Teachers have an old adage about the best way to learn something is to teach it. My colleague, Kevin Cartwright, and I had that concern about Reflectance Transformation Imaging (RTI), because the National Museum of the American Indian had joined the NPCTT grant with the role of assisting with the production of educational materials on RTI and Photogrammetry techniques. Fortunately, we got the opportunity to learn RTI in a four-day workshop on June 8-11 at the Smithsonian Cultural Resources Center in Suitland, Maryland, under the tutelage of Carla Schoer and Mark Mudge. CHI photographer Marlin Lum came to document the training and lend his own expertise to the classes. Michael Ashley arrived on the on the third day to talk about the new techniques for managing metadata.
The CHI instructors and staff were brought to Washington, DC by Carolyn McClellan, who is a relatively new Assistant Director at the National Museum of the American Indian (NMAI) heading up the Community and Constituent Services department. Carolyn first learned of CHI when she was working at the Bureau of Land Management. She participated in the digital documentation of rock art at Legend Rock in Montana. The project utilized close range photogrammerty techniques under the direction of BLM staffers Nefra Matthews and Tom Noble. Carla and Mark directed the RTI captures of some of the same features. These four experts will be teaming up again in the upcoming NPCTT training session at the Presidio in San Francisco on July 23-24.
We had contracted for a 12-seat class from CHI, and a variety of specialists at the Smithsonian attended. In addition to myself, Carolyn and Kevin, community liaisons Robert Alexander and Caleb Strickland and four photographers from the NMAI photo services department headed by Cynthia Frankenberg participated. Melvin Wachowiak, a conservator from the Smithsonian Museum Conservation Institution, attended with great interest. A recent intern of Mel’s, Rebecca Mendelshon, joined the training, too. We had two attendees from Smithsonian Exhibits Central, Vince Rossi and Adam Metallo, who have a keen interest in digital modeling.
NMAI conservator Emily Kaplan proved to be a very important contributor to the class. Emily is qualified to handle NMAI collections, so she was able to bring in the museum RTI subjects that are a focus of current research or being prepared for upcoming exhibits. These included Mississippian copper pieces, Mayan jades, a decorative Mayan carved panel, an Aztec stone carving, and several Incan qeros (ceremonial goblets). Emily was very excited to utilize RTI imagery on the qeros, because they have been a research focus of hers for nearly 10 years.
The workshop went extremely well, and all participants received a through grounding in RTI concepts and techniques. The experience well informed Kevin and I for our Friday session of shooting an educational clip on RTI capture. We brainstormed the approach with Michael Ashley, and we decided to write up a shot list that closely followed the “Guide to Highlight RTI Image Capture” document developed by Carla and Mark. By doing so, the instructional video and document would reinforce each other. Mark and I became the “talent” for the shoot, with Mark moving the camera strobe to each hemispheric position while I played the role of string master who assures that each lighting is done from the correct distance and angle. Carla triggered each shot in the sequence from a laptop that communicated with the camera. Kevin was our videographer and Michael read out each shot on our shot list to provide a slate for the editing tasks. We hope that the experience of creating this short educational video clip will help CHI document other aspects of RTI creation.
Filed under: Technology | Tags: Digital Conservation, Digital Imaging, Digital Preservation, reflectance imaging, RTI
The United Nations Environment Programme (UNEP) declares World Environment Day each June, making this month a time to focus on how we can improve our environment and our planet.
Our global cultural heritage is a vital element of our environment. Like our natural and physical world, heritage sites and artifacts have been adversely affected by climate change and other negative environmental effects, many caused by human activities.
UNEP has created the Champions of the Earth Laureates Program to recognize the extraordinary efforts made by dedicated researchers and activists to increase environmental protection and awareness.
CHI has been inspired by the UNEP program to create a Heritage Heroes initiative that appreciates people in the heritage community who have advanced the field in so many ways. UNEP recognition categories include science and innovation, policy, inspiration and action, and entrepreneurial vision.
The CHI team can think of numerous cultural heritage workers who deserve recognition in each of these areas and in other categories, too.
However, for our first nominee, we have selected someone who has really led the way in promoting digital techniques to document and preserve cultural heritage.
Tom Malzbender, senior research scientist at Hewlett Packard Labs, has helped the field of digital cultural heritage by developing, refining, and sharing advanced imaging techniques and other processes to digitally document and preserve artifacts.
Listen to him describe interactive relighting in a post on this blog. We hope you agree that he is a heritage hero! Let us know about your heritage heroes by posting comments in our blog.
We are interested in all kinds of heroes — not only those who excel in technology, but also those who inspire others to action — historic preservation advocates, fieldwork fiends, educators, and those working in other relevant fields.
Cultural Heritage Imaging 
Filed under: Commentary, News, On Location | Tags: Digital Imaging, Digital Preservation, Training
I’m both proud of and a bit surprised by what we have been able to accomplish with a small team (and small budget) over the 21 years since our founding.
The best part of this work for me is getting to meet, collaborate with, learn from, and teach so many people with a love for art and history and culture. Every time we deliver training we learn from the people who take our classes. It doesn’t matter if they are full time photographers at a prestigious museum, or undergrads just getting started with photography. Every single person has something to share, a passion for something I don’t know about, a photography tip, a great story to tell.
Our most recent work collaborating with Indigenous communities is an honor. While we are the trainers with imaging skills to impart, we get the incredible opportunity to visit special locations and learn about objects meaningful to these communities. A Passamaquoddy petroglyph site in North East Maine is a special place. It’s not open to the public, in order to protect the fragile artwork. To spend time there and to hear the stories and explanations from Passamaquoddy people is an incredible gift.
This type of collaboration is synergistic. The folks we work with get new skills and a way forward to document their own material culture. Our greatest pleasure is in empowering communities to take control of their own cultural narrative. These culture bearers should be deciding what to document, how things are shared (or not shared) and what stories to tell along with them.
Overall, I am immensely grateful to be part of Cultural Heritage Imaging. So many people have contributed, supported us, advised us. Thank you all! We have an Acknowledgments page on our website, though it isn’t complete. We’ve had the opportunity to meet, and teach, and share knowledge with thousands of people over these 21 years. I look forward to every additional encounter.