Filed under: Conferences, Grants, Guest Blogger, Technology | Tags: 3D data, CHI, conservation, Digital Imaging, Digital Preservation, Open Source, RTI, symposium
Our guest blogger, Emily B. Frank, is currently pursuing a Joint MS in Conservation of Historic and Artistic Works and MA in History of Art at New York University, Institute of Fine Arts. Thank you, Emily!
With the National Endowment for the Humanities (NEH) back on the chopping block in the most recent federal budget proposal, I feel particularly privileged to have taken part in the NEH-funded symposium, Illumination of Material Culture, earlier this month.
Co-hosted by The Metropolitan Museum of Art and Cultural Heritage Imaging (CHI), the symposium brought together conservators, curators, archaeologists, imaging specialists, cultural heritage and museum photographers, and the gamut of engineers to discuss and debate uses, innovations, and limitations of computational imaging tools. This interdisciplinary audience fostered an environment for collaboration and progress, and a few themes emerged.
The sold-out crowd at the symposium at The Met
(1) The emphasis among practitioners seems to have shifted from isolated techniques to integrating a range of data types.
E. Keats Webb, Digital Imaging Specialist at the Smithsonian’s Museum Conservation Institute, presented “Practical Applications for Integrating Spectral and 3D Imaging,” the focus of which was capturing and processing broadband 3D data. Holly Rushmeier, Professor of Computer Science at Yale University, gave a talk entitled “Analyzing and Sharing Heterogeneous Data for Cultural Heritage Sites and Objects,” which focused on CHER-Ob, an open source platform developed at Yale to enhance the analysis, integration, and sharing of textual, 2D, 3D, and scientific data. CHI’s Mark Mudge presented a technique for the integrated capture of RTI and photogrammetric data. The theme of integration propagated through the panelists’ presentations and the lightning talks, including but not limited to presentations by Kathryn Piquette, Senior Research Consultant and Imaging Specialist at University College London, on the integration of broadband multispectral and RTI data; Nathan Matsuda, PhD Candidate and National Science Foundation Graduate Fellow at Northwestern University, on work at NU-ACCESS with photometric stereo and photogrammetry; as well as a lightning talk by Chantal Stein, in collaboration with Sebastian Heath, Professor of Digital Humanities at the Institute for the Study of the Ancient World; and myself, about the integration of photogrammetry, RTI, and multiband data into a single, interactive file in Blender, a free, open source 3D graphics and animation software.
(2) There is an emerging emphasis on big data and the possibilities of machine learning.
Paul Messier, art conservator and head of the Lens Media Lab at the Institute for the Preservation of Cultural Heritage, Yale University
The notion of machine learning and the possibilities it might unlock were addressed in multiple presentations, perhaps most notably in the “RTI: Beyond Relighting,” a panel discussion moderated by Paul Messier, Head of the Lens Media Lab, Institute for the Preservation of Cultural Heritage (IPCH), Yale University. Dale Kronkright presented work in progress at the Georgia O’Keeffe Museum in collaboration with NU-ACCESS that utilizes algorithms to track change to the surfaces of paintings, focusing on the dimensional change of metal soaps. Paul Messier briefly described the work being done at Yale to explore the possibilities for machine learning to work iteratively with connoisseurs to push data-driven research forward.
Mark Mudge, President of CHI, participates in a panel discussion
(3) The development of open tools for sharing and presenting computational data via the web and social media is catching up.
Graeme Earl, Director of Enterprise and Impact (Humanities) and Professor of Digital Humanities at the University of Southampton, UK, gave a keynote entitled “Open Scholarship, RTI-style: Museological and Archaeological Potential of Open Tools, Training, and Data,” which kicked off the discussion about open tools and where the future is heading. Szymon Rusinkiewicz, Professor of Computer Science at Princeton University, presented “Modeling the Past for Scholars and the Public,” a case study of a cross-listed Archaeology-Computer Science course given at Princeton in which students generated teaching tools and web content that provided curatorial narrative for visitors to the museum. CHI’s Carla Schroer presented new tools for collecting and managing metadata for computational photography. Roberto Scopigno, Research Director of the Visual Computing Lab, Consiglio Nazionale delle Richerche (CNR), Istituto di Scienza e Tecnologie dell’Informazione (ISTI), Pisa, Italy, delivered the keynote on the second day of the symposium about 3DHOP, a new web presentation and collaboration tools for computational data.
We had the privilege of hearing from Tom Malzbender, without whose work at HP Labs in the early 2000s this symposium would never have happened.
The keynotes at the symposium were streamed through The Met’s Facebook page. The other talks were recorded and will be available in three to four weeks. Enjoy!
Tom Malzbender, the inventor of RTI, at the podium
Filed under: Guest Blogger, Technology, Training, Workshops | Tags: 3D data, conservation, photogrammetry, Training
Lauren Fair is Associate Objects Conservator at Winterthur Museum, Garden, & Library in Buffalo, New York. She also serves as Assistant Affiliated Faculty for the Winterthur/University of Delaware Program in Art Conservation (WUDPAC). Lauren was a participant in CHI’s NEH grant-sponsored 4-day training class in photogrammetry, August 8-11, 2016 at Buffalo State College. She posted an account of her experience in the class in her own blog, “A Conservation Affair.” Here is an excerpt from her fine post.
I have discovered the perfect way to decompress after a four-day intensive seminar on 3D photogrammetry: go to your friend’s cabin on a small island in a remote part of Canada. While you take in the fresh air and quiet of nature, you can then reflect on all that you have shoved into your brain in the past week – and feel pretty good about it!
The Cultural Heritage Imaging (CHI) team – Mark, Carla, and Marlin – have done it again, in that they have taken their brilliance and passion for photography, cultural heritage, and documentation technologies, and formulated a successful workshop on 3D photogrammetry that effectively passes on their expertise and “best practice” methodologies.
The course was made possible by a Preservation and Access Education and Training grant awarded to CHI by the National Endowment for the Humanities.
(Read the rest of Lauren’s blog here.)
Filed under: Guest Blogger, Technology, Training | Tags: 3D data, conservation, photogrammetry, Training
Our guest blogger, Emily B. Frank, is currently pursuing a Joint MS in Conservation of Historic and Artistic Works and MA in History of Art at New York University, Institute of Fine Arts. Thank you, Emily!
I’ve been following the development and improvement of photogrammetry software for the past few years. As an objects conservation student with a growing interest in the role of digital imaging tools in the study and conservation of art, I’ve always found photogrammetry of theoretical interest. In my opinion, until recently the limited accuracy of the software and tools impeded widespread applications in conservation. With recent advances, this is no longer the case; sub 1/10th mm accuracy has changed the game.
This January, the stars aligned and I was able (and lucky) to participate in CHI’s January photogrammetry training. From January 11 to 14, I lived and breathed photogrammetry in CHI’s San Francisco studio. The four-day course was co-instructed by Carla Schroer, Mark Mudge, and Marlin Lum, who each brought something extraordinary to the experience.
CHI’s January 2016 photogrammetry class: blogger Emily Frank is fourth from the right.
For those of you that don’t know them personally, I’ll provide context; these guys are total gurus. Carla brings business and tech know-how from years of work in Silicon Valley earlier in her career. She has a warm and direct teaching style that is accessible no matter what your photography/imaging background. Mark is a true visionary; he is rigorous and inventive, and always carefully pushing the brink of what’s possible. Marlin is the photographer of the group and a master at fabricating the perfect tool/workstation for the capture of near-perfect source images. His never-ending positivity is contagious. Together they are practically unstoppable. It’s obvious that they love teaching and truly believe in the power of the tools they are sharing.
The class began with a brief theoretical introduction, then dove into practical aspects of capture and processing. We swiftly covered how to approach a range of situations, what equipment to use, where to compromise, and where to stick to a specific protocol, etc. We focused on methodology, and we practiced a lot. We moved through capture and processing of increasingly complex projects, and we received detailed handouts to supplement everything we were learning. The class also afforded students the opportunity to work on a larger group project; this January we captured a 3D model of a reproduction colossal Olmec head located outdoors at City College of San Francisco. CHI focuses on repeatability and process in order to achieve a robust, reproducible result.
Setting up for image capture at the January 2016 photogrammetry class; blogger Emily Frank is far left.
An added benefit of the class was the insight gained through conversation with the other students, who included museum photographers, landscape photographers, archaeologists, classicists, 3D-imaging academics, and the founder of a virtual reality start-up. This diversity fostered a breeding ground for inventive implementation, and the inevitable collaboration left me envisioning new ways to employ photogrammetry as a tool in my work.
For those of you who have ever considered the use of photogrammetry, I would strongly encourage you to sign up for one of CHI’s upcoming trainings. I still have a lot to learn and master, but I left the training with the feeling that with practice I would be able to capture and process 3D data with the accuracy and resolution to meaningfully contribute to the academic study of works of art.
Notes from CHI:
- Emily Frank has included a link to a 3D model of a reproduction colossal Olmec head located at City College of San Francisco. This huge outdoor sculpture was a practice subject in CHI’s January photogrammetry class in which our guest blogger Emily Frank was a participant. The model was created with photogrammetry, and it is presented on Sketchfab, a website for 3D models.
- See our Flickr photo album of the January 2016 photogrammetry class in which blogger Emily Frank participated.
Filed under: On Location, Training | Tags: CHI, conservation, light array, MoMA, RTI
By Elizabeth Peña
Last week, the CHI team headed to the Big Apple to deliver a custom-built lighting array to the Museum of Modern Art Conservation Department, and to conduct a 4-day training session with MoMA conservators and guests. It was wonderful to work with such an accomplished, collegial group whose insights inspired us every step of the way. By the end of the week, the group had accomplished RTI’s ranging from a Jeff Koons basketball to a Brancusi sculpture, as well as paintings by Gottlieb and Gorky, a Schwitters collage, and several photographs for an important photograph characterization study. Many thanks to Jim Coddington and everyone at MoMA for their generous hospitality. We look forward to continuing to work with the MoMA staff as they begin to incorporate RTI into their work.
Clockwise from left: Linda Zycherman, Corey Toler-Franklin (Princeton), Mark Mudge (CHI), Szymon Rusinkeiwicz (Princeton), Carla Schroer (CHI), Rick Johnson (Cornell), Marlin Lum (CHI), Mary McGinn (Winterthur), Chris McGlinchy, Robert Kastler, Paul Messier (Paul Messier LLC), Dan Kushel (Buffalo State), Michael Duffy, Lee Ann Daffner, Jim Coddington. Not pictured: Scott Gerson, Ana Martins, Cindy Albertson, Elizabeth Peña (CHI)
Cultural Heritage Imaging 