Filed under: 3D, Equipment, Lighting, On Location, photogrammetry, RTI | Tags: Maori weaving, photogrammetry, RTI, TeRa
In January 2020 Mark Mudge and I traveled to the British Museum in London to document the only existing Māori canoe sail of its kind, made over 200 years ago. The imaging work was performed in collaboration with the New Zealand project Te Rā – The Māori Sail Whakaarahia anō te rā kaihau! – Raise up again billowing sail! funded by The Royal Society – Te Apārangi Marsden Fund.
The New Zealand team produced a 13½-minute video of the project that you can watch here: Imaging Te Rā at the British Museum 2020
helps prepare the sail for imaging
The construction and materials of the last known Māori sail, Te Rā, had not been identified, documented, or made publicly available, until this project put significant efforts into these identifications and documentation. Māori textile researchers from New Zealand brought in CHI to image the sail, which is made with fragile plant materials and feathers. The CHI team used both photogrammetry and Reflectance Transformation Imaging (RTI) to help the experts examine and understand more about the delicately woven and perishable materials. The research team wanted to gain a greater understanding of how the Māori sailed the ocean and the intricacies of their weaving techniques.
We worked with the sail on site at the British Museum for 5 days.
The first day was all preparation: meeting the team, examining the sail, setting up equipment, testing lights, and troubleshooting. The second day was spent on the imaging. The initial preparation had begun back in the CHI studio in San Francisco, when Marlin Lum, Imaging Director, prepared for the intensive imaging project by creating a life-size paper template of the sail so the CHI team could work out the imaging logistics ahead of time. Marlin had also created an ingenious camera rig to manage the imaging and protect the fragile materials. Marlin’s rig was attached to a rental pro video slider unit that we picked up in London on the first morning.
At the museum collection facility, the sail was spread out on a protective foam core platform on the floor, covered by black paper. Because the sail has a pattern of holes in it, we performed tests on how best to mask out the holes so that they would be correctly modeled as holes in the final model. The black paper worked best. Over this the team positioned the trolley with its cantilevered arm that could move across and incrementally shoot the entire area, photo by photo. The camera height could be adjusted using a slider and the camera angle could be adjusted using a ball head.
Here is my project note from the morning of the second day:
“Light tests and light adjustments are done. We add a Speedlite to the mix of lights to deal with a corner that was a bit dark. We will trigger the Speedlite (Michael’s Canon 600) with the PocketWizard TT1 and TT5 combo and all 4 Monoblocks are set to slave mode. It takes a bit of time to tune everything in using the light meter and small adjustments. We feel now the entire sail is evenly lit and imaging can begin.”
Scale bars were placed around the small end of the sail as were color checkers. Using a Canon 5DSR with 24mm f2.8 IS USM lens, and shooting at 18 inches distance from the subject, the imaging began with a calibration pass with 90-landscape-270 rows – then returned to the 90 position for the remainder of the imaging in that pass.
The feathers that trim the sail presented a significant imaging challenge: they stick up, and there are knots and places where the material juts out. The camera focus was set manually to allow some extra depth of field above where the main body of the sail was laid out, so that these elements would remain in focus.
As the work progressed, I recorded this:
“We completed the second pass of the sail with a 50mm lens today and shot 3 RTIs of detail areas chosen by Donna from the Maori textile team. Then we had a crew come in to turn the sail over, and we prepped everything for the back side (which is actually more important for the weavers). We will begin shooting that first thing tomorrow.”
Image: © TeRa Project, Marsden Fund, 2020:
After completing the work on site each day, we returned to our London apartment and began the next step: processing the images of the sail. We have built the RTIs and some other high-resolution 2D outputs of the sail and shared them with the team. The detail is fantastic. We look forward to the team’s continued research and the publishing of their findings, along with our imaging results.
Special thanks to: Donna Campbell, co-Principle Investigator (co-PI) for the research project worked closely with us on site; Julie Adams, Curator of the Oceania Collections at the British Museum, hosted the imaging project; Michael O’Neill, a photographer from the National Museum of New Zealand Te Papa Tongarewa; Kira Zumkley, a London-based heritage photographer and researcher; and Jill Hassell, museum assistant. Catherine Smith, co-PI on the project aided in logistics and overall project management.
You can read more about the sail in the research team’s blog and also the British Museum’s description of the sail from its online collection.
Filed under: 3D, Guest Blogger, On Location, photogrammetry, Training, Workshops
In October 2019, our training team at CHI delivered a 4-day photogrammetry class for staff at the Library of Congress (LoC) in Washington, D.C. The class was part of a pilot project to test the use of photogrammetry for building digital models of three-dimensional items held in the Library’s collections. Eileen Jakeway, innovation specialist in Digital Strategy at the LoC, wrote a blog about it. Check it out!
The Library also released some 3D models, including a cast of Abraham Lincoln’s hand (this is CHI’s snapshot of the model).
Filed under: Commentary, Guest Blogger, News, On Location, Technology | Tags: ancient footprints, photogrammetry, Preservation
Sarah Duffy, PhD is a Postdoctoral Research Associate at the University of York in the Department of Archaeology. In May of 2013, after a series of storms, ancient footprints were revealed on a beach near Happisburgh (pronounced “Hays-boro”) on Britain’s east coast in Norfolk (see a 6-minute video). The footprints were fragile and washing away a little day by day. Sarah was called to the site by Dr. Nick Ashton, Curator of Palaeolithic and Mesolithic collections at the British Museum, to document it. Here is our interview with Sarah about this dramatic discovery.
Sarah shooting photogrammetry in the rain. Image courtesy of Natural History Museum, London, UK
CHI: Sarah, can you tell us how you got involved in the project and what you found when you arrived?
Sarah: It really came down to good timing and an opportune meeting of research colleagues. When the footprints were discovered, I had just begun working with Dr. Beccy Scott at the British Museum on a project based in Jersey called “Ice Age Island”. Beccy and my partner, Dr. Ed Blinkhorn, another early prehistoric archaeologist, have collaborated for many years, and he introduced us. During the week of the discovery, Beccy happened to be at a research meeting with Dr. Nick Ashton and suggested that he get in touch with me about the Happisburgh finding.
The next day, I received a call from Nick who asked if I would be able to take a trip to Norfolk to record some intertidal Pleistocene deposits at Happisburgh. Having just completed my PhD thesis (a “dissertation” in US currency), I was up for an adventure and ready to take on the challenge, and so I was on a train to the southeast coast two days later.
My first plan of action was to figure out how on earth you pronounced the name of the site! The next step was to figure out what equipment I would need to have available when I arrived. This proved somewhat challenging, as I had never visited the Norfolk coast, and it seems quite humorous in hindsight that one of the pieces of kit I requested was a ladder.
All of this said, the urgency to get the site photographed became clear when I showed up one very rainy afternoon in March. Standing on the shore, I felt very privileged to have been invited to record such an important set of features, which disappeared within only weeks of their discovery by Dr. Martin Bates.
CHI: What were your goals in the project and why did you choose to shoot images for photogrammetry? Can you tell us a little bit about your approach?
Sarah: Since I wasn’t sure what to expect when I reached the site, I took both photogrammetric and RTI kit materials with me. I intended to capture the 3D geometry of the prints with photogrammetry and subtle surface relief with RTI. However, when I arrived, both the weather and tidal restrictions limited the time we were able dedicate to recording. I therefore focused my efforts on photogrammetry, which proved a flexible and robust enough technique that we were able to get the kit down the cliff side in extremely challenging conditions and capture images that were used later to generate 3D models.
Based on the looming return of the tide and the amount of time required to prepare the site, our window of access was quite small. While I took the images, aided by Craig Williams and an umbrella, the rest of the team battled the rain and tide by carefully sponging water from the base of the features. As mentioned, I originally intended to capture images from above the site using a ladder. However, as the ladder immediately sank into the wet sand, I was forced to find other means of overhead capture: namely Live View, an outstretched arm, and umbrella. There was just enough time to photograph the prints, loosely divided into two sections, using this recording approach before we had to retreat back up to the top of the cliff (and to a very warm pub for a much deserved fireside pint!).
3D model of laminated surface containing the footprints at Happisburgh. Photo by Sarah M. Duffy
CHI: When you got back to your office, how long did it take you to process the images, and what software did you use?
Sarah: Originally, I used the Standard Edition of PhotoScan by Agisoft, later returning to the image set in order to reprocess it with their Professional Edition. PhotoScan’s processing workflow is relatively straightforward, and the time required to generate geometry is somewhat dependent on the hardware one has access to. The post-processing of the images was by far the most time-consuming component of the processing sequence. Since the software looks for patterns of features, there was a substantial amount of image preparation that needed to be completed first, before models could be produced. For example, rain droplets on the laminated surface that contained the prints needed to be masked out, as well as the contemporary boot prints that accumulated in the sand that surrounded the site throughout the image sequence.
CHI: How were the 3D models you produced used by the other archaeologists involved with the site?
Sarah: Once the models had been generated, the rest of the team, including Nick Ashton, Simon Lewis, Isabelle De Groote, Martin Bates, Richard Bates, Peter Hoare, Mark Lewis, Simon Parfitt, Sylvia Peglar, Craig Williams, and Chris Stringer, wrote the paper on the results. Nick Ashton and Isabelle De Groote closely analyzed the models of the prints in order to study size, movement, direction, and possible age of the early humans who might have created these features. Isabelle later worked with the 3D printing department at Liverpool John Moores University in order to have one of the digital models printed.
CHI: Since the footprints were washed away, your images are the best record of the site that exists. Are the 3D models accessible? What will you do to preserve this material?
Sarah: Coverage of the footprints, including excerpts of the digital models that I generated and the 3D printout, can be viewed at the Natural History Museum exhibit in London, Britain: One Million Years of the Human Story, which closes September 28th. Findings from the analysis have also been published in PLOS ONE, an open-access, peer-reviewed scientific journal.
As mentioned, when I visited the site last March, I had hoped to undertake a RTI survey. Although conditions on the day of recording did not permit multi-light capture, I have since been able to generate virtual RTI models that reveal the subtle topography of the prints. An excerpt of one of these models can be viewed on my website.
Additionally, the research team, in collaboration with the Institute of Ageing and Chronic Disease at Liverpool, are currently working on extracting further information from the image set. Findings from this work will be made available in the future. Once analysis is complete, the images and resulting models will be archived with the British Museum.
CHI: Thank you for your time, Sarah, and what a great story!
Sarah Duffy has been collaborating with Cultural Heritage Imaging (CHI), including taking CHI’s training in Reflectance Transformation Imaging (RTI) and working with the technique since 2007 while she was a graduate student in Historic Preservation at the University of Texas at Austin. Sarah authored a set of guidelines for English Heritage on RTI. During her doctoral work, she also began to apply her imaging skills in the area of photogrammetry.
We often get asked why we set up CHI as a nonprofit. I can understand the question, because we are doing some pretty high-tech projects, and we work with a number of famous institutions whose names people recognize, perhaps making us seem grander and better endowed than we really are.
There are a number of reasons why a “public benefit charity” structure made sense to Mark and me when we founded CHI in 2002. The greatest impetus for it was a personal vision we shared.
Mark and Carla at entrance to Dolmen de Antales, a Megalithic tomb in Portugal. June 2006
My background is in computer science, and I worked in software product development for years. At some point I had decided I wanted to apply my skills to “make the world a better place.”
Mark had similar leanings. His background was in philosophy and studio arts, primarily sculpture. He began looking into 3D modeling and laser scanning in the late ’80s, and by the mid-1990s he was teaching the subject. I had a minor in sculpture and ceramics. We both loved history, art, and archaeology. We had met in 1983 and married in 1989. By the late ‘90s, digital cameras were coming into play, and structured light scanning technology was becoming available for 3D capture.
Mark and I got fired up. We started seeking out people who worked in archaeology or museums to better understand their needs. Our first questions were: What did they wish to do that they couldn’t do in the field? Could the emerging imaging technologies help them in research and creating access to more cultural material?
Over time, and as we learned more, the seeds of CHI took root in us. By 2002 we began to imagine how existing and emerging technologies could be used to create robust, powerful, low-cost tools to document cultural heritage objects and collections. And so we formed Cultural Heritage Imaging.
Today, well over 10 years after we started our nonprofit, we remain committed to fostering the improvement, availability and adoption of these documentary tools. We see them as “democratizing technology,” because our vision is founded on making cultural and natural science techniques and materials available to people all over the world.
Many of our collaborations are only possible because we are a nonprofit. “Pulling on the same oar” for humanity’s benefit is a powerful reward. Our nonprofit status is attractive to top researchers and organizations who are drawn to work on and contribute to saving history. These experts are sometimes willing to help for very little money, and occasionally they even raise their own grant funding. Our open source approach is inclusive and allows others to add new features to the tools, moving the whole community forward.
The downside of this commitment to openness is there is a constant need to raise money, and much of the money we get is earmarked for specific purposes. It’s great to get funding for a project we want to do, like the National Endowment for the Humanities Start-up grant we recently received. However, many of the requirements of running the organization and fostering community growth are not covered by the grant funds.
Funding is critical! We get a lot of volunteer support, we work with students and professors, we get discount rates from many professionals. We are extremely grateful for this help and it makes an enormous difference. At the end of the day, we rely on the good graces of our donors to keep us, and the community, going.
I have had the good fortune to attend a few recent events that allowed me to see some really useful work other folks are doing in our field. I thought it worth a blog post to mention a few with some links. I’ll note that I have seen even more cool stuff, but if there wasn’t a paper or a page I could link to, I decided not to include it here.
First, Mark Mudge and I were at Computer Applications and Quantitative Methods in Archaeology (CAA) in late April in Paris. Yes, I know, it is a hard-knock life having to present your work in Paris in April. I always love CAA because it is a great conference for sharing information and real-life experiences. People are super helpful, and everyone wants to see everyone else succeed. This isn’t the norm for a lot of conferences.
Musee de Cluny, Paris
I want to point out 2 projects from there. The first is Eleni Kotoula’s RTI on Papyrus case study. New here is Eleni’s use of multispectral imaging and also her experiment with transmitted RTI. Eleni was interested in information for conservation about the state of this papyrus, which is mounted on cloth and under glass. The second project at CAA isn’t an RTI project, but it’s very cool and worth mentioning anyway. It is the work of Adam Rabinowitz et al. on PeriodO. As folks who follow our efforts know, we at CHI are big fans of metadata, process-history tracking, and related topics. Figuring out how to talk about periods in archaeology and art is really hard, and Adam and team have an idea for an interesting approach. This project recently won National Endowment for the Humanities support, so it will be able to go forward. You can and should contribute to this effort yourself!
Next up is the American Institute for Artistic and Historic Works (AIC) conference, which took place at the end of May, right here in San Francisco. It was great for us to have so many folks we have worked with here in SF. One of the things I noticed at this conference was that Reflectance Transformation Imaging (RTI) showed up in a number of talks, though that wasn’t the focus of the talk. RTI is another tool to look at objects people are studying, and RTIs are being shown right alongside IR images and X-rays and the like. YAY! My takeaway is that RTI is an accepted part of the practice for art conservators. We are super happy to see that.
Finally, I was able to attend a 3-day workshop on RTI current practice and future directions, hosted by the Cyprus Institute in Nicosia, Cyprus in early June. This was “All RTI, All the Time!” and it was very productive to be part of a dedicated meeting like this. There were many noteworthy projects presented there, and I’ll point out a few. Up first, the work of Todd Hanneken and others integrating spectral imaging and RTI. While many of us have done spectral imaging and RTI going back several years, what is new here is the use of a MegaVision monochrome camera system, and taking 11 spectral bands. RTI was shot in the visible and used for luminance data to generate the RTIs, and the color data collected via the spectral bands was then applied to the images shot in visible light. The team also tested shooting full RTIs in each spectral band for comparison. In addition, work from the Visual Computing Lab in Pisa for a WebGL-based RTI viewer, released in January of this year, was discussed. At the moment, this work is limited to streaming large RTI files and then allowing the user to pan, zoom, and relight, but some possible future directions were outlined. It is open source, so you can try it out yourself. There is also a project at The University of Southampton to develop a web-based RTI viewer, and we received an update on that project, but I don’t have a link where I can send you just yet.
RTI group in the old city of Nicosia
As part of the discussion on where RTI is going, there was a lot of interest in quantitative uses of RGB and normals data. There are a variety of people working in this area, though they didn’t present directly at any of these meetings. Several of these folks are working with us at CHI, and we are very excited by this direction. First up, the work of Dale Kronkright, Greg Bearman, and several others to look at tracking changes through normals, and also to quantify normal calibration. You can find both papers here. Additionally, there is great work going on at Simon Fraser University under Professor Mark Drew to improve the accuracy of surface normals calculated from RTI data sets. They are also working on improving the appearance of RTI data in the viewing environment. There are a number of papers on this topic, most recently the masters thesis of Mingjing Zhang.
It is an exciting time to be working with RTI data! There is much more work going on than I could include here, and more that hasn’t been published yet. I want to close with a plug for the CHIForums where many topics like this are discussed, and there is a Projects Forum where folks can put up links to their work, as well as get comments and feedback.
Filed under: Commentary, News, Technology | Tags: Antikythera Mechanism, PTM, RTI
Tom Malzbender imaging a piece from the Antikythera Mechanism
We are absolutely thrilled to announce that Tom Malzbender has joined the Cultural Heritage Imaging Board of Directors!
Tom is a long-time friend of CHI and has been an adviser and collaborator on many projects. Tom is best known as the co-inventor (with Dan Gelb) of Polynomial Texture Mapping (PTM) in 2001 while he was at HP Labs. PTM is the first form of Reflectance Transformation Imaging (RTI).
Tom has had a long research career in the fields of computer graphics and computer vision as demonstrated by his many published papers. He has frequently applied this work to cultural heritage material, most notably as part of the team that deciphered the Antikythera Mechanism. This groundbreaking work was featured in the NOVA documentary “Ancient Computer”
Welcome Tom!
Filed under: Commentary, News, Training | Tags: glossary of terms, photographic terms, technical terms
Over the years we have received a lot of requests for a glossary of terms used in RTI, and we are happy to announce that a new “Glossary of Photographic and Technical Terms for RTI” is available on our website! It includes photographic terms you need to know for RTI, like “Depth of Field,” “Color Temperature,” and “Aperture.” Also included are technical terms from computer graphics and computer vision like “BRDF,” “Fitting Algorithm,” and “Phong Lighting Model.” We have included terms for file formats like DNG, XMP and TIFF, along with basics in multi-spectral imaging such as “Infrared” and “Ultraviolet-induced Visible Fluorescence Photography.” We also included terms related to keeping good process history in your RTI work, including “Digital Lab Notebook,” “ICOM-CIDOC,” and “Empirical Provenance.” We did our best to adapt the definitions for RTI users, and we also included a few notes and recommendations on photographic settings.
As always with our work at CHI, this project was a collaboration. Lots of folks offered terms they wanted to see defined, and some provided definitions. We especially want to thank Tom Malzbender for definitions for many of the technical terms; Yosi R-Pozeilov for sharing his extensive glossary of photographic terms; and technical writer Judy Bogart for pulling it all together. And finally, we had a wee bit of funding for this work from the Institute of Museum and Library Services, as part of a larger grant project in their 21st Century Museum Professionals grants. Much of the work was done through volunteer efforts.
If you value this kind of documentation, along with the free open source RTI software, please consider making a donation to help support it.
What an encouraging way to end 2013: our Annual Giving campaign raised almost twice as much as the previous year! Our donors’ continued support of Cultural Heritage Imaging (CHI) is both touching to us personally and vital to our mission.
Our donors’ gifts enable CHI to develop innovative digital imaging tools and practices and disseminate them to experts and students all over the world. Specifically, this financial support helps us complete software projects, like our recent release of the updated RTIViewer 1.1 and our update to RTIBuilder (coming soon). Donations also fill in the gaps in our funding so we can refine our training materials and develop new instructional programs. We are currently working on a new class in collecting high-quality, accurate, 3D models using a digital camera (stay tuned to learn more about that). CHI also engages in a variety of projects with museums and historic sites, and donor contributions allow us to keep our fees as low as possible for these projects.
In the long run, financial gifts support our many users around the globe who are working on cultural documentation in vital fields such as archaeology, computer imaging, museum and library sciences, natural sciences, and data archiving.
We are deeply grateful to our donors for their generosity.
–The CHI team
We are thrilled to announce the release of the RTIVewer 1.1 software!
This update release includes the most asked for features in the RTIVIewer. As with prior versions, this is free, open source software. We have been working with it for a while, and we are excited to get this out to everyone in the RTI community. I am most excited about surfacing all the numerical settings data within the interface. Of course those numbers were in the software, but you couldn’t see them or work with them directly. The new bookmarks and snapshots features take advantage of and keep track of these settings for you. Read more about all of the new features and how to use them in the updated User Guide.
For those interested in the back story, here is how this release came about.
We had a tiny amount of money in a 21st Century Museum Professionals grant from the Institute for Museum and Library Services to pay for some software updates. We really wanted to add the support for normal visualizations, as that is incredibly useful both as a visualization of the surface normal data and as a way to compare the calculated normals over time, or across related data sets. We also heard over and over again that folks wanted to be able to get back to specific views in their RTI file. A significant amount of preliminary work for a bookmarks feature had been done by Leif Isaksen of the University of Southampton. We picked up his work (with his volunteer help) and expanded it to include interface updates and also to save these details with snapshots.
We were able to procure the development services of Ron Bourret, a senior developer who was willing to do some part time work at a very discounted rate. When the money for the project ran out, Ron volunteered his services to complete it. We also had volunteer help from Gianpaolo Palma, of the Visual Computing Lab in Pisa. Gianpaolo was one of the principal developers of the original version of RTIViewer. Then we had some testers, and time from the CHI staff to oversee it all, test it, prepare material for the documentation, etc. To complete things, the fabulous tech writer, Judy Bogart, stepped in and updated the user guide, as a volunteer. We had hoped to ship the release earlier in the year, but once it became a volunteer project, the work had to be fit in around other things people were doing, like travel and paid commitments.
While we are totally happy with and proud of the result, we know that the process can run faster and more efficiently when we have funding. Adequate funding is essential in these releases, even when we get incredible volunteer support.
If you use RTI tools, or if you think they are valuable – please support our efforts. We suggest a donation of $50 per year for users of the tools and services, like the CHIForums. We are a small independent nonprofit organization and we rely on donations to help support this work. We appreciate all donations, in any amount.
We accept donations any time, and right now through December 31, 2013 is our annual giving campaign. If you are in the US, your contribution is tax deductible. Thank you for your consideration
Cultural Heritage Imaging 
Filed under: Commentary, News, On Location | Tags: Digital Imaging, Digital Preservation, Training
I’m both proud of and a bit surprised by what we have been able to accomplish with a small team (and small budget) over the 21 years since our founding.
The best part of this work for me is getting to meet, collaborate with, learn from, and teach so many people with a love for art and history and culture. Every time we deliver training we learn from the people who take our classes. It doesn’t matter if they are full time photographers at a prestigious museum, or undergrads just getting started with photography. Every single person has something to share, a passion for something I don’t know about, a photography tip, a great story to tell.
Our most recent work collaborating with Indigenous communities is an honor. While we are the trainers with imaging skills to impart, we get the incredible opportunity to visit special locations and learn about objects meaningful to these communities. A Passamaquoddy petroglyph site in North East Maine is a special place. It’s not open to the public, in order to protect the fragile artwork. To spend time there and to hear the stories and explanations from Passamaquoddy people is an incredible gift.
This type of collaboration is synergistic. The folks we work with get new skills and a way forward to document their own material culture. Our greatest pleasure is in empowering communities to take control of their own cultural narrative. These culture bearers should be deciding what to document, how things are shared (or not shared) and what stories to tell along with them.
Overall, I am immensely grateful to be part of Cultural Heritage Imaging. So many people have contributed, supported us, advised us. Thank you all! We have an Acknowledgments page on our website, though it isn’t complete. We’ve had the opportunity to meet, and teach, and share knowledge with thousands of people over these 21 years. I look forward to every additional encounter.