Issue Twelve

1

Introduction: Re-viewing Digital Technologies and Art History

 

A widespread opinion within the academic community is that art historians have been left behind by the digital turn in the humanities (see Greenhalgh 2004, Zorich 2012, and the essay by Elizabeth Honig in this issue). According to many researchers and educators, the field of digital art history (DAH) — that is, the application of computational tools and analytical techniques to art-historical research questions — has not fulfilled its potential and remains a marginal branch of the discipline (Zorich 2012, 6). As Benjamin Zweig has argued, however, the assumption that art history has lagged behind other humanities disciplines in employing digital technologies is not entirely correct. In a 2015 article, he documents a selection of pioneering DAH projects, initiatives that emerged as early as the 1970s. Examples include the 1983 collaboration between the Getty Trust and the Architectural Drawings Advisory Group to produce a cataloging standard for digitized drawings that would allow scholars to search across all electronic repositories of works on paper as well as manipulate this information in ways that could stimulate new views of the material and thus, new research questions. The ambitious MORELLI project, launched in the mid 1980s by William Vaughan, a professor of art history at Birkbeck, University of London, is another example of an early DAH project. MORELLI, named for the nineteenth-century Italian connoisseur Giovanni Morelli who developed a system of identifying an artist’s “hand” by means of the close examination of a few key details that the artist executes consistently, was a pattern recognition tool that sought to classify and evaluate the formal qualities of images (Zweig 2015).

Unfortunately, these and similar initiatives did not fulfill their potential. Issues of funding, sustainability, archiving and access, copyright, and technological barriers ensured that what few gains were made were quickly undermined. In short, art historians faced challenges sourcing the software, maintaining and supporting collaborations and staff, and building and maintaining the datasets necessary for sustained intellectual engagement with DAH. As these early projects foundered, the field of literary studies advanced in the digital humanities — and with good reason. When the dataset is a text that can be scanned, when the “catalog” — in this case, the set of words included in that text — is readable across all platforms, it is easier to explore research questions using widely available digital tools, such as topic modeling and word embeddings. Unfortunately, these tools are not as useful for art historians, unless they want to analyze the oeuvre of an art historian, critic, or the writings of an important art-historical figure. Such an approach could be useful, but what about working with images? Isn’t that what art history is about?

This is one of the reasons why there remains anxiety among art historians that they have fallen behind their academic peers: art history is different. What defines art history is the study of the visual. Thus, the tools used and methodologies developed for DAH should support visual analysis and learning. Unfortunately, in the rush toward working digitally, many art historians and museum professionals have enthusiastically borrowed theoretical models and technical terms from disciplines and sub-disciplines such as literary theory, computer science, and cultural analytics without careful consideration as to how these methods and terms function within the specificities of the field of art history. Equally troubling is how many art historians have adopted a software developed for other disciplines and industries without due appreciation of how it structures data and thus might privilege certain information and promote certain trends (see Jaskot and Van der Graff 2017). In short, art historians require different tools — such as image-recognition software — tools that allow them to search, organize, catalog, and investigate images effectively, and few tools that fulfill these needs are available. Fortunately, with recent advances in the fields of computer vision and Artificial Intelligence, this will change. The future is looking bright.

But what about the present? Despite the challenges outlined above, we would argue that it is still possible for art historians to benefit from embracing existing current digital tools and computational techniques. As the essays in this special issue attest, there is a place in the discipline right now for the digital.

The issue begins with Alison Langmead’s analysis of art history’s longstanding engagement with image-based reproductions and how these “significant remediations” have affected the development of the discipline. Far from being marginalized by the digital turn, she argues for art history’s central role in the digital humanities as a model for the “mindful” adoption of technology. The discipline, she concludes, “can offer objective lessons on the risks of taking both the technical and social affordances of [digital] tools for granted” and thus, may promote awareness of how technologies impact the research process.

The remaining essays are divided into two groups that analyze DAH at work in the art gallery and the university. C. Richard Johnson, Jr. and William A. Sethares’s “Hunting for Weave Matches: Computation in Art Scholarship” outlines the pioneering application of signal processing to a traditional technique of painting analysis — thread counting. Determining the weave density of the canvas support of a painting offers conservators crucial technical information as well as useful clues regarding the painting’s origin and approximate date of execution. Manual techniques for thread counting, however, are time-consuming and laborious. Johnson, a professor of engineering at Cornell University, realized that this process could be automated by means of algorithmic analysis of x-rays of paintings. Using this method, the canvas supports of different paintings may be matched. These matches suggest that the paintings may have originated from the same bolt of cloth, a discovery that in turn suggests the paintings were in the same place at one point in their history. In their article, the authors outline the procedure for comparing possible weave matches in full, stage by stage, providing increased understanding of this ground-breaking technique and offering a model for future collaborations between art historians and scientists.

Animated Shadows on Virtual Stone: Ancient Sundials in a Gallery Setting” by Sebastian Heath, Rachel Herschman, and Christine Roughan describes the use of animated displays at a 2016–2017 exhibition held at New York University’s Institute for the Study of the Ancient World (ISAW). The exhibition introduced audiences to more than one hundred time-tracking devices from Greco-Roman antiquity. To illustrate how ancient audiences experienced these devices, the organizers formed collaborations across multiple departments, including the work of graduate students, to develop a series of 3D animations using the open-source animated suite Blender. The resulting digital surrogates were cost-effective and highly informative, not only helping the public to understand how the objects on display functioned but also showing examples that could not be included in the exhibition due to size or location. Happily, these “exhibits” will enjoy an afterlife on the journal’s site.

Appropriately, many of the articles in this issue examine the use of digital tools and new methodologies in the classroom. Elizabeth Honig provides an honest and enlightening analysis of two courses she designed that disrupt the art history lecture, the cornerstone of art-historical instruction. As she notes, transitioning from the lecture format, reliant on the projection of images in a darkened room as well as the instructor’s expertise, to an interactive model that requires students to engage with data collection, digital technologies, and each other is not a simple process. Professors of art history will have to gain new skills in computer science and statistics; what will be more difficult is learning to embrace the serendipitous encounters, unplanned epiphanies, and failures of project-based learning. The professor “cannot control either process or outcomes” as in a lecture course, Honig observes. Reworking the traditional art history class, however, will ultimately enable students to develop new skills in critical analysis and knowledge production.

3D Modeling in the Urban Classroom: Using Photogrammetry for the Study of Historic Architecture in Coral Gables, Florida” presents an additional, highly innovative approach to rehabilitating the traditional art history course. Instead of focusing on the formal qualities and construction history of the architectural monuments in lectures and emphasizing art-historical research and writing in assignments, Karen Mathews, Assistant Professor of Art and Art History at the University of Miami, and her team seize the opportunity to teach students about data collection and curation, collaboration, online exhibitions, digital tools and storytelling, and public art history as well. The materials, textual and visual, that are produced during the semester are published on an interactive website, a project that not only increases the students’ but also the public’s engagement, creating “bridges between the university and the community around it [and] promoting awareness of cultural heritage sites and their preservation.” The authors’ thorough explanation of their process generously allows other educators to investigate this innovative pedagogical paradigm.

Two articles in this special issue focus on Pre-Columbian topics; this may not be coincidental but instead indicative of how specialists of non-Western cultures have often been critical of conventional research methods and pedagogical strategies and are more willing to explore novel approaches in their scholarship and instruction. Ellen Hoobler’s article, produced in collaboration with three of her students, presents an additional example of how 3D modeling can offer increased understanding of the material past. Hoobler’s original plan was to expand on her dissertation research examining the tombs of Monte Albán in Oaxaca, Mexico, built by the Zapotec peoples in ca. 500 BCE–850 CE, by producing an interactive model of one of these tombs, including all of its contents. During the course of two summers, her team created dozens of 3D models, visualizations, and videos as well as a website documenting their work. While the completion of her original vision proved a much more difficult process than anticipated, the experience of Hoobler and her students yields instructive insight into issues of collaboration, sustainability, funding, and community engagement. Hoobler notes that perhaps the most important lessons her students gained from this DAH project were the “byproducts” of their contributions: increased skills in visual analysis and archival research as well as a deeper comprehension of the process of contextualization.

Outlining the incorporation of DAH methods and tools into a Pre-Columbian art history survey course, Lauren G. Kilroy-Ewbank’s essay expands on several of the themes developed throughout this special issue, including the instructive byproducts of the student-centered DAH project. The centerpiece of her course is the creation of a collaborative online exhibition using Omeka, a popular open-source content management system for the production of online exhibitions, focused on the Mixtec Codex Zouche-Nuttall (ca. 1450). The assignment requires students to source and annotate images, create metadata, and assess online resources as well as undertake traditional art-historical research; it also encourages students to consider issues of digital visual culture, digital storytelling, and the possibilities of public art history. Like Honig and Hoobler, Kilroy-Ewbank finds that student engagement with DAH is not always a straightforward process. Yet, she argues, students receive valuable lessons regarding responsibility, both to their team and the discipline, from the experience. Helpfully, Kilroy-Ewbank includes her course syllabus as an appendix, making it easy for similar-minded pedagogues to integrate these types of assignment in their own classrooms successfully.

The issue concludes with two non-peer-reviewed pieces that record experiences of working within the field of DAH. John B. Henry documents his evolving research on David Wojnarowicz and how information resources created by the Artist Archives Project that guide researchers through the collections held by New York University’s Fales Library and Special Collections affected his understanding of the artist. Henry argues that this tool not only facilitates research but also offers the opportunity for additional knowledge creation through the incorporation of online comments and the institution of an online community. More than a digitized collection, it is in effect an “ambitious project in digital art history” that offers new models for academic study.

Finally, Naraelle Hohensee presents her 360-degree video of Seattle’s Olmsted Brothers-designed Volunteer Park (1904–1910), an educational resource that offers an immersive environmental experience as well as presentations of historical documentation. Her literal exploration of this public space fuses design history with urban studies and offers an embodied understanding of the site, thus — like many of the DAH projects introduced in this issue — providing increased comprehension of how people interact with the built environment. The result is both an informative and entertaining mediation on the designers’ accomplishment and a subtle analysis of the evolving role of the historian in the digital age that raises questions regarding the use of digital storytelling in the academy and across cultural institutions.

Technology that allows art historians to work with images rapidly and effectively will be available in the near future, and art historians must take an active role in determining how this technology is developed. After all, who better than art historians to direct these advancements? Or, as Kilroy-Ewbank observes: “Art historians (and our students) are […] positioned to think critically about digital visuality and analyze how digital visual environments encode ideas.” Art historians should remain alert to these new developments in computer vision, stay informed, and, when possible, collaborate with technologists, computer scientists, and other digital humanists to ensure that these professionals and their projects benefit from their expertise. In this way art historians will once again become significant contributors to the digital humanities.

Bibliography

Greenhalgh, Michael. 2004. “Art History.” In A Companion to Digital Humanities, edited by Susan Schreibman, Ray Siemens, and John Unsworth, 31–45. Oxford: Blackwell Publishing Ltd. DOI: 10.1002/9780470999875.ch3.

Jaskot, Paul B., and Ivo van der Graaff. 2017. “Historical Journals as Digital Sources: Mapping Architecture in Germany, 1914–24.” Journal of the Society of Architectural Historians 76, no. 4 (December): 483-505. DOI: 10.1525/jsah.2017.76.4.483.

Zorich, Diane. 2012. Transitioning to a Digital World: Art History, Its Research Centers, and Digital Scholarship. New York: Samuel H. Kress Foundation. http://www.kressfoundation.org/research/transitioning_to_a_digital_world/.

Zweig, Benjamin. 2015. “Forgotten Genealogies: Brief Reflections of the History of Digital Art History.” International Journal for Digital Art History 1. DOI: 10.11588/dah.2015.1.21633.

About the Authors

Kimon Keramidas is Associate Director and Clinical Assistant Professor in NYU’s Center for Experimental Humanities and Adjunct Assistant Professor for the CUNY Graduate Center Doctoral Certificate in Interactive Technology and Pedagogy. Kimon is one of the founding member’s of The Journal of Interactive Technology and Pedagogy, as well as being a founding member of NYCDH.org, co-director of OutHistory.org and co-investigator of History Moves. Kimon has worked extensively on digital exhibitions, and is currently co-curating an exhibition for the Freer|Sackler Asian Art Galleries of the Smithsonian Institute on the Sogdians, a middle ages mercantile culture from Central Asia. His most recent project is The Interface Experience, a multi-platform exhibition which included a physical exhibition, web application, and award-winning catalog for the Bard Graduate Center. Kimon’s web site @kimonizer

Ellen Prokop is the Associate Head of Research and a member of the Digital Art History Lab at the Frick Art Reference Library, New York, and Adjunct Professor of Art History at Hunter College, City University of New York. She was the lead author and editor of Art History in Digital Dimensions: A Report on the Proceedings of the Symposium (2017), and has published several articles and essays on Spanish art of the sixteenth and seventeenth centuries, including most recently a chapter in El Greco Comes to America: The Discovery of a Modern Old Master(2017). Please contact her at prokop@frick.org

4

Table of Contents: Issue Twelve

Introduction
Kimon Keramidas and Ellen Prokop

Art and Architectural History and the Performative, Mindful Practice of the Digital Humanities
Alison Langmead

Hunting for Weave Matches: Computation in Art Scholarship
C. Richard Johnson, Jr. and William A. Sethares

Animated Shadows on Virtual Stone: Ancient Sundials in a Gallery Setting
Sebastian Heath, Rachel Herschman, and Christine Roughan

Teaching Renaissance Workshop Practice as Network Analysis
Elizabeth Alice Honig

3-D Modeling in the Urban Classroom: Using Photogrammetry for the Study of Historic Architecture in Coral Gables, Florida
Karen Rose Mathews, Amin Sarafraz, and Chris Mader

Of Software and Sepulchers: Modeling Ancient Tombs from Oaxaca, Mexico
Ellen Hoobler with Arturo Hernández Jr., Ve’Amber Miller, and Catherine Quinn

Doing Digital Art History in a Pre-Columbian Art Survey Class: Creating an Omeka Exhibition Around the Mixtec Codex Zouche-Nuttall
Lauren G. Kilroy-Ewbank

Views from the Field

Digital Developments in 2010s for an Art History Student and David Wojnarowicz
John B. Henry

Wandering Volunteer Park
Naraelle Hohensee

Issue Twelve Masthead

Issue Editors
Kimon Keramidas
Ellen Prokop

Managing Editor
Alessandro Zammataro

Copyeditors
Anne Donlon
Anke Geertsma
Jojo Karlin
Michelle A. McSweeney
Benjamin Miller

Staging Editors
Lisa Brundage
Anne Donlon
Laura Kane
Benjamin Miller
Teresa Ober
Danica Savonick
Luke Waltzer

2

Art and Architectural History and the Performative, Mindful Practice of the Digital Humanities

Abstract

Art and architectural historians have long relied on image-based reproductions of their primary source material to produce scholarship. However, film-based photography and digitization, the reproduction techniques most often used for these purposes, do more than simply convey an object from one mode to another. They create significant remediations, composed of a variety of processes and materials. Photography and digitization are also different technologies from one another, and their use has been implemented fitfully and heterogeneously over time within the field. Thus, generations of art and architectural historians have not only become familiar with the process of embedding technologies into the humanities but also gained field-wide experience with the impact such technologies’ presence and obsolescence can have on research processes. This article argues that art and architectural history can serve in some ways as a model for the adoption of new technologies into the humanities, but it can also offer objective lessons on the risks of taking both the technical and social affordances of these tools for granted. Technologies can create rupture, but they can also participate in, and even engender, a mindful continuity with thoughtful and effective past practices. The lessons of art and architectural history can show that engaging with technologies in the humanities is best done mindfully, with a commitment to bringing their full socio-technical environments into view—periodically and over time.

Since the early days of the field in the late nineteenth century, art and architectural historians have relied on image-based reproductions of primary source material to do our work, a practice that has given the discipline significant experience with using technologies to do the work of the humanities. Photography and digitization—the two main image-reproduction technologies of the twentieth and twenty-first centuries—do not duplicate their subjects uncritically, however. They do not simply convey an object from one mode to another; they are transformative technologies. The reference images they produce are, and have always been, significant remediations of our objects of study, composed of a variety of processes and materials that we allow to stand in for what is not present. They have actively shaped our disciplines in sometimes overt, sometimes covert, ways.

That said, photography and digitization are also different technologies from one another, and their use has been implemented fitfully and heterogeneously over time within the field. Art and architectural historians have thus not only become familiar with the process of embedding technologies into the humanities, we have also gathered hard-won, field-wide experience with the impact that their presence and obsolescence over time can have on our research processes. The story is not always one of success. Our discipline has occasionally permitted the technical and social affordances of these shifting technologies to become invisible to us. We have often chosen to elide, ignore, or take for granted the ways that the socio-technical environments of these remediations have transformed the daily operations and rituals of our discipline.

Because of this time-tested relationship, I wish to argue that art and architectural history offers the Digital Humanities approximately 115 years of experience with being attuned (or not attuned) to the impact of relying on technologically mediated representations of the phenomenal world to perform humanities research. This type of scholarship, that is, one not directly reliant on primary sources but instead on remediations of those sources, is the fundamental, originary condition of the Digital Humanities. Art and architectural history can serve in some ways as a model for the mindful adoption of technologies into the humanities, but it can also offer objective lessons on the risks of taking both the technical and social affordances of these tools for granted.

Herman Grimm and His Skioptikon

Throughout history, works of art and architecture have been reproduced and distributed via paper-based media, whether by drawings or printing technologies. However, the rise of modern art-historical study, which took place over the course of the late nineteenth century in Germany, was concomitant with the rise of a set of photographic technologies that would transform the discipline profoundly. Around 1890, the art historian Herman Grimm normalized the use of the lantern slide projector—the Skioptikon—in the classrooms of the University of Berlin (Figures 1 and 2).

 

In his 1892 work, “Transforming University Lectures on Modern Art History Through the Use of Skioptikons,” Grimm noted that what attracted him most to this technology was that the slides allowed him to move away from a focus on the contextual, literary, and historical texts about the art, and move towards a study of what was actually visible in the art.[1] Before this period, to bring the visual object into the classroom, lecturers might have passed around printed reproductions or they might have employed verbal descriptive techniques such as ekphrasis—a highly personalized narrative used to evoke the experience of looking at a work of art or architecture. Instructors may have also suggested that students remember their last encounter with the object, or recommend they go and see it on their own in their travels. These images allowed Grimm to lecture much more effectively in class about the visual forms of the work itself by means of large, black-and-white projections that the entire class could see communally.[2] Absent objects could be made shimmeringly present by patterns of shadow and light on the wall.

Wölfflin: Thisness-and-Thatness

Just a few years later, the research and presentation practices of the art historian Heinrich Wölfflin would not only transform the way the discipline operationalized these representations, they would also fundamentally change the way the field approaches its very subject material. Wölfflin is credited with standardizing the use of, not just one, but two, lantern slide projectors in the classroom, lecturing consistently in front of simultaneous pairs of images at the University of Berlin between 1901 and 1912 (Figures 3 and 4). This technological tweak was small, but its effect was mighty. Shifting the field from a focus on single objects to a comparative mode of analysis was truly transformative, as it asked historians to move away from a consideration of synchronicity to diachronicity. His approach was quite rapidly taken up field-wide. Objects, once dutifully considered in isolation, were now expected to be brought into conversation with one another across time and space.

 

Nevertheless, this transformation was not solely technical. According to accounts of his lecture style, Wölfflin’s classroom was also a type of full-body infotainment experience—a bit like the phantasmagoric Magic Lantern shows, popular since the eighteenth century, that used similar technologies. He would turn off the lights, fire up the projectors, and instead of lecturing from the front of the room, he would sit out in the crowd of his students, sharing with them the view on the pairs of images as they came up, set after set, image after image in succession. It is said that when each new pairing would come on the screen, he would pause dramatically, as if to give the objects a chance to shine on their own before submitting them to his piercing comparative analyses.[3]

This use of paired reproductions and vivid, spoken rhetoric was not simply an expression of early twentieth-century Germanic ed-tech melodrama. With this approach, Wölfflin profoundly influenced both the style of argumentation and scholarly expression in the field of art and architectural history to this day. His art history was one based not only on comparison, but also on the communal experience of looking and listening, and the socio-technical affordances of image reproduction that brought these practices together were at its heart.

Indeed, Robert Nelson and Dan Karlholm have argued that Wölfflin and Grimm were both radically experimenting with a style of academic argumentation that proceeded first from the image and the voice, rather than the more traditional written text.[4] This approach was designed to display rhetorical and oratorical skill, a tactic that takes full advantage of the medium of speech and the performativity of the slide lecture.[5] It allowed art historians to call on any number of rhetorical techniques that work primarily in the performative vein, such as deixis, or the ability to call on one’s physical human relationship to an object while explicating a point, as in, “over here we see Les Demoiselles d’Avignon…” Art and architectural historians, then as now, could also deploy the use of “anchor slides” in their lectures—images to which one might return frequently, each time making a more nuanced and fully formed argument. This technique easily allows for circular, spiraling, or recursive arguments. Even retractable arguments are more permissible as oral rhetoric. The slide lecture, a foundational methodology to the field of art and architectural history, was and is a multi-modal, embodied experience. Unlike the process of reading, the audience can both listen and see at the same time, rather than needing to shift its gaze from text to image and back again. They also experience the argument synchronously and communally. These techniques are difficult to reproduce in writing, yet they remain at the core of our training and profoundly influence the way we interpret our primary sources.

This Technology Changed Us

The technology of image reproduction at the heart of this disciplinary shift, the glass lantern slide, was soon made obsolete. 35mm Kodachrome slide production began in 1936, and this photographic technique fully solidified the ubiquity of the paired, projected image in the art-historical classroom. Kodachrome was, of course, a color process, offering obvious chromatic improvements over the older black-and-white lantern slides. 35mm slides were also smaller and far easier to make and store than the older technology (Figures 5 and 6).

 

While their technical affordances were considered improvements over the older technologies, their arrival did not cause a reconsideration of the role of the reproduced image in discipline. The field swallowed them into its practice and kept them pinned to the early twentieth-century use case offered by Wölfflin and Grimm. The technological armature of these slides remained hidden from the audience, and possibly from the field itself, as part of the performative rhetoric of the art-historical classroom.

However, this technology did transform the discipline in its own way. The most demonstrable impact made by 35mm slide technology was perhaps to be found outside the classroom. The millions and possibly billions of 35mm slides produced for the discipline of art and architectural history over the course of the twentieth century created, quite literally, a weighty mark on the field. Such vast quantities of these slides were produced globally for each department of art and/or architectural history that they created a physically massive, disciplinary-specific, information infrastructure not shared by many other fields of the humanities—that is, the slide room (Figure 7).[6]

 

While easier to make than glass lantern slides, 35mm slides still remained a bit of a hassle to produce, and their creation, organization, and storage was a capital-intensive endeavor that encouraged the creation of common repositories. Whether called the slide library, the visual resources collection, or the slide room, this socio-cultural environment often became the “town square” for departments of art and architectural history.[7] It was an information commons, a resource shared by a community of inquirers, and a physical location that drew members of the department together in one place for a shared purpose. Scholars certainly had their own personal collections, but the slide room was a central location where people not only went to access image resources but also to meet and discuss their scholarship and the more mundane things of life. Some, if not most, departments also had communal slide sorters in these spaces, allowing patrons to walk by and see the growing image-focused networks of argumentation being made by their colleagues and teachers. A smattering of slides across one of these sorters could have a multitude of possible meanings (Figure 8).[8]

Yet, the changes wrought by the influx of 35mm slides were not all social, they impacted habits of scholarship as well. This information commons operated within a form of information scarcity. Because 35mm slides were not quite a dime-a-dozen, they could also become “quasi-unique” to scholars.[9] These types of views showed just what one needed to make a point, and were prized. It is worth reflecting back on the day when it was normal to walk into the slide room, hoping that one, single, small, colored piece of plastic was there to allow us to make a point in a lecture. Because, if not, the hassle of making a slide was significant, requiring finding a book or a vendor, getting to a copy stand, having a camera loaded with slide film (and possibly taking only a few slides off that roll), having it developed through a process that took time, money, and often great effort, etc. Even if not directly responsible for producing slides, there was always a significant time delay between needing and image and finding it in hand.

If the desired slide was not in the slide room, a scholar could also simply choose not to make that point, or to make a totally different point. In this way, the availability of the technical infrastructure could—and often still does—change the shape of art-historical scholarship.[10] But often, the slide was blissfully there, because these collections were carefully perfected for particular departments and faculties by a cadre of trained information professionals (“slide librarians” or “visual resources curators”) during the course of nearly a century. Nowadays, these collections, each containing tens of thousands of 35mm slides, often look more like piles of junk than the massively capital-intensive information commons they once were (Figures 9 and 10).

 

We Study What We Can See, But We Can Also Elide What We Wish

We do not usually think of our research and teaching images as these rampaging, obnoxious piles of disorder, although it is easily possible to imagine that this is exactly how they are currently organized on the Internet. Instead, when projected, these images were used as evidence for our arguments, as surrogates for an original, or, rhetorically, even as the object itself. It is rare to find a lecturer in art history who has not elided the gap between the image on the screen and the object under consideration. We say things like:

Here on the screen is the Demoiselles d’Avignon, painted by Pablo Picasso in 1907, although it was not displayed publically until 1916. It is a work in oil on canvas, and measures 243.9 x 233.7 centimeters. That is around 8-foot-square in old money. (Figure 5)

No such thing is actually on the screen. The projection is not that size; it was not made on that date. Such is the permitted use of the oral rhetoric that is so fundamental to our field. It is a seemingly innocent illusion/elision between the represented and its representation, but it is an elision none the less. Hiding the imaging technologies as we do, both verbally and physically, allows the discipline to fulfill the Wölfflinian ideal of presenting an argument that seamlessly combines a spoken explication alongside a display of relevant image evidence, audible and visible to all.[11]

Given that the particular technological affordances of glass lantern slides, and the 35mm slides that followed them, were at the very heart of the normalization of this method of art-historical inquiry, it seems somehow unsatisfying to consider this elision entirely innocent. This discipline, the one that studies representation theory itself, has had numerous opportunities to be more mindful of this approach. Artists have certainly done so. Mark Tansey’s enormous oil painting, the Innocent Eye Test from 1981, pokes a little fun at such behavior (Figure 11).[12]

The painting, The Innocent Eye Test, by Mark Tansey which shows a cow being shown a painting of other cows by a group of men

Figure 11. Mark Tansey, Mark (b. 1949). “The Innocent Eye Test,” 1981. Oil on canvas. 78 x 120 in. (198.1 x 304.8 cm). Collection of the Metropolitan Museum of Art. Gift of Jan Cowles and Charles Cowles, in honor of William S. Lieberman, 1988 (1988.183). ©Mark Tansey

Here we see a cow being shown a painting of other cows by a group of men in suits. The men peer at the cow, seemingly wondering what her (necessarily non-verbal) response will be to what she sees, an act that begs the question of whether the scene depicts an “innocent” having a vision test or instead an experiment about a scientifically “innocent eye.” The man on the extreme right dressed in a white lab coat, takes notes on a clipboard, while the man with a mop on the extreme left stands as testimony to the embodied reality of having a cow in a gallery space. In a way, art and architectural history has been performing a variation of this silly experiment on our audiences for more than a century.

Yet even beyond the human tendency to use this rhetorical sleight-of-hand to elide the relationship between the represented and its representation, the technologies used to remediate the objects of our study have themselves had a fundamental impact on what we have chosen to study at all. It is not only the case that we choose to study those objects for which we can find a representation—whether in a slide room or on the Internet. It is also a well-known, field-wide trope that art and architectural history has traditionally focused on those aspects of visual culture best represented by the most advanced image reproduction technologies available at the time.[13] The early black-and-white lantern slides, for example, allowed scholars, including Wölfflin himself, to focus on line, shading, composition, planarity/surface, even content/iconography over materiality, all without the “distraction” of color information (Figure 12).

 

The addition of color to the slides did not magically erase the ways that the technological affordances of our reproductions shape our scholarship (Figure 13). It has never been the quality of the representation that asks us to compromise on our interactions with the object, it is the very act of reproduction itself. The introduction of color to these images may have allowed for the study of more image features, but the colors studied remain steadfastly those of the reproduction. Maintaining a color match between a representation and its referent was, as it continues to be, difficult at best. Representation is a form of interpretation and remediation, from the framing chosen, to the color balance used, to the precise technology selected. It is not a neutral act; it is materially transformative.[14]

Digital Images Are Numbers

Over 100 years after projected image technologies transformed the field of art and architectural history, the use of film-based slides came to an end. In 2004, Eastman Kodak stopped making 35mm slide projectors. In 2012, Eastman Kodak stopped making 35mm slide film, an act that ceded the playing field definitively to digital imaging. But just as at the moment of transition between lantern slides and 35mm slides, art and architectural historians, as a group, did not hasten to probe the affordances of this new technology for possible transformative impacts on our methods and approaches.[15] Instead, the decline of film-based image reproduction technologies was simply matched by a rise in the use of digital images within software presentation packages such as Microsoft PowerPoint.[16] That is, the discipline chose to adopt digital images as “digital slides,” surrogates of the surrogates we had already been using.

This strong focus on only those affordances of digital images that simulated the historical use of film-based images skimmed over fact that this newer form of reproduction was, and is, produced by an extremely different set of technologies. Digital images and film-based images are not made up of same materials, and they do not function internally in anything like the same manner. Digital images are not colored pieces of plastic or glass. They are, like every other thing that can be represented within a digital computer, made up solely of numbers (Figures 14 and 15).

 

The matrices used by the computer to produce images on the screen can easily be made visible, but to do so does require an act of intention.[17] In Figure 15a, we see a detail, in the red channel only, of the right corner of the mouth as represented by the digital image that is Figure 15. Looking closely, one can see that very shape of this detail is just visible to the human eye by tracing the triangular pattern of the larger numbers, indicating a greater amount of red, against the ground of smaller numbers, indicating a lesser amount of red (Figure 15a).

 

But the mouth, whose pattern is thus barely visible in this set of numbers, is not truly there at all, not even as a smear of red chemicals on a piece of plastic. Computers must enact these numbers—perform them—in order to provide us with a rendering that looks like an image. While it is possible to use these matrices of numbers in a manner that is functionally equivalent to film-based slides, it remains true that digital images are built on an entirely different model of representation, one in which treating color as numbers is a fundamental, inescapable reality.[18]

The Social Effects of the Digital Turn

The demise of film-based imaging and the concomitant rise of digital imaging also caused a radical shift in the social environment surrounding the use of image reproductions in the field of art and architectural history. In the twenty-first century, the ways in which we collect, search for, retrieve, and disseminate our images are utterly different than they were throughout the twentieth. For one thing, the act of creating and distributing a reproduction of an image in a book now has a fundamentally different relationship to copyright law than it did in the days of the physical slide library.[19] However, one of the most prominent social ramifications of the digital imaging revolution within the field may in fact have been the demise of the slide library itself, along with the “town hall” space that it afforded. The integration of digital images into our disciplinary workflow dissolved the need for this communal room, and sent art and architectural historians back to their individual desks, pinning them in relative isolation to their screens and keyboards.

As scholars in this particular historical moment, we are essentially each responsible for finding and organizing our own image resources in our own personal digital world. Whether using Google, ArtSTOR, or some other digital service, art and architectural historians nowadays tend to create collections by hunting down images using textual search terms rather than by proceeding to a specific physical drawer carefully arranged within a much larger assemblage of cabinets, all professionally organized hierarchically by period, location, creator, and then object. Like direct searches, browsing for images is also now much more likely to happen on the basis of the results offered by a textual search algorithm than the tactile perusing of a carefully-curated, highly-intentional sequence of 35mm slides. This said, within art and architectural history itself, the impact of this move from a centrally catalogued set of canonical images has not always been a detrimental one. Our monolithic, Western-centric tradition of cataloging told a very particular story about what was and was not valued in our disciplines, and the massive physicality of these collections did not easily allow for the types of reconfigurations of interconnections that are now possible in the digital environment.

From every angle, this shift from a physical system of search and browse to an algorithmic one has profoundly changed the way our discipline interacts with, and attends to, the image reproductions we rely on. We look for pictures with words, wade through search results of varying responsiveness, and we tend to do so in isolation. Indeed, the transformative impact of this search-based shift in scholarly attention has also been noted by other fields in the humanities, such as the discipline of history, as they too begin to rely more heavily on digitizations of their primary source material.[20]

More Than Doubling Down on the Index

Art and architectural history has more than once shown itself to be relatively uninterested in re-thinking the use of changing technologies in our field, and even perhaps slightly resistant to considering the socio-technical armature of our profession as an active agent that shapes our teaching and research.[21] We have absorbed, taken for granted, and in many ways “un-seen,” the full disciplinary scaffold that we have built on top of the original introduction of film-based, photographic slides in the classroom—from the performative nature of its basic mode of argumentation to the socio-technical impacts of the massive, professional image information management systems that constituted the slide libraries.[22] The field has also chosen not to dwell, up to a point, on the ways that digital imaging has transformed technologically and socially the very act of image representation yet again.

Each time we have adopted a new type of image reproduction technology, we have tended to focus on retaining the results of the last transformation rather than initiating a deep understanding of the current impetus for change and its potential impact on our field. For example, the penchant for veering into showmanship that accompanied Wölfflin’s approach to lecturing has been more strongly retained by the discipline than the memory of why communally visible images in the classroom were so revolutionary in the first place. The discipline has, along these lines, shown quite a bit of fascination with the creation of digital virtual environments, some of which run on platforms like the Unity gaming engine. This love of producing engaging, absorbing images is certainly part of a long-standing tradition in the discipline, but cleaving to this habit has had a field-wide impact not only on the types of research we do but also on the ways we are perceived outside our discipline. Our field began by adopting the infotainment technology of the Magic Lantern show, and we can use digital gaming platforms in similar ways now if we like.[23] But we should do so mindfully, and with full understanding of what these approaches offer us in the twenty-first century.

Similarly, we have had a long-standing disciplinary habit, noted above, of rhetorically eliding the distance between representations and what they represent, and digital images can certainly be used to this end. But no matter how indexical, suitable, or numerous the representations of an object are, what is on the screen will always resolutely remain a representation that stands in for something else. Using the ease and flexibility of digital imaging to multiply the number of images present, or to make these representations seem more immersive, or any other approach that simply doubles down on the indexicality of these images, will never change this state of affairs.[24] Multiplying representations can even have the effect of drawing increased attention to the very absence the scholar is trying to cover up as the diminishing returns on adding yet one more image, one more angle, one more point-of-view become ever more conspicuous.[25]

Digital images have more to offer the field than their often jaw-dropping visual appearance. In the digital studies community, studying only the screen-facing aspects of a digital object risks a pitfall known as “screen essentialism.”[26] That is, it is not enough to assume that what is most important about a digital object is what it looks like when displayed, because digital objects always include an armature of numerically-encoded information and behaviors that enact what becomes visible. Other affordances of digital imaging and its socio-technical infrastructure can provide ways to interrogate the role of remediation in the study of material culture and the built environment. By extension, this work may have much to offer to the study of any digitized object, transformed into numbers as they all are by the encoding process.

The discipline of art and architectural history has only just begun to confront the possibilities inherent to this new model of representing an object as a matrix of numbers—that is, we are just now considering the possibility that computing over these representations could be part of our acceptable disciplinary methodologies. Scholars such as Lev Manovich are approaching digitized and born-digital images in this manner, producing provocative results.[27] The computing and information sciences have also shown great interest in using representations of our primary source material in their own investigations of computer vision and image analysis, implementing a mixture of their methodologies and what they have gleaned of ours through the literature.[28] Further direct collaborations between these fields may result in new knowledges that benefit us all.

It is critical to our field, however, that we not take up these encoding-focused approaches without first considering our contemporary reasons for doing so, as well as the ways that they are best situated within our long-standing technological historiography. We introduced the use of image reproductions in order to facilitate an understanding of our primary sources, not to supplant them or take their place. And yet, the digital approaches that focus on computing over these matrices of numbers can only delve ever more deeply into the innards of the surrogates themselves. To commit to this line of inquiry, the field of art and architectural history will need to accept fully that the results of this computational process, one that can only work on the representation, may be used to interpret the original object it represents successfully. This is not just an innocent elision between the object and its remediation, this is a potential collapse. Working directly with the matrices of our digital images strives, perhaps, to uncover information within these encodings that the human eye cannot otherwise perceive in the “real” world, whether because of a change of scale, from microscopic to immense, or technique, whether experimental or mathematical. This method seeks information about the experiential world in a place entirely divorced from it—a central characteristic of the digital turn itself.[29] Great things may come from this approach, but only if it is done mindfully and with full knowledge of the costs and benefits.

Taking Different Cues from a History of Working with Technology in the Humanities

While diving ever deeper into the foundationally representational nature of the digital image is one path forward for a digitally-engaged history of art and architecture, it is also conceivable that there could be explorations that do not partake of a narrative of technological rupture, but instead one of mindful, engaged continuity with both the technical and socially-based disciplinary traditions that still work for us. Perhaps in a manner akin to Wölfflin’s shift from projecting one sole image to a pair, thinking deeply about the affordances of our changing technologies can provide a sense of intellectual parallax, enabling art and architectural historians to separate the useful interpretive techniques that are important to retain from the framing of the technical affordances that originally facilitated them.

One such behavior, ripe with possibility in the digital era, is the traditional art-historical mode of argumentation rooted in oral, rather than written, rhetoric. More than just an act of showmanship, Wölfflin taught an experience. In his classrooms, he created an environment of shared potential. In his argumentation, his reasoning did not always unfold linearly, instead it moved back and forth, in zig-zags, towards his conclusions. Even if many of his interpretations are no longer considered convincing, his remarkable style of presentation made a fundamentally lasting mark on the field. Art-historical knowledge produced in this way has always been best taught, shared, and understood as an engaged performance rather than as the recitation of a linear, written text.

This type of performative knowledge can find an easy home in, and a deep connection to, the world of digital interactivity, especially in the era of the Internet. Numerous scholars, especially in the field of digital preservation, are exploring the importance of conceiving of the networked, digital environment not as a static object that can be directly preserved, but instead as a lived performance that is constantly unfolding and changing over time.[30] Users issue commands that are interpreted by the machines at a given time and in a given context, and while the computer will always perform the same operations when asked, the results it produces will always be both contingent and dependent on the data available at that time.[31] The interaction between the user and the computer can thus produce new performative knowledge together.

Art and architectural historians can take advantage of this happy congruence, not only by drawing our deep understanding of this type of embodied, interactive knowledge production but also by allowing the technological affordances of this new digital environment to push us to think more deeply about this interpretive act. The Visual Media Workshop at the University of Pittsburgh (VMW) has been investigating such a set of digitally focused, performative, art-historical methodologies using large-scale, lab-based projects like Itinera (http://itinera.pitt.edu and Figures 16a-b).

 

Itinera is a digital project that focuses on collecting, arranging, and visualizing data about culturally-motivated travel in the eighteenth and nineteenth centuries. At its heart, the project is a complex data model designed to represent what we know about past behaviors, actions, movements, and collections in a particular historical context. In practice, it is far more than this particular technology. Itinera serves as a continuous point of interaction between the data model, the visualizations that activate the data, and the students and faculty who work so carefully to input information gleaned from historical primary sources. It has been thrilling to participate in the ways that the site engenders new performative knowledge. Undergraduates come to learn the slipperiness of historical materials as they come to grips with the specific requirements of Itinera’s data model. Every year, the project gets a new graduate student for a project manager, and every year that project manager interacts with the system differently, asking new questions of the system, creating new data, and new ways of looking at that data.[32]

The project team has found that Itinera produces new knowledge, not because it is heading towards a conclusion, but because it will always be in a state of creation and enactment. To be sure, it can also be used for more directive purposes. Itinera can help train students on the specific techniques and approaches of the Digital Humanities, from the principles of information visualization to the hows and whys of normalizing historical data. Yet it is also a continual performance between computers, programmers, users, and inquirers. It asks the team to focus on the impact of our historical storytelling, and it points out the gaps in our knowledges as well as the presences. It is never finished, always lacking, but therefore open to the possibilities of the next interaction, the next performance.

But it is not only in the technical sphere that connections can be made and explored between the disciplinary traditions of art and architectural history and contemporary digital infrastructures. Such linkages can also occur in the social sphere.[33] Spaces such as the Visual Media Workshop can work to counter-balance the trend of isolated search-and-retrieval behaviors, drawing on the history of our discipline and re-instantiating some of the “town square” functions made possible by the former slide library. The Itinera team not only works together physically in the communal space that is the VMW—a space that, importantly, was the former location of the University of Pittsburgh’s slide library (Figures 7 and 17)—but it also works together virtually, in the space carved out by the project’s digital environment, complete with its interfaces, visualizations, and technological infrastructures.

A photograph of the interior of the Visual Media Workshop at the University of Pittsburgh, taken in October 2017, that shows a grouping of desks with computers, but that is not currently populated with people.

Figure 17. The Visual Media Workshop in October 2017. Photo: Author.

Moreover, Itinera is also not the only project housed in the VMW. Students and technologists work together in this space collaborating across a number of projects, taking lessons from one arena and applying it to another. Because of our physical and intellectual collocation, there is space for chance conversations and for serendipitous findings produced within the interactions of a community.[34] The project teams of the Visual Media Workshop consistently note that the importance of embodied contact with other scholars cannot be underestimated when working on a shared technological infrastructure. Working with digital tools, and staying mindful of our full socio-technical environments, helps us produce knowledge that is as much a social and performative act as an intellectual one.

Using Technologies to Study the Humanities

Art and architectural history has long-standing experience with transforming an academic discipline through technologically engaged practices, and it can offer its findings fruitfully to the Digital Humanities writ large. Our field has always been multimodal, experiential, and performative—even to the point of theatricality. Its members have used technologies actively and mindfully both to expand scholarly opportunities and to change the way we study our primary sources. Yet we have also enacted the less-advantageous practice of coming to take the socio-technical affordances of these technologies for granted. We know what it is like to absorb these tools into a discipline so completely that the formative effects they once offered become seemingly invisible and replaced only by their results. When this happens, the technologies at the heart of fantastic innovation can also become the handmaidens of a field-wide, scholarly inertia.

The technologically engaged traditions of the field of art and architectural history demonstrate that the power of these tools does not, and should not, end with their initial novelty and impact. Engaging with technologies in the humanities is best done mindfully, with a commitment to bringing their full socio-technical environments into view—periodically and over time. These affordances need to be kept in sight not only so they do not ossify but also so that they can continue to prompt us to do our best work. Using technologies to help study the humanities need not always be about rupture and beginnings. Technologies can participate in, and even engender, a mindful continuity with thoughtful and effective past practices.

Appendix: Presenting “Art and Architectural History and the Performative, Mindful Practice of the Digital Humanities”

Editors’ Note (5/4/18): During February of 2018 the author of this piece, Alison Langmead, presented this paper at the Maryland Institute for Technology and the Humanities (MITH). As a journal that looks to enable multiple perspectives on the pieces we publish and due to the fact that questions of performativity and performative research that are present in the piece we welcomed the request of the author to include a video of that presentation/performance in the journal and within her article. You will find the video below.

Notes

[1] A fantastic description of Grimm and his approach to the use of projected images in the classroom can be found in Karlholm 2010.
[2] Although the underlying photographic technology was resolutely black-and-white, numerous glass lantern slides were also hand-colored to enhance their appearance and create a greater illusion of naturalism.
[3] Robert Nelson has presented a relatively lengthy translation of a description of Wölfflin’s presentation style that was offered in the 1920s by one of Wölfflin’s former students, Franz Landsberger: “Wölfflin, the master of extemporaneous speaking, places himself in the dark and together with his students at [his] side. His eyes like theirs are directed at the picture. He thus unites all concerned and becomes the ideal beholder, his words distilling the experiences common to everyone” (Nelson 2000, 419 citing Landsberger 1924, 93–94). Karlholm 2010 also explicates Landsberger’s discussion of the experience.
[4] Nelson’s thoughtful piece was produced at the very height of the disciplinary transition between the film-based 35mm slide and the digital image, and it stands as one of the most powerful statements of this socio-technical transition. It is both filled with nostalgia for the performativity of the old slide lecture, and also affection for the discipline in the face of its potential transformation. Karlholm’s piece was written a bit later and focuses on a more strictly historical evaluation of the role of spoken rhetoric in the formation of the traditions of the discipline.
[5] This is a tradition with which I am playing here. The current paper has been delivered twice, once in draft form at the 2015 ACH meeting in Ottawa, and again later that year, in a final form, as an invited lecture for the University of Alabama. This written text, however, departs dramatically from the original spoken presentation, especially in the number of words needed to convey the same information and the reduced number of images acceptable given the format.
[6] Other fields of the humanities that do not take textual content as their core subject matter, such as those focused on music and/or spoken language, have also produced similarly disciplinary-specific, technologically rich information resources over time. For an example from a historical perspective, see Schwartz 1995, and for a contemporary example looking at audio recordings held by music libraries, see Hooper and Force 2014.
[7] The chattiness of this space depended on the department, of course. Beth Harris and Steven Zucker presented the slide library as a “town square” in their fantastic piece (2008). Spaces like these were also often called “Visual Resource Collections” because they contained more than just 35mm slides. Numerous art history departments also had photo study collections well before the advent of 35mm slides that contained printed photographs used for both reference and teaching. Over the course of the twentieth century, any number of different image-based media could have been collected in these spaces, such as moving images or larger-scale transparencies.
[8] As Johanna Drucker recently noted, with digital technologies, “we could situate a work within the many networks from which it gains meaning and value, and then present the results within complex visual arguments—the kind that were elaborately constructed on slide tables before being reduced to side-by-side comparisons for lectures or standard print publications” (2013, 6).
[9] Harris and Zucker present the concept of the “quasi-unique” slide (2008, 35).
[10] That there are millions of images available to us on the Web, accessible via search engines, does not always mitigate the disappointment of not being able to find an image of the one object needed to make a point.
[11] Stephen Murray points out a few ramifications of this elision (2009). Nelson also uses scenes from Wendy Wasserstein’s play, The Heidi Chronicles, as evidence of the art-historical ability to use a representation as an effective replacement for the original object (2000, 417–18).
[12] It is perhaps worth noting that Mark Tansey’s mother, Luraine Tansey, was the originator, along with Wendell Simons, of the first “Universal Slide Classification System” for visual resource collections. For a description of their system that, as the title notes, was produced with computer automation in mind, see Simons and Tansey 1970.
[13] Some argue that Wölfflin’s mode of argumentation was as much a product of his paired projections as it was the result of the fact that his projections were in black-and-white. An excellent assessment of the impact of reproduction quality on the study of the history of art, especially in Wölfflin’s time, can be found in Karlholm 2010. See also Witcombe 2008 and Nelson 2000.
[14] Drucker eloquently describes the interpretive act of photographic reproduction in the context of the choices inherent to the process (2013).
[15] Since the arrival of the digital computer, of course, there have always been a handful of art and architectural historians interested in investigating every corner of this tool for its possible uses in the field. Many of the earliest studies, of course, arrived before the ability to digitize images directly, and tended, therefore, to focus on metadata and textual information. In a manner that parallels Grimm’s transformation from a scholar focused on text to one focused on images, the history of using computers in the field of art and architectural history begins with the use of supporting texts as well. For an example this early metadata-focused work see Prown 1966. For an overview of a number of the earliest Digital Art History projects, see Zweig 2015.
[16] Although, as Stephen Carroll notes: “Replacing the slide projector with an LCD projector and a computer running PowerPoint doesn’t significantly alter the pedagogy, but it does create a host of new technological problems (e.g., creating and managing a digital archive, coping with the technical limitations of PowerPoint, interface problems, etc.)” (2008, 27).
[17] Opening any still image file in a basic hex editor such as HEXEdit (http://www.hexedit.com/) or Hex Fiend (http://ridiculousfish.com/hexfiend/) will reveal a representation of the image encodings quite quickly. To see the image matrices channel by channel, as well as other modes of digital image re-presentation, the tool of choice would be the much more complicated analytical software package, MATLAB (https://www.mathworks.com/products/matlab.html?s_tid=hp_products_matlab).
[18] For more on digital computing and “functional equivalence,” see Josh Ellenbogen and Alison Langmead, “Forms of Equivalence: Bertillonnage and the History of Information Management,” forthcoming.
[19] For a fascinating, action-research-style project on the relationship between copyright and digital imaging in the fields of art and architectural history, see Wallace and Deazley 2016. For a more technical introduction to these issues, see the College Art Association’s “Code of Best Practices in Fair Use in the Visual Arts.”
[20] A 2013 volume of the journal Visual Resources was given over to the discussion of the impact of the digital on the field of art history, and a number of articles published therein address this gap, some even going so far as to decry that “Digital Art History” is lagging terribly far behind the other fields of the Digital Humanities. Drucker presents a particularly forceful argument of this kind, including a distinction between “digitized” and “digital” art history (2013). Nuria Rodríguez Ortega also offers a call for the field to see the entire digital ecosystem as a power structure not to be ignored or treated lightly (2013). In a more boosterist vein, Anne Collins Goodyear, Paul B. Jaskot, and Pamela Fletcher have all written commentary for the College Art Association asserting that Digital Art History is instead finally finding its feet; see Goodyear and Jaskot 2014 and Fletcher 2015.
[21] There are, it should be noted, digital art history projects that take as their core idea to recreate the old armature of our reproductions. See, for example, the Virtuelles Kupferstichkabinett of the Herzog-Anton Ulrich Museum in Braunschweig (http://www.virtuelles-kupferstichkabinett.de/) which skeuomorphically reproduces the appearance of a slide table. For a discussion of this project in the context of a disciplinary notion of “framing” within digital art history projects, see Doulkaridou 2015.
[22] Consider, for example, the Virtual Hadrian’s Villa (http://idialab.org/virtual-hadrians-villa/), a fantastic project out of the IDIA Lab at Ball State University and the Virtual World Heritage Laboratory at the University of Indiana that uses the Unity gaming engine to provide their audience with the ability to imagine walking through this ancient Roman environment.
[23] For a description and analysis of a mode of art-historical presentation designed around the use of six projected images at a time, and also for a view point on the use of digital imaging in the field different from the one presented in the current paper, see Bligh and Lorenz 2010.
[24] Murray has also noted that image reproduction technologies allow art and architectural historians to spend much of their time talking resolutely about what is not there (2011). Interestingly enough, although Nelson also argues convincingly that the field’s use of reproductions has fundamentally shaped our discipline in ways we do not always admit, he concludes his piece with the assumption that virtual environments will “further [collapse] the distinction between object and subject” (2000, 434). This will only be the case if we, the discipline, allow it to be the case.
[25] On the subject of screen essentialism, see Kirschenbaum 2008 and Montfort [2004] 2005. On the use of glitching to appreciate the impact of screen essentialism, see Owens 2012.
[26] See Manovich 2012. Manovich 2015 discusses data analytical approaches to works of art at a more general level. The author has also posted a number of his projects online at http://manovich.net/index.php/exhibitions/display:thumb.
[27] Computer scientists are eagerly using digital representations of material culture to perform their own research, sometimes producing papers with titles that also suggest pretentions to art-historical knowledge. See Ginosar, Haas, Brown, and  Malik 2015; and Kovashka and Lease 2010; Shamir 2012; and Elgammal and Saleh 2015. For a discussion of the ways that computer vision and art history could possibly find fruitful spaces of an interdisciplinary collaboration, see Spratt and Elgammal 2015.
[28] Wendy Hui Kyong Chun has explored this aspect of computing in the most adroit of manners, identifying a general tendency to fetishize the belief that computing can reveal invisible forces that generate visible effects in the world (2011). Also on the ways in which humanities scholars have long been acquainted with the desire to make the invisible, visible, see Nowviskie 2015.
[29] On the connection between preserving digital objects and preserving performances, see Hedstrom, Lee, Olson, and Lampe 2006 or Boutard 2015. I owe the second citation to the work of Aisling Quigley.
[30] Take, for example, every user’s unique experience with the homepage of Amazon.com on any one given visit. This webpage changes almost constantly, partly because its algorithms are designed to produce variety, but also because it displays different data based on any number of contextual factors, including the user’s clicking and purchasing behavior. It is thus hard to “preserve” a copy of Amazon.com, as it is not a static thing. It can be said that the user and the computer carry out an interactive, behavioral dance together to produce the ephemeral performance that is http://www.amazon.com during any one given session.
[31] To read about a few of these project managers’ approaches, see Christopher Drew Armstrong et al., “Itinera’s Displacements: A Roundtable,” Journal18, forthcoming.
[33] In suggesting a multi-phase chronology of the impact of the digital on the field of art history, Murtha Baca and Anne Helmreich have provided a number of excellent technological impacts made by the digital, but do not focus on the social. See Baca and Helmreich 2013.
[33] For more on the current projects of the Visual Media Workshop, see https://haa.pitt.edu/visual-media-workshop.

Bibliography

Baca, Murtha, and Anne Helmreich. 2013. “Introduction.” Visual Resources 29, nos. 1–2 (March–June): 1–4.

Bligh, Brett, and Katharina Lorenz. 2010. “Vorsprung durch Technik: Multi-Display Learning Spaces and Art-Historical Method.” Computers and the History of Art Conference Proceedings 13, edited by Anna Bentowska and Jeremy Pilcher. http://eprints.nottingham.ac.uk/27983/.

Boutard, Guillaume. 2015. “Towards Mixed Methods Digital Curation: Facing Specific Adaptation in the Artistic Domain.” Archival Science 15 (2) (June): 169–89. https://link.springer.com/article/10.1007/s10502-014-9218-0.

Carroll, Stephen. 2008. “Dangerous Romances: The Rhetoric of Teaching (Art History) with Technology.” In Teaching Art History with New Technologies: Reflections and Case Studies, edited by Kelly Donahue-Wallace, Laetitia La Follette, and Andrea Pappas, 23–32. Newcastle: Cambridge Scholars Publishing.

Chun, Wendy Hui Kyong. 2011. Programmed Visions: Software and Memory. Cambridge, Mass.: MIT Press.

College Art Association. 2015. “Code of Best Practices in Fair Use for the Visual Arts.” February 2015. Accessed November 25, 2017. http://www.collegeart.org/pdf/fair-use/best-practices-fair-use-visual-arts.pdf.

Doulkaridou, Elli. 2015. “Reframing Art History.” International Journal for Digital Art History 1: 67–83. https://journals.ub.uni-heidelberg.de/index.php/dah/article/view/21638/15411.

Drucker, Johanna. 2013. “Is There a ‘Digital’ Art History?” Visual Resources, special issue on Digital Art History, edited by Murtha Baca and Anne Helmreich, 29, nos. 1–2 (Spring): 5–13.

Elgammal, Ahmed, and Babak Saleh. 2015. “Quantifying Creativity in Art Networks.” In Proceedings of the Sixth International Conference on Computational Creativity, 39–46. Provo, Utah: Brigham Young University.

Fletcher, Pamela. 2015. “Reflections on Digital Art History.” caa.reviews, June 18, 2015. http://www.caareviews.org/reviews/2726.

Ginosar, Shiry, Daniel Haas, Timothy Brown, and Jitendra Malik. 2015. “Detecting People in Cubist Art.” In Computer Vision – ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science 8925, edited by Lourdes Agapito, Michael M. Bronstein, and Carsten Rother, 101–16. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-16178-5_7.

Goodyear, Anne Collins, and Paul B. Jaskot. 2014. “Digital Art History Takes Off.” CAA News Today, October 7, 2014. http://www.collegeart.org/news/2014/10/07/digital-art-history-takes-off/.

Grimm, Herman. (1892) 1897. “Die Umgestaltung der Universitätsvorlesungen über Neuere Kunstgeschichte durch die Anwendung des Skioptikons.” In Beiträge zur deutschen Culturgeschichte, 276–395. Berlin: Verlag von Wilhelm Herz.

Harris, Beth, and Steven Zucker. 2008. “The Slide Library: A Posthumous Assessment for Our Digital Future.” In Teaching Art History with New Technologies: Reflections and Case Studies, edited by Kelly Donahue-Wallace, Laetitia La Follette, and Andrea Pappas, 33–41. Newcastle: Cambridge Scholars Publishing, 2008.

Hedstrom, Margaret L., Christopher A. Lee, Judith S. Olson, and Clifford A. Lampe. 2006. “‘The Old Version Flickers More’: Digital Preservation from the User’s Perspective.” American Archivist 69, no. 1 (Spring/Summer): 159–87. http://americanarchivist.org/doi/pdf/10.17723/aarc.69.1.1765364485n41800.

Hooper, Lisa, and Donald C. Force. 2014. Keeping Time: An Introduction to Archival Best Practices for Music Librarians. Middleton, Wisconsin: A-R Editions.

Karlholm, Dan. 2010. “Developing the Picture: Wölfflin’s Performance Art.” Photography & Culture 3 (July): 207–16.

Kirschenbaum, Matthew. 2008. Mechanisms: New Media and the Forensic Imagination. Cambridge, Mass.: MIT Press.

Kovashka, Adriana, and Matthew Lease. 2010. “Human and Machine Detection of Stylistic Similarity in Art.” Proceedings of the 1st Annual Conference on the Future of Distributed Work: CrowdConf 2010 (October 4, 2010). https://people.cs.pitt.edu/~kovashka/ut/kovashka-crowdconf10.pdf.

Landsberger, Franz. 1924. Heinrich Wölfflin. Berlin: Elena Gottschalk.

Manovich, Lev. (2012) 2013. “Media Visualization: Visual Techniques for Exploring Large Media Collections.” In The International Encyclopedia of Media Studies, edited by Kelly Gates, vol. 6. Malden, Mass.: Blackwell Publishing, Inc.

———. 2015. “Data Science and Digital Art History.” International Journal for Digital Art History 1: 13–35. https://journals.ub.uni-heidelberg.de/index.php/dah/article/view/21631.

Montfort, Nick. (2004) 2005. “Continuous Paper: The Early Materiality and Workings of Electronic Literature.” Web-text of talk given at the Modern Languages Association. http://nickm.com/writing/essays/continuous_paper_mla.html.

Murray, Stephen. 2009. “Art History and the New Media: Representation and the Production of Humanistic Knowledge.” In Working Together or Apart: Promoting the Next Generation of Digital Scholarship: Report of a Workshop Co-Sponsored by the Council on Library and Information Resources and The National Endowment for the Humanities, 57–61. Washington, D.C.: CLIR (March).

———. 2011. “The Crisis in Art History?” Visual Resources 27 (December): 314–18. https://doi.org/10.1080/01973762.2011.622214.

Nelson, Robert S. 2000. “The Slide Lecture, or The Work of Art ‘History’ in the Age of Mechanical Reproduction.” Critical Inquiry 26, no. 3 (Spring): 414–34.

Nowviskie, Bethany. 2015. “A Game Nonetheless.” March 15, 2015. Accessed February 1, 2018. http://nowviskie.org/2015/a-game-nonetheless/.

Owens, Trevor. 2015. “Glitching Files for Understanding: Avoiding Screen Essentialism in Three Easy Steps.” The Signal Blog, Library of Congress, November 5, 2012. https://blogs.loc.gov/thesignal/2012/11/glitching-files-for-understanding-avoiding-screen-essentialism-in-three-easy-steps/.

Prown, Jules David. 1966. “The Art Historian and the Computer: An Analysis of Copley’s Patronage, 1753–1774.” Smithsonian Journal of History 1 (Winter): 17–30.

Putnam, Lara. 2016. “The Transnational and the Text-Searchable: Digitized Sources and the Shadows They Cast.” The American Historical Review 121 (2) (April): 377–402.

Rodríguez Ortega, Nuria. 2013. “Digital Art History: An Examination of Conscience.” Visual Resources 29 (1–2) (March): 129–33. https://doi.org/10.1080/01973762.2013.761124.

Schwartz, Michael. 1995. “Computers and the Language Laboratory: Learning from History.” Foreign Language Annals 28, no. 4 (December): 527–35. https://doi.org/10.1111/j.1944-9720.1995.tb00825.x.

Shamir, Lior. 2012. “Computer Analysis Reveals Similarities between the Artistic Styles of Van Gogh and Pollock.” Leonardo 45, no. 2: 149–54.

Simons, Wendell, and Luraine Tansey. 1970. A Slide Classification System for the Organization and Automatic Indexing of Interdisciplinary Collections of Slides and Pictures. Santa Cruz: University of California.

Spratt, Emily, and Ahmed Elgammal. “Computational Beauty: Aesthetic Judgment at the Intersection of Art and Science.” In Computer Vision – ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science 8925, edited by Lourdes Agapito, Michael M. Bronstein, and Carsten Rother, 35–53. Cham: Springer International Publishing. https://link.springer.com/chapter/10.1007/978-3-319-16178-5_3.

Wallace, Andrea, and Ronan Deazley. 2016. “Display at Your Own Risk.” Accessed October 21, 2017. http://displayatyourownrisk.org.

Witcombe, Christopher L.C.E. 2008. “Bye bye, slides / Bye bye, carousels / Hello Internet / I think I’m a-gonna cry-y.” In Teaching Art History with New Technologies: Reflections and Case Studies, edited by Kelly Donahue-Wallace, Laetitia La Follette, and Andrea Pappas, 14–22. Newcastle: Cambridge Scholars Publishing.

Zweig, Benjamin. 2015. “Forgotten Genealogies: Brief Reflections on the History of Digital Art History.” International Journal for Digital Art History 1: 39–49. http://journals.ub.uni-heidelberg.de/index.php/dah/article/view/21633/15405.

About the Author

Alison Langmead teaches and researches in the fields of art history and information studies, focusing especially on the mindful application of digital methods therein. Dr. Langmead serves as the Director of the Visual Media Workshop (VMW), whose mission is to encourage the exploration of methods for producing, disseminating, and preserving academic work using digital technologies. She is also the principal contact for the DHRX: Digital Humanities Research at Pitt initiative, which represents a transdisciplinary network of scholars who use digital methods to study the ways in which humans interact with their environments, whether social or cultural, natural or human-created.

Figure 6 shows two paintings by Vermeer and their weave maps: The Girl Interrupted at Her Music from the Frick Collection and Young Woman with a Water Pitcher from the Metropolitan Museum of Art. The weave maps show that these two paintings were made from the same bolt of fabric.
1

Hunting for Weave Matches: Computation in Art Scholarship

Abstract

Manual thread counts are widely used in the technical analysis of a painting’s canvas (Franken 2017). When the average thread counts of two canvases are similar, this suggests that the two canvases are derived from the same bolt; conversely, if they differ substantially, they cannot have originated from the same roll. Yet average thread counts alone, no matter how close, are not enough to establish that two canvases were manufactured together. With the advent of computer methods, it is now possible to “count” the threads at every location in a canvas. Transforming this numerical procedure into an image produces weave maps such as in Figure 1, which display values of the thread count as colored dots. Striped patterns in the colors are local thread count variations attributable to the mechanics of the weaving process. When two canvases have similar patterns of stripes, such as the two by Vermeer in Figure 1, they can be presumed to have a common origin, thus placing the canvases (and the paintings) in the same place at the same time. This paper describes an organized procedure for carrying out the search for weave matches, includes a summary of the findings of the Counting Vermeer project, and introduces a new match between two of Johannes Vermeer’s canvases.

Johnson & Sethares (Figure 1)

Figure 1: Johannes Vermeer, The Geographer (top), ca. 1668–1669, Oil on canvas, 53 x 46.6 cm. Städelsches Kunstinstitut und Städtische Galerien, Frankfurt am Main and Johannes Vermeer, The Astronomer (bottom, rotated 180◦), ca. 1668, Oil on canvas, 50 x 45 cm. Musée du Louvre, Paris (artwork from Wikimedia Commons), and corresponding vertical weave maps (at right). Each pixel in the weave map represents the value of a thread count at a single evaluation point, which is carried out automatically over the complete canvas. To convert the similarity assessment into a visual task, the density values for each evaluation tile are transformed into colored squares that indicate the densities of the vertical threads. The immediately obvious defining feature in these two maps is the pattern of stripes. As this pattern is the result of the manufacturing process, it will be shared by bolt mates. This match was first presented in “Canvas Weave Match Supports Designation of Vermeer’s Geographer and Astronomer as a Pendant Pair” (Johnson and Sethares 2016).

Background

In March 2006, Ella Hendricks, head of painting conservation at the Van Gogh Museum, agreed to tutor Rick Johnson (the first author of this article) in the activities of a conservator with the goal of expanding the use of computer-based tools in painting analysis. At the time, thread counting was typically accomplished using x-radiograph film of a canvas posted on a light box and measured with a magnifying headset. After shadowing the department for fifteen months, the author recognized that thread counting could serve as a candidate for automated analysis via Fourier methods. Fourier analysis is a common tool taught to undergraduate electrical engineers that is useful for estimating the periodic components in a signal. In the thread counting application, the “signal” is the greyscale intensity fluctuations visible in the x-radiograph corresponding to the threads. Once the potential of Fourier analysis to automate canvas thread counting was confirmed, the Thread Count Automation Project (TCAP) was formed in 2007 to coordinate teams of experts in digital signal processing. The teams tested a variety of procedures and a variety of ways of presenting the results. One fruitful method visualizes the thread count data over a complete canvas using color to represent the varying thread densities. The resulting weave maps (such as in Figure 1) are often striped, and offer a detailed view of the small variations in the density pattern of the weave. These variations often extend over the width and breadth of the roll originally containing the canvas. A weave match occurs when the weave maps from two different canvases have the same pattern of stripes. This has become compelling forensic evidence in establishing rollmate status between two separate canvases.

When combined with information about a painter’s studio practice, material data (e.g. the range of ground layer materials used by the artist), and documentation (e.g. in letters, financial transactions, and memoirs), canvas weave matches can assist in authentication, dating, and inference of artist’s intent, as Liedtke, Johnson, and Johnson recognized in 2012 for paintings by Vermeer. That same year, document-rich studies incorporating weave matches appeared of paintings by Vincent van Gogh (Tilborgh et al. 2012) and Diego Velázquez (Pérez d’Ors, Johnson, and Johnson 2012). In the case of Vermeer, for whom substantial studio documentation is lacking, the eight weave match pairs discovered so far (Johnson Counting 2017) from among Vermeer’s thirty-four paintings on canvas (Liedtke 2008) potentially offer additional insight into unanswered questions, in particular those regarding dating. When a weave match is made between canvases that stylistic analysis dates as several years apart, this can challenge the prevailing sense that an artist would be unlikely to hoard canvas for a long period. Assembling a weave match study across the entire oeuvre of a painter can provide valuable data regarding chronology. A comparison of weave maps for paintings by different artists from the same period and place could help to establish patterns of interaction among the artists.

In the decade since the creation of the first automated thread counting procedures, researchers have used weave maps of thread density and angle to analyze Old Master European paintings from the fifteenth to the early twentieth centuries. Striped weave maps have also been produced for twelfth and thirteenth-century Chinese silk painting supports. The extension to other fabrics with periodic weave patterns can be envisioned as long as they can be imaged with resolution sufficient for a human to count the threads, this might include clothing, flags, and other woven cultural heritage objects. Thus, this decade-long project to develop procedures that use tools from digital signal processing as aids to art historical analysis of paintings on fabric demonstrates the potentials of technology and the trans-disciplinary collaboration between art historians, signal processing engineers, and the institutions that provide the support and data that enable collaborations. The objective of the present paper is to document the procedure employed in the study of Vermeer’s canvases (Johnson Counting 2017) as it advances from scanned x-radiographs, through weave maps, and onto the hunt for weave matches. The audience for this document is presumed to be the end users of the weave match reports; no knowledge of digital signal processing or computer programming is presumed, and therefore, mathematical language is avoided.

A Procedure for Finding Weave Matches

Hunting for Weave Matches presents the complete procedure for comparing possible weave matches and attempting to locate matched pairs. The procedure is accomplished in several stages. First, it is necessary to gather appropriate x-radiographs and transform them into digitized form. Second, manual thread counting is needed both to provide a ground truth and to initialize the computer methods. Third, computer methods draw the weave maps of the individual canvases. Fourth, the weave maps must be compared to each other, and plausible matches detected. Finally, possible matches must be studied by referring back to the x-ray images, to the paintings, and to the incorporation of art historical knowledge. Though it may not be immediately obvious, many of these steps require interaction between the eye of the conservator (or art historian) and the computational algorithm, between the expert and the machine.

The success of the automated thread counting project provides an example of collaboration between art history and computational science where software tools were developed to target a basic problem of interest to art historians and conservators. The human expert is an inherent part of the decision process and a crucial participant in the application of such tools. In the creation of Counting Vermeer (Johnson 2017), x-radiographs providing full-painting coverage of all thirty-four of Vermeer’s works on canvas were digitized, stitched, hand counted, weave mapped, and compared. In documenting the result of the interactions between art historians and signal processing engineers over the course of the Counting Vermeer project, and by formalizing the procedures developed in this collaboration, this paper hopes to show how such interactions can be mutually beneficial.

Compiling a formalized procedure may appear somewhat pedantic; after all, given software for drawing weave maps, what else needs to be done but to press the “run” button? There are several issues, however. First, how is the basic data to be gathered? For example, if an x-ray is scanned at too low a resolution, the evidence for existing stripes may be ambiguous or lost entirely. Secondly, when conducting the manual count, where and how many locations should be counted? Finally, when comparing weave maps, how should stripes be assessed as aligned and a match declared? By following the procedure outlined in this paper, and diagrammed as a “flow chart” in Figure 2, it is possible to carry out the procedure in a reproducible manner. This does not mean that interpretations of weave maps are indisputable; rather, it demonstrates that the basic data on which arguments are based can be re-derived in a systematic manner by any researcher. Yet the interpretation of that data will always require an experienced eye.

Johnson & Sethares (Figure 2)

Figure 2: Schematic flow chart of the complete “hunting for weave maps” procedure.

The Hunt

Digitizing

A key parameter in the study of digital x-radiographs is the size of each pixel, which is typically specified in terms of dots per inch and abbreviated dpi.

Step 1: For all canvases to be studied and compared, obtain x-radiographs digitized (scanned) at sufficiently high resolution. Ten dots (pixels) per thread is the recommended resolution.

For 10 dots per thread, the dpi is 25.4 times the thread count in threads per centimeter (th/cm). For canvas with a thread count of 12 th/cm a dpi of 300 will provide 10 dots per thread. For a thread count of 24 th/cm a resolution of 600 dpi provides 10 dots per thread. Fewer than 10 dots per thread can sometimes provide an adequate image. But fewer than 5 dots per thread typically produces images that are difficult to hand count. A simple rule of thumb is that the chosen resolution needs to be high enough to make manual thread counting feasible.

Stitching

When the canvas is too large to be covered by a single x-radiograph, it is necessary to take multiple images.

Step 2: Construct a composite of the full painting with the constituent digitized x-radiographs using computational stitching.

In order to reassemble these segments, some overlap is necessary (at least 10%) between all adjacent x-radiographs. The re-assembly process can be done in two different ways. The weave maps can be calculated first and then a drawing program (such as Photoshop) can be used to align the stripes in the constituent images, or a stitching algorithm can be used to reconstruct a full x-radiograph, from which the weave map is then calculated (Johnson, Erdmann, and Johnson 2011; Conover, Delaney, and Loew 2013). Since the stitching process is somewhat complicated, there is the possibility that a discontinuity in the stitching may introduce artifacts into the weave maps (for example, a feature may be distorted or may appear doubled). For smaller canvases where a single x-radiograph can cover the complete canvas, skip this step.

Manual Thread Counting

Given the repetitive nature of the thread counting task, it is tempting to delegate all the tedious tasks to the computer. However, there are two good reasons to conduct an initial manual count. The first is that computer-based calculations of “thread count” do not literally count individual threads the way a person might. Rather, they carry out a numerical procedure whose result closely approximates the thread count (Sethares “Automated” 2017). The second reason to conduct manually-assisted thread counts is that all current software methods for thread counting need to be initialized or trained. For example, the Fourier method (Sethares “Automated” 2017) needs to be told “approximately” what the thread count is, and it can then quite reliably fine-tune this answer. Yet if the initial guess the software is given is far from the correct value, then the resulting computed result may well also be incorrect. Thus, a manual thread count is needed to ensure that the computer-generated counts are plausible.

Step 3: For each canvas, perform a manual thread count in several (5 to 15 are suggested) patches (1 to 2 cm squares are suggested) across the painting (with no two counting the same threads as they continue through the painting canvas) of threads in both the horizontal and vertical directions (relative to the painting orientation). Software is available to assist and document this manual thread counting (Sethares “Computer-Assisted” 2017).

Automated Counting

Weave maps compute “thread counts” in square tiles of size x by x centered on a grid of points that are the same distance d apart in the vertical and horizontal directions. The separation should be no larger than the edge length of the square evaluation tiles. For example, it is common to maintain a simple integer relationship x = n d between x and d where n = 1, 2, 3, or 4. Typical choices for x range from 0.5 to 2 cm. Since radiographs are in one to one correspondence with the canvas, these blocks can be visually mapped directly onto the canvas.

Step 4: For a suitable range of values of x (e.g. 0.5, 1.0, 1.5, and 2 cm) and a suitable range of values for d (e.g. 1, 2, 3, and 4) compute the thread counts in tiles covering the composite x-radiograph.

Counting software using Fourier spectral analysis is available (Sethares “Computer-Assisted” 2017). The details of extracting accurate thread counts from peaks in the spectrum depend on the weave type, e.g. simple (also known as tabby) and twill (Johnson, Johnson, and Erdmann 2013). Most Old Master paintings are on simple weave canvas. This spectral method works well in approximating the thread count only if the threads are sufficiently regularly spaced. If the spacing is too irregular and not approximately periodic, the spectral information, while no longer necessarily providing a close match to the actual thread count, can still be used as an image feature allowing weave comparison.

Match Plausibility via Scatter Plot

If the average counts in two paintings of these manual thread counts are too different, i.e. they differ by more than 2 th/cm in both directions, then they cannot be rollmates and continuing to draw weave maps is unnecessary if the only issue to be determined is if they are rollmates. One way to organize the data from a large number of paintings is to draw a scatter plot as in Figure 3. This shows all the computed counts in both directions for all thirty-four Vermeer paintings on canvas, labeled by L number (Liedtke 2008). Canvases that are far apart need not be considered for possible matching. On the other hand, canvases that are nearby in the scatter plot deserve further consideration.

Step 5: Given the computed thread count averages (both horizontal and vertical directions) for each canvas under examination, draw the scatter plot by plotting the smallest value on the horizontal axis and the largest value on the vertical axis.

Johnson & Sethares (Figure 3)

Figure 3: Scatter plot of average thread counts. Each small circle plots the thread count (smaller direction vs. larger direction) and are labelled with the adjacent L numbers. Tight count matches of a specific painting are within a 2 cm square box centered on coordinates of a given painting.

Weave Maps

Step 6: For each painting under examination, map the thread count values into a color image using a colorbar to associate the numbers to colors. Construct one weave map for the horizontal threads and another for the vertical threads.

Software for converting the computed thread counts from each tile into weave maps is available (Sethares “Automated” 2017). The average of the computed thread counts in one thread direction should be used as the center of the colorbar for the corresponding weave map. The range of the colorbar should extend from 3 th/cm below the center value of the color bar to 3 th/cm above it. (These numerical suggestions are for the typical canvas thread counts of fifteenth to early twentieth-century European canvases, which typically range from around 6 th/cm up to the low 20s.) The weave map puts the color for the computed thread count value for each evaluation tile in a d by d sized square centered on the point on which the evaluation tile is centered.

Tiling Selection to Reveal Stripes

If the square evaluation tile side dimension x is too small (which is relative to the degree of count variability across the painting), a weave map will appear random (e.g. speckled, without stripes) and will not be useful for weave matching. If x is too large, the weave map will have a blob-like appearance with no apparent stripes. This is illustrated in Figure 4, which shows a single canvas analyzed with a variety of x and d values.

Step 7: Examine the resulting weave maps for various x and d. Select an x and a d that allow the weave maps of each canvas being counted to exhibit stripes in both of its two thread directions, if possible.

Sometimes the x-radiograph image can be of such poor quality that stripes appear in only one weave map direction— horizontal (H) or vertical (V)—no matter how x and d are chosen. The weave match hunting procedure can continue in such a case but this limits the matching test orientation options.

Johnson & Sethares (Figure 4)

Figure 4: Using different-sized regions (parameter d) examine the canvas at different scales (parameter x) and can lead to different results for thread density maps. Weave maps drawn in various color schemes display the same information, but the stripes may be easier to see in some color schemes.

Re-Coloring the Weave Maps

When comparing any two (or more) weave maps, it is necessary that they be plotted with the same color bars. This is one of the reasons why the weave-map data must be maintained in numerical form (rather than as static jpeg images, for instance).

Step 8: For the x and d chosen in the previous step (that cause stripes to appear in at least one of the two weave maps—with one of horizontal threads and the other of the vertical threads—of each canvas) use the same color bar to compose weave maps drawn to the same scale for all of the paintings to be compared for possible weave matches.

The color bar should be centered on a value that is near either the horizontal (H) or vertical (V) average count of the two canvases. If one canvas is to be compared to multiple canvases with which it has a count match, i.e. in one comparison of H to H and V to V or H to V and V to H the average thread counts computed across the entire images are close to one another, the average H and V thread counts of the one canvas to be compared to several others should be used as color bar centers. Weave maps to the same physical scale should have the same relative sizes as the (composite) x-radiographs of the canvases.

This process is illustrated in the accompanying video demonstration (at about 40 seconds, when the title is “Visually compare L13 with”). Subtle recoloring of the weave maps, originally colored about their individual average counts, occurs when they are collated to compare with L13. The group of paintings chosen for comparison to L13 have average counts within 1 th/cm of each other in both directions. Such “tight” count matches, within 1 th/cm in both directions for a H to H and V to V or H to V and V to H comparison, were chosen because the first six weave matches among Vermeer’s paintings on canvas were found to be within this degree of similarity (Johnson “Exploiting” 2017).

Looking for Matches

Step 9: Compare the horizontal thread stripe patterns of the weave maps of each pair of canvases to see if for some relative positioning the stripe patterns align. Repeat for weave maps of the vertical threads.

These weave maps must use the same x and d, the same procedure for extraction of thread counts from the spectra of the evaluation tiles, and the same color bars. Various orientations should be considered, including one on the right and one on the left of images with horizontal stripes and the reverse left-right pairing. In addition, right-left and left-right orientations should be investigated after rotation by 180 degrees of one of the maps. Furthermore, the right-left and left-right orientations should be considered after one of the weave maps has been right-left flipped. Flipping will be necessary if the ground has been applied to opposite sides of the original canvas.

This procedure is shown in the accompanying video demonstration (0:49–1:26, when comparing L13 with L07, L08, and L09). Slide the images around in all orientations until a match appears, often seeming to suddenly “lock in.” For the vertical thread weave maps of the canvases being compared, above-below and below-above configurations (rather than right-left and left-right configurations) should be examined for vertical stripes, along with the corresponding rotation and flip.

Rotating Weave Maps for Cross-Comparison

Step 10: Repeat the visual matching of Step 9 to compare the horizontal threads weave map of one canvas and the vertical threads weave map for the second canvas rotated by 90 degrees. Similarly, repeat for the vertical threads weave map of one canvas and the horizontal threads weave map for the second canvas rotated by 90 degrees.

Only one (or none) of these four orientation comparisons outlined in Steps #9 and #10, i.e. H to H, V to V, H to V, and V to H, can reveal matching stripe patterns. Stripe alignment is a judgment call to be made by the art expert.

A New Match

The accompanying video demonstration presents the process of looking for matches for L13 (Figure 5). This visual comparison procedure must be repeated for each of the plausible candidates that are nearby in the scatter plot of Figure 3. In the end, the video shows that L09 provides a good match for L13!

Johnson & Sethares (Figure 5)

Figure 5: A screen shot of the accompanying video demonstration shows the comparison procedure, which requires the eye of an expert.

These two weave matching paintings are Girl Interrupted at Her Music, The Frick Collection (L09) and Young Woman with a Water Pitcher, The Metropolitan Museum of Art (L13) (Figure 6). This discovery was welcomed by the staff of The Frick Collection as the painting surface has suffered from pigment degradation and overcleaning prior to its purchase by the institution, a situation that complicates efforts to date the painting. This match was discovered in June 2017 (after the completion of the text for Counting Vermeer (Johnson 2017)) by the process described here and illustrated in the video. If weave matching pairs among Vermeer’s paintings are assumed to imply that the two paintings were painted at around the same time, this may challenge the range of datings by various catalogers of Vermeer’s paintings based solely on stylistic analysis (Janson).

Johnson & Sethares (Figure 6)

Figure 6: Recent weave match of Girl Interrupted at Her Music, The Frick Collection (L09) and Young Woman with a Water Pitcher, The Metropolitan Museum of Art (L13). L09 is rotated 90 degrees to match its vertical thread map with the horizontal thread map of L13, as shown in the accompanying video.

Concluding Remarks

This paper presents an organized procedure for canvas analysis resulting from a decade of intense collaboration between art museum curators, conservators, and signal processing engineers (Johnson “Thread Count”). The discovery and utilization of striped weave maps required an immersion by engineers in the problems and techniques of art experts; a willingness (unusual at the start of the project in 2007) by participating museums to share high resolution scientific data with researchers outside the museum community; visualization of the numerical results in a form suited to the advanced close-looking skills of art experts; the commitment of the computational and art experts to find a common (non-mathematical) cross-disciplinary language necessary to sustain the collaboration and move into uncharted territory; and the immersion of the art experts in the interpretation of the results (rather than a futile attempt to displace experts with computer-generated “knowledge”). The results have far exceeded the preconceptions of all parties involved.

 

Bibliography

Conover, Devin M., John K. Delaney, and Murray H. Loew. 2013. “Automatic Registration and Mosaicking of Conservation Images.” Proceedings of the Society of Photo-Optical Instrumentation Engineers (SPIE) 8790, Optics for Arts, Architecture, and Archaeology IV. 87900A. DOI:10.1117/12.2021318.

Franken, Michiel. 2017. “Sixty Years of Thread Counting.” In Counting Vermeer: Using Weave Maps to Study Vermeer’s Canvases, edited by C. Richard Johnson, Jr. and William A. Sethares. The Hague: RKD-Nederlands Instituut voor Kunstgeschiedenis. http://countingvermeer.rkdmonographs.nl.

Janson, Jonathan. n.d. “Dating Vermeer’s Paintings.” Essential Vermeer. http://www.essentialvermeer.com/references/dates.html#.WXkKSVGQzIU.

Johnson, C. Richard Jr. n.d. “Thread Count Automation Project (TCAP) Timeline (2007–2014).” http://people.ece.cornell.edu/johnson/tcap.html.

———. 2017. “Exploiting Weave Maps.” In Counting Vermeer: Using Weave Maps to Study Vermeer’s Canvases, edited by C. Richard Johnson, Jr. and William A. Sethares. The Hague: RKD-Nederlands Instituut voor Kunstgeschiedenis. http://countingvermeer.rkdmonographs.nl.

Johnson, C. Richard Jr., and William A. Sethares. 2017. “Canvas Weave Match Supports Designation of Vermeer’s Geographer and Astronomer as a Pendant Pair.” Journal of Historians of Netherlandish Art 9, no. 1 (Winter). DOI:  10.5092/jhna.2017.9.1.17.

Johnson, C. Richard Jr., and William A. Sethares, eds. 2017. Counting Vermeer: Using Weave Maps to Study Vermeer’s Canvases. The Hague: RKD-Nederlands Instituut voor Kunstgeschiedenis. http://countingvermeer.rkdmonographs.nl.

Johnson, Don H., Robert G. Erdmann, and C. Richard Johnson, Jr. 2011. “Whole-Painting Canvas Analysis Using High- and Low-Level Features.” Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. DOI: 10.1109/ICASSP.2011.5946567.

Johnson, Don H., C. Richard Johnson, Jr., and Robert G. Erdmann. 2013. “Weave Analysis of Paintings on Canvas from Radiographs.” Signal Processing (Special Issue on Image Processing for Art Investigation) 93 (March): 527–40.

Liedtke, Walter. 2008 Vermeer: The Complete Paintings. Ghent, Belgium: Ludion Press.

Liedtke, Walter, C. Richard Johnson, Jr., and Don H. Johnson. 2012. “Canvas Matches in Vermeer: A Case Study in the Computer Analysis of Fabric Supports.” Metropolitan Museum Journal 47: 99–106.

Pérez d’Ors, Pablo, C. Richard Johnson, Jr., and Don H. Johnson. 2012. “Velázquez in Fraga: a New Hypothesis about the Portraits of El Primo and Philip IV.” The Burlington Magazine CLIV (September): 620–25.

Sethares, William A. 2017. “Automated Creation of Weave Maps.” In Counting Vermeer: Using Weave Maps to Study Vermeer’s Canvases, edited by Johnson, C. R. Jr. and W. A. Sethares. The Hague: RKD-Nederlands Instituut voor Kunstgeschiedenis. http://countingvermeer.rkdmonographs.nl.

———. 2017 “Computer-Assisted Manual Thread Marking.” In Counting Vermeer: Using Weave Maps to Study Vermeer’s Canvases, edited by Johnson, C. R. Jr. and W. A. Sethares. The Hague: RKD-Nederlands Instituut voor Kunstgeschiedenis. http://countingvermeer.rkdmonographs.nl.

Van Tilborgh, Louis, Tieo Meedendorp, Ella Hendriks, Don H. Johnson, C. Richard Johnson, Jr., and Robert G. Erdmann. 2012. “Weave Matching and Dating of Van Gogh’s Paintings: An Interdisciplinary Approach.” The Burlington Magazine CLIV (February): 112–22.

Visitor to the Time and Cosmos exhibition looking closely at the Carthage Roofed Sundial, next to which is an iPad running an animation of shadow on the sundial.
3

Animated Shadows on Virtual Stone: Ancient Sundials in a Gallery Setting

Abstract

From October 2016 to April 2017, the Institute for the Study of the Ancient World (ISAW) at New York University was the venue for the exhibition Time and Cosmos in Greco-Roman Antiquity. Among the objects on display were ancient sundials, some of which were accompanied by digital animations that illustrated how such devices worked. The purpose of the current article is to place these digital resources in the context of the collaborative environment that created them and to show how they can continue to be effective in communicating the sometimes complicated operation of ancient sundials, including examples that were not on display in the gallery due to size constraints. After an introduction to the workings of the objects themselves, we discuss the role of this digital content in the visitor’s experience and as a museum education resource for docents.

Visitor to the Time and Cosmos exhibition looking closely at the Carthage Roofed Sundial, next to which is an iPad running an animation of shadow on the sundial.

Figure 1: Installation view of a visitor and the Roofed Spherical Sundial with Greek Inscription with an animation running at its side, 2016. The operation of this sundial is discussed and illustrated with animation in the text.

Introduction

From October 19, 2016 to April 23, 2017, the Institute for the Study of the Ancient World (ISAW) at New York University was the venue for the exhibition Time and Cosmos in Greco-Roman Antiquity (Jones 2016).[1] Twenty-seven lenders contributed more than one hundred objects ranging from sundials and calendars to ancient works of art that placed these time-tracking devices in their cultural context. Among the many goals of this international loan exhibition was to communicate to general audiences how Greek and Roman sundials functioned and were read in antiquity. We accomplished this in part by displaying digital animations that simulated the passage of light and shadow on the surfaces of three of the sundials that were on display. Figure 1 (above) shows the close association of physical object with its digital surrogate and indicates that visitors were able to take in both as they moved through the gallery. Additional animations allowed virtual incorporation of sundials that were not on display due to size or other practical constraints.

The purpose of the current article is to place these digital resources in the context of the collaborative environment that created them and to show how they are effective in communicating the sometimes complicated operation of ancient sundials. After an introduction to the workings of the objects themselves, we discuss the role of this digital content in the visitor’s experience and as a museum education resource for docents. The last section discusses the work to incorporate ancient sundials that could not be brought into the gallery because they are inscribed on a large building in Athens, Greece. Physical objects, the creation and use of their digital surrogates, and the interaction of visitors and guides with this material are the underlying focus throughout. Anecdotal feedback from visitors suggests that the animations were compelling and we hope that this aspect of the work is apparent in the current presentation. We also hope that placing these digital resources within a discussion of our goals is itself a pedagogic and professional resource for anyone considering similar work.

The exhibition Time and Cosmos drew on the expertise of many members of the ISAW community, and where possible we relied on open-source or free software and freely licensed content to create the digital resources that appeared in the galleries.[2] We believe these aspects of the work mean that our approach is repeatable in other institutional contexts. The authors of the current article are respectively a member of the faculty at ISAW, a member of the ISAW exhibitions staff, and an ISAW graduate student studying ancient science and its transmission in the Medieval and Early Modern periods. Our collaboration is founded on interactions that occurred within our academic context. In the spring of 2016, as the Time and Cosmos exhibition was in the planning stages, Heath taught the graduate seminar “Computational Photography and 3D Tools for the Ancient World.” An emphasis of the course was the use of open-source and free software and the potential for 3D animations to communicate visual aspects of scholarly work, including student initiated research (Heath 2015). Roughan, at the time in her first year of graduate work, enrolled in the course and chose as her project a virtual reconstruction of the Tower of the Winds, a Hellenistic-era octagonal monument in Athens well known for its sculpted personifications of winds that also had a sundial on each of its eight walls (Figure 14). Heath and Alexander Jones had already begun to collaborate on the animation of ancient sundials, inspired in part by the growing use of virtual tools to simulate ancient solar observations (Frischer et al. 2017), and it was clear that this work could have a role in the upcoming exhibition. Roughan’s student work on the Tower of the Winds also fit perfectly with the overarching theme of placing ancient technology in its cultural context. Heath’s seminar used the open-source animation suite Blender (2017) as its default digital tool. Accordingly, all the animations and renderings in this article were made, at least in part, with that software package. Herschman worked with both Roughan and Heath to develop the narrative aspects of the animations so that they would work effectively in the gallery and contribute to the educational mission of the exhibition (Wyman et al. 2011). We can say with confidence that digital pedagogy at the graduate level encouraged collaboration between many components of our small institution. We emphasize the collaborative nature of our effort for the very practical reason that it allowed all the work shown to be accomplished at low cost. In the past, such animations might have required a budget of tens of thousands of dollars at least. By taking advantage of open-source software, existing digital content where possible, previously purchased iPads, and our combined digital skills, the total incremental cost of including animations in the gallery was well under that amount.

An Animated and Illustrated Introduction to Ancient Sundials

Figure 2: Animation of shadow on the Pompeii Horizontal Sundial at Winter Solstice

Animations running on iPads were an important component of the Time and Cosmos exhibition. Accordingly, we include five animations in this section and six in the article overall. Figure 2 animates the passage of shadow across a Roman-period horizontal sundial from Pompeii in Italy as it would have appeared on the winter solstice, or December 21 or 22 in our modern calendar.[3] That is the shortest day of the year when the sun is low in the sky and shadows are long. Readers are encouraged to click on the image to initiate playback.[4] Achieving the combination of physical object and an animation showing how it worked was the main goal in creating these digital resources. It is of course the case that we cannot replicate that combination in this article. We can, however, place animations in the context of a narrative explanation of how sundials were used, which is what follows immediately here. The combination of viewing and reading is loosely analogous to the experience of listening to a gallery docent, a role explored further below. While an article is fundamentally different from what happens in a gallery, we hope readers are able to approach a more intimate understanding of these objects and then bring that perspective to our further discussion.

The principles that allowed an ancient sundial to be an effective time-keeping device can be expressed in straightforward terms.[5] As the sun is perceived to move during any given day from its rising in the east to its setting in the west, shadows cast by objects in the path of the sun’s rays will also move. A thin rod can cast a well-defined shadow and the movement of that shadow across a marked surface will indicate the passage of time. Additionally, the time of year also causes the length of cast shadows to change from day to day. At midday on the summer solstice, which often occurs on June 22 in our modern calendar, the sun will be at its highest point in the sky and shadows will be short on a sundial whose surface is oriented parallel to the ground. Six months later, at the winter solstice on or about December 22, the sun will be relatively low at noon, meaning that shadows will be long. These, then, are the two major cycles that many ancient sundials utilized: a daily cycle for telling time, and an annual cycle used to indicate progression through the year.

Horizontal Sundial from Pompeii

Rendering of shadow on the Pompeii Horizontal Sundial at three Roman hours before midday on the winter solstice, the shortest day of the year when the sun is low and shadows are long. The shadow is cast towards the lower right part of the sundial.

Figure 3: Rendering of shadow on the Pompeii Horizontal Sundial at three Roman hours before midday on the winter solstice, the shortest day of the year when the sun is low and shadows are long. The viewer is looking towards the south.

 

Rendering of shadow on the Pompeii Horizontal Sundial at three Roman hours after midday on the winter solstice. The shadow is cast towards the lower left part of the sundial.

Figure 4: Rendering of shadow on the Pompeii Horizontal Sundial at three Roman hours after midday on the winter solstice.

Just as animations in the gallery helped visitors understand the operation of the sundials they were viewing, the static illustrations and embedded animations in this article are intended to make the above description more accessible. Complementing the animation in Figure 2, Figure 3 renders shadow at three Roman hours before noon on the winter solstice as it would have appeared on the same horizontal sundial from Pompeii, the city in Italy most famous for having been destroyed by the volcano Vesuvius in 79 CE. A so-called horizontal sundial consists of a flat surface onto which a shadow is cast by a gnomon, which is the technical term for the pyramidal rod restored in Figures 2–6. This is the simplest form of ancient sundial and the most easily understood. Figure 4 shows the same sundial six Roman hours later, or three Roman hours after midday. In combination with Figure 2, Figures 5 and 6 show animations of shadow passing over the Pompeii sundial on the winter solstice (Figure 2 above), the spring equinox (Figure 5)—approximately March 22nd on our modern calendar when the day and night are of essentially equal length—and the summer solstice (Figure 6), when the sun is highest at noon and the shadow cast by the sundial’s gnomon is short. In combination with the still renderings, we intend that these digital surrogates for the physical object effectively communicate the way this sundial worked.

Figure 5: Animation of shadow on the Pompeii Horizontal Sundial at Spring equinox
Figure 6: Animation of shadow on the Pompeii Horizontal Sundial at Summer Solstice

A Double Sundial from Delos, Greece

Rendering of the Delos Double Spherical Sundial shortly after sunrise on spring equinox. In this rendering, the sun is low on the eastern horizon. As the sun rises in the sky, the shadow of the right-hand gnomon will move down the right-hand quarter sphere until midday, when the left-hand quarter-sphere will become readable.

Figure 7: Rendering of the Delos Double Spherical Sundial shortly after sunrise on spring equinox. In this rendering, the sun is low on the eastern horizon. As the sun rises in the sky, the shadow of the right-hand gnomon will move down the right-hand quarter sphere until midday, when the left-hand quarter-sphere will become readable.

The operation and reading of the Pompeii Horizontal sundial are relatively straightforward to represent in digital form, and the same basic principles are at work for all the sundials shown in this article. Figure 7 uses a simplified virtual space to show a so-called double-spherical sundial dated to the 3rd to 2nd century BCE and from the Aegean island of Delos.[6] Figure 7 shows the shadows cast by two virtually restored horizontal gnomons as they would have appeared early in the morning on the spring equinox. The sun is rising to the viewer’s right and the right-hand gnomon casts its shadow onto the right hand quarter sphere. Figure 8 shows the shadow approximately an hour before midday. Figure 9 is an animation of the shadow during the entire spring equinox, and readers may want to play that before reading further. The key movement the animations shows is that the readable shadow passes to the western curved surface after midday, meaning to the left of the rendered perspective. As noted, the basic principle is the same as seen on the Pompeii Horizontal Sundial. The Delos sundial is nonetheless a very clever arrangement of surfaces and gnomons and there is license to think that its designers enjoyed their work, though this is a purely speculative modern reaction.

Delos Double Spherical Sundial before midday on spring equinox. The right-gnomon is still casting the readable shadow, but this will change after midday as the sun moves to the left and casts the readable shadow on the left-hand quarter sphere.

Figure 8: Delos Double Spherical Sundial before midday on spring equinox. The right-gnomon is still casting the readable shadow, but this will change after midday as the sun moves to the left and casts the readable shadow on the left-hand quarter sphere.
 
Figure 9: Animation of the Delos Double Sundial showing the passage of shadow during the spring equinox.

“Roofed” Spherical Sundial

The next sundial we discuss here is a so-called roofed sundial said to be from Carthage in North Africa, but more likely intended to have been set up near Rome in Italy. This is a remarkable piece of ancient technology. Instead of having an upward-facing readable surface onto which a gnomon casts a shadow, a so-called roofed sundial is a downward-facing curved surface with a hole near its top. The light of the sun passes through the hole, or “oculus,” creating a bright spot in a field of shadow. The path that the spot travels serves the same purpose as the tip of the shadow of the gnomons in the previous two examples. Figure 10 renders the appearance of the working surface at one Roman hour before midday on the summer solstice.[7] The sun is very high so that much of the sundial is in shadow. The readable dot is just to the left of the lowest point. In this rendering, the viewer is looking north and the sun is both behind and slightly to the right, or east. Figure 11 is an animation of the path of the bright dot on the spring equinox.

Roofed Spherical Sundial showing the hour before midday on the summer solstice. Much of the interior surface of the sundial is in shadow and there is a bright spot of light indicating the hour of the day.

Figure 10: Roofed Spherical Sundial showing the hour before midday on the summer solstice.
 
Figure 11: Animation of Roofed Spherical Sundial showing approximate movement of shadow and the bright spot indicating time during the spring equinox.

We have noted that the essential principle by which any sundial operates, the casting of shadow, is straightforward. The particulars can be complex and the gridlines on individual objects are difficult to understand without seeing shadows moving over them. We again encourage readers to play these animations and to see them as an essential—and we hope enjoyable—complement to our descriptions. By doing so, the role of these digital surrogates in the gallery experience is accessible. That experience is the topic of the next section.

Installation, Presentation, and Experience

Installation view from Time and Cosmos in Greco-Roman Antiquity, 2016. The Delos Double Spherical Sundial is at the left, with animation running on nearby iPad. There are no visitors shown in this image.

Figure 12: Installation view from Time and Cosmos in Greco-Roman Antiquity, 2016. The Delos Double Spherical Sundial is at the left, with animation running on nearby iPad.
 

The exhibitions program at ISAW is a powerful, public-facing visual expression of the research that takes place here. In addition to serving a scholarly community, the galleries are open to the public and admission is free of charge. Time and Cosmos was featured in high-circulation news publications, and attracted a broad audience (Wilford 2016; Rothstein 2017). Showcasing academic work to diverse audiences, ISAW exhibitions aim to make rigorous scholarship accessible and engaging to the varied communities that it serves.

For gallery visitors unfamiliar with Greco-Roman timekeeping instruments, the diversity of ancient sundial styles presented in the exhibition was often a surprise. To a general audience, the word “sundial” is often associated with an image of a flat disk and triangular, finlike gnomon, similar to what one might find in a garden. Time and Cosmos presented a range of differently shaped sundials that were understood in antiquity not only as tools to measure time’s passage but also as a representation of the cosmos, since the movement of the sun provided the organizing structure for the division of hours and seasons.

Contemporary clocks and watches do not reveal the science and math behind their functioning as ancient sundials do. Introducing this concept to visitors required not only an explanation of the many differently shaped sundials but also an efficient primer on Greco-Roman cosmology. Incorporating digital animations for a strategic selection of sundials was an important curatorial approach for showing how these instruments worked, as well as how they depicted the movement of the heavens in miniature. The video of the Double Spherical Sundial with Greek Inscriptions (Figure 9) illustrated how sundials reflected the two-sphere model of Greek cosmology—its shape is an inverted copy of the celestial sphere—and allowed visitors to understand quickly how all other sundials were different geometric representations of a spherical cosmos.

Representing movement was key to presenting these artifacts in an accessible way. Ancient sundials were not static or merely decorative objects, but performance instruments. Since all are missing their gnomons and were presented in a gallery with regulated artificial lighting, it was impossible to show visitors how the sundials would have worked using the artifacts alone. Even a scale replica with a recreated gnomon exhibited outdoors would not have been accurate: each sundial is calibrated to a particular latitude, one different from New York City.

The animations were a way to overcome the static nature of the exhibition space, making it engaging for a general visitor while at the same time presenting a specific and idealized representation of how these artifacts would have been used by the ancients, down to the correct latitude. We were also able to optimize the shadows by drawing them darker than they would have appeared under natural sunlight, for example.

The animations also allowed us to accelerate the sun’s movement over the course of a day, compressing the sunrise-to-sunset cycle into a sequence approximately thirty seconds long. The same sequence was repeated for the winter solstice, spring equinox, summer solstice, and autumn equinox—each time showing the day getting longer or shorter according to the season. It was often a discovery for visitors that ancient sundials not only showed the hour of the day but also indicated the season of the year (or in the case of the Pompeii Horizontal Sundial, the zodiacal cycle of the sun). From a practical standpoint, animating a day in fast-forward meant each video had a total runtime of approximately two minutes, which ensured visitors kept moving through the gallery space without bottlenecks or overcrowding around certain works.

ISAW offered free guided gallery tours to the public every Friday evening, and interested groups could also prearrange private tours outside of the regular schedule. Led by qualified scholars and PhD candidates with expertise in ancient science or art, docents engaged visitors with interactive, inquiry-based tours. The animations provided useful tools to the docents and helped prompt questions about the artifacts on view. As visitors observed the network of lines carved into a sundial’s face, the docents could direct their attention to the animation below and point out how the shadow crossed them during the course of a day and year.

In addition to a general visitor’s expectations of what constitutes a sundial in the first place, there was the additional challenge that all of the sundials on display were missing their metal gnomons. The animations helped to call visitors’ attention to this absence from the physical objects. Showing a sundial indoors is a bit like showing a stopped clock, and to an untrained eye, looking at one without a gnomon can seem like looking at a clock face with no hands. The animations not only helped overcome these exhibition challenges by recreating the gnomon but also drew visitors’ attention back to the artifact itself. Pairing a real sundial with an animation, gallery guests would compare the two and this often prompted questions about the specific sundial: Why is the gnomon missing? What is the history of this specific artifact? On guided tours, docents could discuss the widespread recycling of metals in antiquity and comment on how the mathematical and calculable path of the sun (as viewed from earth) allows scholars today to reconstruct exactly the gnomon necessary for the given sundial lines and latitude.

The animations were successful because they not only illustrated the larger principles of Greco-Roman timekeeping and cosmology but also illuminated the specific artifacts on view, inviting a consideration of their individual object histories. In a gallery setting, next to a real work of art, the animations pointed back to the thing itself. Rather than serving as a substitute or competing with the object for a visitor’s attention, the digital animations enhanced the experience of the stone sundials.

One example is our presentation of the Roofed Spherical Sundial with Greek Inscriptions. This sundial marked a change from the other sundials included in the exhibition: it told time using a moving spot of light within a shaded bowl (Figure 11). The underlying cosmology is consistent with the other videos, yet it was important to demonstrate how to read this unique dial, and that the hole at the top was actually an oculus and an important part of how the sundial functioned. The video clearly illustrated the distinctiveness of this instrument’s operation, while echoing the same daily and seasonal patterns as the other sundial videos.

Understanding the unique history of an individual sundial also helped reveal the larger cultural view of time in antiquity and the greater context for such instruments. Again, the Roofed Spherical Sundial offers a case in point. Although this piece is precisely calibrated for the latitude of Rome—it is described by the exhibition’s curator Alexander Jones as a display of “mathematical virtuosity” (Jones 2016: 25)—its findspot is recorded as Carthage, indicating that it was moved at some point in ancient history. At this different latitude it would not have told time as precisely as it would have in Rome, but it does reveal that even in antiquity the sundial was valued as an art object as well as a timepiece. Elegantly carved to resemble a skyphos drinking cup with oak leaves and acorns (similar to first-century CE luxury silverwork) the artifact is a masterpiece of science and art.

The Roofed Spherical Sundial, presented on the same table and at the same height as the other sundials, often prompted questions from visitors about how it would have been installed in antiquity. To view the interior of the sundial, visitors would have to lower their heads and look up into it (Figure 1). The docent could direct gallery guests to the animation, which displays the correct viewing angle (from below the sundial) before drawing their attention to the depiction of a sundial atop a column in the Roman Mosaic Depicting the Seven Sages (“Plato’s Academy”) on the gallery wall across from the sundial (Figure 13). The mosaic shows a sundial mounted above the heads of the assembled philosophers in a symposium-style setting. Bridging the presentation of a scientific instrument with an interpretation for other artworks, the animations helped unite different curatorial themes, including a sundial’s association with wisdom, by emphasizing its actual position.

Installation view showing carved exterior of the Roofed Spherical Sundial with Greek Inscription (right) and Roman Mosaic Depicting the Seven Sages (“Plato’s Academy”) on opposite wall (left), 2016. There is a single visitor shown in the image.

Figure 13: Installation view showing carved exterior of the Roofed Spherical Sundial with Greek Inscription (right) and Roman Mosaic Depicting the Seven Sages (“Plato’s Academy”) on opposite wall (left), 2016.

The Tower of the Winds

Computer rendering of the model of the Tower of the Winds, situated in a model of Athens. To the right the Roman Agora in Athens is visible (situated west of the tower). To the left is one wall of the so-called Agoranomion and beyond it the Acropolis of Athens (located south of the tower).

Figure 14: A rendering of the model of the Tower of the Winds, situated in a model of Athens. To the right the Roman Agora in Athens is visible (situated west of the tower). To the left is one wall of the so-called Agoranomion and beyond it the Acropolis of Athens (located south of the tower).
 

There were several visualizations in the exhibition that brought in relevant material that could not be physically present in the galleries. An animation was the vehicle that presented a masterpiece of ancient architectural and scientific design: the Tower of the Winds. This construction, also known by the name the Horologion of Andronikos, is a 13.5-meter tall marble octagonal tower located beside the Roman Agora of Athens. Its eight walls each face a cardinal or intercardinal direction and are topped by friezes depicting the personified wind deity of that direction. Its relevance to the exhibition however is as a horologium: the tower itself is a monumental and multifaceted sundial. Carved into each of the eight walls is a vertical sundial calibrated for the direction in question.

While the tower could not be situated in the gallery space for obvious reasons, an iPad with the animation was paired with one of the other gallery objects. The Double Vertical Sundial from Delos provided another model of a vertical sundial, this one with its faces directed southeast and southwest (Figure 15). The museum visitor could observe that the layout of the sundials on these faces matched those on two walls of the Tower of the Winds.

Photograph of a Double Vertical Sundial from Delos. It bears vertical grids similar to those on the Tower of the Winds in Athens.

Figure 15: Double Vertical Sundial from Delos.
 

The Tower of the Winds animation required the most original work and has its origins in a graduate seminar on 3D technologies taught at ISAW. As noted in the introduction to this article, that seminar was taught by Heath in Spring of 2016 and attracted PhD students from ISAW, NYU’s Institute of Fine Arts, and the Anthropology Department. Its focus was on using 3D tools to communicate aspects of students’ own research so that rendering the movement of shadow on the Tower of the Winds was a very suitable project to take on during the term. The final realization of the animation, and the following discussion, is the work of C. Roughan. 3D model data for the Tower of the Winds did not exist so the model was built using the comprehensive measurements presented by Stuart and Revett (1762) and the updated and more precise numbers in Kienast (2014). This data encompassed architectural components on a large scale and down to details such as the moldings. More significantly, a chapter by Karlheinz Schaldach in Kienast (2014) measured the angles of the octagonal walls and the layout of the sundials to a high degree of precision. The 3D modeling software SketchUp was used to build the model of the tower from this data, while textures for the model were produced from photographs of the tower in the open source image editor GIMP.

Like the other sundials, the animation for the Tower of the Winds was created using Blender. The Tower of the Winds did present two challenges to its animation: it was desirable to depict the tower as a work of architecture in its surrounding city and it was necessary to present to the viewer the operation of eight different sundials on one piece. The former goal was accomplished by placing the Tower of the Winds model into a CC-BY-NC model of second century CE Athens which was available in Blend Swap, a repository for open source Blender models (Aguirre 2014). The latter was accomplished with a moving camera, which circled around the tower and followed the sunlight as it illuminated and cast shadows on the eight walls and sundials of the structure.

Figure 16: Animation of the Tower of the Winds at the Spring Equinox

The moving camera guides the viewer’s understanding of the Tower of the Winds. The full animation opens with a shot of the full tower before circling and panning to present it in the context of the surrounding city of Athens. With this accomplished, the camera then zooms in to circle the tower itself and display the workings of all eight sundials (Figure 16). These choices aimed to acquaint the viewer with the tower in its entirety and in its public setting—details that were key because the tower could not be physically present.

In the exhibition the Tower of the Winds animation joined harmoniously with the other pieces to tell the story of the many and varied sundials in antiquity. The positioning of the iPad with the Tower of the Winds meant that most tours approached it after previous works had prompted discussion about typical settings for sundials, the varying sundial faces, the sundial as an artistic object, and the sundial as a display of ancient cultures’ mastery over the cosmos. All of these themes prove very relevant to any discussion of the Tower of the Winds. As the tour came to the animation of the tower, members of the public—already introduced to sundials situated in public contexts, to sundial faces calculated for different projections and directions, and to sundials which boasted of both artistic and scientific skill—could appreciate these elements in a single and monumental work.

Conclusion

We close by re-emphasizing the collaborative nature of our work. It is not new to place animations in a gallery setting. In 2017, however, it was possible to use relatively low-cost tools and openly licensed data to achieve the digital manifestation of ISAW’s in-house expertise that appear above. Faculty, exhibition staff, and graduate students worked together closely on this project. While the proximate intended beneficiaries of this effort were the members of the public who visited the galleries while the Time and Cosmos exhibition was installed, presenting the animations in this publication allows its results to reach a wider audience.

Notes

[1] The exhibition was curated by curated by Alexander Jones, Professor of the History of the Exact Sciences in Antiquity (ISAW); the acknowledgements on pp. 12–15 of Jones 2016 directly credit all those who had a role in its success. The authors of this article are grateful to the JITP editors and to the anonymous readers for their comments.
[2] ISAW is constituted as a separate academic unit within New York University, but is analogous in scale to an individual department. There are eleven full-time faculty, approximately twenty graduate students, and twenty staff. Additional information about ISAW is available online at http://isaw.nyu.edu/
[3] Brief catalog information of all the objects discussed here follows the main text. The underlying model for the animation in Figure 2 was prepared in Blender using photography by Guido Petruccioli. The shadows were animated using the “Sun Position” Blender add-on.
[4] The exact interface for initiating playback will depend on which browser a reader is using. As of this writing, most browsers display a small set of controls below the video that have the familiar “play” right pointing triangle icon
[5] A more detailed discussion of the principles behind ancient sundials appears in the exhibition catalogue (Jones 2016, 23–7)
[6] The model used to create this image and related animation is available via the Berlin Sun Dial Project (2012). BSDP data is available under a Creative Commons Attribution Non-Commercial Share-Alike license, which very much simplified our ability to integrate the Delos Double Spherical Sundial model into the gallery experience and into this article.
[7] This model was prepared by Alexander Jones by compiling multiple photographs into 3D data using a technique known as photogrammetry that is becoming very common in art-historical and archaeological studies (Olson et al. 2013).

Catalogue

  1. Horizontal Sundial with Greek Inscriptions. Marble, H. 53 cm; W. 34.5 cm; D. 3 cm, Pompeii, before 79 CE. Museo Archeologico Nazionale di Napoli: 2476. (Figures 2–6). Jones 2016, no. 7.
  2. Double Spherical Sundial with Greek Inscriptions. White marble, H. 45 cm; W. 32 cm; D. 19 cm, Gymnasium, Delos, 2nd century BCE. Archaeological Museum, Delos: B4367. (Figures 7–9). Jones 2016, no. 2.
  3. Roofed Spherical Sundial with Greek Inscriptions. Marble, H. 54 cm; Diam. 74 cm; D. 34 cm, Carthage (?), ca. 1st–2nd century CE. Musée du Louvre, Paris, Département des Antiquités grecques, étrusques et romaines: MNE1178/MA 5074. (Figures 10–11). Jones 2016, no. 6.
  4. Double Vertical Sundial. White marble, H. 29.6 cm; W. 21 cm; D. 14 cm, Oikos of Dionysos, Delos, ca. 100 BCE. Archaeological Museum, Delos: B594. (Figure 15). Jones 2016, no. 8.

Photo Credits

Figures 1, 12, 13: Photo © Institute for the Study of the Ancient World, photographer Andrea Brizzi; Figure 15: Photo © Institute for the Study of the Ancient World, photographer Orestis Kourakis.

Bibliography

Aguirre. 2014. “Roman Athens 165AD Game Engine 2.49B.” <https://www.blendswap.com/blends/view/72326.

Berlin Sun Dial Project. 2012. “3D model of the Sundial B4367, Delos.” Retrieved from <http://repository.topoi.org/BSDP/BSDP0050>

Blender [software]. 2016. Retrieved from <http://blender.org>

Frischer, Bernard, and John Pollini. 2017. “New Light on the Relationship between the Montecitorio Obelisk and Ara Pacis of Augustus.” Studies in Digital Heritage 1:1. DOI: 10.14434/SDH.V1I1.23331.

GIMP [software]. 2016. Retrieved from <https://www.gimp.org/>

Heath, Sebastian. 2015. “Closing Gaps with Low-Cost 3D.” In. Visions of Substance: 3D Imaging in Mediterranean Archaeology, edited by Brandon
Olson and William Caraher, 53–61. Digital Press at The University of North Dakota: Grand Forks.

Jones, Alexander, ed. 2016. Time and Cosmos in Greco-Roman Antiquity. New York and Princeton: ISAW/Princeton University Press.

Kienast, Herman J. 2014. Der Turm der Winde in Athen. Wiesbaden: Reichert Verlag Wiesbaden.

Olson, Brandon, Ryan Placchetti, Jamie Quartermaine, and Anee Killebrew. 2013. “The Tel Akko Total Archaeology Project (Akko, Israel): Assessing the suitability of multi-scale 3D field recording in archaeology.” Journal of Field Archaeology 38.3: 244–62.

Rothstein, Edward. 2017. “Time and Cosmos in Greco-Roman Antiquity’ Review: Sundials and Stargazing.” Wall Street Journal, January 3.

SketchUp [software]. (2016). Retrieved from <https://www.sketchup.com/>

Stuart, James, and Nicholas Revett. 1762. The Antiquities of Athens. Vol I. London: John Haberkorn.

Wilford, John. 2016. “A Manhattan Exhibit With Antiquity on the Clock.” The New York Times, October 25.

Wyman, B., Scott Smith, Daniel Meyers, and Michael Godfrey. 2011 “Digital Storytelling in Museums: Observations and Best Practices.” Curator: The Museum Journal 54: 461–68.

About the Authors

Sebastian Heath is Clinical Assistant Professor of Ancient Studies at the Institute for the Study of the Ancient World, New York University. His teaching and research focus on computational approaches to Mediterranean archaeology and material culture as well as Digital Humanities.

Rachel Herschman is Curatorial Assistant at the Institute for the Study of the Ancient World, New York University. Previously, she was Curatorial Assistant for Publications at the Jewish Museum and prior to that, an Educator at the Lower East Side Tenement Museum. She is currently completing her PhD on the history of puppets and puppetry in twentieth-century Germany.

Christine Roughan is a graduate student at the Institute for the Study of the Ancient World, New York University studying the transmission and use of ancient mathematical and scientific texts across cultural boundaries.

Skip to toolbar