Tagged pedagogy

Printed pages, bound with a ring; top page includes a landing spaceship and a bulldog mascot.
2

From Page to Screen and Back Again: Archives-Centered Pedagogy for the 21st Century Writing Classroom

Abstract

This paper describes the efforts of three instructors to incorporate archival research into first-year and advanced undergraduate writing courses. Inspired by recent scholarship on the value of archives-centered pedagogy in rhetoric and composition, we participated in the second cohort of the University of Georgia’s Special Collections Libraries Faculty Teaching Fellowship program, an effort to help faculty learn best practices and methods for using primary source material held in our Special Collections Libraries. In the program we developed courses that ran during Academic Year 2017–18: two First-Year Composition II courses and one upper level writing course, Writing for the World Wide Web. We found that working with archival material in writing courses allowed students to remix, appropriate, and curate the past as they identified new avenues for exploration in the unanswered questions and creative provocations presented by the historical record. In addition, the collaborative and active nature of the archives-based composition process helped build an awareness of the social nature of writing and the material properties of texts that are essential for critical 21st-century literacy.

Introduction

In 2017, we participated in the University of Georgia’s (UGA) Special Collections Libraries Faculty Teaching Fellowship (SCLFTF) with a common goal of using archival collections and research methods to improve student writing. The fellowship offered us access to the expertise of the archivists and the space of the library for our student population in courses that we developed over the course of the program. As Wendy Hayden (2015, 404) has noted, “One challenge to integrating archival research into undergraduate courses has been the lack of practical advice and training in archival research provided by the field.” UGA’s archival Teaching Fellowship  program provided us with crucial training in navigating the collections, working with finding aids, and understanding the “archival and library principles that support robust discovery and integration of relevant special collections materials” (Center for Teaching and Learning, n.d). During Spring 2017 semester, we each developed writing courses that would introduce students—both first-years and upper-level English majors—to archival research.

In this article, we describe the resulting archives-centered courses that we ran during Academic Year 2017–18 and discuss what we see as the most significant implications and opportunities for writing pedagogy that emerged from our experience. More specifically, we focus on the way this work foregrounded the technologies and materialities of texts and the collaborative and social nature of writing activities. In our courses, students, instructors, and librarians worked together to assemble and recontextualize archival materials through varied lenses and to produce new collaborative and multimodal texts that drew on that material in different ways, not necessarily simply as sources to be cited, but as inspirations for new ways of thinking about the past and future. Using archival research also gave our students the opportunity to think in new ways about how library-based material can produce new questions for exploration and how rare books and manuscripts can inform and inspire textual form and delivery systems in the digital age.

A key question for us was, “What does this kind of focus on textual materiality and physical interaction with primary texts bring to the table for writing pedagogy?” We observed that archival work is not, as typically depicted, solitary. As Matthew A. Vetter has noted, instructors who use the archives must collaborate with the librarians and often with outside organizations in charge of the archives as well; as such the authority in the classroom is dispersed throughout a community that is able to include and inspire the students (2014, 36–37). In each of our courses, we, the instructors, could provide some guidance but not prescribed rules for interaction with the archive, nor could we predict the outcomes of the class research.

The instructor generally curates the archive in an undergraduate setting, encouraging the students to work collaboratively with the texts to decode unfamiliar media. In addition, all work must be done at the archive, in reading rooms with strict rules, all of which takes reading out of the private space and into a social one. In her consideration of how to tap into the social affordances of digital media in scholarly publishing, Kathleen Fitzpatrick (2007) reminds us that “the technology of the book, and the literate public with which it interacted, produced a general trend toward individualizing the reader, shifting the predominant mode of reading from a communal reading-aloud to a more isolated, silent mode of consumption.” Classroom archival work shifts the focus back to reading as a communal act, serving as a model for cooperative writing. Fitzpatrick notes that “texts have thus never really operated in isolation from their readers, and readers have never been fully isolated from one another, but different kinds of textual structures have given rise to and interacted within different kinds of communication circuits.” One of these communication circuits is the work the archivist put into developing an archival collection. A well-developed collection has been built with an eye toward how the material is connected. So, by the time the collection is available to the public, the networks between the materials have already been established. Thus, archival work allows for an alternative “communication circuit” between readers and writers—both a return to more traditional (communal) modes and forward movement toward new modes of communication enabled by new media. In addition, by bringing different but related materials together, the archive allows students to see how diverse texts and types of media are in conversation with one another.

Following these textual considerations, we wondered, “How does archives-centered writing pedagogy promote the kinds of collaborative, curatorial, and recombinatory skills that are critical to digital age composition and literacy?” Building on the idea of archives-centered pedagogy as social and networked production and dissemination of knowledge, archival work in the undergraduate writing classroom also engages students in developing what the National Council of Teachers of English defines as 21st century literacies, including collaborative problem-solving, information management, and multimodal textual analysis and production skills. We were also inspired by the London Recut project, which uses digital film archives to allow communities to co-curate and remix archival material based on affinity and interest. As Recut’s Andrew Chitty notes (2011, 418), “Opening up film and video archives for use (not just viewing) by the wider public may create new narratives and interpretation, but it might also create new uses discovered by the users themselves.”

All of our courses were engaged in a kind of “meta-remix” composing process in that we asked students to mash up, combine, and translate primary source materials in a variety of ways, whether through historical reenactments, creation of mini collections/exhibits, or inspiration for digital textual design plans or their own zine compositions. These meta-remixes pressed students to find sources that provoked them to rethink their preconceptions rather than simply finding sources to use as evidence for preconceived arguments. In what follows, we provide individual case studies of our courses and conclude with some final thoughts on the benefits of archival work in writing courses.

Saxton’s ENGL 1102: “Scandal in the Archives” in First-Year Composition II

I was drawn to the archives and the archival Teaching Fellowship because of the ways in which archival materials demand investigative and engaged interaction. Susan Wells (2002, 58) has posited that the archives “prompt us … to resist early resolutions of questions that should not be too quickly answered”; this resistance might take the form of refusing answers, unearthing new depths or expanses for research, or necessitating new forms of expression to encapsulate its contents. My hope was to find materials that might inspire students to dig deeper into their sources to better analyze and contextualize them, but also to become comfortable with more open-ended research.

I coupled the archive’s lack of closure with the similarly open theme of scandal. Scandals, by their nature, offer a sense of mystery; even from the same smattering of facts, the connections between those facts and conclusions from them vary. Scandals disrupt modes of meaning and, as such, are interesting sites to examine rhetorical and contextual meaning. As Adrienne McLean notes, scandals are “discursive constructions as well as events, and it matters who controls the selection and omission of their narrative details” (2001, 2). Moreover, the culture in which the scandal occurs matters; what might be a scandal in 1900 might not elicit a reaction in 2018. In this way, scandal allows for a thorough investigation of who controls the narrative and how it is received; scandals, the students learn, resist fixed facts but instead show the ways in which meaning is constructed.

The archives and the focus on scandal forced my students to grapple directly with this openness but also to rely on their classmates to build a new network of knowledge. For example, the first scandal we investigated followed the archived media flurry surrounding the disappearance of an 18-year-old servant, Elizabeth Canning, in London in January 1753. Despite the hundreds of witness statements, thousands of pages of speculation, and incredibly detailed court documents, there is no authoritative document revealing the truth of what happened to Canning during the 28 days she was missing. Working in teams, students shared responsibility for the hundreds of pages of texts on the event. Yet, even with the accumulation of information, my students noted that their sources required them to read with a critical and active eye to determine what was important. Such analysis was built through collaboration as each group had to work together to create meaning—filling in factual background for their peers but also offering theories of how best to understand the event.

""

Figure 1. Students encounter a carefully preserved edition of Henry Fielding’s treatise supporting Elizabeth Canning as well as Crisp Gascoyne’s defense of Mary Squires. (Image courtesy of Hargrett Rare Book and Manuscript Library/University of Georgia Libraries.)

In addition to researching the scandal, the students were asked to inhabit the texts, taking on the roles of Canning supporters, defenders of the accused Mary Squires, or undecided “jury” members. Borrowing from the Reacting to the Past model, students searched the documents to find evidence and viewpoints that would cast doubt or bolster Canning’s story. Because of the breadth of the archive, group members were forced to collaborate, sharing information and determining a “narrative” of the event or, in the jury’s case, questions about the most puzzling parts of the evidence. This research culminated in a day of gossip as the Canning and Squire supporters attempted to sway the jury. The exercise asked students to take control of the archives and experience the scandal. Ultimately, students reported feeling overwhelmed by the ways archives pushed them to decide what was important in the reading and when their research was “finished” but such ownership of the work also inspired them to more and better research. Likewise, they were able to experience how the Canning scandal spiraled through the act of gossiping. The nature of scandal and the extensiveness of the archive resulted in a break in the pyramid structure of the classroom hierarchy and isolated writing; instead students built a network of information they then accessed in the process of creating new analyses of how the Canning event was reported.

Throughout the semester I repeatedly struggled with how to facilitate student interactions with the physical archive; however, student responses indicated that the physicality of the text was crucial because of its unique ways of provoking questions and revealing gaps in knowledge. Because the 60 total students could not all fit in the archives at the same time and because the archives had more limited access hours, my class used a combination of physical and digital archives, beginning in the special collections and moving into online replications or additions. While the blended method has significant logistical and access benefits, the students preferred their interactions with the hard texts. Looking at the online versions of 1913–1915 newspapers that covered the Leo Frank case, one student complained that the search functions “ruined” the research. The online versions cut out the surrounding articles to show only the searched-for material. The time in the archives, however, had shown the students that not all articles pertaining to the case mentioned Leo Frank but the extensive coverage would often give head-scratching in-depth coverage of a wide range of characters, such as the “Epps boy” who may or may not have seen Mary Phagan on a trolley or the long character pieces on the lawyers involved in the case. The search function, by taking over the investigation, limited the contextual range and sense of discovery the archives provided.

""

Figure 2. Image on left shows a full-page view of The Atlanta Constitution; image on right shows the screen view of a targeted search. The targeted search cut out three related articles. (Image courtesy of Hargrett Rare Book and Manuscript Library/University of Georgia Libraries.)

For each scandal, the students strove not just to understand the archives but also to comprehend the ways in which the archives interact with a larger sense of history and culture. The performative aspects of embodying the Canning case forced students to consider contemporary and historical values. Likewise, the class read and created adaptations to continue these discussions. We read a 1947 novel adaptation of the Canning case—Josephine Tey’s The Franchise Affair—and a 1937 film adaptation of the Frank case: Mervyn LeRoy’s They Won’t Forget. In working with these adaptations, students were able to note how each creator approached the archive; Tey shared an anxiety about young women’s sexuality with the original Squires supporters while LeRoy worried about the impartiality of Southern courts as did the northern journalists covering the Frank case. From these adaptations, the students recognized the importance of perspective and audience and the weight that interpretive power can have on the present. They, too, were asked to perform this curation of the archive—creating their own adaptation of one of the scandals. Throughout the semester, the students were asked to remix or immerse themselves into the scandals; in doing so, they engaged in deeper levels of analysis and application in their writing.

Reeves’s ENGL 1102: “Aliens in the Archives” in First-Year Composition II

My objective was to show students the collaborative and symbiotic nature of writing, how composition begets composition, and encourage students to become not just consumers but also active members of writing communities. To do this, I turned to the Hargrett Rare Book and Manuscript Collection and its store of pulp magazines and apazines. Pulp magazines proliferated in the first half of the 20th century and were made up of genre fiction printed on cheap wood pulp paper. In these circulations science-fiction fan culture started. Like all fan cultures, community was a key component, and in this community, the written word became a means of connection. Fans started out writing letters to the editors, then moved to writing letters to each other based on the published fan letters, and graduated to the creation of apazines. Apazines, or amateur press association magazines, are handmade magazines with parts written by individual members, which are then sent to a predetermined editor, who collates the entries and then mails the completed apazine out to members. Science-fiction apazines became an important way for fans and budding fiction writers to communicate about their favorite authors and pulps, plan fan conventions, and make personal and professional connections. Ultimately, the pulps and magazines offer students the chance to look beyond academia and see how composition has shaped culture and how they might join such conversations.

""

Figure 3. This issue of Super Science Stories, November 1941, is of particular interest to my students as it includes the first story renowned author Ray Bradbury was paid for. (Image courtesy of Hargrett Rare Book and Manuscript Library/University of Georgia Libraries.)

This science fiction fan community and its connections between pulps, apazines, and authors was new territory for my students. As this contextual investigation is not the focus of FYC, I curated my students’ archive visits. Prior to our first visit, I divided students into six groups, with each focusing on a specific pulp writer. When they arrived at the library, the pulps that contained their author’s writing were waiting for them. For this first visit I had them focus on the pulp as an item. They examined the construction, paper and font type, use of color and art, and type and placement of ads. As a group they analyzed what these elements told them about the time period in which the pulp had been published and the intended audience. Such close interaction with the materiality of the text disrupted students’ conceptions of “acceptable” writing communities and forms, providing a clear example of how writing communities create their own ethos and voice.

This wide-ranging first visit was coupled with an in-depth read of a full pulp. The students returned to the reading room on their own and read their pulp from cover to cover in preparation for two short papers: a starred review of the pulp and an analysis of the part their pulp played in building a writing community. Before they began this second paper they were introduced to the libraries’ apazine collection. As Hayden (2015, 421) notes, one way to include the productive pedagogy of the archive in first year composition courses is through “smaller-scale projects … [involving] primary research or work with particular documents or collections.” As with the first visit, I curated their interaction with the apazines, so they would be looking at issues that had connections to their pulp. Both the apazine and the pulp collections have thousands of entries and no guiding information. While the possibility of not finding what you are searching for is an important part of archive learning, the goal of this class is to improve student writing through the archives—being able to navigate the archives is secondary. To do otherwise at this level and with these time constraints would result in students’ frustration, failure, and resentment toward the archives and composition.

After the short papers were completed, students made two collaborative apazines and engaged directly in the communal process observed in the archives. The first apazine was made up of responses to archive resources. As a class, students drafted the rules of their apazine (i.e., entries can’t be over 500 words; Courier font only; graphics required), designed cover art, and voted on a title. Each student then revised one of their earlier papers, which became their apazine contribution. On the due date, each student brought 22 copies of their entry to class, which were then collated, and each student received a hard copy of the class apazine. The rest of class period was then spent in reading and conversation about the apazine. The second apazine was composed of responses to and interactions with their peers’ apazine writing. A student might write a response to a review of a story they hated but their peer loved, express admiration for a well-analyzed connection, or build on the research started by a peer. Each student entry had to be in conversation with an entry from the first apazine. In this way students were not just consumers of archival material but were producing writing that will itself be archived—at the end of semester, the apazines were donated to the University of Georgia’s Lamar Dodd Art Library. By making their own network of connected writing, students were able to experience the social nature of writing and produce a new archive of zine art.

Printed pages, bound with a ring; top page includes a landing spaceship and a bulldog mascot.

Figure 4. Finished class apazine. The title, “Dawn of the Dawgs,” is an amalgamation of science fiction and University of Georgia culture.

Davis’s ENGL 4832W: “Rare Books and Book Technology” in Writing for the World Wide Web

The relevance of archival research for many of the upper-level writing courses I teach was clear from the start of my time as an archival Teaching Fellow, but the course that I ultimately structured around a major archival research component was Writing for the World Wide Web. Writing for the web is not simply about content creation. I have to prepare students for a future in which machines join us as readers and writers in networks, engaging in processes of pattern recognition. Writing for the Web has to focus not just on content production but also on how to work with and against algorithms, software, data, and metadata, as well as helping digital media authors understand themselves as participants in a network of distributed cognition.

The Hargrett Rare Book and Manuscript Collection presented a wealth of material that would intersect nicely with one of our texts, Naomi Baron’s Words Onscreen: The Fate of Reading in a Digital World. My goal was to foreground the problem of writing for online readers—readers who, as Baron’s research indicates, aren’t so much reading as scanning, skimming, and clicking quickly away to the newest, the now-est, the next. I focused on this problem of “not-reading” (or, in web lingo, TL;DR) in this course as the major design problem for writers in the digital age to solve, a problem that will, if we do not think carefully and critically about how to foster effective reading onscreen, have significant consequences for literacy and knowledge. In past semesters, I have drawn extensively on Murray’s conception of the “Four Affordances” of digital media to foster a design thinking approach to digital textual composition. In this course, I put Murray and Baron’s ideas into conversation with the history of the book as a material object in hopes of creating productive thinking about digital textual design. In addition to Baron’s text, I included Nicole Howard’s The Book: The Life Story of a Technology, in order to provide students with an accessible history of the book and to emphasize the connection between technologies of reading and writing. This combination provided the framework for an examination of the examples of book technology and its evolution contained within UGA’s Hargrett Rare Book and Manuscript Collection. Essentially, the course would foreground the way technologies enable particular kinds of textual production which, in turn, produce particular kinds of reading and writing practices—practices that ultimately have wide-ranging cultural effects.

I developed a design project that asked students to use rare books from the collection as inspiration for an innovative digital textual design concept. The Hargrett holds a wide range of texts—everything from early print incunabula to conceptual artists’ books—that would require them to reconsider their understanding of what a book is, as well as the kind of literacy practices that different types of texts cultivate. The project involved several components including a depiction of the text’s design (visuals, description/explanation, written manuscript of text); an analysis of how the design plan remediated features of the inspiration text and drew on digital media affordances; and a critical reflection on their design process. Additionally, we needed to connect the dots between the inspiration texts from the archive. To achieve that aim, we created a digital exhibit using Omeka, not only because it allowed us to create a public-facing product, but also because it introduced students to metadata, both conceptually and practically. Collectively “curating” and framing an exhibit of the archival material and working with the common vocabulary of Dublin Core Metadata standards would give us a final collaborative project to present to the Special Collections Library faculty as well as other interested faculty members and students.

My own work as an instructor consisted largely of facilitation and research: I searched the archives, in consultation with a Hargrett librarian, for an initial collection of material that would represent a range of rare book items. On our first visit to the library, I gave each student an item to review along with a worksheet that asked them to consider several questions about the material aspects of the book they were examining and how it fostered or constrained different kinds of reading practices.

""

Figure 5. The prompt worksheet for Spring 2018 Writing for the Web students’ first visit to the Special Collections Library, asking them to explore and consider material properties and reading practices as they examine rare book items from the Hargrett Collection.

For our second visit, I asked students to tell me the kinds of texts they found most interesting from our first visit and, additionally, to provide an initial idea for their project that would help guide our archivist and me in curating a second collection of material for another round of hands-on exploration. We provided students with a tutorial on how to search the Hargrett collection themselves so that they could request additional material for viewing on their own. We also visited the Digital Arts Library Project, a collection of “legacy computers and video game systems as well as a collection of electronic literature pieces, digital interactive narrative pieces, and video games” (Digital Humanities, n.d.), and a copy of Raymond Queneau’s (1961) Cent mille milliards de poemes, a print precursor of digital media’s procedural affordance. Eventually, each student found a rare book (or two) that served as the primary inspiration for their design concept and they were each responsible for entering the information about the book (along with their own images taken during their time with the book at the library) into the Omeka site I set up at my web domain (having given each of them contributor access). For that exhibit, I also worked with the students to develop a conceptual frame for the project that would ground the exhibit in the concepts and scholarship that we were working with throughout the semester and, on the last day of class, we presented our work to an audience of interested colleagues. The event gave students a chance to engage in dialogue about their ideas and design process.

Title reads 'Translating, Transitioning, Transcending: Rebinding the book for digital reading.'

Figure 6. The collaboratively-produced promotional flyer for Writing for the Web’s end-of-semester exhibit of the design concepts inspired by rare book material.

Discussion

Our experiences suggest that archival work in the writing classroom facilitates greater interaction between the material properties of written texts and the students, while fostering collaborative curation. These collaborations add to or create new collections that are, in a sense, adaptations of the original archives. Reframing archival material in these ways makes new connections or linkages between seemingly disparate materials and reinforces the social and networked nature of knowledge production and a re-conception of how to use source material for remixing and remaking.

While our courses took us in diverse directions in terms of archival material and foci, the materiality of the archival texts played a large role early on for all of us. Pulps are characterized by colorful, larger-than-life covers that demand attention, as do the daring conceptual artists’ books and texts produced during the early days of printing press technology. These texts forced the students to reconsider how materiality affects reading practices. More eye-catching in a different way, the postcard that depicted Leo Frank’s lynching put students in physical contact with brutal history. This type of active learning pushes students outside their comfort zone and puts them in situations that require them to consider class content and apply that thinking toward course goals and their lives. Students began to see themselves as “scholar adventurers blowing dust off documents that could contain mysteries, answers, or maps of the past” (Norcia 2008, 107). It’s clear this technique relies heavily on critical and analytical thinking, which in turn improves and fosters strong writing skills (Bernstein and Greenhoot 2014; Gingerich et al. 2014). Perhaps even more important, it exposes students to a whole new world of composition. The inclusion of apazines, letters, and art projects in the archives showed students the legitimacy and value of such unconventional writing.

As each class progressed, students used the skills gained from archival research to recalibrate and restructure composition. Working with a physical text, as Kara Poe Alexander (2013) found when she incorporated scrapbooking into her first-year writing course, teaches “students the concept of affordance and demonstrates to them how materiality impacts design, composition, and rhetorical choices; it also provides a low-key, low-stakes entry into multimodal composing and reflexivity on the rhetorical decision making process.” A material example of the mingling of words and art/bookcraft gave students the tools they needed to compose their own multimodal projects and move from the page to the screen, without losing what made the original art projects unique. While Reeves’s students took advantage of the do-it-yourself nature of zines to produce their own, Davis’s students were unable to actually produce the digital texts they designed, lacking the advanced programming and coding skills necessary to bring those conceptual plans to life. This foregrounds again the social and collaborative nature of digital textual composition in which skilled programmers and visual artists might be required to actually produce an interactive digital text, just as a community of specialized craftsmen was needed to produce early print texts.

Ultimately, through both research and writing, the insistence on a more open, flexible network of knowledge remained key. This is perhaps best illustrated through one of the texts that several students in Writing for the Web found particularly compelling—a copy of Queneau’s (1961) Cent mille milliards de poemes. This mid-twentieth century precursor to the digital hypertext demonstrated the way that a single text can be remixed and reconfigured to provide an interactive experience for readers. That concept of interactivity became a key goal for Davis’s students’ design projects as they discussed the ways that the rare book material from the archives provoked a sense of pleasure in discovery and exploration. Janet Murray identifies this kind of pleasure in the text as an effect of careful design in her definition of the Procedural Affordance of digital media: “Procedurality and participation are the affordances that create interactivity and visible procedurality combined with transparent participation creates the experience of agency for the interactor, a key design goal for any digital artifact” (n.d.). In each of our classes, the experience of working with archival materials provided an experience not unlike that of “reading” Queneau’s text in which the ability to recombine and reconfigure the sonnets results in a sense of endless possibility for construction and reconstruction of meaning.

In her argument for “textual curation” as a unique “category of compositional craft,” Krista Kennedy cites Johndan Johnson-Eilola’s (2005, 134) contention that “Creativity is no longer the production of original texts, but the ability to gather, filter, rearrange, and construct new texts” (quoted in Kennedy 2016, 176). As in the Pop-Up Archives Project Jenny Rice and Jeff Rice facilitated at the University of Kentucky, our students curated experiences of archival material whose goals were “neither preservation nor a totalizing narrative” (2015, 247), but recontextualizations that, as in the conception of curation in the art world, put forward new arguments. Thoughtful curation requires immersion into larger conversations about issues and discernment about what is relevant and important in order to generate further discussion by “customiz[ing] archives toward their own ends” (Enoch and VanHaitsma 2015, 221). This year our students created their own handmade apazines, designed concepts for interactive digital texts, and performed reenactments of historical scandals. In each instance, they were asked to use historical materials throughout the compositional process, from the starting point of invention, all the way to the delivery of their ideas through curated performance, exhibits, and portfolios that present new understanding or expose new lines of inquiry.

We have come to consider archives-centered writing instruction as a pedagogy of remix, curation, and appropriation in which students are faced with a set of materials that may be vast and yet incomplete—an archive filled with gaps and unanswered questions that, like Queneau’s sonnets, can overwhelm with a sense of infinite possibility and insistent lack of closure. As scholars of digital culture have long insisted, remix is the foundation of knowledge construction and creative production. We each asked our students to discover ideas and compose new texts through a communal process of appropriation and reconfiguration that resulted in an awareness of what Neal Lerner (2010) has framed as the incompleteness of histories (203) and in, we hope, a reconsideration of what writing and textual form mean in the 21st century digital age. For student writers, exploring a variety of historical texts can decenter their conception of what constitutes writing or textual form, as Wells (2002) notes when she claims that “[a]rchival study of other kinds of texts also broadens our own sense of how difficult it is to write in new and untried ways” (59–60). That awareness is critical as we continue to chart the waters of digital writing at this particular technological moment. Digging into the past, we find in the archive a pedagogy well-suited to the future of writing.

Bibliography

Alexander, Kara Poe. 2013. “Material Affordances: The Potential of Scrapbooks in the Composition Classroom.” Composition Forum27 (Spring). http://compositionforum.com/issue/27/material-affordances.php.

Bernstein, Daniel, and Andrea Follmer Greenhoot. 2014. “Team-Designed Improvement of Writing and Critical Thinking in Large Undergraduate Courses.” Teaching & Learning Inquiry 2 (1): 39–61. https://doi.org/10.2979/teachlearninqu.2.1.39.

Center for Teaching and Learning. The University of Georgia. n.d. “Faculty Services & Programs: Special Collections Libraries Faculty Teaching Fellows.” Accessed June 15, 2018. http://ctl.uga.edu/pages/special-collections-libraries-faculty-fellows-program

Chitty, Andrew. 2011. “London Re-cut: Reclaiming History through the Co-curated Remixing of Film.” Curator: The Museum Journal 54, no. 4 (October): 413–418.

Digital Humanities, The University of Georgia. n.d. “Projects.” DIGI: The Digital Humanities Initiative of the Willson Center and UGA Libraries, accessed June 13, 2018. https://digi.uga.edu/projects/.

Enoch, Jessica, and Pamela VanHaitsma. 2015. “Archival Literacy: Reading the Rhetoric of Digital Archives in the Undergraduate Classroom.” College Composition and Communication 67, no. 2 (December): 216–242.

Fitzpatrick, Kathleen. 2007. “Commentpress: New (social) Structures for New (networked) Texts.” Journal of Electronic Publishing 10, no. 3. https://doi.org/10.3998/3336451.0010.305.

Gingerich, Karla J., Julie M. Bugg, Sue R. Doe, Christopher A. Rowland, Tracy L. Richards, Sara Anne Tompkins, and Mark A. McDaniel. 2014. “Active Processing via Write-to-Learn Assignments: Learning and Retention Benefits in Introductory Psychology.” Teaching of Psychology 41 (4): 303–308. https://doi.org/10.1177/0098628314549701.

Hayden, Wendy. 2015. “‘Gifts of the Archives: A Pedagogy for Undergraduate Research.” College Composition and Communication 66, no. 3 (February): 402–426.

Johnson-Eilola, Johndan. 2005. Datacloud. Cresskill, NJ: Hampton Press.

Kennedy, Krista. 2016. “Textual Curation.” Computers and Composition, 40 (June): 175–189. https://doi.org/10.1016/j.compcom.2016.03.005.

Lerner, Neal. 2009. “Archival Research as a Social Process.” In Working in the Archives: Practical Research Methods for Rhetoric and Composition, edited by Alexis E. Ramsey, Wendy B. Sharer, Barbara L’Eplattenier, & Lisa S. Mastrangelo, 195–205. Carbondale, IL: Southern Illinois University Press.

McLean, Adrienne. 2001. “Introduction.” In Headline Hollywood: A Century of Film Scandal, edited by Adrienne L. McLean and David A. Cook, 1–25. New Brunswick, NJ: Rutgers University Press.

Murray, Janet. n.d. “Glossary.” Janet H. Murray, accessed June 13, 2018. https://inventingthemedium.com/glossary/.

National Council of Teachers of English. 2013. “Definition of 21st Century Literacies.” Updated February 28, 2013. NCTE, accessed October 5, 2018. http://www2.ncte.org/statement/21stcentdefinition/

Norcia, Megan A. 2008. “Out of the Ivory Tower Endlessly Rocking: Collaborating across Disciplines and Professions to Promote Student Learning in the Digital Archive.” Pedagogy 8 (1): 91–114.

Queneau, Raymond. 1961. Cent mille milliards de poèmes. Paris, France: Gallimard.

Rice, Jenny and Jeff Rice. 2015. “Pop-Up Archives.” In Rhetoric and the Digital Humanities, edited by Jim Ridolfo and William Hart-Davidson, 245–254. Chicago: The University of Chicago Press.

Vetter, Matthew A. 2014. “Archive 2.0: What Composition Students and Academic Libraries Can Gain from Digital-Collaborative Pedagogies.” Composition Studies 42 (1): 35–53.

Wells, Susan. 2002. “Claiming the Archive for Rhetoric and Composition.” In Rhetoric and Composition as Intellectual Work, edited by Gary A. Olson, 55–64. Carbondale, IL: Southern Illinois University Press.

About the Authors

Elizabeth Davis is the Coordinator of the Interdisciplinary Writing Certificate Program at the University of Georgia. In her teaching and research, she focuses on experiential learning in the writing classroom, digital rhetoric and storytelling, and ePortfolio pedagogy and assessment.

Nancee Reeves is a lecturer at the University of Georgia, where she teach literature and writing. Her research interests include science-fiction and how it shapes and is shaped by social policies.

Teresa Saxton is a lecturer at the University of Dayton, where she teaches classes on writing and eighteenth-century literature. Her current pedagogical projects are interested in bringing together the archives, public writing and advocacy.

Student writing prompt that reads: "Our past, undoubtedly, influences our future. Looking back at your past, was there any experience (physically, emotionally, mentally) that greatly impacted the kind of student you are today? What was the nature of this experience; was it bad, good, embarrassing, etc.? Try your best to reconstruct that experience. If proven to be difficult, use your imagination and develop an idea similar to that experience - draw from that idea, and construct an essay around that thought. Paint a map for your readers, who will also be witnessing this journey with you."
0

“Diving Into the Wreck”: (Re)Creating the Archive in the First Year Writing Classroom

Abstract

“I came to explore the wreck,” Adrienne Rich begins in her poem “Diving into the Wreck,” and tumbles to the depths of her questions about efficacy—of speaking, of writing, and of teaching—during a time when students activists shut down campuses across the country, striking for anti-racist education policies from curriculum design to admissions. With a desire to connect our students at Brooklyn and Queens College with the history of student activism at CUNY, we developed a semester long peer-peer writing exchange to take place between our composition classes where our students developed and exchanged writing prompts inspired by Rich’s archival teaching material. By having our students document and record the unfolding of their written exchange, we argue that this type of collaborative project offers a new way of conceiving how participants in a classroom can build, envision, and record new ways of learning. As every classroom leaves behind an archive of writing, notes, and lesson plans, we ask, what do we do with the written materials we and our students leave behind, the materials that signal the embodied work of building a space of learning? How can the work that students leave behind inspire and enact its own unique pedagogy? This paper will present the unfolding of our students’ writing exchange, ultimately demonstrating that the archive of materials left behind by Rich and our own project can further inspire students and instructors to question what is possible while living and working in the ever-shifting space of the writing classroom.

I came to explore the wreck.

The words are purposes.

The words are maps.

I came to see the damage that was done

and the treasures that prevail.

-Adrienne Rich, “Diving Into the Wreck”(2013, 22)

Student writing prompt that reads: "Our past, undoubtedly, influences our future. Looking back at your past, was there any experience (physically, emotionally, mentally) that greatly impacted the kind of student you are today? What was the nature of this experience; was it bad, good, embarrassing, etc.? Try your best to reconstruct that experience. If proven to be difficult, use your imagination and develop an idea similar to that experience - draw from that idea, and construct an essay around that thought. Paint a map for your readers, who will also be witnessing this journey with you."

Figure 1. The image above shows a writing prompt created by a first year writing student at CUNY for the intra-classroom writing exchange between Brooklyn and Queens College.

“I came to explore the wreck,” Adrienne Rich begins her poem, and tumbles to the depths of her questions about efficacy—of speaking, writing, and teaching—during a time when student activists shut down campuses across the country, striking for antiracist education policies from curriculum design to admissions. When, as instructors of writing at Queens College and Brooklyn College, CUNY, we realized that we’d independently assigned our first-year writing classrooms selections from Rich’s recently published archive of teaching materials, we knew that beyond reading and analyzing her writing exercises, syllabi, or notes, our students would need to produce an archive of teaching materials of their own. We wondered, what could the process of recording and collecting their own work teach our students about the archive itself?

Designed as a collaboration between our students, ourselves, and Adrienne Rich’s teaching materials from Basic Writing at City College, we created an intra-classroom writing exchange in Spring 2018 which drew on the recent publication, ‘What We Are Part Of’: Teaching at CUNY: 1968-1974, (Parts I & II), published by Lost & Found: the CUNY Poetics Document Initiative in 2013. The project involved a total of forty-nine students, twenty-five at Queens and twenty-four at Brooklyn; half of the twenty-four Brooklyn College students were in CUNY’s SEEK (Search For Education, Elevation, and Knowledge) Program. Working simultaneously with other primary documents circulating during Adrienne Rich’s time at CUNY, our classes used digital file-sharing technology to eventually create an archive of their own writings. While discussing that no archive is ever complete–that any written record is a reconstruction of a lived context–we approached the archive as an evolving and contingent pedagogical map. Adrienne Rich’s poem “Diving Into the Wreck” was an important locus for this conversation because of the ways we were able to evoke the poem in the classroom as a living archive in a critically contingent digital space such as PennSound. Both classes listened to audio recordings hosted on UPenn’s poetry archive, giving students the chance to hear a recording of Adrienne Rich reading “Diving into the Wreck” at Stanford in the 1970s. The resonance of the poem’s themes in our own classrooms emphasized how the archive is kept alive and determined by the spaces in which it is contained. Ultimately, this allowed students to envision themselves as doing the work of both institutional critique and self archiving.

Tracing the Archive through CUNY’s History of Teacher & Student Activism

Lost & Found: the CUNY Poetics Document Initiative, published by the Center for the Humanities at The Graduate Center, CUNY, publishes “extra-poetic” material such as correspondence, journals, notes, transcriptions of letters and syllabi and pedagogical residue related to New American Poetry. Lost & Found “finds” the archive in sites which concretely include personal and institutional collections, raw materials gathered by editors, in interviews with living writers and selections from their material records, documents which circulate among poets, scholars, educators and fans, and in recirculated volumes which find their homes in collections, in libraries and in the classroom. More abstractly, the project locates the archive in person-to-person contact, verbal and non-quantifiable exchange, affective registers and especially in friendship.

The extent to which the classroom and the archive are considered together in the Lost & Found project cannot be understated. The publication collects pedagogical materials from a generation of poet educators teaching at CUNY in the 1960s and ‘70s. The Center for Humanities curates suggested groupings on their website for contemporary educators engaged in the building of syllabi for courses across CUNY and beyond with themed collections such as “Feminist Practice and Writing”; “Teaching Pedagogies/Methodologies”; “Resistance”; “Friendship and Politics”; “Radical Poetics”; “Queer Poetics,” and more.

Series IV’s “What We Are Part Of”: Teaching at CUNY: 1968-1974, Adrienne Rich (Parts I & II), collects the material traces of poet Adrienne Rich’s teachings at City College, and the series’ pedagogical focus continues with Series VII’s publication of investigations into other CUNY poets and educators: June Jordan: ‘Life Studies,’ 1966-1976, Audre Lorde: I teach myself in outline, Notes, Journals, Syllabi, & an Excerpt from Deotha, and Toni Cade Bambara: “Realizing the Dream of a Black University” & Other Writings (Parts I & II).

In the volume we introduced to our CUNY classrooms, we discussed how the notes, syllabi, and writing assignments created by Adrienne Rich exist not only as a record of poetic inquiry and pedagogical theory that Rich engaged with while teaching at City College, but also as a testament to the relationships formed through Rich’s commitment to deploying the “classroom” as a performative space in which writing, protest, and embodied action intersected. In designing an assignment sequence of our own, we noted the contingency inherent to the notion of the “classroom” for Rich: with classes closed frequently during the period due to student strikes and institutional flux, letters exchanged in the mail and individual meetings off-campus became the learning environments for Rich’s composition students.

(Dis)Locating the Classroom

The ontological designation that comes with naming helps us understand that Rich often called the classroom into being through an act of naming alone: to declare an exchange a “classroom” makes it so, whether in a basement cafeteria or by way of the U.S. Postal Service. In fact, where Rich locates the classroom is as important as how and where she dislocates it, for to her the classroom is also “cell–unit–enclosed & enclosing space in which teacher & students are alone together / Can be a prison cell / commune / trap / junction–place of coming-together / torture chamber”(Rich 2013, vol. 1, 15). In our own writing exchange, the use of file-sharing technology facilitated the exchange of student writing outside and between our two classrooms. Each classroom was able to create a folder of student work in Dropbox that functioned as an online dossier. So while our classrooms were separated across two different physical campuses, our students’ works were collected in this temporary digital classroom.

Printout: Notes, Statements, & Memos on SEEK 1969–1972. Introductory: What we are a part of. Classroom as cell—unit—enclosed & enclosing space in which teacher & students are alone together. Can be prison cell, commune, trap, junction—place of coming-together, torture chamber. But also part of much bigger nationwide cultural revolution: "Compensatory" education increasingly important aspect of "higher" education. a) movement for social change—break down false barriers of class & color to make all education truly open to all people who want it. b) movement for educational reform—such programs are surely going to effect changes in nature of teaching at all levels. c) At present, we are involved in THE key area of university teaching new territory—few if any proven "methods". Many inherited prejudices & rigidities stand in our way. a) in the educational hierarchy which has a vested interest in old methods. b) in students who have been taught that the classroom is something apart from "life" except that it will eventually either help you or prevent you from getting paycheck—are unaccustomed to relating classroom experience to larger whole.

Figure 2. Image from Adrienne Rich, “What We are Part Of”: Teaching at CUNY: 1968-1974 ed. Iemanjá Brown, Stefania Heim, erica kaufman, Kristin Moriah, Conor Tomás Reed, Talia Shalev and Wendy Tronrud, (Lost & Found: The CUNY Poetics Document Initiative Series IV, 2013), 15.

In a memo on SEEK from 1969 or 1970 (exact date unknown), Rich goes on to suggest that the classroom is “also part of much bigger nationwide cultural revolution,” elaborated as such

a. movement for social change–break down false barriers of class & color to
make all education truly open to all people who want it b. movement for educational reform–such programs are surely going to effect changes in nature of teaching at all levels […]. (Rich 2013, vol. 1, 15).

To locate the classroom in the exchange between teacher and student and simultaneously in the nationwide cultural revolution is to bring politics to the classroom and the classroom to the world. Rich knew that to teach in the classroom was to engage the world from close proximity, a paradox because such engagement allowed her to tap into much more far-reaching social and political engagements than she’d found through poetry alone.

CUNY Students and the Archive

Focusing on Rich’s Writing Exercises, the first written component of the assignment sequence asked students to respond to a “Dream Course” exercise in which Rich prompted her students with the following:

Writing exercises drawn from various classes 1969–1974: "Write a description of a course you would like to take some day—on any subject, or covering any kind of material. Talk about how you feel this material could best be taught, and what you would hope to be doing in the course. (It might be film-making, writing, history, some technical skill, contemporary issues, art, etc.) Talk about how you'd like this course to be run, under what conditions you would most enjoy and profit from it—how much classroom time how much reading and writing, how much individual work with a teacher, field trips, etc. If you know books you would like to be reading in such a course, name them, telling why you chose them. Also tell why this particular course would seem valuable to you, what you hope to gain from it for your life."

Figure 3. Image from Adrienne Rich, “What We are Part Of”: Teaching at CUNY: 1968-1974 ed. Iemanjá Brown, Stefania Heim, erica kaufman, Kristin Moriah, Conor Tomás Reed, Talia Shalev, and Wendy Tronrud, (Lost & Found: The CUNY Poetics Document Initiative Series IV, 2013), 7–8.

This first part of the assignment sequence asks students to put themselves in Rich’s classroom and imagine how the stakes of writing changed when the campus was transformed by protests. Our students were asked to read the “5 Demands” distributed in 1969 by a group of Black and Puerto Rican students at City College asking for equal representation and anti-racist admissions processes, as well as flyers, pamphlets, and notes that circulated across CUNY. Some of these materials can be found in the CUNY Digital History Archive, an online archive that collects digitized materials from CUNY’s history beginning in 1847 with the creation of the Free Academy in New York City and continuing to the present moment. To help students conceptualize their relationship to wider CUNY history, the CDHA offers a rich entry into the history of CUNY’s infrastructure, policies, and impact as a public institution, a history that implicates each student and determines their experience of education in the present. For instance, in order to access the “5 Demands,” students had to locate a link titled the “Creation of CUNY–Open Admissions Struggle” from a longer timeline, which ushered them to a page presenting wider archival materials from the late 1960s (oral histories, articles from student newspapers, and faculty memos). The CDHA’s Project History, which we also explored in the classroom setting, emphasizes that the CHDA emerged out of “gaps in the knowledge of CUNY faculty, students, staff, and alumni about that history,” a mission that resonated with our class’ focus on the archive as a means of generating engagement in the present with activism in the past.

Typewritten list of demands and justifications. Demand 1: A School of Black and Puerto Rican Studies. Demand 2: A Freshman Orientation for Black and Puerto Rican Students. Demand 3: That the SEEK Students have a Determining Voice in the Setting of Guidelines for the SEEK Program, Including the Hiring and Firing of SEEK Personnel. Demand 4: That the Racial Composition of the Entering Freshman Class be Racially Reflective of the High School Population.

 

Typewritten list of demands and justifications, continued. Demand 5: That All Education Majors be Required to take Black and Puerto Rican History and the Spanish Language. Followed by a summary of the events of the April 1969 City College occupation.

Figure 4. Unknown, “Five Demands,” CUNY Digital History Archive, accessed September 26, 2018, http://cdha.cuny.edu/items/show/6952.

The next component of the assignment sequence had students compose their own writing prompts to be exchanged through the same Dropbox folder with a student at a different campus. Giving students the option to use the Dream Course they designed as inspiration for their exercise, we randomly assigned partners to students at Queens and Brooklyn Colleges. Two weeks later, after our students received their completed assignments, each class discussed their initial reactions to their partners’ responses and to the assignment sequence more broadly. Finally, our students reflected on their experience on their own and turned in a portfolio of the whole exchange, including a final reflection essay.

Documenting the Present

The exchange took place in a dialogic space in which students used their own assignment to deepen their understanding of Adrienne Rich’s pedagogy as emerging out of a moment when students were calling their education into question. After discussing the “5 Demands,” current Brooklyn and Queens students prompted their partners to speak about contemporary debates including discussions around tuition-free higher education. One student wrote to his partner:

Writing Prompt: "The topic of tuition, free tuition, how high or low tuition should be, is constantly being discussed by students, professors, institutions, as well as law makers, and politicians. For this assignment you are asked to give your take on this debate. What do you believe you should be paying for a degree? Should students who cannot afford College be forced into taking out loans that will take them years to pay off? Be sure to not only discuss your opinion but why this will be most beneficial for everyone."

Figure 5. The above image shows a student prompt created for the writing exchange.

In asking each other to use writing as means of interrogating the wider education system in their current moment, these students performed—and, in turn, affirmed—continuities between the historical conditions of Rich’s archive and the present moment. Linking student activism in the late 1960s to debates around Free Tuition at CUNY in early 2018, another student used the assignment to prompt questions about education and access:

Writing Prompt: "Write a 1-2 page response, size 12 Times New Roman, double spaced. Describe what would your life be like if you did not have a college education and in what ways would it affect your life as it is now. Explain and give examples on how your attitude towards education would be and how would you view people who do not have the privilege to have an education."

Figure 6. The above image shows a student prompt created for the writing exchange.

Adrienne Rich’s Writing Exercises are opportunities for “reflection and action,” each assignment prompting students to tease out a “relationship to his [her/their] world, to his identity, to his sense of time and space, his trust in and suspicion of others, his ways of identifying others” (Rich 2013, vol. 1, 30) By  designing their own writing prompts and then documenting the unfolding of an epistolary exchange, students came to a new way of conceiving of how participants in a classroom can build, envision, and also leave a record of the work that can move beyond the space and time of a single classroom.

Remarking on the experience of working with partners they have never met in person, a student at Brooklyn College observed that the structure of the assignment performs the process of community building and activism: “[The exchange] could be seen as a performance from Adrienne Rich’s notes on teaching…it could resemble the strike from the 70s and us having to always engage even with students we have not interacted with.” During the university-wide strike, solidarity meant connecting students from different CUNY institutions through a circulation of flyers, memos, and other written material; community was created through shared embodied demonstrations and exchanges across CUNY’s disparate campuses. As this student points out, this project forged connections between students from Queens and Brooklyn, which helped students feel embedded in CUNY, a public university comprised of twenty-five campuses across New York City’s five boroughs. Now as the complexity of our students’ exchange is embodied in—and reduced to—a folder of written documents, our students experienced how the archive is always incomplete in so far as it is only a fragment of a dynamic and living context; furthermore, the archive is always changing as it is part of an ongoing dialogue between the moment of its creation and the work it inspires today.

Next Steps

When we envision future iterations of this assignment, we realize we as instructors need to account for how the habits and codes we used to relate to students influenced the structure of the exchange. As one student suggests, allowing students to contact each other on their own terms—rather than through the instructors—would emphasize the importance of writing for one another rather than depending on the instructors’ authority. Beyond putting students in direct contact with one another in both public and private platforms for exchange, we conceptualize a means of engaging a wider public by collaborating more directly with existing digital platforms such as Lost & Found, CDHA, and PennSound. Since these public archives served as key pedagogical material and framing devices for students, we envision the next steps of this project as not just engaging with but contributing to their form and content. Projects that allow students to engage with the historical record through a practice of self-archiving challenge us to restructure existing hierarchies and rethink where and how learning takes place. By envisioning a type of study rooted in investigating and enacting the process of building an archive, this project produces an immaterial space within the university where students shift the power and become the interlocutors for each other.

It is in this not-yet-mediated space of connectivity and exchange that we were able to honor and continue the work of CUNY’s student-activists; it is here that we can build new archives of learning in and beyond the classroom, to “reexamine all that we’ve been doing, try untested things, put ourselves on the line, be willing to take risks” (Rich 2013, vol. 1, 16).

Bibliography

Rich, Adrienne. 1973. Diving into the Wreck: Poems, 1971–1972. 1st ed. New York: Norton.

Rich, Adrienne. 2013. “What We Are Part Of.” In Teaching at CUNY: 1968-1974, vol. 1–2, ed. Iemanja Brown et al. New York: Lost and Found.

Lost & Found. n.d. “About Lost & Found.” Accessed June 15, 2018. https://www.centerforthehumanities.org/lost-and-found/about-lost-and-found.

About the Authors

Marguerite Daisy Atterbury is a writer and doctoral student at The Graduate Center, CUNY. Her research centers on 20/21st C. poetry with an interest in gender, race and coloniality. She is the co-director of NM Poetics, an annual summer program founded in 2010 to support conversation around aesthetics and politics in northern New Mexico. Her work engages audiences through various media including film, installation and performance as well as more traditional outlets of production and publication. She received her MFA from the Milton Avery School of the Arts at Bard College.

Maxine Krenzel is a doctoral student in English at CUNY’s Graduate Center. Her research interests are in composition-rhetoric theory, focusing on the history and pedagogy of first year writing programs, as well as feminist theory and autobiography. She teaches writing, literature, and ESL courses at Brooklyn College.

Sample concept map of ‘junk food’ and its related issues, complete with details and examples of each.
2

Advancing Information Literacy in a Semester-Long Library Instruction Course: A Case Study

Abstract

The following case study investigated the efficacy of Information Literacy (IL) pedagogy on undergraduate research in a credit-bearing library instruction class. More specifically, the study analyzed student success and sought to determine whether written reflection and practice strengthen IL skills, including the fundamental ability to develop a research question and thesis statement. Developing research questions and formulating thesis statements are among the most challenging duties of a young researcher. From high school through undergraduate, students often have minimal experience conducting research. They may not know where to begin the research process and what steps are necessary. Student frustration is exacerbated by the fact that typically IL instruction is one-shot guidance, given only once in a semester, making it difficult for a librarian to cover all that is needed. Can a semester long, credit-bearing course aid student success in research and improve IL skills? The instructors introduced several techniques to improve IL skills, and instructors evaluated three class assignments based on their college’s core competencies. Additionally, instructors collected and analyzed students’ written reflections of their progress and an end of semester survey as both qualitative and quantitative data.

Introduction

Information Literacy (IL) is one of the defining concepts of academic librarianship. It influences core functions including reference, collection development and especially library instruction. However, the definition of IL is malleable and influenced by the proliferation of online resources, developments in information technology, and trends in academic publishing, all of which have dramatically altered research methods. In January 2016, the Association of College and Research Libraries (ACRL), a division of the American Library Association (ALA), adopted the Framework for Information Literacy (Framework) for Higher Education. Its six core concepts afford librarians maximum flexibility when teaching IL (American Library Association 2015). This adoption was shortly followed by ACRL rescinding the Information Literacy Competency Standards for Higher Education (American Library Association 2000), which had served as the defining IL document for professional librarianship since 2000. The ACRL Framework defines IL as, “the set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued, and the use of information in creating new knowledge and participating ethically in communities of learning.” Moreover, the framework is based on interconnected core concepts with flexible options for implementation, rather than a set of prescriptive standards or learning outcomes.

The Library Media Resources Center (hereafter Library) at LaGuardia Community College, part of the City University of New York (CUNY) founded in 1971, maintains an active and evolving IL program that impacts reference services, library instruction, and credit-bearing courses. The latter is exemplified by LRC103: Internet Research Strategies, a one-credit, liberal arts elective offered by the Library; it has been offered since 2004, and IL is central to the course’s syllabus (Keyes and Namei 2010, 29). The course teaches students “analytical thinking, problem-solving, and information literacy skills necessary for academic research and digital citizenship” (LaGuardia Community College Catalog 2017-2018). Students receive one hour of face-to-face instruction each week, covering concepts (concept mapping, research question development, citation) and resources (subscription databases, digital images, digitized primary sources) central to developing IL. While LaGuardia is not unique in offering a credit-bearing IL course, a 2016 study concluded that only 19% of higher education institutions surveyed offer such courses (Cohen et al. 2016, 566). Due to this small percentage, credit-bearing IL courses present a relatively unique opportunity to teach IL to students. This is particularly true when compared to traditional library instruction sessions, which are typically one hour long and offered once each semester for select courses (e.g. English 101).

The following case study investigated the efficacy of IL pedagogy on undergraduate research in a section of LRC103 offered during the Spring 2017 semester at LaGuardia. More specifically, the study analyzed student success and sought to determine whether written reflection and practice strengthen IL skills, including the fundamental ability to develop a research question and thesis statement. In fact, the ACRL Framework recognizes the importance of research question advancement. As outlined in Research as Inquiry, research “depends upon asking increasingly complex or new questions whose answers in turn develop additional questions” (The Association of College and Research Libraries 2015). Developing research questions and formulating thesis statements are among the most challenging duties of a young researcher. From high school through undergraduate, students often have minimal experience conducting research. They may not know where to begin the research process and what steps are necessary (Fernando and Hulse-Killacky 2006, 103-104). Student frustration is exacerbated by the fact that typically IL instruction is one-shot guidance, given only once in a semester, making it difficult for a librarian to cover all that is needed. Can a semester long, credit-bearing course aid student success in research and improve IL skills? The instructors introduced several techniques to improve IL skills, and instructors evaluated three class assignments based on the college’s core competencies. Additionally, instructors collected and analyzed students’ written reflections of their progress and an end of semester survey as both qualitative and quantitative data. As a platform to post reflection, the authors implemented electronic portfolio (ePortfolio) practice for the course. Deeply embedded in LaGuardia’s academic culture, its current ePortfolio program utilizes Digication software in both pedagogy and assessment (LaGuardia Community College, “About ePortfolio”, 2017). All twelve enrolled students were eligible to participate, and eleven elected to take part in the study.

Literature Review

The following literature review reflects the goals of this study and is not intended to be comprehensive. Unlike conventional library instruction, the uniqueness of this study was that it examined students’ IL skills over the course of an entire semester. The research was empirical, using outcomes-based and affective analysis to study IL pedagogy. This case study expanded on the term project for LaGuardia’s LRC102, Information Strategies: Managing the Revolution, a credit-bearing course previously taught at LaGuardia, which called for an annotated bibliography, accompanied by a narrative of research where students describe the process used to find each item in the bibliography and explain its inclusion. In a study of LRC102, Fluk concluded that further research should be done into how research logs and journal writing affect student learning and how logs and journals should best be assigned (Fluk 2009, 50).

Colleges and universities have targeted the following learning objectives when creating or redesigning credit-bearing IL courses: developing research topics research questions, and thesis statements (Mulherrin, Kelley, Fishman, Orr 2004, 24; Frank and MacDonald 2016, 17). Broadly considered, the literature on measuring and assessing the impact of IL instruction on educational outcomes is varied, especially in the wake of the 2015 adoption of the ACRL Framework, which omitted specific standards, competencies, and learning outcomes. Examples from community colleges and/or credit bearing IL courses were sought for this literature review. Longitudinal studies of students at Hostos Community College, a CUNY school with comparable demographics to LaGuardia’s, and Western Georgia University demonstrated that students taking IL workshops and a credit-bearing IL course, respectively, resulted in higher graduation rates, higher pass rates on reading and writing tests, and higher cumulative grade point averages. The Hostos Community College study results determined that students taking IL workshops experienced a 35.3% graduation rate, compared with 9.8% for students who did not take the workshops. Additionally, students who completed the IL workshop passed the CUNY Proficiency Exams for Reading at a rate of 78.5% and for Writing at a rate of 73.5%; the students who did not take the workshops passed the exams at a rate of 57.6% and 47.2% (Laskin and Zoe 2017, 13-16; Cook 2014, 276-279). Similarly, University of Western Georgia concluded that overall graduation rates for students in the study who completed their credit-bearing IL course graduated within six years at significantly higher rates than those who did not, 56% versus 30% (Cook 2014, 277-278).

In their discussion of CUNY’s Critical Thinking Skills Initiative, Gashurov and Matsuuchi stressed the importance of IL for LaGuardia’s LRC103 course to ensure CUNY students are prepared for today’s competitive job market (Gashurov and Matsuuchi 2013, 70-71). The Critical Thinking Skills Initiative was in part a reaction to the financial crisis of 2007-2008, but LaGuardia’s commitment to IL can be traced back to 1991 when it began offering LRC102. As mentioned above, LRC103 was first offered in 2004 and is central to the Library’s IL program (Keyes and Namei 2013, 29). More recently, the Citation Project, a multi-institutional study on source usage in college writing, has concluded that students struggle with all aspects of citation and comprehending sources: summarizing, paraphrasing, and quotation, to name a few (Jamieson and Howard 2013, 125-126). Jamieson’s further research claims that IL pedagogy based on the ACRL Framework, more so than the older ACRL IL competencies, may help students better understand their sources (Jamieson 2017, 128-129), which matches the goals of the present study.

At the postsecondary level, ePortfolio use has matured from a tool to document professional development to a web portal for accessing work, tracking academic growth, and planning a career, acting as a record of skills, achievements, and learning (LaGuardia Community College, “Introduction: What is an ePortfolio?”, 2017). Nevertheless, academic libraries have been slow implementing ePortfolios as compared to other campus departments, due in part because IL instruction is typically offered once per semester, in one class, and tailored to a specific assignment. However, a few have administered ePortfolios as a method of improving research and critical thinking. In 2008, Three Rivers Community College designed a plan whereby students searched for scholarly articles and then discussed the techniques used to retrieve them in a written reflection of their online learning experience posted into their ePortfolio (Florea 2008, 424-425). More recently, in collaboration with another campus department, the Otis College Library in 2014 created a research assignment that students uploaded to their ePortfolio and that instructors graded using the college’s core competencies (Giuntini and Venturini 2014, 11-15).

Methods and Analysis

Instructed by the authors, the LRC103 class in this study met weekly in one-hour face-to-face sessions for twelve weeks in the spring 2017 semester. Class lessons and assignments aimed to advance student research ability by fostering IL skills. The first class lesson introduced fundamental database tools, such as subject headings and subject term delimiters, to narrow a broad topic down to specific issues and subjects. The technique helps students comprehend article indexing and focuses student research to an elemental concept. For example, a search for “global warming” in a standard database yields thousands of results. However, the recommended subject headings “global warming & politics” and “global warming & the environment” generates a more manageable list. Subject term delimiters, custom to databases, refine this list to specifics.  The assignment accompanying the lesson sought to discover if database tools support critical thinking development. First, it prompted students to write a 200-word description of an article found in a research database, summarizing the author’s viewpoint and any evidence provided in their argument. Next, it asked students to frame and develop a research question for further inquiry related to the article’s topic. Lastly, in a reflection, students explained if writing the summary helped them review and disseminate the material to forge a unique and specific area to research (See Appendix A).

The second lesson demonstrated use of an online encyclopedia, illustrating the expansive subject list available. Then, students read an article on a select topic and gathered keywords. Students made note of words that they felt were key to understanding the topic. The final part of the lesson introduced concept maps, a graphical tool for organizing and representing knowledge. Concept maps break down a topic into related issues, with details or examples for each issue (Appalachian State University: Belk Library and Information Commons 2017). Words are usually “enclosed in circles or boxes of some type, and relationships between concepts [are] indicated by a connecting line linking two concepts” (Novak and Cañas 2008). Using the words marked in the encyclopedia article, students created concept maps. Following this lesson, students completed the second assignment, the class midterm, which asked them to develop a topic and their own argument using methods learned in class. Students had the option to use the first assignment topic or to select a new one. Suggestions provided were affordable housing, human trafficking, and junk food. The instructors recommended that students first break down the topic using a concept map and then develop a related viewpoint or argument from one issue or concept in the map.  For the first part of the midterm, each student needed to find one scholarly article in support of their thesis argument and give a thirty-second, persuasive pitch in class to argue their viewpoint. In their ePortfolio, they provided an MLA citation of the article and wrote a one-paragraph description, which included their thesis statement, an explanation of the topic, and the reason they selected it. In the second part of the midterm, students supported their arguments with two additional scholarly articles, one in support of their thesis and one counterpoint. To showcase their evidence, students created an annotated bibliography. For this class, an annotated bibliography referred to a list of resources, each with a reference citation in Modern Language Association (MLA) style and a summary or evaluation (Stacks, et al. 2017). Finally, in a one-paragraph reflection, students considered whether or not the lesson and midterm helped them narrow down their research and develop their arguments (See Appendix B).

Sample concept map of ‘junk food’ and its related issues, complete with details and examples of each.

Figure 1: Sample concept map of ‘junk food’ and its related issues, complete with details and examples of each.  Concept maps break down a topic or main idea into related issues or concepts, and onto details or examples.

The class final required students to explain the most successful ways to develop a research question based on skills learned in class, in either a five-minute video, five-minute audio recording, or Microsoft PowerPoint presentation of at least five slides. As part of their work, they needed to describe if they will use the skills learned in other classes and assignments (See Appendix C). Lastly, an eight-question survey given to students on the last day of class provided a means to quantitatively measure success of class pedagogy. It was optional and anonymous (See Appendix D).

To evaluate student work, the instructors created an assessment rubric based on one of LaGuardia’s four core competencies, inquiry and problem solving. Inquiry and problem solving is comprised of the ability to design, evaluate, and implement a strategy or strategies to answer an open-ended question or achieve a desired goal. Students advance this competency by framing an issue, gathering evidence, analyzing material, and formulating conclusions (LaGuardia Community College, “Outcomes Assessment”, 2017). Based on this framework, the instructors assessed student work on ability to: 1) analyze and synthesize research material, 2) formulate conclusions to develop research questions and thesis arguments, and 3) understand and integrate IL skills.

Therefore, students who received a letter grade of A on an assignment demonstrated proficient IL skills. A letter grade of B signified competent skills, a C denoted developing skills, and a grade under C deemed the student a novice. In addition to a grade, the instructors also provided constructive feedback to advise students how they could improve their work.
Since each of the three assignments weighed differently towards the student’s final grade, all grades in this article were proportioned based on one-hundred points. For example, if a student assignment received fifteen out of twenty points, the grade was seventy-five, or a C, and the student demonstrated developing IL skills. In addition to grades, the authors analyzed student reflections to draw conclusions on student progress in class and uncover what pedagogies best helped.

Results

In the first assignment, seven students demonstrated proficient skills, two had competent skills, one showed developing skills, and one was a novice, for a class average of 89.5. In a combined midterm grade, six students were proficient, three were competent, one was developing, and one was a novice, for a class average of 89.1. While student work remained at the competent stage in the first two assignments overall, performance improved to proficient on the final, for a class average of 96.7, as students displayed a deeper understanding of research concepts and were able to express them in presentation and reflection.

A line graph shows student progress, from 89.5 in the first assignment, to 89.1 in the midterm, and to 96.7 in the final exam.

Figure 2: The line graph shows student progress in each of the four class assignments based on 100 points.  The class average changed from 89.5 in the first assignment, to 89.1 in the midterm, and to 96.7 in the final exam.

 

Student obstacles in the first two assignments were inability to narrow down a topic in a focused research question and lack of solid arguments in thesis statements. For example, the research questions “are artists overly-hypocritical of other artists’ work for biased reasons?” and “is society to blame for engraving the idea that men were/are much more superior than women?” were not open-ended but rather took a position. Similarly, the question “what are the causes of animal extinction?” could be improved by selecting a specific animal or animal habitat.

Conversely, the question “how did Edgar Allan Poe’s life affect his writing?” was open-ended and focused but could be revised by concentrating on one event in Poe’s life. In the midterm, the statement “[weight gain and disease due to junk food intake] has been a problem that has been occurring for many years and there is a solution to the problem” was not a solid thesis but rather only stated there was a solution. On the other hand, the thesis “college students should get free tuition” suggested a solution but didn’t offer any justification. Lastly, the complete statement “due to the highly addictive nature of junk food and food manufacturers reluctance to alter their products or marketing, only some type of severe intervention will improve the quality of the food made in America and lessen the rates of obesity and diabetes” demonstrated a strong thesis and highlighted student learning progress, acknowledging the complexity of the issue while taking a side.

Another student challenge was inability to follow directions. Some failed to provide an opposing viewpoint in the annotated bibliography while others placed too much opinion in a summary. For example, one student wrote: “[with this article] I came up with many more questions than answers.” Still, another student didn’t provide summaries at all, but rather simply listed citations. While most students explained class pedagogy well in the final exam, some didn’t explain it thoroughly enough or didn’t provide examples in relation to assignments. For example, one student simply added a bullet list on the final to support the best ways to successfully develop a research question rather than explaining them. Several students neglected to distinguish between their assignments, making it uncertain where one assignment ended and another began.

Student reflection on progress was generally positive. In fact, a student suggested that one skill learned in the course was the “ability to think critically about information found” in research. In a first assignment reflection, a student commented, “after laying out all the information and my personal thoughts, I felt that I had a better understanding of the article, making it easier to develop my own research question.” Another submitted that in summarizing the article they “started to really absorb the information.” In midterm reflections, concept maps most successfully aided student success. One wrote: “[concept maps] helped narrow down the possibilities of creating research questions and starting my search with general keywords where I could find articles.” Another added: “it allows me to develop a cohesive structure for the ideas that I want to present and analyze the relationship between the ideas and the main concepts as well as how the ideas complement the concept.” Reflections on the annotated bibliography were also positive and suggested that students not only developed IL skills but planned to integrate concepts in other classes. “It breaks down the articles and picks apart key details,” one student suggested. Another delved deeper, adding that they will retain class work for reference in case they need citation assistance: “It will come in handy in classes where the professor prefers MLA8 style.”

Results of the final survey indicated that students were generally pleased with pedagogy and instruction provided, and they generally agreed that reflection aided research. All participants identified both making a concept map and using fundamental database tools as the most useful approaches to develop research questions. Written feedback was also primarily positive, indicating satisfaction in semester-long IL course. One student said: “I thought this class was really helpful and should have been one of the first classes that I took here at LaGuardia because it helped a lot with writing research papers and finding information.” Another said: “the topics helped with my knowledge and expanded my experience with different databases.”

Discussion

This semester-long case study provides an argument that the course helped students develop IL skills and that further research is warranted. Its limitations were that it was conducted on one class with a low enrollment. The ideal case is either a class with a larger enrollment in a longitudinal study or a comparative study of two class sections, one section using reflection as a learning practice and one without. The authors hope their work can serve as a framework for subsequent studies at LaGuardia and elsewhere to foster IL skills.

While grade success may suggest that students gained academic proficiency in the class, student reflection provides the best argument for credit-bearing IL courses. In their own words, students reflected how they integrated key concepts into their academic work that will be used in both future classes and in life. Students suggested the concept map as the key method to success in the course, making this graphical tool a vital part of library instruction. It allows students to break down a topic and make conclusions about what area to research. Reflections also provided an opportunity to connect class pedagogy to lifelong learning. In a final study feedback response, a student summarized the need for semester-long instruction, and that the course should have been one of the first classes that they took at LaGuardia to guide their research and IL skills.

Conclusion

Student achievement in the course demonstrates that when applied in a credit-bearing IL course, strong IL pedagogy and effective use of instructional technology aids and enhances student success. Students generally felt that the IL skills they developed in LRC103 can be utilized in other courses. However, for IL instruction to be successful, strong pedagogy is tantamount in concert with thoughtful implementation of instructional technology, in this case ePortfolio. Ideally, credit-bearing IL instruction would be offered when a student begins college. The following is a list of considerations when making IL pedagogy decisions generally and possible next steps for LRC103.

Prepare useful lessons and select appropriate assignments

Nothing replaces solid pedagogy. Constructive assignments foster student learning. The lesson on concept maps as a method to develop focused research topics spurred the greatest jump in level of the inquiry and problem-solving competency. Assignments that encouraged metacognition — Student midterm reflections and answers in the final survey — also suggest concept maps as a useful method to help narrow a research topic.

Instructional technology best practices

There is no ideal course management platform.  An easy-to-use format where material and information can be added and retrieved is ideal. Naturally, the library may not be the final voice in what platform software a campus uses. However, it can suggest recommendations based on feedback from students. It is recommended that class time should be allotted at the beginning of the semester for course software instruction. Subsequent instruction should also be considered at the time assignments are introduced or prior to due dates, in order to model best practices.

Finally, organization and maintenance of a platform is key to success, and, as with any electronic tool, ePortfolio is only as good as the effort put to its use. Things to avoid are unlabeled assignments, irrelevant material, uploads that require additional software, broken links, and incomplete evidence.

Gather Qualitative Data

Since LRC103 is a one-credit course with modest enrollment, the sample size will remain small thereby limiting the impact of quantitative data. Gathering more qualitative data in the form of written reflections and student interviews could benefit the ongoing development of IL pedagogy for librarians teaching this course. Regardless of the instructional technology utilized, student reflection and metacognition are essential for credit-bearing IL instruction courses.

Collaborate with other academic departments

To promote library resources and services, collaborate with other departments. The English department is one option. Developing a research question, finding information, formulating a thesis, and then writing an argumentative paper are the basis for a common English class paper. Beyond English, there are ample opportunities incorporate IL pedagogy in various disciplines: history, social sciences, and STEM programs. An essential feature of the ACRL Framework is its flexibility. “Research as Inquiry,” “Information has Value,” and “Searching as Strategic Exploration,” three of the six frames, are central to academic research regardless of discipline. For example, LaGuardia’s Library has collaboratively developed a curriculum of one-hour, one-shot library instruction sessions for the college’s First Year Seminars, introductory, discipline-specific courses that provide remediation (LaGuardia Media Resource Center, FYS Library Instruction, 2017). The curriculum maps from LaGuardia’s core competencies (e.g. global learning, integrative learning) to related concepts in the ACRL Framework and library instruction lesson plans for each seminar; the entire curriculum is hosted on the LibGuides platform. This type of collaboration could be expanded to the Library’s credit-bearing courses to incorporate discipline-specific IL pedagogy. One way to incorporate is participation in LaGuardia’s Learning Communities, which pair two or more courses around a common theme (LaGuardia Community College, “Liberal Arts Learning Communities,” 2018). These learning communities could give LaGuardia librarians an opportunity to teach discipline-specific versions of LRC103 that would implement the conclusions from this case study and supporting research.

Bibliography

American Association of Colleges and Universities. 2017. “High-Impact Educational Practices.” http://www.aacu.org/leap/hips.

Appalachian State University: Belk Library and Information Commons. 2017. “Concept Mapping.” Accessed on October 9, 2017. https://library.appstate.edu/research-help-guides/video-tutorials/concept-mapping.

The Association of College and Research Libraries. 2010. “Information Literacy Competency Standards for Higher Education.” Accessed on October 9, 2017. https://alair.ala.org/handle/11213/7668?show=full.

The Association of College and Research Libraries. 2015. “Framework for Information Literacy for Higher Education.” Accessed on October 9, 2017. http://www.ala.org/acrl/standards/ilframework#introduction.

Beagle, Donald. 2010. “The Emergent Information Commons: Philosophy, Models, and 21St Century Learning Paradigms.” Journal of Library Administration 50, no. 1: 7-26.

Bryant, Lauren H. and Jessica R. Chittum. 2013. “ePortfolio Effectiveness: A(n Ill-Fated) Search for Empirical Support.” International Journal of ePortfolio 3, no. 2: 189-198.

Clark, J. Elizabeth, and Bret Eynon. “E-portfolios at 2.0–Surveying the Field.” Peer Review 11, no. 1 (2009): 18-23.

Cohen, Nadine, Liz Holdsworth, John M.Prechtel, Jill Newby, Yvonne Mery, Jeanne Pfander, and Laurie Eagleson. 2016. “A Survey of Information Literacy Credit Courses in US Academic Libraries.” Reference Services Review 44, no. 4: 564-582.

Cook, Jean Marie. 2014. “A Library Credit Course and Student Success Rates: A Longitudinal Study.” College & Research Libraries, 75, no. 3: 272-283.

Duvall, Sara, and Peter Pasque. 2013. “The 21st Century Literacies Gap: A Case for Adoption of the Student Learning Networks Model Grades 9-16.” Public Services Quarterly 9, no. 1: 70-80.

Fernando, Delini M., and Diana Hulse-Killacky. 2006. “Getting to the Point: Using Research Meetings and the Inverted Triangle Visual to Develop a Dissertation Research Question.” Counselor Education & Supervision 46, no. 2 (December): 103-115.

Florea, Mona. 2008. “Using WebCT, Wiki Spaces, and ePortfolios for Teaching and Building Information Literacy Skills.” Journal of Library Administration 48, no. 3-4: 411-430.

Fluk, Louise. 2009. “The Narrative of Research as a Tool of Pedagogy and Assessment: A Literature Review.” In-Transit: The LaGuardia Journal on Teaching and Learning 4: 40-56.

Frank, Emily and Amanda MacDonald. 2016. “Eyes Toward the Future: Framing For-credit Information Literacy Instruction.” Codex (2150-086X) 4, no. 4: 9-22.

Giuntini, Parme and Jean-Marie Venturini. 2014. “Learning by Doing: Using Eportfolios for Assessment at Otis College of Art and Design.” Library Hi Tech News 31, no. 7 (August): 11-15.

Guder, Christopher. 2013. “The Eportfolio: A Tool for Professional Development, Engagement, and Lifelong Learning.” Public Services Quarterly 9, no. 3 (July-September): 238-245.

Hampe, Narelle, and Suzanne Lewis. 2013. “E-portfolios Support Continuing Professional Development for Librarians.” Australian Library Journal 62, no. 1: 3-14.

Hsieh, Ting-Chu1, et al. 2015. “Longitudinal Test of Eportfolio Continuous Use: An Empirical Study on the Change of Students’ Beliefs.” Behaviour & Information Technology 34, no. 8 (August): 838-853.

Jamieson, Sandra. 2017. “What the Citation Project Tells Us About Information Literacy in College Composition.” In Information Literacy: Research and Collaboration across Disciplines. Perspectives in Writing Series. Edited by Barbara D’Angelo, Sandra Jamieson, Barry Maid, & Janice R. Walker, 119-143. Fort Collins, Colorado: WAC Clearing House & University Press of Colorado, 2017.

Jamieson, Sandra, and Rebecca Moore Howard. 2013. “Sentence-Mining: Uncovering the Amount of Reading and Reading Comprehension In College Writers’ Researched Writing” in The New Digital Scholar: Exploring and Enriching the Research and Writing Practices of NextGen Students. Edited by Randall McClure and James P. Purdy, 111-133. Medford, NJ: American Society for Information Science and Technology.

Kehoe, Ashley and Michael Goudzwaard. 2015. “ePortfolios, Badges, and the Whole Digital Self: How Evidence-Based Learning Pedagogies and Technologies Can Support Integrative Learning and Identity Development.” Theory into Practice 54, no. 4: 343-351.

Kuh, George and Carol Geary Schneider. 2008. High-Impact Educational Practices: What They Are, Who Has Access to Them, and Why They Matter. Washington, DC: American Association of Colleges and Universities.

LaGuardia Community College. 2017. “About ePortfolio.” Accessed on October 9, 2017. http://www.eportfolio.lagcc.cuny.edu/about/.

LaGuardia Community College. 2016. “Fast Facts.” http://www.laguardia.edu/About/Fast-Facts/.

LaGuardia Community College. 2017. “Frequently Asked Question.” Accessed on October 9, 2017. http://www.laguardia.edu/ssm/faq.

LaGuardia Community College. 2017. “Introduction: What is an ePortfolio?” Accessed on October 9, 2017. http://www.eportfolio.lagcc.cuny.edu/students/default.htm.

LaGuardia Community College. 2018. “Liberal Arts Learning Communities.” Accessed on March 6, 2018. http://www.laguardia.edu/clusters/.

LaGuardia Community College. 2017. “Outcomes Assessment.” Accessed on October 9, 2017. http://www.laguardia.edu/Assessment/Resources.

LaGuardia Community College, Library Media Resources Center. 2017. “First Year Seminar Curriculum Map.” Accessed on March 6, 2018. http://guides.laguardia.edu/fys.

Laskin, Miriam and Lucinda Zoe. 2017. “Information Literacy and Institutional Effectiveness: A Longitudinal Analysis of Performance Indicators of Student Success.” CUNY Academic Works. https://academicworks.cuny.edu/ho_pubs/60.

Mulherrin, Elizabeth, Kimberly B. Kelley , Diane Fishman & Gloria J. Orr. 2004. “Information Literacy and the Distant Student.” Internet Reference Services Quarterly 9, no. 1-2: 21-36.

Novak, Joseph D. and Alberto J. Cañas. 2008. “The Theory Underlying Concept Maps and How to Construct and Use Them.” Florida Institute for Human & Machine Cognition. Accessed on October 9, 2017. https://cmap.ihmc.us/docs/theory-of-concept-maps.

Osborn, Jennifer. 2009. “E-Portfolios: Personal Learning, Professional Development.” Incite 30, no. 6: 18.

Stacks, Geoff, et al. 2017. “Annotated Bibliographies.” Purdue Online Writing Lab. Accessed on October 9, 2017. https://owl.english.purdue.edu/owl/resource/614/01.

Appendix A: Prompt for Assignment 1

Prompt for Assignment #1.  First, students were asked to write a 200-word description of an article found in class.  Next, they were asked to develop their own research question based on the article. Lastly, they needed to explain in 100 words if writing the summary helped them develop the research question.

Appendix B: Prompt for Midterm

Prompt for the midterm, which was divided into two parts.  In the first part, based on the thesis from Assignment #1 or another thesis on a topic of their own choosing, students needed to first, find one article in support of their thesis and then upload a citation of the article to their ePortfolio.  Secondly, they worked on 30-second, persuasive pitch of their viewpoint, which they later delivered in class. Lastly, they wrote a 50-100 word paragraph in their ePortfolio, explaining why they selected the topic. In second part, students found two additional articles, one in support of their argument and one opposed to it.  Then, the created an annotated bibliography of all three articles and posted it their ePortfolio. Lastly, in a short paragraph in their ePortfolio, they reflected on the assignment and explained if it helped them narrow down and develop a research question.

Appendix C: Prompt for Final

Prompt for the final.  Using a five-minute video, five minute audio recording, or PowerPoint presentation, students were asked to explain the best ways to successfully develop a research question based on the skills learned in class.  In their answer they need to first, describe whether using ePortfolio as a reflective tool helped them develop a research question, then determine if the class assignments help you make connections to other classes, and lastly if they will use the skills you learned in class in future assignments.

Appendix D: Final Survey

Eight-question, student questionnaire to determine success of class pedagogy.  Questions sought to determine both which class lesson for developing research questions worked best to developing a research question and which ePortfolio reflection was most helpful.

About the Authors

Derek Stadler is the Web Services Librarian at CUNY LaGuardia Community College. Derek holds a B.S. in Computer Science, as well as an M.S. in Library Science and a M.A. in History. In addition to library research, Derek is also an avid history researcher, with a focus on New York City and urban studies.

Ian McDermott is an Assistant Professor and Instruction Librarian at LaGuardia Community College, City University of New York. His teaching and research focuses on information literacy and open educational resources. He is particularly interested in exploring the intersection of information literacy and critical pedagogy. He received an MLIS from the University of Pittsburgh, an MA in Art History from Purchase College, SUNY, and a BFA in Photography from the University of Illinois, Urbana-Champaign.

4

Confessions of a Premature Digital Humanist

Abstract

Traditional interpretations of the history of the Digital Humanities (DH) have largely focused on the field’s origins in humanities computing and literary studies. The singular focus on English departments and literary scholars as progenitors of DH obscures what in fact have been the DH field’s multidisciplinary origins. This article analyzes the contributions made by the US social, public, and quantitative history subfields during the 1970s and 1980s to what would ultimately become the Digital Humanities. It uses the author’s long career as a social, quantitative, and public historian (including his early use of mainframe computers in the 1970s to analyze historical data) and his role and experiences as co-founder of CUNY’s pioneering American Social History Project to underscore the ways digital history has provided a complementary pathway to DH’s emergence. The piece also explores the importance of digital pedagogy to DH’s current growth and maturation, emphasizing various DH projects at the CUNY Graduate Center that have helped deepen and extend the impact of digital work in the academy.

“And you may ask yourself—Well… How did I get here?”
Talking Heads, “Once In a Lifetime” (1981)

 
Much actual and virtual ink has been spilled over the past few years recounting how the field of Digital Humanities came into being. As a social historian and someone who has been involved in digital work of one sort or another since the mid 1970s, I am somewhat bemused by what Geoffrey Rockwell has aptly termed the “canonical Roberto Busa story of origin” offered by English department colleagues (Rockwell 2007). That canonical DH history usually starts with the famous Father Roberto Busa developing his digital concordances of St. Thomas Aquinas’s writings beginning in 1949 (the first of which was published in 1974) with critical technical support provided by Thomas Watson, head of IBM.[1] It quickly moves from there to recount the emergence of humanities computing (as it was originally known) in the 1980s, followed by the development of various digitized literary archives launched by literary scholars such as Jerry McGann (Rossetti) and Ed Folsom (Whitman) in the 1990s (Hockey 2004). In this recounting, academics in English, inspired by Father Busa, pushed ahead with the idea of using computers to conceive, create, and present the digital concordances, literary editions, and, ultimately, fully digitized and online archives of materials, using common standards embodied in the Text Encoding Initiative (TEI), which was established in 1987.[2] The new field of Digital Humanities is said to have emerged after 2004 directly out of these developments in the literary studies field, what Willard McCarty terms “literary computing” (McCarty 2011, 4).[3]

As a historian who believes in multi-causal explanations of historical phenomena (including what happens intellectually inside of universities), I think there are alternative interpretations of this origin story that help reveal a much more complicated history of DH.[4] I will argue in this piece that the history field—particularly historians working in its social, public, and quantitative history sub-fields—also made a substantial and quite different contribution to the emergence of the Digital Humanities that parallels, at times diverges from, and even anticipates the efforts of literary scholars and literary studies.[5] I will first sketch broader developments in the social, public, and quantitative history sub-fields that began more than four decades ago. These transformations in the forms and content of historical inquiry would ultimately lead a group of historians to contribute to the development of DH decades later. I will also use my own evolution over this time period (what I dub in the title of this piece my “premature” Digital Humanism), first as a social and labor historian, then as a media producer, digital historian, and finally now as a teacher of digital humanities and digital pedagogy, to illustrate the different pathways that led many historians, myself included, into contributing to the birth and evolution of the Digital Humanities. I will use my ongoing collaborations with my colleagues at the American Social History Project (which I co-founded more than 35 years ago) as well as with Roy Rosenzweig and the Center for History and New Media to help tell this alternate DH origins story. In the process, I hope to complicate the rather linear Father Busa/humanities computing/TEI/digital literary archives origin story of DH that has come to define the field.

Social and Labor History

Social history first emerged in the pre-World War II era with the founding in 1929 in France of the Annales school of historical inquiry by Lucien Febvre and Marc Bloch and carried forward by Fernand Braudel in the 1950s and Emmanuel Le Roy Ladurie in the 1970s. The field of social history found fertile new ground in the United States during the 1960s and 1970s. The “new” social history was very much a product of the rejection of traditional political history narratives and a search for new methodologies and interdisciplinary connections. Social history examined the lives and experiences of “ordinary people”—workers, immigrants, enslaved African Americans, women, urban dwellers, farmers, etc.—rather than the narrow focus on the experiences of Great White Men that had dominated both academic and popular history writing for decades if not centuries. This changed historical focus on history “from the bottom up” necessitated the development of new methodological approaches to uncover previously unused source materials that historians needed to employ to convey a fuller sense of what happened in the past. Archives and libraries had traditionally provided historians access to large collections of private and public correspondence of major politicians, important military leaders, and big businessmen (the gendered term being entirely appropriate in this context) as well as catalogued and well-archived state papers, government documents, and memoirs and letters of the rich and famous. But if the subject of history was now to change to a focus on ordinary people, how were historians to recount the stories of those who left behind few if any traditional written records? New methodologies would have to be developed to ferret out those hidden histories.[6]

The related sub-field of labor history, which, like social history, was also committed to writing history “from the bottom up,” illustrates these methodological dilemmas and possibilities. Older approaches to US labor history had focused narrowly on the structure and function of national labor unions and national political parties, national labor and party leaders, and what happened in various workplaces, drawing on government reports, national newspapers, and union records. The new labor history, which was pioneered in the early 1960s, first by British Marxist historians such as Eric Hobsbawm and E. P. Thompson, sought to move beyond those restricted confines to tell the previously unknown story of the making of the English working class (to appropriate the title of one of Thompson’s most important works). Hobsbawm and especially Thompson relied heavily in their early work on unconventional local and literary sources to uncover this lost history of English working people. The new labor history they pioneered was soon adapted by US labor historians, including David Montgomery, David Brody, and Herbert Gutman and by graduate students, deploying an array of political and cultural sources to reveal the behaviors and beliefs of US working people in all of their racial and ethnic diversity. The new US labor history embraced unorthodox historical methodologies including: oral history; a close focus on local and community studies, including a deep dive into local working-class newspapers; broadened definitions of what constituted work (e.g. women’s housework); and working-class family and community life and self-activity (including expressions of popular working-class culture and neighborhood, political, and religious associations and organizations). I committed myself to the new labor history and its innovative methodologies in graduate school at UCLA in the early 1970s when I began to shape my doctoral dissertation, which sought to portray the ways black, white, and immigrant coal miners in the West Virginia and Colorado coal fields managed to forge interracial and interethnic local labor unions in the late nineteenth and early twentieth centuries (Brier 1992).

Public History

A second activist and politically engaged approach to communicating historical scholarship—public history—also emerged in the 1970s. Public history grew in parallel to and was made possible by the new academic field of social history. To be sure, while social history spoke largely to the history profession, challenging its underlying methodological and intellectual assumptions, public history and the people who self-identified as public historians often chose to move outside the academy, embedding themselves and their public history work inside unions, community-based organizations, museums, and political groups. Public historians, whether they stayed inside the academy or chose to situate themselves outside of it, were committed to making the study of the past relevant (to appropriate that overused Sixties’ phrase) to individuals and groups that could and would most benefit from exposure to and knowledge about their “lost” pasts (Novick 1988, 512–21).

Public history’s emergence in the mid-1970s signaled that at least one wing of the profession, albeit the younger, more radical one, was committed to finding new ways and new, non-print formats to communicate historical ideas and information to a broad public audience through museum exhibits, graphic novels, audio recordings and radio broadcasts, and especially film and television. A range of projects and institutions that were made possible by this new sub-field of public history began to take shape by the late 1970s. I worked with fellow radical historians Susan Porter Benson and Roy Rosenzweig and the three of us put together in 1986 the first major collection of articles and reports on US public history projects and initiatives. Entitled Presenting the Past, the collection was based on a special theme issue of the Radical History Review (the three of us were members of the RHR editorial collective) that we had co-edited five years earlier.[7] Focusing on a range of individual and local public history projects, Presenting the Past summarized a decade of academic and non-academic public history work and projects in the United States (Benson, Brier, and Rosenzweig 1986).[8]

Stephen Robertson, who now heads the Roy Rosenzweig Center for History and New Media (CHNM)[9] at George Mason University, has correctly noted, in a widely read 2014 blog post,[10] that we can and should trace the origins of the much newer sub-field of digital history, a major contributor to the Digital Humanities’ growth, to the public history movement that was launched a quarter century earlier (Robertson 2014). Robertson goes on to suggest that this early focus on public history led digital historians to ask different questions than literary scholars. Historians focused much more on producing digital history in a variety of presentational forms and formats rather than literary scholars’ emphasis on defining and theorizing the new Digital Humanities field and producing online literary archives. This alternative focus on public presentations of history (i.e., intended for the larger public outside of the academy and the profession) may explain why digital historians seem much less interested in staking out their piece of the DH academic turf while literary scholars seem more inclined both to theorize their DH scholarship and to assert that DH’s genesis can be located in literary scholars’ early digital work.

Quantitative History

A third, and arguably broader, methodological transformation in the study and writing of US history in these same years was the emergence of what was called quantitative history. “Cliometrics” (as some termed it, a bit too cutely) held out the possibility of generating new insights into historical behavior through detailed analyses of a myriad of historical data available in a variety of official sources. This included, but was certainly not limited to, raw data compiled by federal and state agencies in resources like census manuscripts.[11] Quantitative history, which had its roots in the broader turn toward social science taken by a number of US economic historians that began in the late 1950s, had in fact generated by the early 1970s a kind of fever dream among many academic historians and their graduate students (and a raging nightmare for others) (Thomas 2004).[12] Edward Shorter, a historian of psychiatry (!), for example, authored the widely-read The Historian and The Computer: A Practical Guide in 1971. Even the Annales school in France, led by Ladurie, was not immune from the embrace of quantification. Writing in a 1973 essay, Laurie argued that “history that is not quantifiable cannot claim to be scientific” (quoted in Noiret 2012). Quantitative history involved generating raw data from a variety of primary source materials (e.g., US census manuscripts) and then using a variety of statistical tools to analyze that data. The dreams and nightmares that this new methodology generated among academic historians were fueled by the publication of two studies that framed the prominence and ultimate eclipse of quantitative history: Stephan Thernstrom’s Poverty and Progress, published in 1964, and Robert Fogel and Stanley Engerman’s Time on the Cross, which appeared a decade later (Thernstrom 1964; Fogel and Engerman 1974).

Thernstrom’s study used US census manuscripts (the original hand-coded forms for each resident produced by census enumerators) from 1850 to 1880 as well as local bank and tax records and city directories to generate quantitative data, which he then coded and subjected to various statistical measures. Out of this analysis of data he developed his theories of the extent of social mobility, defined occupationally and geographically, that native-born and Irish immigrant residents of Newburyport, Massachusetts enjoyed in those crucial years of the nation’s industrial takeoff. The critical success of Thernstrom’s book helped launch a mini-boom in quantitative history. A three-week seminar on computing in history drew thirty-five historians in 1965 to the University of Michigan; two years later a newsletter on computing in history had more than 800 subscribers (Graham, Milligan, and Weingart 2015). Thernstrom’s early use of quantitative data (which he analyzed without the benefit of computers) and the positive critical reception it received helped launch the quantitative history upsurge that reshaped much US social and urban history writing in the following decade. Without going into much detail here or elaborating on my own deep reservations about Thernstrom’s methodology[13] and the larger political and ideological conclusions he drew from his analysis of the census manuscripts and city directories, suffice it to say that Thernstrom’s work was widely admired by his peers and emulated by many graduate students, helping him secure a coveted position at Harvard in 1973.[14]

The other influential cliometric study, Fogel and Engerman’s Time on the Cross, was widely reviewed (including in Time magazine) after it appeared in early 1974. Though neither author was a social historian (Fogel was an economist, Engerman an economic historian), they were lavishly praised by many academics and reviewers for their innovative statistical analysis of historical data drawn from Southern plantation records (such as the number of whippings meted out by slave owners and overseers to enslaved African Americans). Their use of statistical data led Fogel and Engerman to revise the standard view of the realities of the institution of slavery. Unlike the conclusions reached by earlier historians such as Herbert Aptheker and Kenneth Stampp that centered on the savage exploitation and brutalization of slaves and their active resistance to the institution of slavery, Fogel and Engerman concluded that the institution of slavery was not particularly economically inefficient, as traditional interpretations argued, that the slaves were only “moderately exploited,” and that they were only occasionally abused physically by their owners (Aptheker 1943 [1963]; Stampp 1956 [1967]). Time on the Cross was the focus of much breathless commentary both inside and outside of the academy about the appropriateness of the authors’ assessments of slavery and how quantitative history techniques, which had been around for several decades, would help historians fundamentally rewrite US history.[15] If this latter point sounds eerily prescient of the early hype about DH offered by many of its practitioners and non-academic enthusiasts, I would argue that this is not an accident. The theoretical and methodological orthodoxies of academic disciplines are periodically challenged from within, with new methodologies heralded as life- (or at least field-) changing transformations of the old. Of course, C. Vann Woodward’s highly critical review of Fogel and Engerman in the New York Review of Books and Herbert Gutman’s brilliant book-length takedown of Time on the Cross soon raised important questions and serious reservations about quantitative history’s limitations and its potential for outright distortion (Woodward 1974; Gutman 1975; Thomas 2004). Gutman’s and Woodward’s sharp critiques aside, many academic historians and graduate students (myself included) could not quite resist dabbling in (if not taking a headlong plunge into) quantitative analysis.

Using a Computer to do Quantitative History

Though I had reservations about quantitative history—my skepticism stemming from a general sense that quantitative historians overpromised easy answers to complex questions of historical causation—I decided to broaden the fairly basic new labor history methodology that I was then using in my early dissertation research, which had been based on printed historical sources (government reports, nineteenth-century national newspaper accounts, print archival materials, etc.). I had been drawn to coal miners and coal mining unionism as a subject for my dissertation because of the unusual role that coal miners played historically as prototypical proletarians and labor militants, not only in the United States, but also across the globe. I was interested in understanding the roots of coal miners’ militancy and solidarity in the face of the oppressive living and working conditions they were forced to endure. I also wanted to understand how (or even if) white, black, and immigrant mineworkers had been able to navigate the struggle to forge bonds of solidarity during trade union organizing drives. I had discovered an interesting amount of quantitative data in the course of my doctoral dissertation research: an enumeration of all coal strikes (1,410 in number) that occurred in the United States in the 1881–94 period detailed in the annual reports of the US Commissioner of Labor.[16] This was what we would now call a “dataset,” a term that was not yet used in my wing of the academy in 1975. This critical fourteen-year historical period witnessed the rise and fall of several national labor union organizations among coal miners, including the Knights of Labor, the most consequential nineteenth-century US labor organization, and the birth of the United Mine Workers of America, the union that continues to represent to this day the rapidly dwindling number of US coal miners.

In my collaboration with Jon Amsden, an economic and labor historian and UCLA faculty member, the two of us decided to statistically analyze this data about the behavior and actions of striking coal miners in these years. The dataset of more than 1,400 strikes statistically presented in large tables was simply too large, however, to analyze through conventional qualitative methods to divine patterns and trends. Amsden and I consequently made a decision in 1975 to take the plunge into computer-assisted data analysis. The UCLA Computer Center was a beehive of activity in these early years of academic computing, especially focused on the emerging field of computer science.[17] The center was using an IBM 360 mainframe computer, running Fortran and the Statistical Package for the Social Sciences (the now venerable SPSS, originally released in 1968, and first marketed in 1975) to support social scientific analyses (Noiret 2012).

IBM 360 Computer, circa 1975
Figure 1: IBM 360 Computer, circa 1975

 
Amsden and I began by recording some of the characteristics involved in each of the 1,410 coal strikes that occurred in those 14 years: year of the strike, cause or objective of the strike, and whether a formal union was involved. To make more detailed comparisons we drew a one-in-five systematic random sample of the coal strikes. This additional sampled data included the number of workers involved in each strike, strike duration, and miners’ wages and hours before and after the strike. We laboriously coded each strike by hand on standard 80-character IBM Fortran coding sheets.

IBM Fortran Coding Sheet
Figure 2: IBM Fortran Coding Sheet

 
We then had a keypunch operator at the UCLA Computer Center (no doubt a woman, sadly unknown and faceless to us, righteous labor historians though we both were!)[18] transfer the data on each strike entry to individual IBM Fortran punch cards, originally known at Hollerith cards (Lubar 1992). That process generated a card stack large enough to carry around in a flat cardboard box the size of a large shoe box.

Fortran Punch Card
Figure 3: Fortran Punch Card

 
We regularly visited the UCLA Computer Center in the afternoon to have our card stack “read” by an IBM card reading machine and then asked the IBM 360 to generate specific statistical tabulations and correlations we requested, trying to uncover trends and comparative relationships among the data.[19] The nature of this work on the mainframe computer did not require us to learn Fortran (I know DHer Steve Ramsay would disapprove![20]), though Amsden and I did have to brush up on our basic statistics to be able to figure out how to analyze and make sense of the computer output. We picked up our results (the “read outs”) the next morning, printed on large, continuous sheets of fanfold paper.

IBM 360 Fanfold Paper
Figure 4: IBM 360 Fanfold Paper

 
It was a slow and laborious process, with many false starts and badly declared and pointless computing requests (e.g., poor choices of different data points to try to correlate).

Ultimately, however, this computerized data analysis of strike data yielded significant statistical correlations that helped us uncover previously unknown and only partially visible patterns and meanings in coal miners’ self-activity and allowed us to generate new insights (or confirm existing ones) into the changing levels of class consciousness exhibited by miners. Our historical approach to quantitative analysis was an early anticipation, if I can be permitted a bit of hyperbole, of Franco Moretti’s “distant reading” techniques in literary scholarship (Moretti 2005), using statistical methods to examine all strikes in an industry, rather than relying on a very “close reading” of one, two, or a handful of important strikes that most labor historians, myself included, typically undertook in our scholarly work. Amsden and I wrote up our results in 1975 and our scholarly article appeared in the Journal of Interdisciplinary History in 1977, a relatively new journal that featured interdisciplinary and data-driven scholarship. The article received respectful notice as a solid quantitative contribution to the field and was reprinted several times over the next three decades (Amsden and Brier 1977).[21]

One of our key statistical findings was that the power and militancy of coal miners increased as their union organizations strengthened (no surprises there) and that heightened union power between 1881 and 1894 (a particularly contentious period in US labor history) generated more militant strikes in the coal industry. Our data analysis revealed that these militant strikes often moved away from narrow efforts to secure higher wages to allow miners across the country to pose more fundamental challenges to the coal operators’ near total control over productive relations inside coal pits. Below are two screen shots, both generated by SPSS, from the published article: a scatter diagram (a new technique for historians to employ, at least in 1975) and one of the tables. The two figures convey the kinds of interesting historical questions we were able to pose quantitatively and how we were able to represent the answers to those questions graphically.

Scatter Diagram of Multi-establishment US Coal Strikes, 1881 to 1894
Figure 5: Scatter Diagram of Multi-establishment US Coal Strikes, 1881 to 1894

 
Figure 5 above shows the growth in the number of multi-establishment coal strikes and the increasing number of mines involved in strike activity over time, a good measure of increasing union power and worker solidarity over the critical 14-year period covered in the dataset.

Table 3: Index of Strike Solidarity, comparing Union-Called Coal Strikes with Non-Union Strikes
Table 3: Index of Strike Solidarity, comparing Union-Called Coal Strikes with Non-Union Strikes

 
Table 3 employs a solidarity index that Amsden and I developed out of our analysis of the coal strike statistics, based on the ratio of the number of strikers to the total number of mine employees in a given mine whose workers had gone out on strike. The data revealed that union-called strikes were consistently able to involve a higher percentage of the overall mining workforce as compared to non-union strikes and with less variation from the norm. This table lay at the heart of why I had decided to study coal miners and their unions in the first place. I hoped to analyze why and how miners consistently put themselves and their unions at the center of militant working-class struggles in industrializing America. I might have reached some of these same conclusions by analyzing traditional qualitative sources or by looking closely at one or a handful of strikes. However, Amsden and I had managed to successfully employ a statistical analysis in new ways (at least in the history field) that allowed us to “see” these developments and trends in the data nationally and regionally. We were able therefore to argue that the evolving consciousness of miners over time was reflected in their strike demands and in their ability to successfully spread the union message across the country. I should note here that the United Mine Workers of America had become the largest union by far in these early years of the American Federation of Labor. In sum, we believed we had developed a new statistical methodology to analyze and understand late nineteenth-century working-class behavior. We had used a computer to help answer conceptual questions that were important in shaping our historical interpretation. This effort proved to be a quite early instance of the use of digital techniques to ask and at least partially answer key historical (and, by definition, humanities) questions.

From Quantitative History to the American Social History Project

Around the time of the 1977 publication of the coal miners on strike article I decided to follow my public history muse, morphing from a university-based history scholar and professor-in-training, albeit one who had begun to use new digital technologies, into an activist public historian. I had moved to New York City soon after completing the computer-aided project on coal mining strikes to learn how to produce history films. This was a conscious personal and career choice I made to leave the academy to become an independent filmmaker. My commitment to historical ideas having a greater public and political impact drove my decision to change careers. On my first job in New York in 1977 as research director for a public television series of dramatic films on major moments in US labor history I met Herbert Gutman, one of the deans of the new labor and social history whose work I had read and admired as a graduate student. I spent the next two years researching and producing historical documentaries and other kinds of dramatic films.

The author in 1980 doing research for an educational television project on NYC history at the Columbia Univ. library. (Picture credit: Julie List)
Figure 7: The author in 1980 doing research for an educational television project on NYC history at the Columbia Univ. library. (Picture credit: Julie List)

 
Two years after meeting Gutman I was invited by Herb, who taught at the CUNY Graduate Center, to co-teach a summer seminar for labor leaders for which he had secured funding from the National Endowment for the Humanities (NEH). The NEH summer seminars, in an innovative combination of academic and public history, were designed to communicate to unionized workers the fruits of the new social and labor history that Herb had done so much to pioneer and to which I had committed my nascent academic career in graduate school at UCLA. With the success of these summer seminars, which we taught at the CUNY Graduate Center in 1979 and 1980, Gutman and I decided to create the American Social History Project (ASHP) at CUNY. We reasoned that reaching 15 workers each summer in our seminars, though immensely rewarding for all involved (including the two teachers), was not as efficient as creating a new curriculum that we could make available to adult and worker education programs and teachers across the country. The project quickly received major grants in 1981 and 1982, totaling $1.2 million, from the NEH and the Ford Foundation, and under Herb’s and my leadership we rapidly hired a staff of a dozen historians, teachers, artists, and administrators to create a multimedia curriculum, entitled “Who Built America?” (WBA?). The curriculum mixed the writing of a new two-volume trade book focused on working people’s contributions to US history with a range of new multimedia productions (initially 16mm films and slide/tape shows, VHS videos and, later, a range of digital productions, including two Who Built America? CD-ROMs and several web sites such as “History Matters”). ASHP also had a second, clear orientation, in addition to developing multimedia materials: We built a vibrant education program that connected the project in its first few years with CUNY community college faculty and also New York City high school teachers who used our media materials (including specially designed accompanying viewer guides) in their classes that helped deepen and refine Who Built America?’s pedagogical impact on students. We hoped this multimedia curriculum and ASHP’s ongoing engagement with teachers would broaden the scope and popular appeal of working-class and social history and would be widely adopted in high school, community college, and worker education classrooms around the country as well as by the general public.[22]

I should note here that my early exposure to electronic tools, including being a “ham” radio operator and electronics tinkerer in high school in the early 1960s and using mainframe computers at UCLA in 1975, inclined me to become an early and enthusiastic adopter of and proselytizer for personal computers when they became publicly available in the early 1980s. I insisted in 1982, for example, against resistance from some of my ASHP colleagues who expected to have secretarial help in writing and editing their WBA? chapter drafts, that we use personal computers (I was Kaypro II guy!) to facilitate the drafting and editing of the Who Built America? textbook, work on which began that year (ASHP 1990, 1992).[23]

Kaypro II Computer
Figure 8: Kaypro II Computer

 
ASHP stood outside of the academic history profession as traditionally understood and practiced in universities at that time. As a grant-funded, university-based project with a dozen staff members, many of us with ABDs in history who worked on the project full-time (not on traditional nine-month academic schedules), ASHP staff were clearly “alt-ac”ers several decades before anyone coined that term. We wore our non-traditional academic identities proudly and even a bit defiantly. Gutman and I also realized, nonetheless, that ASHP needed a direct link to an academic institution like CUNY to legitimize and to establish an institutional base that would allow the project to survive and thrive, which led us to instantiate ASHP inside of CUNY. The American Social History Project, in fact, celebrated its 35th anniversary in CUNY in October 2016.[24] That was a consequential decision, obviously, since ASHP might not have survived without the kind of institutional and bureaucratic support that CUNY (and the Graduate Center) have provided over the past three and a half decades. ASHP, at the same time, also stood outside of the academic history profession in believing in and in producing our work collaboratively, which militated against the “lone scholar in the archive” cult that still dominates most academic scholarship and continues to fundamentally determine the processes of promotion and tenure inside the academy. Public history, which many ASHP staff members came out of, had argued for and even privileged such collaborative work, which in a very real sense is a precursor to the more collaborative work and projects that now define much of the new digital scholarship in the Digital Humanities and in the “alt-ac” careers that have proliferated in its wake. Well before Lisa Spiro (2012) enumerated her list of key DH “values”—openness, collegiality and connectedness, diversity, and experimentation—we had embodied those very values in how we structured and operated the American Social History Project (and continue to do so), a set of values that I have also tried to incorporate and teach in all of my academic work ever since.

ASHP’s engagement with collaborative digital work began quite early. In 1990 we launched a series of co-ventures with social historian Roy Rosenzweig (who had been a valued and important ASHP collaborator from the outset of the project a decade earlier, including as a co-author of the Who Built America? textbook) and Bob Stein, the head of The Voyager Company, the pioneering digital publisher. Roy and I had begun in the late 1980s to ruminate about the possibilities of computer-enhanced historical presentations when Bob Stein approached me in 1990 with a proposal to turn the first volume of the WBA? trade book (which had just been published) into an electronic book (ASHP 1990).[25] Applying the best lessons Roy and I and our ASHP colleagues had learned as public historians who were committed to using visual, video, audio, and textual tools and resources to convey important moments and struggles in US history, we worked with Voyager staff to conceive, design, and produce the first Who Built America? CD-ROM in 1993, covering the years 1876 to 1914 (ASHP 1993).[26] As noted earlier, our use of multimedia forms was an essential attribute that we learned as practitioners of public history, a quite different orientation than that relied on by literary DHers who work with text analysis.

The disk, which was co-authored by Roy Rosenzweig, Josh Brown, and me, was arguably the first electronic history book and one of the first e-books ever to appear. The WBA? CD-ROM won critical popular acclaim and a number of prestigious awards, inside in the academy and beyond (Thomas 2004). It also generated, perhaps because of its success, a degree of political notoriety when its inclusion by Apple in the tens of thousands of educational packs of CD-ROMs the company gave away to K-12 schools that purchased Apple computers in 1994-95 led to a coordinated attack on WBA?, ASHP, and Apple by the Christian Right and the Moral Majority. The Radical Right was troubled by the notion conveyed in several of the literally hundreds of primary historical documents we included in the CD-ROM that “gay cowboys” might have been involved in the “taming” of the West or that abortion was common in early twentieth-century urban America. The right-wing attacks were reported in the mainstream press, including the Wall Street Journal and Newsweek.

Putting the ‘PC’ in PCs,” Newsweek, February 20, 1995
Figure 9: “Putting the ‘PC’ in PCs,” Newsweek, February 20, 1995

 
The Right, however, ironically failed in all the furor to notice the CD-ROM’s explicitly pro-worker/anti-capitalist politics! The Right tried to get Apple to remove the WBA? CD-ROM from the education packs, but Apple ultimately backed ASHP and WBA?, though only after much contention and negative publicity.[27]

Despite this political controversy, the first WBA? CD-ROM and early historical web projects like Ed Ayers’s Civil War-era The Valley of the Shadow (1993) helped imagine new possibilities for digital scholarship and digital presentations of historical work. I would suggest that the appearance of the first WBA? CD-ROM nearly a quarter century ago was one of the pioneering instances of the new digital history that contributed a decade later to the emergence of the Digital Humanities, making Roy, Josh, and me and our ASHP colleagues what I have termed in the title of this article and elsewhere in print “premature digital humanists.”[28] That said, I do believe we missed an opportunity to begin to build connections to other scholars outside of history who were undertaking similar digital work around the same time that we completed the WBA? CD-ROM in 1993. Jerry McGann, for example, was beginning his pioneering work at the University of Virginia on the Rossetti Archive and was writing his landmark study “The Rationale of HyperText” (McGann 1995). And while we became aware of each other’s work over the next half dozen years, we never quite came together to ponder the ways in which our very disparate disciplinary approaches to digital scholarship and presentation might have productively been linked up or at least put into some kind of active dialogue. As a result, digital history and digital literary studies occupied distinct academic silos, following quite different paths and embracing very different methodologies and ideas. And neither digital history nor digital literary studies had much in common with the digital new media artists who were also working in this same period and even earlier, grouped around the pioneering journal Ars Electronica.[29] This was a missed opportunity that I believe has hindered Digital Humanities from being more of a big tent and, more importantly, allowing it to become a more robust interdisciplinary force inside the academy and beyond.

In any case my digital history colleagues and I continued to pursue our own digital history work. Roy Rosenzweig, who taught at George Mason University, founded the Center for History and New Media in 1994 a year after the first WBA? CD-ROM appeared. Our two centers next collaborated on several award-winning digital history projects, including the History Matters website mentioned earlier, which made many of the public domain primary source documents presented originally in the WBA? CD-ROM available online. This proved to be a particularly useful and accessible way for teachers at both the high school and college levels to expose their students to a rich array of primary historical sources. And, following the September 11, 2001 terrorist attacks in New York and Washington, DC, our two centers were invited by the Sloan Foundation to collaborate on the development of the September 11 Digital Archive (9/11DA). As Josh Brown and I argued in an article on the creation of the 9/11DA, September 11th was “the first truly digital event of world historical importance: a significant part of its historical record—from e-mail to photography to audio to video—was expressed, captured, disseminated, or viewed in (or converted to) digital forms and formats” (Brier and Brown 2011, 101). It was also one of the first digital projects to be largely “crowdsourced,” given our open solicitation of ordinary people’s digital reminiscences, photos, and videos of the events of September 11th and its aftermath. As historians faced with the task of conceiving and building a brand new digital archive from scratch that focused on a single world historical event, we were also forced to take on additional roles as archivists and preservationists, something we had previously and happily left to professional librarians. We had to make judgments about what to include and exclude in the 9/11 archive, how and whether to display it online, how to contextualize those resources, and, when voluntary online digital submissions of materials by individuals proved insufficient to allow us to offer a fully-rounded picture of what happened, how to target particular groups (including Muslims, Latinos, and the Chinese community in lower Manhattan) with special outreach efforts to be able to include their collective and individual stories and memories in the 9/11DA. Our prior work in and long-term engagement with public history proved essential in this process. We ended up putting the archive online as we were building it, getting the initial iteration of the site up on the web in January 2002 well before the lion’s share of individual digital submissions started pouring in. The body of digital materials that came to constitute the September 11 Digital Archive ultimately totaled nearly a quarter million discrete digital items, making it one of the largest and most comprehensive digital repositories of materials on the September 11 attacks.[30]

While literary scholars confront similar issues of preservation of and access to the materials they are presenting in digital archives, they usually have had the good fortune to be able to rely on extant and often far more circumscribed print sources as the primary materials they are digitizing, annotating, and presenting to fellow scholars and the general public. Public historians who are collecting digital historical data to capture what happened in the recent past or even the present, as we were forced to do in the September 11 Digital Archive, do not have the luxury of basing our work on a settled corpus of information or data. We also faced the extremely delicate task of putting contemporary people’s voices online, making their deepest and most painful personal insights and feelings available to a public audience. Being custodians of that kind of source material brings special responsibilities and sensitivities that most literary digital humanists don’t have to deal with when constructing their digital archives. Our methodologies and larger public imperatives as digital historians are therefore different from those of digital literary scholars. This is especially true given our commitment in the 9/11DA and other digital history archiving projects like the CHNM’s “Hurricane Digital Memory Bank” (on the devastating 2005 Gulf Coast hurricanes Katrina and Rita), as well as ASHP’s current CUNY Digital History Archive project. The latter focuses on student and faculty activism across CUNY beginning in the late 1960s and on presenting historical materials that are deeply personal and politically consequential.[31]

It is important to note that while ASHP continued to collaborate on several ongoing digital history projects with CHNM (headed first by Dan Cohen and Tom Scheinfeldt after Roy’s death in 2007, and, since 2013, by Stephen Robertson), the two centers have moved in different directions in terms of doing digital history. CHNM’s efforts have focused largely on the development of important digital software tools. CHNM’s Zotero, for example, is used to help scholars manage their research sources, while its Omeka software offers a platform for publishing online collections and exhibitions. CHNM has also established a strong and direct connection to the Digital Humanities field, especially through its THATCamps, which are participant-directed digital skills workshops and meetings.[32] On the other hand, ASHP has stayed closer to its original purpose of developing a range of well curated and pedagogically appropriate multimedia historical source materials for use by teachers and students at both the high school and college levels, intended to help them understand and learn about the past. Emblematic of ASHP’s continuing work are The Lost Museum: Exploring Antebellum American Life and Culture and HERB: Social History for Every Classroom websites as well as Mission US, an adventure-style online series of games in which younger players take on the role of young people during critical moments in US history.[33]

From ASHP to ITP and the Digital Humanities

I moved on in my own academic career after formally leaving ASHP as its executive director in 1998, though I remained actively involved in a number of ongoing ASHP digital projects. These included the development of a second WBA? CD-ROM, covering the years from 1914 to 1946, which was published in 2001 (ASHP 2001) and is still available, as well as the aforementioned 9/11 Digital Archive and the CUNY Digital History Archive. As I morphed over three decades from analog media producer, to digital media producer, to digital archivist/digital historian, I became keenly aware of the need to extend the lessons of the public and digital history movements I helped to build to my own and my graduate students’ classroom practices. That was what drove me to develop the Interactive Technology and Pedagogy (ITP) certificate program at the CUNY Graduate Center in 2002. My goal was to teach graduate students that digital tools offered real promise beyond the restricted confines of academic research in a single academic field to help us reimagine and to reshape college classrooms and the entire teaching and learning experience, as my ASHP colleagues and I began doing more than 30 years ago with the Who Built America? education program. I always tell ITP students that I take the “P” in our name (“Pedagogy”) as seriously as I take the “T” (“Technology”) as a way to indicate the centrality of teaching and learning to the way the certificate program was conceived and has operated. I have coordinated ITP for almost 15 years now and will be stepping down as coordinator at the end of the spring 2017 term. I believe that the program has contributed as much to digital pedagogy and to the Digital Humanities as anything else I’ve been involved in, not only at the CUNY Graduate Center where I have been fortunate to have labored for almost all of my academic career, but also in the City University of New York as a whole.[34] One of the ITP program’s most important and ongoing contributions to the Digital Humanities and digital pedagogy fields has been the founding in 2011 of the online Journal of Interactive Technology and Pedagogy, which is produced twice-yearly and is directed by an editorial collective of digital scholars and digital pedagogues, including faculty, graduate students, and library staff.

Working with faculty colleagues like Matt Gold, Carlos Hernandez, Kimon Keramidas, Michael Mandiberg, and Maura Smale, with many highly motivated and skilled graduate students (too numerous to name here), and committed digital administrators and leaders like Luke Waltzer, Lisa Brundage, and Boone Gorges, as well as my ongoing work with long-time ASHP colleagues and comrades Josh Brown, Pennee Bender, Andrea Ades Vasquez, and Ellen Noonan, I have been blessed with opportunities to help create a robust community of digital practice at the Graduate Center and across CUNY. This community of scholars and digital practitioners has helped develop a progressive vision of digital technology and digital pedagogy that I believe can serve as a model for Digital Humanities work in the future. Though far from where I began forty years ago as a doctoral student with an IBM 360 computer and a stack of Fortran cards, my ongoing digital work at CUNY seems to me to be the logical and appropriate culmination of a career that has spanned many identities, including as a social and labor historian, public historian, digital historian, digital producer, and, finally, as a digital pedagogue who has made what I hope has been a modest contribution to the evolution and maturation of the field of Digital Humanities.

Notes

[1] Busa, an Italian Jesuit priest, traveled to New York City in 1949 and convinced IBM founder Thomas Watson to let him use IBM’s mainframe computer to generate a concordance of St. Thomas Aquinas’s writing, Busa’s life work. The best book on the key role of Father Busa is Steven E. Jones. 2016. Roberto Busa, S.J., and The Emergence of Humanities Computing: The Priest and the Punched Cards. New York: Routledge. Geoffrey Rockwell argues that an alternative to starting the history of DH with Busa is to look to the work of linguists who constructed word frequency counts and concordances as early as 1948 using simulations of computers (Rockwell 2007). Willard McCarty, one of the founders of humanities computing, has recently suggested that we could probably trace DH’s origins all the way back to Alan Turing’s “Machine” in the 1930s and 1940s. See McCarty, Willard. 2013. “What does Turing have to do with Busa?” Keynote for ACRH-3, Sofia Bulgaria, December 12. http://www.mccarty.org.uk/essays/McCarty,%20Turing%20and%20Busa.pdf.

[2] The origins of the TEI are described at http://www.tei-c.org/About/history.xml.

[3] See especially the following contributions on DH’s origins in Debates in the Digital Humanities: Matthew Kirschenbaum’s “What is DH and What’s It Doing in English Departments?” http://dhdebates.gc.cuny.edu/debates/text/38; and Steven E. Jones’s “The Emergence of the Digital Humanities (as the Network Is Everting)” http://dhdebates.gc.cuny.edu/debates/text/52. Kenneth M. Price and Ray Siemens reproduce a similar chronology of the literary origins of DH in their 2013 introduction to Literary Studies in the Digital Age (https://dlsanthology.commons.mla.org/introduction/). Willard McCarty is apparently working on his own history of literary computing from Busa to 1991. It is interesting to note, on the other hand, that Franco Moretti, a literary scholar, a key player in DH, and author of one of the field’s foundational texts, Graphs, Maps, Trees: Abstract Models for Literary History, readily acknowledges that academic work in quantitative history (which I discuss later in this essay) helped shape his important concept of “distant reading” (Moretti 2005, 1-30). Distant reading is a fundamental DH methodology at the core of digital literary studies.

[4] I am obviously not tilling this ground alone. There are several major projects underway to dig out the origins/history of Digital Humanities. One of the most promising is the efforts of Julianne Nyhan and her colleagues at the Department of Information Studies, University College London. Their “Hidden Histories: Computing and the Humanities c.1949-1980” project is based on a series of more than 40 oral history interviews with early DH practitioners with the intention of developing a deeper historical understanding of the disciplinary and interdisciplinary starting and continuation points of DH (Nyhan, et al. 2015; Nyhan and Flinn 2016).

[5] My colleague Michael Mandiberg has astutely noted that DH has other important origins and early influences besides literary studies and history. He suggests that DH “has been retracing the steps of new media art,” evidenced by the founding of Ars Electronica in 1979. https://www.aec.at/about/en/geschichte/.

[6] One of the pioneers of this new social history methodology, the Philadelphia Social History Project, based at the University of Pennsylvania, employed early mainframe computers in the late 1970s to create relational databases of historical information about the residents of Philadelphia (Thomas 2004).

[7] Radical History Review 25 (Winter 1980-81). The RHR issue had two other co-editors: Robert Entenmann and Warren Goldstein.

[8] The Presenting the Past collection included essays by Mike Wallace, Michael Frisch, and Roy Rosenzweig analyzing how historical consciousness has been constructed by history museums and mainstream historical publications, as well as essays by Linda Shopes, James Green, and Jeremy Brecher on how local groups in Baltimore, Boston, and in Connecticut’s Brass Valley created alternative ways and formats to understand and present their community’s history of oppositional struggles.

[9] Roy founded CHNM in 1994. The center was appropriately named for him following his death in 2007.

[10] A much-expanded version of Robertson’s original blog post appeared in the 2016 edition of Debates in the Digital Humanities (Gold and Klein 2016): http://dhdebates.gc.cuny.edu/debates/text/76.

[11] A useful introduction to quantification in history can be found at “What Is Quantitative History?” on the History Matters website: http://historymatters.gmu.edu/mse/numbers/what.html. Historian Cameron Blevins also discusses the origins of quantitative history in his essay in Debates in the Digital Humanities 2016: http://dhdebates.gc.cuny.edu/debates/text/77.

[12] Carl Bridenbaugh, a traditional historian of colonial American history, sharply attacked those who would “worship at the shrine of the Bitch goddess QUANTIFICATION” (quoted in Novick 1988, 383–84; capitalization in the original).

[13] I devoted a chapter of my dissertation to a critique of Thernstrom’s conclusions in Poverty and Progress and subsequent publications about the political impact of a large “floating proletariat” on working-class social mobility in US history, which he concluded served to undercut working-class consciousness. My dissertation argued otherwise.

[14] Thernstrom had been teaching at UCLA, where I first encountered him while working on my doctorate. He departed for Harvard in 1973 just in time for Roy Rosenzweig to become one of his doctoral students. Roy completed his dissertation in 1978 on workers in Worcester, Massachusetts, which incorporated little of Thernstrom’s quantitative methodology, but instead employed much of Herbert Gutman’s social and labor history approach. See Rosenzweig, Roy. 1985. Eight Hours for What We Will: Workers and Leisure in an Industrial City, 1870-1920. New York: Cambridge Univ. Press.

[15] Peter Passell, a Columbia economist, in a review of Time on the Cross, declared: “If a more important book about American history has been published in the last decade, I don’t know about it” (Passell 1974). The authors, Passell concluded, “have with one stroke turned around a whole field of interpretation and exposed the frailty of history done without science.”

[16] The strikes were detailed in the third and tenth printed annual reports of the US Commissioner of Labor. U.S. Commissioner of Labor, Third Annual Report. . .1887: Strikes and Lockouts (Washington D.C.: U.S. GPO, 1888); U.S. Commissioner of Labor, Tenth Annual Report. . .1894: Strikes and Lockouts (Washington D.C.: U.S. GPO, 1896).

[17] UCLA was one of the first campuses on the West Coast to develop a computer center, growing out of its early ARPANET involvement. With Stanford, UCLA had participated in the first host-to-host computer connection on ARPANET in October 1969. See http://internetstudies.ucla.edu/. I have no idea what model number of IBM 360 UCLA was using in 1975, but it may well have been the last in the line, the Model 195. See http://www-03.ibm.com/ibm/history/exhibits/mainframe/mainframe_FS360.html. See also Roy Rosenzweig’s (1998) important review essay on the history of the Internet, “Wizards, Bureaucrats, Warriors, and Hackers: Writing the History of the Internet”: http://rrchnm.org/essay/wizards-bureaucrats-warriors-hackers-writing-the-history-of-the-internet/.

[18] Melissa Terras and Julianne Nyhan, in an essay in Debates in the Digital Humanities 2016, tell a similar story about the unknown female keypunch operators Father Busa employed. http://dhdebates.gc.cuny.edu/debates/text/57.

[19] These included regression analyses, standard deviations, and F and T tests of variance.

[20] In a short blog post, Ramsay argued that DHers needed to “make things,” to learn how to code to really consider themselves DHers; it caused quite a flap. See Ramsay, Stephen. 2011. “Who’s In and Who’s Out.” Stephen Ramsay Blog. http://stephenramsay.us/text/2011/01/08/whos-in-and-whos-out/.

[21] The 1977 article was reprinted in Rabb, Theodore and Robert Rotbert, eds. 1981. Industrialization and Urbanization: Studies in Interdisciplinary History. Princeton, NJ: Princeton University Press and in excerpted form in Brenner, A., B. Day and M. Ness, eds. 2009. The Encyclopedia of Strikes in American History. Armonk, NY: M.E. Sharpe. One of the deans of U.S. labor history, David Montgomery, referenced our data and article and employed a similar set of statistical measures in his important article on nineteenth-century US strikes. Montgomery, David. 1980. “Strikes in Nineteenth-Century America.” Social Science History 4: 91-93.

[22] I continued to serve as ASHP’s executive director until 1998, when my shoes were ably filled by my long-time ASHP colleague, Joshua Brown, who continues to head the project to this day. I went on to serve as a senior administrator (Associate Provost and then Vice President) at the Graduate Center until 2009, when I resumed my faculty duties there.

[23] I needed special permission from our funder, the Ford Foundation, to spend ten thousand dollars of our grant to buy four Kaypro II computers (running the CPM operating system and the Wordstar word processing program) on which the entire first volume of WBA? was produced. I keep my old Kaypro II, a 30-pound “luggable,” and a large box of 5.25” floppy computer disks to show my students what early personal computers looked and felt like. My fascination with and desire to hold on to older forms of technology (I also drive a fully restored 1972 Oldsmobile Cutlass Supreme as well) apparently resonates with contemporary efforts to develop an archeology of older media formats and machines at places like the Media Archaeology Laboratory at the University of Colorado. See http://mediaarchaeologylab.com/.

[24] This decision to formally establish ASHP as part of the CUNY Graduate Center proved particularly important, given Herb Gutman’s untimely death in 1985 at age 56. ASHP became part of the Center for Media and Learning (CML) that we founded at CUNY in 1990, which has also provided the institutional home for the Graduate Center’s New Media Lab (NML), which I co-founded in 1998 and continue to co-direct. The NML operates under the aegis of the CML.

[25] I recounted Roy’s and my visit in 1989 to a Washington, DC trade show of computer-controlled training modules and programs in my tribute to him after his death in 2007. See http://thanksroy.org/items/show/501.

[26] Because the first WBA? CD-ROM was produced for earlier Mac (OS9) and PC (Windows 95) operating systems, it is no longer playable on current computer systems, yet another orphaned piece of digital technology in a rapidly evolving computing landscape.

[27] Michael Meyer, “Putting the ‘PC’ in PCs,” Newsweek (February 20, 1995): 46; Jeffrey A. Trachtenberg, “U.S. History on a CD-ROM Stirs Up a Storm,” Wall Street Journal (February 10, 1995): B1-B2; and Juan Gonzalez. “Apple’s Big Byte Out of History.” New York Daily News (February 8, 1995): 10. We managed to fend off the Right-wing attack with what was then an unheard of barrage of email messages that we were able to generate from librarians and school teachers all over the world. It’s important to recall that email was still a relatively new technology in 1995 (AOL, Prodigy, and CompuServe were all launched in that year). The librarians emailed Apple in droves, convincing the company that unless it kept the WBA? CD-ROM in its education packs, the librarians would be unable to recommend future purchases of Apple computers for their schools. After the appointment of a panel of unnamed educators had endorsed the value of the WBA? CD-ROM, Apple resumed distributing copies of the disk in their education bundles for another year, with the total number of distributed WBA? CD-ROMs reaching almost 100,000 copies.

[28] I appropriated the “premature” phrase and explained its historical origins in the mid-1930s fight against fascism in a footnote to my article, “Where’s the Pedagogy? The Role of Teaching and Learning in the Digital Humanities” (Gold 2012, fn12). The standard work on digital history is Dan Cohen and Roy Rosenzweig. 2005. Digital History: A Guide to Gathering, Preserving, and Presenting the Past on the Web. Philadelphia: University of Pennsylvania Press.

[29] Lev Manovich (2001) in The Language of New Media notes that artists began using digital technology during the 1990s to extend and enhance their work, a key moment in what he describes as “the computerization of culture” (221).

[30] It remains, to this day, in the top 15 results one gets out of the nearly 200 million results in a Google search for “September 11.”

[31] See CHNM’s Sheila Brennan and Mills Kelly’s essay on the Hurricane Digital Memory Bank, “Why Collecting History Online is Web 1.5,” on the CHNM website at http://chnm.gmu.edu/essays-on-history-new-media/essays/?essayid=47. The initial online iteration of the CUNY Digital History Archive can be found at http://cdha.cuny.edu/.

[32] Descriptions and details about CHNM’s various projects described here can be found at http://chnm.gmu.edu/.

[33] Descriptions and details about ASHP’s various projects described here can be found on the ASHP website: http://ashp.cuny.edu/.

[34] My contribution to the 2012 edition of Debates in the Digital Humanities was an article entitled “Where’s the Pedagogy? The Role of Teaching and Learning in the Digital Humanities,” which argued that DHers need to pay more attention to pedagogy in their work. http://dhdebates.gc.cuny.edu/debates/text/8.

Bibliography

American Social History Project. 1990, 1992. Who Built America? Working People and Nation’s Economy, Politics, Culture and Society. New York: Pantheon.

———. 1993. Who Built America: From the Centennial Celebration of 1876 to the Great War of 1914 (CD-ROM). Santa Monica, CA: Voyager Co.

———. 2001. Who Built America? From the Great War of 1914 to the Dawn of the Atomic Age (CD-ROM). New York: Worth Publishers.

American Social History Project and Center for History and New Media. 1998. History Matters: The U.S. History Survey on the Web. http://historymatters.gmu.edu.

Amsden, Jon and Stephen Brier. 1977. “Coal Miners on Strike: The Transformation of Strike Demands and the Formation of a National Union.” The Journal of Interdisciplinary History: 8, 583–616.

Aptheker, Herbert. 1943 (1963). American Negro Slave Revolts. New York: International Publishers.

Benson, Susan Porter, Stephen Brier, and Roy Rosenzweig. 1986. Presenting the Past: Essays on History and the Public. Philadelphia: Temple University Press.

Brier, Stephen. 1992. “‘The Most Persistent Unionists’: Class Formation and Class Conflict in the Coal Fields and the Emergence of Interracial and Interethnic Unionism, 1880 –1904.” PhD diss., UCLA.

Brier, Stephen and Joshua Brown. 2011. “The September 11 Digital Archive: Saving the Histories of September 11, 2001.” Radical History Review 111 (Fall 2011): 101-09.

Fogel, Robert William and Stanley L. Engerman. 1974. Time on the Cross: The Economics of American Negro Slavery. Boston: Little, Brown and Company.

Gold, Matthew, ed. 2012. Debates in the Digital Humanities. Minneapolis: University of Minnesota Press.

Gold, Matthew and Lauren Klein, eds. 2016. Debates in the Digital Humanities 2016. Minneapolis: University of Minnesota Press.

Graham, S., I. Milligan, and S. Weingart. 2015. “Early Emergences: Father Busa, Humanities Computing, and the Emergence of the Digital Humanities.” The Historian’s Macroscope: Big Digital History. http://www.themacroscope.org/?page_id=601.

Gutman, Herbert. 1975. Slavery and the Numbers Game: A Critique of Time on the Cross. Urbana, IL: University of Illinois Press.

Hockey, Susan. 2004. “The History of Humanities Computing.” In A Companion to Digital Humanities, edited by Susan Schreibman, Roy Siemens, and John Unsworth. Oxford: Blackwell. http://www.digitalhumanities.org/companion/view?docId=blackwell/9781405103213/9781405103213.xml&chunk.id=ss1-2-1.

Lubar, Steven. 1992. ‘Do Not Fold, Spindle or Mutilate’: A Cultural History of the Punch Card.” Journal of American Culture 15: 43–55.

Manovich, Lev. 2001. The Language of New Media. Cambridge: The MIT Press.

McCarty, Willard. 2011. “Beyond Chronology and Profession: Discovering How to Write a History of the Digital Humanities.” Willard McCarty web page. University College London. http://www.mccarty.org.uk/essays/McCarty,%20Beyond%20chronology%20and%20profession.pdf.

McGann, Jerome. 1995. “The Rationale of Hypertext.” http://www2.iath.virginia.edu/public/jjm2f/rationale.html.

Moretti, Frank. 2005. Graphs, Maps, Trees: Abstract Models for Literary History. Brooklyn, NY: Verso.

Noiret, Serge. 2012 [2015]. “Digital History: The New Craft of (Public) Historians.” http://dph.hypotheses.org/14.

Novick, Peter. 1988. That Noble Dream: The ‘Objectivity Question’ and the American Historical Profession. New York: Cambridge Univ. Press.

Nyhan, Julianne, Andrew Flinn, and Anne Welsh. 2015. “Oral History and the Hidden Histories Project: Towards Histories of Computing in the Humanities.” Digital Scholarship in the Humanities 30: 71-85. Oxford: Oxford University Press. http://dsh.oxfordjournals.org/content/30/1/71/.

Nyhan, Julianne and Andrew Flinn. 2016. Computation and the Humanities: Towards an Oral History of Digital Humanities. Cham, Switzerland: Springer Open. http://link.springer.com/book/10.1007%2F978-3-319-20170-2.

Passell, Peter. 1974. “An Economic Analysis of that Peculiarly Economic Institution.” New York Times. April 28. http://www.nytimes.com/1974/04/28/archives/an-economic-analysis-of-that-peculiarly-economic-institution-vol-ii.html.

Robertson, Stephen. 2014. “The Differences between Digital History and Digital Humanities.” Stephen Robertson’s Blog. May 23. https://drstephenrobertson.com/blog-post/the-differences-between-digital-history-and-digital-humanities/.

Rockwell, Geoffrey. 2007. “An Alternate Beginning to Humanities Computing.” Geoffrey Rockwell’s Research Blog. May 2. http://theoreti.ca/?p=1608.

Rosenzweig, Roy. 1998. “Wizards, Bureaucrats, Warriors, and Hackers: Writing the History of the Internet.” American Historical Review 103: 1530-52. http://rrchnm.org/essay/wizards-bureaucrats-warriors-hackers-writing-the-history-of-the-internet/

Shorter, Edward. 1971. The Historian and the Computer: A Practical Guide. Englewood Cliffs, NJ: Prentice-Hall.

Spiro, Lisa. 2012. “‘This is Why We Fight’: Defining the Values of the Digital Humanities.” In Debates in the Digital Humanities, edited by Matthew Gold. Minneapolis: University of Minnesota Press. http://dhdebates.gc.cuny.edu/debates/text/13.

Stampp, Kenneth. 1956 (1967). The Peculiar Institution: Slavery in the Ante-Bellum South. New York: Knopf.

Thernstrom, Stephan. 1964. Poverty and Progress: Social Mobility in a Nineteenth Century City. Cambridge: Harvard University Press.

Thomas. William G. II. 2004. “Computing and the Historical Imagination.” In A Companion to Digital Humanities, edited by Susan Schreibman, Ray Siemens, and John Unsworth. Oxford: Blackwell.

Woodward, C. Vann. 1974. “The Jolly Institution.” New York Review of Books. May 2.

Acknowledgments

The author thanks Jon Amsden, Josh Brown, Matt Gold, Steven Lubar, Michael Mandiberg, Julianne Nyhan, Stephen Robertson, and Luke Waltzer for helpful comments and suggestions on an earlier draft of this essay.

About the Author

Stephen Brier is a social and labor historian and educational technologist who teaches in the PhD program in Urban Education and is the founder and coordinator of the Interactive Technology and Pedagogy doctoral certificate program, both at the CUNY Graduate Center. He served for eighteen years as the founding director of the American Social History Project/Center for Media and Learning and as a senior administrator for eleven years at the Graduate Center. Brier helped launch the Journal of Interactive Technology and Pedagogy in 2011 and served as a member of the journal’s editorial collective until 2017.

96

A Survey of Digital Humanities Programs

Abstract

The number of digital humanities programs has risen steadily since 2008, adding capacity to the field. But what kind of capacity, and in what areas? This paper presents a survey of DH programs in the Anglophone world (Australia, Canada, Ireland, the United Kingdom, and the United States), including degrees, certificates, and formalized minors, concentrations, and specializations. By analyzing the location, structure, and disciplinarity of these programs, we examine the larger picture of DH, at least insofar as it is represented to prospective students and cultivated through required coursework. We also explore the activities that make up these programs, which speak to the broader skills and methods at play in the field, as well as some important silences. These findings provide some empirical perspective on debates about teaching DH, particularly the attention paid to theory and critical reflection. Finally, we compare our results (where possible) to information on European programs to consider areas of similarity and difference, and sketch a broader picture of digital humanities.

Introduction

Much has been written of what lies inside (and outside) the digital humanities (DH). A fitting example might be the annual Day of DH, when hundreds of “DHers” (digital humanists) write about what they do and how they define the field (see https://twitter.com/dayofdh). Read enough of their stories and certain themes and patterns may emerge, but difference and pluralism will abound. More formal attempts to define the field are not hard to find—there is an entire anthology devoted to the subject (Terras, Nyhan, and Vanhoutte 2013)—and others have approached DH by studying its locations (Zorich 2008; Prescott 2016), its members (Grandjean 2014a, 2014b, 2015), their communication patterns (Ross et al. 2011; Quan-Haase, Martin, and McCay-Peet 2015), conference submissions (Weingart 2016), and so forth.

A small but important subset of research looks at teaching and learning as a lens through which to view the field. Existing studies have examined course syllabi (Terras 2006; Spiro 2011) and the development of specific programs and curricula (Rockwell 1999; Siemens 2001; Sinclair 2001; Unsworth 2001; Unsworth and Butler 2001; Drucker, Unsworth, and Laue 2002; Sinclair & Gouglas 2002; McCarty 2012; Smith 2014). In addition, there are pedagogical discussions about what should be taught in DH (Hockey 1986, 2001; Mahony & Pierazzo 2002; Clement 2012) and its broader relationship to technology, the humanities, and higher education (Brier 2012; Liu 2012; Waltzer 2012).

This study adds to the literature on teaching and learning by presenting a survey of existing degree and certificate programs in DH. While these programs are only part of the activities that make up the broader world of DH, they provide a formal view of training in the field and, by extension, of the field itself. Additionally, they reflect the public face of DH at their institutions, both to potential students and to faculty and administrators outside of DH. By studying the requirements of these programs (especially required coursework), we explore the activities that make up DH, at least to the extent that they are systematically taught and represented to students during admissions and recruitment, as well as where DH programs position themselves within and across the subject boundaries of their institutions. These activities speak to broader skills and methods at play in DH, as well as some important silences. They also provide an empirical perspective on pedagogical debates, particularly the attention paid to theory and critical reflection

Background

Melissa Terras (2006) was the first to point to the utility of education studies in approaching the digital humanities (or what she then called “humanities computing”). In the broadest sense, Terras distinguishes between subjects, which are usually associated with academic departments and defined by “a set of core theories and techniques to be taught” (230), and disciplines, which lack departmental status yet still have their own identities, cultural attributes, communities of practice, heroes, idols, and mythology. After analyzing four university courses in humanities computing, Terras examines other aspects of the community such as its associations, journals, discussion groups, and conference submissions. She concludes that humanities computing is a discipline, although not yet a subject: “the community exists, and functions, and has found a way to continue disseminating its knowledge and encouraging others into the community without the institutionalization of the subject” (242). Terras notes that humanities computing scholars, lacking prescribed activities, have freedom in developing their own research and career paths. She remains curious, however, about the “hidden curriculum” of the field at a time when few formal programs yet existed.

Following Terras, Lisa Spiro (2011) takes up this study of the “hidden curriculum” by collecting and analyzing 134 English-language syllabi from DH courses offered between 2006–2011. While some of these courses were offered in DH departments (16, 11.9%), most were drawn from other disciplines, including English, history, media studies, interdisciplinary studies, library and information science, computer science, rhetoric and composition, visual studies, communication, anthropology, and philosophy. Classics, linguistics, and other languages were missing. Spiro analyzes the assignments, readings, media types, key concepts, and technologies covered in these courses, finding (among other things) that DH courses often link theory to practice; involve collaborative work on projects; engage in social media such as blogging or Twitter; focus not only on text but also on video, audio, images, games, maps, simulation, and 3D modeling; and reflect contemporary issues such as data and databases, openness and copyright, networks and networking, and interaction. Finally, Spiro presents a list of terms she expected to see more often in these syllabi, including “argument,” “statistics,” “programming,” “representation,” “interpretation,” “accessibility,” “sustainability,” and “algorithmic.”

These two studies form the broad picture of DH education. More recent studies have taken up DH teaching and learning within particular contexts, such as community colleges (McGrail 2016), colleges of liberal arts and science (Alexander & Davis 2012; Buurma & Levine 2016), graduate education (Selisker 2016), libraries (Rosenblum, et al., 2016; Varner 2016; Vedantham & Porter 2016) and library and information science education (Senchyne 2016), and the public sphere (Brennan 2016; Hsu 2016). These accounts stress common structural challenges and opportunities across these contexts. In particular, many underscore assumptions made about and within DH, including access to technology, institutional resources, and background literacies. In addition, many activities in these contexts fall outside of formal degrees and programs or even classroom learning, demonstrating the variety of spaces in which DH may be taught and trained.

Other accounts have drawn the deep picture of DH education by examining the development of programs and courses at specific institutions, such as McMaster University (Rockwell 1999), University of Virginia (Unsworth 2001; Unsworth and Butler 2001; Drucker, Unsworth, and Laue 2002), University of Alberta (Sinclair & Gouglas 2002), King’s College London (McCarty 2012), and Wilfrid Laurier University (Smith 2014), among others. Abstracts from “The Humanities Computing Curriculum / The Computing Curriculum in the Arts and Humanities” Conference in 2001 contain references to various institutions (Siemens 2001), as does a subsequent report on the conference (Sinclair 2001). Not surprisingly, these accounts often focus on the histories and peculiarities of each institution, a “localization” that Knight (2011) regards as necessary in DH.

Our study takes a program-based approach to studying teaching and learning in DH. While formal programs represent only a portion of the entire DH curricula, they are important in several respects: First, they reflect intentional groupings of courses, concepts, skills, methods, techniques, and so on. As such, they purport to represent the field in its broadest strokes rather than more specialized portions of it (with the exception of programs offered in specific areas, such as book history and DH). Second, these programs, under the aegis of awarding institutions and larger accrediting bodies, are responsible for declaring explicit learning outcomes of their graduates, often including required courses. These requirements form one picture of what all DHers are expected to know upon graduation (at a certain level), and this changing spectrum of competencies presumably reflects corresponding changes in the field over time. Third, formal DH programs organize teaching, research, and professional development in the field; they are channels through which material and symbolic capital flow, making them responsible, in no small part, for shaping the field itself. Finally, these programs, their requirements, and coursework are one way—perhaps the primary way—in which prospective students encounter the field and make choices about whether to enroll in a DH program and, if so, which one. These programs are also consulted by faculty and administrators developing new programs at their own institutions, both for common competencies and for distinguishing features of particular programs.

In addition to helping define the field, a study of formal DH programs also contributes to the dialogue around pedagogy in the field. Hockey, for example, has long wondered whether programming should be taught (1986) and asks, “How far can the need for analytical and critical thinking in the humanities be reconciled with the practical orientation of much work in humanities computing?” (2001). Also skeptical of mere technological skills, Simon Mahony and Elena Pierazzo (2002) argue for teaching methodologies or “ways of thinking” in DH. Tanya Clement examines multiliteracies in DH (e.g., critical thinking, commitment, community, and play), which help to push the field beyond “training” to “a pursuit that enables all students to ask valuable and productive questions that make for ‘a life worth living’” (2012, 372).

Others have called on DH to engage more fully in critical reflection, especially in relation to technology and the role of the humanities in higher education. Alan Liu notes that much DH work has failed to consider “the relation of the whole digital juggernaut to the new world order,” eschewing even clichéd topics such as “the digital divide,” “surveillance,” “privacy,” and “copyright” (2012, 491). Steve Brier (2012) points out that teaching and learning are an afterthought to many DHers, a lacuna that misses the radical potential of DH for transforming teaching and professional development. Luke Walzer (2012) observes that DH has done little to help protect and reconceptualize the role of the humanities in higher education, long under threat from austerity measures and perceived uselessness in the neoliberal academy (Mowitt 2012).

These and other concerns point to longstanding questions about the proper balance of technological skills and critical reflection in DH. While a study of existing DH programs cannot address the value of critical reflection, it can report on the presence (or absence) of such reflection in required coursework and program outcomes. Thus, it is part of a critical reflection on the field as it stands now, how it is taught to current students, and how such training will shape the future of the field. It can also speak to common learning experiences within DH (e.g., fieldwork, capstones), as well as disciplinary connections, particularly in program electives. These findings, together with our more general findings about DH activities, give pause to consider what is represented in, emphasized by, and omitted from the field at its most explicit levels of educational training.

Methods

This study involved collection of data about DH programs, coding descriptions of programs and courses using a controlled vocabulary, and analysis and visualization.

Data Collection

We compiled a list of 37 DH programs active in 2015 (see Appendix A), drawn from listings in the field (UCLA Center for Digital Humanities 2015; Clement 2015), background literature, and web searches (e.g., “digital humanities masters”). In addition to degrees and certificates, we included minors and concentrations that have formal requirements and coursework, since these programs can be seen as co-issuing degrees with major areas of study and as inflecting those areas in significant ways. We did not include digital arts or emerging media programs in which humanities content was not the central focus of inquiry. In a few cases, the listings or literature mentioned programs that could not be found online, but we determined that these instances were not extant programs—some were initiatives or centers misdescribed, others were programs in planning or simply collections of courses with no formal requirements—and thus fell outside the scope of this study. We also asked for the names of additional programs at a conference presentation, in personal emails, and on Twitter. Because our sources and searches are all English-language, the list of programs we collected are all programs taught in Anglophone countries. This limits what we can say about global DH.

For each program, we made a PDF of the webpage on which its description appears, along with a plain text file of the description. We recorded the URL of each program and information about its title; description; institution; school, division, or department; level (graduate or undergraduate); type (degree or otherwise); year founded; curriculum (total credits, number and list of required and elective courses); and references to independent research, fieldwork, and final deliverables. After identifying any required courses for each program, we looked up descriptions of those courses in the institution’s course catalog and recorded them in a spreadsheet.

Coding and Intercoder Agreement

To analyze the topics covered by programs and required courses, we applied the Taxonomy of Digital Research Activities in the Humanities (TaDiRAH 2014a), which attempts to capture the “scholarly primitives” of the field (Perkins et al. 2014). Unsworth (2000) describes these primitives as “basic functions common to scholarly activities across disciplines, over time, and independent of theoretical orientation,” obvious enough to be “self-understood,” and his preliminary list includes ‘Discovering’, ‘Annotating’, ‘Comparing’, ‘Referring’, ‘Sampling’, ‘Illustrating’, and ‘Representing’.

We doubt that any word—or classification system—works in this way. Language is always a reflection of culture and society, and with that comes questions of power, discipline/ing, and field background. Moreover, term meaning shifts over time and across locations. Nevertheless, we believe classification schema can be useful in organizing and analyzing information, and that is the spirit in which we employ TaDiRAH here.

TaDiRAH is one of several classification schema in DH and is itself based on three prior sources: the arts-humanities.net taxonomy of DH projects, tools, centers, and other resources; the categories and tags originally used by the DiRT (Digital Research Tools) Directory (2014); and headings from “Doing Digital Humanities,” a Zotero bibliography of DH literature (2014) created by the Digital Research Infrastructure for Arts and Humanities (DARIAH). The TaDiRAH version used in this study (v. 0.5.1) also included two rounds of community feedback and subsequent revisions (Dombrowski and Perkins 2014). TaDiRAH’s controlled vocabulary terms are arranged into three broad categories: activities, objects, and techniques. Only activities terms were used in this study because the other terms lack definitions, making them subject to greater variance in interpretation. TaDiRAH contains forty activities terms organized into eight parent terms (‘Capture’, ‘Creation’, ‘Enrichment’, ‘Analysis’, ‘Interpretation’, ‘Storage’, ‘Dissemination’, and ‘Meta-Activities’).

TaDiRAH was built in conversation with a similar project at DARIAH called the Network for Digital Methods in the Arts and Humanities (NeDiMAH) and later incorporated into that project (2015). NeDiMAH’s Methods Ontology (NeMO) contains 160 activities terms organized into five broad categories (‘Acquiring’, ‘Communicating’, ‘Conceiving’, ‘Processing’, ‘Seeking’) and is often more granular than TaDiRAH (e.g., ‘Curating’, ‘Emulating’, ‘Migrating’, ‘Storing’, and ‘Versioning’ rather than simply ‘Preservation’). While NeMO may have other applications, we believe it is too large to be used in this study. There are many cases in which programs or even course descriptions are not as detailed as NeMO in their language, and even the forty-eight TaDiRAH terms proved difficult to apply because of their number and complexity. In addition, TaDiRAH has been applied in DARIAH’s DH Course Registry of European programs, permitting some comparisons between those programs and the ones studied here.

In this study, a term was applied to a program/course description whenever explicit evidence was found that students completing the program or course would be guaranteed to undertake the activities explicitly described in that term’s definition. In other words, we coded for minimum competencies that someone would have after completing a program or course. The narrowest term was applied whenever possible, and multiple terms could be applied to the same description (and, in most cases, were). For example, a reference to book digitization would be coded as ‘Imaging’:

Imaging refers to the capture of texts, images, artefacts or spatial formations using optical means of capture. Imaging can be made in 2D or 3D, using various means (light, laser, infrared, ultrasound). Imaging usually does not lead to the identification of discrete semantic or structural units in the data, such as words or musical notes, which is something DataRecognition accomplishes. Imaging also includes scanning and digital photography.

If there was further mention of OCR (optical character recognition), that would be coded as ‘DataRecognition’ and so on. To take another example, a reference to visualization and other forms of analysis would be coded both as ‘Visualization’ and as its parent term, ‘Analysis’, if no more specific child terms could be identified.

In some cases, descriptions would provide a broad list of activities happening somewhere across a program or course but not guaranteed for all students completing that program or course (e.g., “Through our practicum component, students can acquire hands-on experience with innovative tools for the computational analysis of cultural texts, and gain exposure to new methods for analyzing social movements and communities enabled by new media networks.”). In these cases, we looked for further evidence before applying a term to that description.

Students may also acquire specialty in a variety of areas, but this study is focused on what is learned in common by any student who completes a specific DH program or course; as such, we coded only cases of requirements and common experiences. For the same reason, we coded only required courses, not electives. Finally, we coded programs and required courses separately to analyze whether there was any difference in stated activities at these two levels.

To test intercoder agreement, we selected three program descriptions at random and applied TaDiRAH terms to each. In only a handful of cases did all three of us agree on our term assignments. We attribute this low level of agreement to the large number of activities terms in TaDiRAH, the complexity of program/course descriptions, questions of scope (whether to use a broader or narrower term), and general vagueness. For example, a program description might allude to work with texts at some point, yet not explicitly state text analysis until later, only once, when it is embedded in a list of other examples (e.g., GIS, text mining, network analysis), with a reference to sentiment analysis elsewhere. Since texts could involve digitization, publishing, or other activities, we would not code ‘Text analysis’ immediately, and we would only code it if students would were be guaranteed exposure to this such methods in the program. To complicate matters further, there is no single term for text analysis in TaDiRAH—it spans across four (‘Content analysis’, ‘Relational analysis’, ‘Structural analysis’, and ‘Stylistic analysis’)—and one coder might apply all four terms, another only some, and the third might use the parent term ‘Analysis’, which also includes spatial analysis, network analysis, and visualization.

Even after reviewing these examples and the definitions of specific TaDiRAH terms, we could not reach a high level of intercoder agreement. However, we did find comparing our term assignments to be useful, and we were able to reach consensus in discussion. Based on this experience, we decided that each of us would code every program/course description and then discuss our codings together until we reached a final agreement. Before starting our preliminary codings, we discussed our understanding of each TaDiRAH term (in case it had not come up already in the exercise). We reviewed our preliminary codings using a visualization showing whether one, two, or three coders applied a term to a program/course description. In an effort to reduce bias, especially framing effects (cognitive biases that result from the order in which information is presented), the visualization did not display who had coded which terms. If two coders agreed on a term, they explained their codings to the third and all three came to an agreement. If only one coder applied a term, the other two explained why they did not code for that term and all three came to an agreement. Put another way, we considered every term that anyone applied, and we considered it under the presumption that it would be applied until proven otherwise. Frequently, our discussions involved pointing to specific locations in the program/course descriptions and referencing TaDiRAH definitions or notes from previous meetings when interpretations were discussed.

In analyzing our final codings, we used absolute term frequencies (the number of times a term was applied in general) and weighted frequencies (a proxy for relative frequency and here a measure of individual programs and courses). To compute weighted frequencies, each of the eight parent terms were given a weight of 1, which was divided equally among their subterms. For example, the parent term ‘Dissemination’ has six subterms, so each of those were assigned an equal weight of one-sixth, whereas ‘Enrichment’ has three subterms, each assigned a weight of one-third. These weights were summed by area to show how much of an area (relatively speaking) is represented in program/course descriptions, regardless of area size. If all the subterms in an area are present, that entire area is present—just as it would be if we had applied only the broader term in the first place. These weighted frequencies are used only where programs are displayed individually.

Initially, we had thought about comparing differences in stated activities between programs and required courses. While we found some variations (e.g., a program would be coded for one area of activities but not its courses and vice versa), we also noticed cases in which the language used to describe programs was too vague to code for activities that were borne out in required course descriptions. For this reason and to be as inclusive as possible with our relatively conservative codings, we compared program and course data simultaneously in our final analysis. Future studies may address the way in which program descriptions connect to particular coursework, and articulating such connections may help reveal the ways in which DH is taught (in terms of pedagogy) rather than only its formal structure (as presented here).

Analysis and Visualization

In analyzing program data, we examined the overall character of each program (its title), its structure (whether it grants degrees and, if so, at what level), special requirements (independent study, final deliverables, fieldwork), and its location, both in terms of institutional structure (e.g., departments, labs, centers) and discipline(s). We intended to analyze more thoroughly the number of required courses as compared to electives, the variety of choice students have in electives, and the range of departments in which electives are offered. These comparisons proved difficult: even within an American context, institutions vary in their credit hours and the formality of their requirements (e.g., choosing from a menu of specific electives, as opposed to any course from a department or “with permission”). These inconsistencies multiply greatly in an international context, and so we did not undertake a quantitative study of the number or range of required and elective courses.

Program data and codings were visualized using the free software Tableau Public. All images included in this article are available in a public workbook at https://public.tableau.com/views/DigitalHumanitiesProgramsSurvey/Combined. As we discuss in the final section, we are also building a public-facing version of the data and visualizations, which may be updated by members of the DH community. Thus, the data presented here can and should change over time, making these results only a snapshot of DH in some locations at the present.

Anglophone Programs

The number of DH programs in Anglophone countries has risen sharply over time, beginning in 1991 and growing steadily by several programs each year since 2008 (see Figure 1). This growth speaks to increased capacity in the field, not just by means of centers, journals, conferences, and other professional infrastructure, but also through formal education. Since 2008, there has been a steady addition of several programs each year, and based on informal observation since our data collection ended, we believe this trend continues.

A bar chart showing the number of new Anglophone DH programs each year from 1991 to 2015. A line showing the cumulative total of programs increases sharply at 2008.
Figure 1. Digital humanities programs in our collected data by year established

Program Titles

Most of the programs in our collected data (22, 59%) are titled simply “Digital Humanities,” along with a few variations, such as “Book History and Digital Humanities” and “Digital Humanities Research” (see Figure 2). A handful of programs are named for particular areas of DH or related topics (e.g., “Digital Culture,” “Public Scholarship”), and only a fraction (3 programs, 8%) are called “Humanities Computing.” We did not investigate changes in program names over time, although this might be worthwhile in the future.

A stacked bar chart comparing the titles of Anglophone DH programs. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 2. Titles of digital humanities programs in our collected data

Structure

Less than half of DH programs in our collected data grant degrees: some at the level of bachelor’s (8%), most at the level of master’s (22%), and some at the doctoral (8%) level (Figure 3). The majority of DH programs are certificates, minors, specializations, and concentrations—certificates being much more common at the graduate level and nearly one-third of all programs in our collected data. The handful of doctoral programs are all located in the UK and Ireland.

A stacked bar chart showing the number of Anglophone DH programs at the undergraduate and graduate levels. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 3. Digital humanities programs in our collected data (by degree and level)

 

In addition to degree-granting status, we also examined special requirements for the 37 DH programs in our study. Half of those programs require some form of independent research (see Figure 4). All doctoral programs require such research; most master’s programs do as well. Again, we only looked for cases of explicit requirements; it seems likely that research of some variety is conducted within all the programs analyzed here. However, we focus this study on explicit statements of academic activity in order to separate the assumptions of practitioners of DH about its activities from what appears in public-facing descriptions of the field.
Half of DH programs in our collected data require a final deliverable, referred to variously as a capstone, dissertation, portfolio, or thesis (see Figure 5). Again, discrepancies between written and unwritten expectations in degree programs abound—and are certainly not limited to DH—and some programs may have not explicitly stated this requirement, so deliverables may be undercounted. That said, most graduate programs require some kind of final deliverable, and most undergraduate and non-degree-granting programs (e.g., minors, specializations) do not.

Finally, about one-quarter of programs require fieldwork, often in the form of an internship (see Figure 6). This fieldwork requirement is spread across degree types and levels.

A stacked bar chart showing whether Anglophone DH programs require independent research as a part of their degree requirements. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 4. Independent research requirements of digital humanities programs in our collected data

 

A stacked bar chart showing the final deliverable requirement (dissertation, portfolio, etc.) of Anglophone DH programs. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 5. Final deliverable required by digital humanities programs in our collected data

 

A stacked bar chart showing whether Anglophone DH programs require fieldwork as a part of their degree requirements. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 6. Fieldwork requirements of digital humanities programs in our collected data

 

Location and Disciplinarity

About one-third of the DH programs in our dataset are offered outside of academic schools/departments (in centers, initiatives, and, in one case, jointly with the library), and most issue from colleges/schools of arts and humanities (see Figure 7). Although much DH work occurs outside of traditional departments (Zorich 2008), formal training in Anglophone countries remains tied to them. Most DH concentrations and specializations are located within English departments, evidence for Kirschenbaum’s claim that DH’s “professional apparatus…is probably more rooted in English than any other departmental home” (2010, 55).

A bar chart showing location of Anglophone DH programs within an institution (college/school, center, department. etc.)
Figure 7. Institutional location of digital humanities programs in our collected data

The elective courses of DH programs span myriad departments and disciplines. The familiar humanities departments are well represented (art history, classics, history, philosophy, religion, and various languages), along with computer science, design, media, and technology. Several programs include electives drawn from education departments and information and library science. More surprising departments (and courses) include anthropology (“Anthropological Knowledge in the Museum”), geography (“Urban GIS”), political science (“New Media and Politics”), psychology (“Affective Interaction”), sociology (“Social and Historical Study of Information, Software, and Networks”), even criminology (“Cyber Crime”).

The number of electives required by each program and the pool from which they may be drawn varies greatly among programs, and in some cases it is so open-ended that it is nearly impossible to document thoroughly. Some programs have no elective courses and focus only on shared, required coursework. Others list dozens of potential elective courses as suggestions, rather than an exhaustive list. Because course offerings, especially in cross-disciplinary areas, change from term to term and different courses may be offered under a single, general course listing such as “Special Topics,” the list of elective course we have collected is only a sample of the type of courses students in DH programs may take, and we do not analyze them quantitatively here.

Theory and Critical Reflection

To analyze the role of theory and critical reflection in DH programs, we focused our analysis on two TaDiRAH terms: ‘Theorizing’,

a method which aims to relate a number of elements or ideas into a coherent system based on some general principles and capable of explaining relevant phenomena or observations. Theorizing relies on techniques such as reasoning, abstract thinking, conceptualizing and defining. A theory may be implemented in the form of a model, or a model may give rise to formulating a theory.

and ‘Meta: GiveOverview’, which

refers to the activity of providing information which is relatively general or provides a historical or systematic overview of a given topic. Nevertheless, it can be aimed at experts or beginners in a field, subfield or specialty.

In most cases, we used ‘Meta: GiveOverview’ to code theoretical or historical introductions to DH itself, though any explicit mention of theory was coded (or also coded) as ‘Theorizing’. We found that all DH programs, whether in program descriptions or required courses, included some mention of theory or historical/systematic overview (see Figure 8).

A table of Anglophone institutions and DH programs showing whether researchers coded ‘Theory’ or ‘GiveOverview’ for the program or required course descriptions.
Figure 8. Theory and critical reflection in digital humanities programs in our collected data

Accordingly, we might say that each program, according to its local interpretation, engages in some type of theoretical or critical reflection. We cannot, of course, say much more about the character of this reflection, whether it is the type of critical reflection called for in the pedagogical literature, or how this reflection interfaces with the teaching of skills and techniques in these programs. We hope someone studies this aspect of programs, but it is also worth noting that only 6 of the 37 programs here were coded for ‘Teaching/Learning’ (see Figure 12). Presumably, most programs do not engage theoretically with issues of pedagogy or the relationship between DH and higher education, commensurate with Brier’s claim that these areas are often overlooked (2012). Such engagement may occur in elective courses or perhaps nowhere in these programs.

European Programs

All of the 37 programs discussed above are located in Anglophone countries, most of them in the United States (22 programs, 60%). We note that TaDiRAH, too, originates in this context, as does our English-language web searches for DH programs. While this data is certainly in dialogue with the many discussions of DH education cited above, it limits what we can say about DH from a global perspective. It is important to understand the various ways DH manifests around the globe, both to raise awareness of these approaches and to compare the ways in which DH education converges and diverges across these contexts. To that end, we gathered existing data on European programs by scraping DARIAH’s Digital Humanities Course Registry (DARIAH-EU 2014a) and consulting the European Association for Digital Humanities’ (EADH) education resources webpage (2016). This DARIAH/EADH data is not intended to stand in for the entirety of global DH, as it looks exclusively at European programs (and even then it is limited in interpretation by our own language barriers). DH is happening outside of this scope (e.g., Gil 2017), and we hope that future initiatives can expand the conversation about DH programs worldwide—possibly as part of our plans for data publication, which we address at the end of this article.

DARIAH’s database lists 102 degree programs, 77 of which were flagged in page markup as “outdated” with the note, “This record has not been revised for a year or longer.” While inspecting DARIAH data, we found 43 programs tagged with TaDiRAH terms, and we eliminated 17 entries that were duplicates, had broken URLs and could not be located through a web search, or appeared to be single courses or events rather than formal programs. We also updated information on a few programs (e.g., specializations classified as degrees). We then added 5 programs listed by EADH but not by DARIAH, for a grand total of 93 European DH programs (only 16 of which were listed jointly by both organizations). We refer to this dataset as “DARIAH/EADH data” in the remainder of this paper. A map of these locations is provided in Figure 9, and the full list of programs considered in this paper is given in Appendices.

A map of Europe showing the number of DH programs in each country, based on DARIAH/EADH listings.
Figure 9. Geographic location of programs in DARIAH/EADH data

 

The DARIAH/EADH data lists 93 programs spread across parts of Europe, with the highest concentration (33%) in Germany (see Table 1). We caution here and in subsequent discussions that DARIAH and EADH may not have applied the same criteria for including programs as we did in our data collection, so results are not directly comparable. Some programs in informatics or data asset management might have been ruled out using our data collection methods, which were focused on humanities content.

Table 1. Summary of programs included in our collected data and DARIAH/EADH data
Country Programs in our collected data
N (%)
Programs in DARIAH/EADH data
N (%)
Australia 1 (3%)
Austria 1 (1%)
Belgium 2 (2%)
Canada 6 (16%)
Croatia 3 (3%)
Finland 1 (1%)
France 8 (9%)
Germany 31 (33%)
Ireland 3 (8%) 4 (4%)
Italy 4 94%)
Netherlands 16 (17%)
Norway 1 (1%)
Portugal 1 (1%)
Spain 2 (2%)
Sweden 1 (1%)
Switzerland 6 (7%)
United Kingdom 5 (14%) 12 (13%)
United States 22 (60%)

Program Titles

A cursory examination of the DARIAH/EADH program title reveals more variety, including many programs in computer linguistics and informatics (see Appendix B). We did not analyze these titles further because of language barriers. And again, we caution that some of these programs might not have been included according to the criteria for our study, though the vast majority appear relevant.

Structure

Most programs in the DARIAH/EADH data are degree-granting at the level of master’s (61%) or bachelor’s (25%) (see Figure 10). While we are reasonably confident in these broad trends, we are skeptical of the exact totals for two reasons. In DARIAH’s Registry, we noticed several cases of specializations being labeled as degrees. Though we rectified these cases where possible, language barriers prevented us from more thoroughly researching each program—another challenge that a global study of DH would encounter. On the other hand, it’s also possible that non-degree programs were undercounted in general, given that the Registry was meant to list degrees and courses. Based on our inspection of each program, we do not believe these errors are widespread enough to change the general distribution of the data: more European programs issue degrees, mostly at the master’s level.

A stacked bar chart showing the number of European DH programs at the undergraduate and graduate levels, as listed by DARIAH/EADH. The segments that make up each bar are color coded by degree type (e.g., doctoral, master’s, bachelor’s, certificate, other).
Figure 10. Digital humanities programs (by degree and level, DARIAH/EADH data)

Location and Disciplinarity

Most European programs are also located in academic divisions called colleges, departments, faculties, or schools (see Figure 11), depending on country. Only a handful of programs are located in institutes, centres, or labs, even less frequently than in our collected data.

A bar chart showing location of European DH programs within an institution (college/department/faculty/school, centre, institute. etc.), as listed by DARIAH/EADH.
Figure 11. Institutional location of digital humanities programs (DARIAH/EADH data)

We did not analyze disciplinarity in the DARIAH/EADH data because the programs span various countries, education systems, and languages—things we could not feasibly study here. However, 43 programs in the DARIAH/EADH data were tagged with TaDiRAH terms, allowing for comparison with programs in our collected data. These speak to what happens in DH programs in Europe, even if their disciplinary boundaries vary.

DH Activities

To analyze the skills and methods at play in DH programs, we examined our TaDiRAH codings in terms of overall term frequency (see Figure 12) and weighted frequency across individual programs (see Figures 13 and 14). Several trends were apparent in our codings, as well as DARIAH-listed programs that were also tagged with TaDiRAH terms.

In our data on Anglophone programs of DH programs, analysis and meta-activities (e.g., ‘Community building’, ‘Project management’, ‘Teaching/Learning’) make up the largest share of activities, along with creation (e.g., ‘Designing’, ‘Programming’, ‘Writing’). This is apparent in absolute term frequencies (see Figure 12, excepting ‘Theorizing’ and ‘Meta: GiveOverview’) and in a heatmap comparison of programs (see Figure 13). Again, the heatmap used weighted frequencies to adjust for the fact that some areas have few terms, while others have more than double the smallest. It is worth noting that ‘Writing’ is one of the most frequent terms (11 programs), but this activity certainly occurs elsewhere and is probably undercounted because it was not explicitly mentioned in program descriptions. The same may be true for other activities.

A series of bar charts showing the number of times each TaDiRAH term appeared in the datasets. Terms are listed under their parent terms, and subtotals are given for each parent term. Data collected by researchers (Anglophone programs) are displayed in blue, and DARIAH data are displayed in orange.
Figure 12. TaDiRAH term coding frequency (grouped)

 

A heatmap of Anglophone DH programs and TaDiRAH parent terms. The saturation of each cell shows the number of times that terms within that parent term were coded for that particular program, whether in program descriptions or course descriptions.
Figure 13. Digital humanities programs in our collected data and their required courses (by area)

Many program specializations seem to follow from the flavor of DH at particular institutions (e.g. the graduate certificate at Stanford’s Center for Spatial and Textual Analysis, University of Iowa’s emphasis on public engagement), commensurate with Knight’s (2011) call for “localization” in DH.

In contrast with the most frequent terms, some terms were never applied to program/course descriptions in our data, including ‘Translation’, ‘Cleanup’, ‘Editing’, and ‘Identifying’. Enrichment and storage activities (e.g., ‘Archiving’, ‘Organizing’, ‘Preservation’) were generally sparse (only 1.9% of all codings), even after compensating for the fact that these areas have fewer terms. We suspect that these activities do occur in DH programs and courses—in fact, they are assumed in broader activities such as thematic research collections, content management systems, and even dissemination. Their lack of inclusion in program/course descriptions seems constituent with claims made by librarians that their expertise in technology, information organization, and scholarly communication is undervalued in the field, whether instrumentalized as part a service model that excludes them from the academic rewards of and critical decision-making in DH work (Muñoz 2013; Posner 2013) or devalued as a form of feminized labor (Shirazi 2014). Ironically, these abilities are regarded as qualifications for academic librarian positions and as marketable job skills for humanities students and, at the same time, as a lesser form of academic work, often referred to as faculty “service” (Nowviskie 2012; Sample 2013; Takats 2013). We suspect that many program descriptions replicate this disconnect by de-emphasizing some activities (e.g., storage, enrichment) over others (e.g., analysis, project management).

Generally, there seems to be less emphasis on content (‘Capture’, ‘Enrichment’, and ‘Storage’ terms) and more focus on platforms and tools (‘Analysis’ and ‘Meta-Activities’ terms) within programs in our collected data. In interpreting this disparity, we think it’s important to attend to the larger contexts surrounding education in various locations. The Anglophone programs we studied are mostly located in the United States, where “big data” drives many decisions, including those surrounding higher education. As boyd and Crawford note, this phenomenon rests on the interplay of technology, analysis, and “[m]ythology: the widespread belief that large data sets offer a higher form of intelligence and knowledge that can generate insights that were previously impossible, with the aura of truth, objectivity, and accuracy” (2013: 663). Within this context, programs advertising analysis, visualization, and project management may appear as more attractive to prospective students and supporting institutions, two important audiences of program webpages. This influence does not mean that such activities do not occur or are not important to DH, but it again turns attention to questions about the way in which these skills are developed and deployed and whether that occurs against a backdrop of critical reflection on methods and tools. How these broad program-level descriptions play out in the context of particular courses and instruction is beyond the scope of this program-level study, but we think that surfacing the way programs are described is an important first step to a deeper analysis of these questions.

When comparing our 37 programs to the 43 TaDiRAH-tagged European ones, several differences emerge—though we caution that these findings, in particular, may be less reliable than others presented here. In our study, we coded for guaranteed activities, explicit either in program descriptions or required course description. In DARIAH’s Registry, entries are submitted by users, who are given a link to another version of TaDiRAH (2014b) and instructed to code at least one activities keyword (DARIAH-EU 2014b). We do not know the criteria each submitter uses for applying terms, and it’s likely that intercoder agreement would be low in absence of pre-coordination. For example, programs in the Netherlands are noticeably sparser in their codings than programs elsewhere—perhaps submitted by the same coder, or coders with a shared understanding and different from the others (see Figure 14).

A heatmap of DH programs and TaDiRAH parent terms, as listed by DARIAH. The saturation of each cell shows the number of times that terms within that parent term were coded for that particular program.
Figure 14. Digital humanities programs (by area, TaDiRAH-tagged subset of DARIAH data)

We tried to compare directly our codings with DARIAH data by looking at five programs listed in common. Only one of these programs had TaDiRAH terms in DARIAH data: specifically, all eight top-level terms. When examining other programs, we found several tagged with more than half of the top-level terms and one tagged with 40 of 48 activities terms. These examples alone suggest that DARIAH data may be maximally inclusive in its TaDiRAH codings. Nevertheless, we can treat this crowdsourced data as reflective of broad trends in the area and compare them, generally, to those found in our study. Moreover, there does not appear to be any geographic or degree-based bias in the DARIAH data: the 43 tagged programs span ten different countries and both graduate and undergraduate offerings, degree and non-degree programs.

Comparing term frequencies in our collected data and DARIAH/EADH data (see Figure 12), it appears that enrichment, capture, and storage activities are more prevalent in European programs, while analysis and meta-activities are relatively less common (see Table 2). While both datasets have roughly the same number of programs (37 and 43, respectively), the DARIAH data has over twice as many terms as our study. For this reason, we computed a relative expression of difference by dividing the total percent of a TaDiRAH area in DARIAH data by the total percent in our study. Viewed this way, ‘Enrichment’ has over five times as many weighted codings in DARIAH as our study, followed by ‘Capture’ with over twice as many; ‘Analysis’, ‘Interpretation’, and ‘Meta-activities’ are less common. Thus, Anglophone and European programs appear to focus on different areas, within the limitations mentioned above and while still overlapping in most areas. This difference might be caused by the inclusion of more programs related to informatics, digital asset management, and communication in the DARIAH data than in our collected data, or the presence of more extensive cultural heritage materials, support for them, and integration into European programs. At a deeper level, this difference may reflect a different way of thinking or talking about DH or the histories of European programs, many of which were established before programs in our collected data.

Table 2. Summary of TaDiRAH term coding frequencies (grouped)
TaDiRAH parent term (includes subterms) In our collected data
N (%)
In DARIAH
N (%)
Factor of difference overall (weighted)
Capture 13 (6.1%) 73 (15.7%) 5.6 (2.55)
Creation 35 (16.5%) 74 (15.9%) 2.1 (0.96%)
Enrichment 4 (1.9%) 48 (10.3%) 12.0 (5.46)
Analysis 47 (22.2%) 77 (16.5%) 1.6 (0.75)
Interpretation 27 (12.7%) 40 (8.6%) 1.5 (0.67)
Storage 11 (5.2%) 43 (9.2%) 3.9 (1.78)
Dissemination 24 (11.3%) 63 (13.5%) 2.6 (1.19)
Meta-Activities 51 (24.1%) 48 (10.3%) 0.9 (0.43)

Reflections on TaDiRAH

Since TaDiRAH aims to be comprehensive of the field—even machine readable—we believe our challenges applying it may prove instructive to revising the taxonomy for wider application and for considering how DH is described more generally.
Most examples of hard-to-code language were technical (e.g., databases, content management systems, CSS, and XML) and blurred the lines between capture, creation, and storage and, at a narrower level, web development and programming. Given the rate at which technologies change, it may be difficult to come up with stable terms for DH. At the same time, we may need to recognize that some of the most ubiquitous technologies and platforms in the field (e.g., Omeka, WordPress) actually subsume over various activities and require myriad skills. This, in turn, might give attention to skills such as knowledge organization, which seem rarely taught or mentioned on an explicit basis.

A separate set of hard-to-code activities included gaming and user experience (UX). We suspect the list might grow as tangential fields intersect with DH. Arguably, UX falls under ‘Meta: Assessing’, but there are design and web development aspects of UX that distinguish it from other forms of assessment, aspects that probably belong better with ‘Creation’. Similarly, gaming might be encompassed by ‘Meta: Teaching/Learning’, which

involves one group of people interactively helping another group of people acquire and/or develop skills, competencies, and knowledge that lets them solve problems in a specific area of research,

but this broad definition omits distinctive aspects of gaming, such as play and enjoyment, that are central to the concept. Gaming and UX, much like the technical cases discussed earlier, draw on a range of different disciplines and methods, making them difficult to classify. Nevertheless, they appear in fieldwork and are even taught in certain programs/courses, making it important to represent them in the taxonomy of DH.

With these examples in mind and considering the constantly evolving nature of DH and the language that surrounds it, it is difficult and perhaps counterproductive to suggest any concrete changes to TaDiRAH that would better represent the activities involved in “doing DH.” We present these findings as an empirical representation of what DH in certain parts of the world looks like now, with the hope that it will garner critical reflection from DH practitioners and teachers about how the next generation of students perceives our field and the skills that are taught and valued within it.

Conclusion and Further Directions

Our survey of DH programs in the Anglophone world may be summarized by the following points.

  • The majority of Anglophone programs are not degree-granting; they are certificates, minors, specializations, and concentrations. By comparison, most European programs are degree-granting, often at the master’s level.
  • About half of Anglophone programs require some form of independent research, and half require a final deliverable, referred to variously as a capstone, dissertation, portfolio, or thesis. About one-quarter of programs require fieldwork, often in the form of an internship.
  • About one-third of Anglophone DH programs are offered outside of academic schools/departments (in centers, initiatives, and, in one case, jointly with the library). By comparison, most European programs are located in academic divisions; only a handful are offered in institutes, centres, or labs.
  • Analysis and meta-activities (e.g., community building, project management) make up the largest share of activities in Anglophone programs, along with creation (e.g., designing, programming, writing). By contrast, activities such as enrichment, capture, and storage seem more prevalent in European programs. Some of these areas may be over- or under-represented for various cultural reasons we’ve discussed above.

As with any survey, there may be things uncounted, undercounted, or miscounted, and we have tried to note these limitations throughout this article.

One immediate application of this data is a resource for prospective students and those planning and revising formal programs. At minimum, this data provides general information about these 37 programs, along with some indication of special areas of emphasis—a compliment to DARIAH/EADH data. As we discussed earlier, this list should be more inclusive of DH throughout the globe, and that probably requires an international team fluent in the various languages of the programs. Following our inspection of DARIAH’s Registry, we believe it’s difficult to control the accuracy of such data in a centralized way. To address both of these challenges, we believe that updates to this data are best managed by the DH community, and to that end, we have created a GitHub repository at https://github.com/dhprograms/data where updates can be forked and pulled into a master branch. This branch will be connected to Tableau Public for live versions of visualizations similar to the ones included here. Beyond this technical infrastructure, our next steps include outreach to the community to ensure that listings are updated and inclusive in ways that go beyond our resources in this study.

Second, there are possibilities for studying program change over time using the archive of program webpages and course descriptions generated by this study. Capture of program and course information in the future might allow exploration of the growth of the field as well as changes in its activities. We believe that a different taxonomy or classification system might prove useful here, as well as a different method of coding. These are active considerations as we build the GitHub repository. We also note that this study may induce some effect (hopefully positive) in the way that programs and courses are described, perhaps pushing them to be more explicit about the nature and extent of DH activities.

Finally, we hope this study gives the community pause to consider how DH is described and represented, and how it is taught. If there are common expectations not reflected here, perhaps DHers could be more explicit about how we, as a community, describe the activities that make up DH work, at least in building our taxonomies and describing our formal programs and required courses. Conversely, if there are activities that seem overrepresented here, we might consider why those activities are prized in the field (and which are not) and whether this is the picture we wish to present publicly. We might further consider this picture in relationship to the cultural and political-economic contexts in which DH actually exists. Are we engaging with these larger structures? Do the activities of the field reflect this? Is it found in our teaching and learning, and in the ways that we describe those?

Acknowledgements

We are grateful to Allison Piazza for collecting initial data about some programs, as well as Craig MacDonald for advice on statistical analysis and coding methods. Attendees at the inaugural Keystone Digital Humanities Conference at the University of Pennsylvania Libraries provided helpful feedback on the ideas presented here. JITP reviewers Stewart Varner and Kathi Berens were helpful interlocutors for this draft, as were anonymous reviewers of a DH2017 conference proposal based on this work.

Bibliography

Alexander, Bryan and Rebecca Frost Davis. 2012. “Should Liberal Arts Campuses Do Digital Humanities? Process and Products in the Small College World.” In In Debates in the Digital Humanities, edited by Matthew K. Gold. Minneapolis: University Of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/25.

boyd, danah and Kate Crawford. 2013. “Critical Questions for Big Data.” Information, Communication & Society 15(5): 662–79. Retrieved from http://dx.doi.org/10.1080/1369118X.2012.678878.

Brennan, Sheila A. 2016. “Public, First.” In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/83.

Brier, Stephen. 2012. “Where’s the Pedagogy? The Role of Teaching and Learning in the Digital Humanities.” In Debates in the Digital Humanities, edited by Matthew K. Gold, 390–401. Minneapolis: University Of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/8.

Buurma, Rachel Sagner and Anna Tione Levine. “The Sympathetic Research Imagination: Digital Humanities and the Liberal Arts.” In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/74.

Clement, Tanya. 2012. “Multiliteracies in the Undergraduate Digital Humanities Curriculum.” In Digital Humanities Pedagogy: Practices, Principles and Politics, edited by Brett D. Hirsch, 365–88. Open Book Publishers. Retrieved from http://www.openbookpublishers.com/product/161/digital-humanities-pedagogy–practices–principles-and-politics.

———. 2015. “Digital Humanities Inflected Undergraduate Programs.” Tanyaclement.org. January 8, 2015. Retrieved from http://tanyaclement.org/2009/11/04/digital-humanities-inflected-undergraduate-programs-2.

DARIAH-EU. 2014a. “Digital Humanities Course Registry.” https://dh-registry.de.dariah.eu.

———. 2014b. “Manual and FAQ.” Digital Humanities Course Registry. Retrieved from https://dh-registry.de.dariah.eu/pages/manual.

“DiRT Directory.” 2014. Retrieved from http://dirtdirectory.org.

“Doing Digital Humanities – A DARIAH Bibliography.” 2014. Zotero. Retrieved from https://www.zotero.org/groups/doing_digital_humanities_-_a_dariah_bibliography/items/order/creator/sort/asc.

Dombrowski, Quinn, and Jody Perkins. 2014. “TaDiRAH: Building Capacity for Integrated Access.” dh+lib. May 21, 2014. Retrieved from http://acrl.ala.org/dh/2014/05/21/tadirah-building-capacity-integrated-access.

Drucker, Johanna, John Unsworth, and Andrea Laue. 2002. “Final Report for Digital Humanities Curriculum Seminar.” Media Studies Program, College of Arts and Science: University of Virginia. Retrieved from http://www.iath.virginia.edu/hcs/dhcs.

European Association for Digital Humanities. 2016. “Education.” February 1, 2016. Retrieved from http://eadh.org/education.

Gil, Alex. “DH Organizations around the World.” Retrieved from http://testing.elotroalex.com/dhorgs. Accessed 10 Apr 2017.

Grandjean, Martin. 2014a. “The Digital Humanities Network on Twitter (#DH2014).” Martin Grandjean. July 14. Retrieved from http://www.martingrandjean.ch/dataviz-digital-humanities-twitter-dh2014.

———. 2014b. “The Digital Humanities Network on Twitter: Following or Being Followed?” Martin Grandjean. September 8. Retrieved from http://www.martingrandjean.ch/digital-humanities-network-twitter-following.

———. 2015. “Digital Humanities on Twitter, a Small-World?” Martin Grandjean. July 2. Retrieved from http://www.martingrandjean.ch/digital-humanities-on-twitter.

Hockey, Susan. 1986. “Workshop on Teaching Computers and Humanities Courses.” Literary & Linguistic Computing 1(4): 228–29.

———. 2001. “Towards a Curriculum for Humanities Computing: Theoretical Goals and Practical Outcomes.” The Humanities Computing Curriculum / The Computing Curriculum in the Arts and Humanities Conference. Malaspina University College, Nanaimo, British Columbia.

Hsu, Wendy F. 2016. “Lessons on Public Humanities from the Civic Sphere.” In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/part/13.

Kirschenbaum, Matthew G. 2010. “What Is Digital Humanities and What’s It Doing in English Departments?” ADE Bulletin 150: 55–61.

Knight, Kim. 2011. “The Institution(alization) of Digital Humanities.” Modern Language Association Conference 2011. Los Angeles. Retrieved from http://kimknight.com/?p=801.

Liu, Alan. 2012. “Where Is Cultural Criticism in the Digital Humanities?” In Debates in the Digital Humanities, edited by Matthew K. Gold, 490–509. Minneapolis, Minn.: University Of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/20.

Mahony, Simon, and Elena Pierazzo. 2012. “Teaching Skills or Teaching Methodology.” In Digital Humanities Pedagogy: Practices, Principles and Politics, edited by Brett D. Hirsch, 215–25. Open Book Publishers. Retrieved from http://www.openbookpublishers.com/product/161/digital-humanities-pedagogy–practices–principles-and-politics.

McCarty, Willard. 2012. “The PhD in Digital Humanities.” In Digital Humanities Pedagogy: Practices, Principles and Politics, edited by Brett D. Hirsch. Open Book Publishers. Retrieved from http://www.openbookpublishers.com/product/161/digital-humanities-pedagogy–practices–principles-and-politics.

McGrail, Anne B. 2016 “The ‘Whole Game’: Digital Humanities at Community Colleges.” In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/53

Mowitt, John. 2012. “The Humanities and the University in Ruin.” Lateral 1. Retrieved from http://csalateral.org/issue1/content/mowitt.html

Muñoz, Trevor. 2013. “In Service? A Further Provocation on Digital Humanities Research in Libraries.” dh+lib. Retrieved from http://acrl.ala.org/dh/2013/06/19/in-service-a-further-provocation-on-digital-humanities-research-in-libraries.

“NeDiMAH Methods Ontology: NeMO.” 2015. Retrieved from http://www.nedimah.eu/content/nedimah-methods-ontology-nemo.

Nowviski, Bethany. 2012. “Evaluating Collaborative Digital Scholarship (or, Where Credit is Due).” Journal of Digital Humanities 1(4). Retrieved from http://journalofdigitalhumanities.org/1-4/evaluating-collaborative-digital-scholarship-by-bethany-nowviskie.

Perkins, Jody, Quinn Dombrowski, Luise Borek, and Christof Schöch. 2014. “Project Report: Building Bridges to the Future of a Distributed Network: From DiRT Categories to TaDiRAH, a Methods Taxonomy for Digital Humanities.” In Proceedings of the International Conference on Dublin Core and Metadata Applications 2014, 181–83. Austin, Texas.

Posner, Miriam. 2013. “No Half Measures: Overcoming Common Challenges to Doing Digital Humanities in the Library.” Journal of Library Administration 53(1): 43–52. UCLA: 10.1080/01930826.2013.756694. Retrieved from http://www.escholarship.org/uc/item/6q2625np.

Prescott, Andrew. 2016. “Beyond the Digital Humanities Center: The Administrative Landscapes of the Digital Humanities.” In A New Companion to Digital Humanities, 2nd ed., 461–76. Wiley-Blackwell.

Quan-Haase, Anabel, Kim Martin, and Lori McCay-Peet. 2015. “Networks of Digital Humanities Scholars: The Informational and Social Uses and Gratifications of Twitter.” Big Data & Society 2(1): 2053951715589417. doi:10.1177/2053951715589417.

Rockwell, Geoffrey. 1999. “Is Humanities Computing and Academic Discipline?” presented at An Interdisciplinary Seminar Series, Institute for Advanced Technology in the Humanities, University of Virginia, November 12.

Rosenblum, Brian, Frances Devlin, Tami Albin, and Wade Garrison. 2016. “Collaboration and CoTeaching Librarians Teaching Digital Humanities in the Classroom.” In Digital Humanities in the Library: Challenges and Opportunities for Subject Specialists, edited by Arianne Hartsell-Gundy, Laura Braunstein, and Liorah Golomb, 151–75. Association of College and Research Libraries.

Ross, Claire, Melissa Terras, Claire Warwick, and Anne Welsh. 2011. “Enabled Backchannel: Conference Twitter Use by Digital Humanists.” Journal of Documentation 67(2): 214–37. doi:10.1108/00220411111109449.

Sample, Mark. 2013. “When does Service become Scholarship?” [web log]. Retrieved from http://www.samplereality.com/2013/02/08/when-does-service-become-scholarship.

Selisker, Scott. 2016. “Digital Humanities Knowledge: Reflections on the Introductory Graduate Syllabus. In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/68.

Senchyne, Jonathan. 2016. “Between Knowledge and Metaknowledge: Shifting Disciplinary Borders in Digital Humanities and Library and Information Studies.” In Debates in the Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein. Minneapolis: University of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/81.

Shirazi, Roxanne. 2014. “Reproducing the Academy: Librarians and the Question of Service in the Digital Humanities.” Association for College and Research Libraries, Annual Conference and Exhibition of the American Library Association. Las Vegas, Nev. Retrieved from http://roxanneshirazi.com/2014/07/15/reproducing-the-academy-librarians-and-the-question-of-service-in-the-digital-humanities.

Siemens, Ray. 2001. “The Humanities Computing Curriculum / The Computing Curriculum in the Arts and Humanities: Presenters and Presentation Abstracts.” November 9–10, 2001. Retrieved from https://web.archive.org/web/20051220181036/http://web.mala.bc.ca/siemensr/HCCurriculum/abstracts.htm#Hockey.

Sinclair, Stefan. 2001. “Report from the Humanities Computing Curriculum Conference,” Humanist Discussion Group. November 16, 2001. Retrieved from http://dhhumanist.org/Archives/Virginia/v15/0351.html.

Sinclair, Stèfan, and Sean W. Gouglas. 2002. “Theory into Practice A Case Study of the Humanities Computing Master of Arts Programme at the University of Alberta.” Arts and Humanities in Higher Education 1(2): 167–83. doi:10.1177/1474022202001002004.

Smith, David. 2014. “Advocating for a Digital Humanities Curriculum: Design and Implementation.” Presented at Digital Humanities 2014. Lausanne, Switzerland. Retrieved from http://dharchive.org/paper/DH2014/Paper-665.xml.

Spiro, Lisa. 2011. “Knowing and Doing: Understanding the Digital Humanities Curriculum.” Presented at Digital Humanities 2011. Stanford University.

TaDiRAH. 2014a. “TaDiRAH – Taxonomy of Digital Research Activities in the Humanities.” GitHub. May 13, 2014. Retrieved from https://github.com/dhtaxonomy/TaDiRAH.

———. 2014b. “TaDiRAH – Taxonomy of Digital Research Activities in the Humanities.” July 18, 2014. Retrieved from http://tadirah.dariah.eu/vocab/index.php.
Takats, Sean. 2013. “A Digital Humanities Tenure Case, Part 2: Letters and Committees.” [web log]. Retrieved from http://quintessenceofham.org/2013/02/07/a-digital-humanities-tenure-case-part-2-letters-and-committees.

Terras, Melissa. 2006. “Disciplined: Using Educational Studies to Analyse ‘Humanities Computing.’” Literary and Linguistic Computing 21(2): 229–46. doi:10.1093/llc/fql022.

Terras, Melissa, Julianne Nyhan, and Edward Vanhoutte. 2013. Defining Digital Humanities: A Reader. Ashgate Publishing, Ltd.

UCLA Center for Digital Humanities. 2015. “Digital Humanities Programs and Organizations.” January 8, 2015. Retrieved from https://web.archive.org/web/20150108203540/http://www.cdh.ucla.edu/resources/us-dh-academic-programs.html.

Unsworth, John. 2000. “Scholarly Primitives: What Methods Do Humanities Researchers Have in Common, and How Might Our Tools Reflect This?” Presented at Symposium on Humanities Computing: Formal Methods, Experimental Practice, King’s College London. Retrieved from http://people.brandeis.edu/~unsworth/Kings.5-00/primitives.html.

———. 2001. “A Masters Degree in Digital Humanities at the University of Virginia.” Presented at 2001 Congress of the Social Sciences and Humanities. Université Laval, Québec, Canada. Retrieved from http://www3.isrl.illinois.edu/~unsworth/laval.html.

Unsworth, John, and Terry Butler. 2001. “A Masters Degree in Digital Humanities at the University of Virginia.” Presented at ACH-ALLC 2001, New York University, June 13–16, 2001.

Varner, Stuart. 2016. “Library Instruction for Digital Humanities Pedagogy in Undergraduate Classes.” In Laying the Foundation: Digital Humanities in Academic Libraries, edited by John W. White and Heather Gilbert, 205–22. Notre Dame, Ind: Purdue University Press.

Vedantham, Anu and Dot Porter. 2016. “Spaces, Skills, and Synthesis.” In Digital Humanities in the Library: Challenges and Opportunities for Subject Specialists, edited by Arianne Hartsell-Gundy, Laura Braunstein, and Liorah Golomb, 177–98. Association of College and Research Libraries.

Waltzer, Luke. 2012. “Digital Humanities and the ‘Ugly Stepchildren’ of American Higher Education.” In Debates in the Digital Humanities, edited by Matthew K. Gold, 335–49. Minneapolis: University Of Minnesota Press. Retrieved from http://dhdebates.gc.cuny.edu/debates/text/33.

Weingart, Scott. 2016. “dhconf.” the scottbot irregular. Accessed March 1, 2016. Retrieved from http://www.scottbot.net/HIAL/?tag=dhconf.

Zorich, D. 2008. A Survey of Digital Humanities Centers in the United States. Council on Library and Information Resources.

Appendix A

List of Digital Humanities Programs in our Collected Data

  • Minor (undergraduate) in Digital Humanities, Australian National University
  • Minor (undergraduate) in Digital Humanities & Technology, Brigham Young University
  • Minor (undergraduate) in Interactive Arts and Science, Brock University
  • BA in Interactive Arts and Science, Brock University
  • MA in Digital Humanities (Collaborative Master’s), Carleton University
  • MA (program track) in Digital Humanities, CUNY Graduate Center
  • Minor (undergraduate) in Digital Humanities, Farleigh Dickinson University
  • BS in Digital Humanities, Illinois Institute of Technology
  • MPhil/PhD in Digital Humanities Research, King’s College London
  • MA in Digital Humanities, King’s College London
  • BA in Digital Culture, King’s College London
  • MA in Digital Humanities, Loyola University Chicago
  • Certificate (graduate) in Digital Humanities, Michigan State University
  • Specialization (undergraduate) in Digital Humanities, Michigan State University
  • MA in Digital Humanities, National University of Ireland Maynooth
  • PhD in Digital Arts and Humanities, National University of Ireland Maynooth
  • Certificate (graduate) in Digital Humanities, North Carolina State University
  • Certificate (graduate) in Digital Humanities, Pratt Institute
  • Certificate in Digital Humanities, Rutgers University
  • Certificate (graduate) in Digital Humanities, Stanford University
  • Certificate (graduate) in Digital Humanities, Texas A&M University
  • Certificate (graduate) in Book History and Digital Humanities, Texas Tech University
  • MPhil in Digital Humanities and Culture, Trinity College Dublin
  • Certificate (graduate) in Digital Humanities, UCLA
  • Minor (undergraduate) in Digital Humanities, UCLA
  • MA/MSc in Digital Humanities, University College London
  • PhD in Digital Humanities, University College London
  • MA in Humanities Computing, University of Alberta
  • Specialization (undergraduate) in Literature & the Culture of Information, University of California, Santa Barbara
  • Concentration (graduate) in Humanities Computing, University of Georgia
  • Concentration (undergraduate) in Humanities Computing, University of Georgia
  • Certificate (graduate) in Public Digital Humanities, University of Iowa
  • Certificate (graduate) in Digital Humanities, University of Nebraska-Lincoln
  • Certificate (graduate) in Digital Humanities, University of North Carolina at Chapel Hill
  • Certificate (graduate) in Digital Humanities, University of Victoria
  • Certificate (graduate) in Certificate in Public Scholarship, University of Washington
  • Minor (undergraduate) in Digital Humanities, Western University Canada

Appendix B

List of Programs in DARIAH/EADH Data

A table of European institutions and DH programs. For each program, the type (e.g., Bachelor’s, Master’s) is listed, as well as whether the program was listed by DARIAH, EADH, or both.
Figure 15: European institutions and DH programs

Appendix C

Data

In addition to creating a GitHub repository at https://github.com/dhprograms/data, we include the program data we collected and our term codings below. Since the GitHub data may be updated over time, these files serve as the version of record for the data and analysis presented in this article.

Data for “A Survey of Digital Humanities Programs”

About the Authors

Chris Alen Sula is Associate Professor and Coordinator of Digital Humanities and the MS in Data Analytics & Visualization at Pratt Institute School of Information. His research applies visualization to humanities datasets, as well as exploring the ethics of data and visualization. He received his PhD in Philosophy from the City University of New York with a doctoral certificate in Interactive Technology and Pedagogy.

S.E. Hackney is a PhD student in Library and Information Science at the University of Pittsburgh. Their research looks at the documentation practices of online communities, and how identity, ideology, and the body get represented through the governance of digital spaces. They received their MSLIS with an Advanced Certificate in Digital Humanities from Pratt Institute School of Information in 2016.

Phillip Cunningham has been a reference assistant and cataloger with the Amistad Research Center since 2015. He received a BA in History from Kansas State University and MSLIS from Pratt Institute. He has interned at the Schomburg Center’s Jean Blackwell Hutson Research and Reference Division, the Gilder-Lehrman Institute for American History, and the Riley County (KS) Genealogical Society. His research has focused on local history, Kansas African-American history, and the use of digital humanities in public history.

Skip to toolbar