All the work of the hand is rooted in thinking.‎ -David Sudnow

All the work of the hand is rooted in thinking.‎ -David Sudnow

Multitouch Interaction Design Space Boundaries (MIDS Boundaries)

There has been little formal study of social factors influencing HCI innovation, although has received limited attention by HCI researchers William Buxton, Paul Dourish and Lucy Suchman. These researchers have each commented on the issue of HCI innovation. Suchman researching the configurations of the “human-machine interface” writes, “tracing the differences within specific sociomaterial arrangements” is needed, but that “this requires expanding our unit of analysis, which the inevitable cuts or boundaries through which technological systems are constituted” (2007, loc. 2).

This research applies Suchman’s suggestion to a particular set of technological systems that is consumer multitouch devices, by focusing on three social factors influencing innovation in interaction design. This study employs the notion of design space as a conceptual frame. Design space is the totality of design choices available to the designer. The Interaction Design Space (IDS) takes the abstract ontology human computer interaction and applies physical characteristics to this ontology as to better understand it as a concrete terrain that can be measured and mapped. Thus here “interaction” refers to interaction with computing devices.

Read More

Multitouch Interaction Notation (MIDS notation)

There are limits to spoken and written language’s ability to describe interaction in any form. John McHale wrote,

… one of our major problems in thinking today is the use of language systems which still represent a fixed compartmentalized world view. The terms available to us for the expression of dynamic, rather than static, concepts are far from satisfactory (McHale, 1965 as cited by Friedman, 1997, p. 12).

Read More

Mapping Commuting Behavior

Goal: quantify and visually organize the way a commuter spends their time.

Read More

ASIST 2010 Student Design Competition


  • Steven Fazzio
  • Justyna Berzowska
  • Alex Garnett
  • Eryn Whitworth
  • Linda Doll

Design Opportunity
In 48 hours between the kickoff meting and the judging:

  1. Form cross-institutional teams;
  2. Develop a preliminary design for an information retrieval system that has the potential to support serendipity in searching a specific collection by a particular set of searchers;
  3. Pitch the concept to a panel of industry and academic experts.

Read More

Lucy Suchman’s “Restoring Information’s Body,” Keynote Address ASIST 2010 

I recorded details notes on Suchman’s address and while my response to these ideas needs more time to coalesce into a narrative form. I wanted to share the notes and drawings I took on the fly. I’ve embedded links to the books, photos, and philosophical concepts mentioned where I could.




Overcoming Ostacles to Designing Collections with Rhetorical Purpose

ABSTRACT—This research project addresses the design process for creating knowledge organization schemes and presents novel means of supporting the sketching of collections. Based on a recent experience designing a digital media collection using the Open Video Digital Library Toolkit, this research analyzes the two major obstacles encountered in sketching collections.

Keywords—Sketching, design, collection, information systems, and digital libraries.

INTRODUCTION—Rhetoric is the art of effective or persuasive argument. Feinberg (2008) demonstrated that collections could convey a rhetorical stance. According to Feinberg, not only do information systems show traces of an intellectual perspective, these information systems can be created as an original expression like other intellectual works (Feinberg, 2007). Feinberg went on to assert that classification schemes can in fact be designed.

This research project addresses the design process for creating knowledge organization schemes put forth by Feinberg (2010) and expands upon one of her design activities to support the sketching of collections. Based on a recent design experience applying Feinberg’s process to the creation of a digital media collection using the Open Video Digital Library Toolkit, this research analyzes the two major obstacles encountered.
Although Feinberg does not explicitly state the utility of this process for the design of collections, there is no structural quality of her process that precludes modification to enable collection creators to enjoy a fuller design language for expression. Thus, this design process could be of great utility to the scholarly communities interested in collections.

COLLECTIONS—Knowledge organization schemes and information systems, Feinberg’s preferred terms, are, at their simplest, conduits for the creation and presentation of collections of information resources. This project is concerned with the initial creation of collections, which involves three facets of work.

  • Selection involves choosing existing items to include in the collection.
  • Arrangement, a term carrying connotations of spatial layout, here means the placement of collection items within the presentation environment. 
  •  Description, the least visual of the three, involves the use of metadata, cataloging, tags and other more narrative structures such as abstracts to give an account of the object’s characteristics.

SKETCHING COLLECTIONS—Feinberg’s design process is a series of design activities. Each one is a formulated mixture of design techniques and methodologies tailored to the design of knowledge organization schemes. The focus of this research project is limited to sketching, which is a rich practice that is essential to any understanding of design (Goldschmidt, 1991). Feinberg (2010, p. 5) describes the sketching design activity, thusly:

"once a number of source concepts have been gathered, the designer begins ‘sketching’ categories and defining potential hierarchical and associative relationships. These sketches map out a potential knowledge organization infrastructure to support the user interactions […] and the rhetorical goals”

Obstacles to Sketching Collections—As an exercise, Feinberg’s process was applied to the design of a digital media collection. The Open Video Digital Library toolkit was used as a prototyping environment. Completing that exercise, it became clear that for the design process to facilitate the conveyance of rhetorical purpose through collection design that the “Sketching” design activity must clarify how to overcome two major obstacles encountered. These are:

  1. Translating the tradition of sketching from visual design in order to capture the emerging collection’s selection, arrangement, and description;
  2. Integrating all three of these facets into an iterative sketching framework through which the design emerges.

Feinberg’s description demonstrates that the design of collections requires a highly non-visual conception of sketching. The object of the sketch is divorced from the physical world. It is clear that sketching is a critical method and thought process through which a design is wrought. It is not clear, however, based on Feinberg’s description how this is meant to be achieved in practice. Furthermore, there is not sufficient scholarship supporting the designer’s transition from sketching the visual to sketching the non-visual. To conceive of a future in which the “design space” of collection-based entities (e.g., information systems and digital libraries) expands to allow for crafting distinct intellectual statements, tools to facilitate the design of collections in all of their constituent facets are needed.

COLLECTION SKETCHING FRAMEWORK (CSF)—The three user interfaces described below are intended to extend the Open Video Digital Library Toolkit to facilitate sketching collections. Prototyping and implementation of the collection sketching framework (CSF) are planned as future extensions of this work.

Process Flowdiagram of CSF—This process flow diagram describes how a user would use the extension for the first time.

Make An Initial Selection And Rough Arrangement

Using screen 1 the designer can sketch the initial selection and arrangement of the collection. With a drag- and-drop style interaction the designer can select from candidate items and place them in the selection box. The items in the selection box are repositionable. A rough arrangement can be hewn through grouping selections as the designer wishes.

Refine Arrangement And Sketch Descriptors

Screen 2 reframes the sketching activity to focus on the arrangement and description of the collection. The left side of the interface allows the designer to sketch descriptive categories for the collection. A variety of types of description can be sketched: a) a hierarchical structure for the sketching of cataloging terms, b) a flat structure for sub- collections, categories, and descriptions, and c) a flat structure of tag descriptors. The right panel of the second interface allows the arrangement of the selected items into sub-collections. An arrow suggests how the designer might drag an item from the top space into one of many groups.

Apply Descriptors To Arrangement And Edit Selection

Screen 3 allows the designer to sketch how those descriptive elements captured in interface 2 would apply to the initial selection. The designer may de-select items in light of the emerging operational image of the collection coming into view. Any selected item can have descriptors applied to it. When an item is selected its description is displayed in the preview window, denoted with a dashed outline. The designer can sketch how they might apply they descriptive elements, as they exist at that moment in the design process.

The CSF uses three interfaces for sketching selection, arrangement, and description of collections.

The design notebook is an important feature of the extension to OVDL and it’s what makes this application of DL software different. The design notebook is situated in an overlay. It works like a journal. Each notebook will have several entries. The person designing the collection will make entries after each meaningful step in the design process. When using the notebook, the collection designer will have the option to review previous entries in the notebook. Shown here is the design notebook overlay at different stages of the design process.

In order to conceive of a design language that allows collections to convey, by intention of the designer, not merely imply original expression, in their construction, tools are needed to facilitate the design of the collections in which all of the facets of collections reinforce the design argument being made. More broadly, this research project is related to a trend in scholarship that translates design methods and techniques to the creation of collections of information resources


  • Feinberg, M. (2007). Beyond retrieval: a proposal to expand the design space of classification. In Proceedings North American Symposium on Knowledge Organization 2007. Toronto.

ACKNOWLEDGMENTS—Dr. Gary Geisler and Dr. Melanie Feinberg both have been great help in advising me on this project. Thanks!