Course Syllabus
Sensemaking & Organizing
CogSci 150, 3 units, Spring 2022
Tuesday & Thursday 11:10am-12:30pm
Wheeler 106
TEACHING TEAM
Professor Robert J. Glushko
glushko@berkeley.edu
Aurum Kathuria
aurumkathuria@berkeley.edu
When something "makes sense” or "is organized” we are discovering or imposing order in the arrangement of concepts, events, or resources of some kind. Sensemaking and organizing are fundamental human activities that raise many multi- or trans-disciplinary questions about perception, language, knowledge, decision making, and interaction with things and with other people.
We can analyze sensemaking and organizing from four interrelated perspectives. The most fundamental one is provided by language and culture, which shapes the perspectives one takes as an individual, in institutional contexts governed by business or legal processes, or in data-intensive or scientific contexts.
COURSE FORMAT and GRADING
The course is primarily lecture-based, but to enable more discussion, breakout sessions, and peer learning a mandatory 1-hour online session will take place on Friday (time TBD)
The expected workload should average 10 hours a week; 4 for the course meetings and 6 for preparation and deliverables. The load will be lighter at the beginning of the semester and heavier toward the end when students are researching and writing their case study, the most important work product for the course.
- 8 assignments (25%)
- 2 timed exams, administered by bCourses (35%; 15% for #1, 20% for #2)
- Case study (25%)
- Purpose: To reinforce the generality of the organizing system framework. After reading ten or more short case studies in the first few weeks of the course, students write one of their own as their course capstone. The best student cases end up in future syllabi
- Class preparation and participation (15%)
SCHEDULE AND READINGS
The primary text is The Discipline of Organizing, (4th edition, 2016). This text has been extensively revised since it was first published and it can be found in multiple versions, and in both print and digital formats. We will be reading parts of the "Core Concepts" and "Abridged" editions; the "Professional" edition can be consulted for more depth.
- Use the freely-downloadable Core Concepts edition from https://ischools.org/Discipline-of-Organizing
- Use the Abridged edition from the Files folder
- Use the Professional edition in Pressbooks (web-based) format
Readings from this text are indicated with “TDO” and a chapter or section number, a * after a number (like 4.1*) means the identified section and all of its subsections
Many readings are short case studies, some from the textbook and some written by students taking this or similar courses. Their diversity demonstrates the breadth of the organizing system concept.
Part 1: Introduction to Sensemaking and Organizing
[1 - Jan 18] [1.1 - Jan 19] Course introduction; the concept of the "Organizing System”
An Organizing System is an intentionally arranged collection of resources and the interactions they support. This definition doesn't specifically mention books, people, datasets, shoes, animals, or any other type of resource. This definition also doesn't mention any specific ways in which resources are used. Finally, this definition allows for any arrangement or structure that is needed to enable the interaction.
This abstraction allows the Organizing System concept to transcend the traditional view that information organization is a human activity and information retrieval is a machine activity, or that information organization is a topic for library and information science and information retrieval is one for computer science. Instead, we readily see that computers now assist people in organizing and that people contribute much of the information used when computers analyze and organize resources.
Because the Organizing System perspective can be applied to any kind of resource, it enables a more nuanced discussion of how the economic, social, and cognitive costs and benefits of organizing are allocated among different stakeholders and over time.
- Foundations for Organizing Systems, TDO Chapter 1 Abridged
- The Concept of "Organizing Principle" TDO 5th edition draft
Case Studies:
- TDO 12.5 Organizing a kitchen (Hardman 2013)
- Time Zones (Volkov 2015)
- Orchestra Seating Arrangements (Hsu 2018)
[2 - Jan 20] Design Decisions for Organizing Systems
This lecture introduces six broad design questions or dimensions whose intertwined answers define an Organizing System: What, why, how, when, by whom or what, and where. This framework for describing and comparing Organizing Systems overcomes the biases and conservatism built into familiar categories like libraries and museums while enabling us to describe them as design patterns. We can then use these patterns to support inter-disciplinary work that cuts across categories and applies knowledge about familiar domains to unfamiliar ones.
Case Studies:
- TDO 12.4 Single-source textbook publishing
- TDO 12.18 Neuroscience lab (Gerber 2013)
- Medical Emergencies (Delzompo 2018)
[3 - Jan 25] Models for Organizing Systems; More Case Studies
Many academic fields – management, operations research, informatics, etc. – provide models or representations for describing organizing systems. In this lecture, we'll show how these different depictions distinguish and highlight different aspects of the organizing system. They can be thought of as different perspectives or points of view whose effectiveness depends on the nature of the resources and organizing principles in the organizing system.
- Guide Dogs for the Blind (Cho 2016)
- Organized Crime (Sondhi 2015)
- Player Tracking in the NBA (Mon 2016)
- Intentional Communities (Sauter 2016)
[4 - Jan 27] The Activities of Sensemaking and Organizing
A perspective that brings together how we organize as individuals or as members of groups with how libraries, museums, governments, research institutions, and businesses create Organizing Systems requires that we generalize the organizing concepts and methods from these different domains. This lecture surveys a wide variety of Organizing Systems and describes four activities or functions shared by all of them: selecting resources, organizing resources, designing resource-based interactions, and maintaining the interactions and resources over time.
- Activities in Organizing Systems, TDO Chapter 3 Abridged
- The Organizing System Lifecycle, TDO 11.1, 11.2, 11.3*
[5 - Feb 1] Resources
The design of an Organizing System is strongly shaped by what is being organized, the first of the six design decisions introduced in the second lecture. To enable a broad perspective on this fundamental issue we use resource to refer to anything being organized, an abstraction that we can apply to physical things, people, digital things, information about either of them, or web-based services or objects.
Two separate aspects cut across the "thingness" distinctions:
- Granularity – do we think of the resource as unitary, or as consisting of parts?
- Abstraction – “thing” or “type of thing” – are we thinking of the resource as a single instance or as a member of a bigger category?
Case Studies:
[6 - Feb 3] Names and Identifiers
A NAME is a label for some thing or some category that is used to distinguish one from another. If a name is used to refer to some specific thing and is unique in some context it is an IDENTIFIER. Choosing good names and identifiers is essential, difficult, and often contentious.
- Resource Identity, TDO 4.3*
- Naming Resources, TDO 4.4*
- Resources Over Time, TDO 4.5*
- Economist (2019), Countryside Catches Up With Napoleon
- Kamiya. G. (2021). The Holier-Than-Thou Crusade in San Francisco. The Atlantic
Case Study:
[7 - Feb 8] Resource Description
Categories can be defined in many different ways according to many different types of principles and processes. The principles by which resources are organized and the interactions that can be supported for them largely depend on the nature and explicitness of the resource descriptions.
[8 - Feb 10] Describing Non-text Resources and Media; Resource Properties Framework
We will apply the concepts of resource abstraction, granularity, and description to art, artifacts, and music.
Two important dimensions for understanding and contrasting resource properties used in descriptions and organizing principles are: property essence—whether the properties are intrinsically or extrinsically associated with the resource, and; property persistence—whether the properties are static or dynamic. Taken together these two dimensions yield four categories of properties.
Case Studies
- TDO 12.16 Dabbawalas of Mumbai (Rathore 2014)
- Spotify’s Recommendation Engine (Ngo 2019)
- Pantone Color System (Liu 2016)
Part 2: Sensemaking and Organizing in Language and Culture
[9 - Feb 15] Introduction to Categorization; Cultural Categories; Astronomical Sensemaking and Other "Natural" Categories
Categories are sets or groups of resources or abstract entities that are treated the same. Categories are involved whenever we perceive, communicate, analyze, predict, classify – or otherwise attempt to make sense of our experiences.
The universality of temporal concepts for "day," "month," "year," and "season" reflects their basis in natural astronomical events that have been systematically observed and recorded for well over ten thousand years. Likewise, all cultures impose patterns on stars, often associated with myths. Studying how these constellation-embodied myths evolve and disperse over time using techniques of evolutionary biologists creates "the tree of myths."
- Categorization: Describing Resource Classes and Types, TDO 7.1, 7.2
- Breasted, J. (1935). The beginnings of time-measurement and the origins of our calendar. The Scientific Monthly, 41(4), 289-304.
- d'Huy, J. (2016). The evolution of myths. Scientific American, 315(6), 62-69.
- Boxer, A. (2020) Selection from A Scheme of Heaven
[10- Feb 17] Universal Cognition? Folk Biology; Linguistic Relativity; Bi-lingualism & Bi-culturalism
All human languages and cultures divide the physical and experiential “worlds” into categories; there are substantial similarities but interesting differences.
- Cultural Categories and Linguistic Relativity, TDO 7.2.1
- Boraditsky, Lera. How Language Shapes the Way We Think. TED Talk, 2017
- Atran, S., and Medin, D. L., & (2008). The Native Mind and the Cultural Construction of Nature. Chapter 1, Introduction.
- Ramírez-Esparza, N., & García-Sierra, A. (2014). The bilingual brain: language, culture, and identity. Handbook of Multicultural Identity: Basic and Applied Perspectives, (pages 35-37 and all the "Conclusion" sections)
[11 - Feb 22] Document Engineering and Modeling
We will discuss techniques of Document Engineering for systematically identifying the content, structure, and presentation components in documents and datasets to enable the design of robust models for information-intensive domains. We will contrast methods and formats for information models that differ in their semantic precision, maintainability, and ease of use.
- Glushko, R., and McGrath, T. (2005) XML Foundations Chapter 2 of Document Engineering (read through Section 2.5.2)
- Getting started with schema.org, sections 1 and 2
- Glushko, R. (2005) Modeling Methods and Artifacts for Crossing the Data/Document Divide XML 2005 Conference Proceedings (read through section 4)
[12 - Feb 24] Describing Relationships and Structures, Part 1
An important aspect of organizing a collection of resources is describing the relationships between them. This lecture introduces the specialized vocabulary used to describe semantic relationships between resources and between the concepts and words used in resource descriptions.
- Describing Relationships and Structures, TDO Chapter 6 (abridged version) - read through Section 6.4
[13 - March 1] Describing Relationships and Structures, Part 2; Social network analysis
The structural perspective analyzes the patterns of association, arrangement, proximity, or connection between resources (and often ignores the reasons for them).
We can apply graph theory to understanding relationships from a structural perspective
- Describing Relationships and Structures, TDO Chapter 6 Abridged - Sections 6.5-6.7
- Hansen, D. L., & Smith, M. A. (2014). Social network analysis in HCI. In Ways of Knowing in HCI (read pages 432-440 carefully; skim the rest)
[14 - March 3] Social thinking; Dis-/Mis-/Mal- information
How do the groups we explicitly or implicitly belong to influence how and what we think? When does social thinking create better decisions and outcomes? When does social thinking create worse decisions and outcomes?
Social thinking is a critical factor in the problem of "fake news" -- which we will unpack into more precise categories so we can better understand its causes, mechanisms, and remedies.
Part 3: Sensemaking and Organizing As Individuals
[15 - March 8] "Automatic organizing" using perceptual processes, Gestalt principles, statistical learning
Physical resources are often organized according to intrinsic physical properties like size, color, or shape because the human visual system quickly and automatically pays a lot of attention to them. Likewise, because people have limited attentional capacity, we ignore a lot of the ongoing complexity of visual (and auditory) stimulation, making us perceive our sensory world as simpler than it really is. Infants have a remarkable ability to extract patterns in auditory and visual inputs so that they can learn their native language and cope with the complexity of their physical environments.
- Cameron, C. Exploring the Gestalt Principles of Design
- Pearl, L. (2018). Acquisition of Language 2. Saffran et al 1996
- Chater, N., & Loewenstein, G. (2016). The under-appreciated drive for sense-making. Journal of Economic Behavior & Organization, 137-141 (sections 1 and 2)
- Chater, N. (2018). The Mind is Flat. Chapter 7, "The Cycle of Thought."
- Saffran, Jenny R. (2020). Statistical Language Learning in Infancy. Child Development Perspectives 49-54.
[16 - March 10] Categories made by Individuals; Personal Possession Management; Personal Information Management
Individual categories are created to satisfy ad hoc requirements that emerge from an individual’s unique experiences, preferences, and resource collections. How people manage their personal possessions is a trendy topic and a lucrative consulting business, but some people have psychological disorders that prevent them from doing it well. How people organize their personal information has been extensively studied by researchers and designers. The Memex, proposed by Vannevar Bush almost 80 years ago, embodied many novel ideas about personal information management and is often viewed as the inspiration for personal computers and the web.
- Individual Categories, TDO 7.2.2
- Matax-Cols, D. (2014). Hoarding Disorder, New England Journal of Medicine.
- Vitale, Odom, & McGrenere (2019). Keeping and Discarding Personal Data: Exploring a Design Space, Designing Interactive Systems Conference.
- Bush, V. (1945). As We May Think. The Atlantic Monthly.
People have a cognitive bias to see order and purpose in the world. The vast majority of our decisions are influenced—at least in part—by our beliefs about the causal structure of the world. It is essential for survival to understand and predict the properties and behaviors of physical objects and substances (Physics), plants and animals (Biology), and other people (Psychology).
But what makes some sequences of events causal, so we make inferences about similar events, and other sequences non-causal? Causes are not deducible, and are not always explicitly visible in sensory input
- Kleinberg, S. (2015). WHY: A Guide to Finding and Using Causes. Chapter 1
- Banerjee, K., & Bloom, P. (2014). Why did this happen to me? Religious believers’ and non-believers’ teleological reasoning about life events. Cognition, 277-280 (section 1), 299-301 (General discussion)
- Thagard, P. (2012). The Cognitive Science of Science: Explanation, Discovery, and Conceptual Change. Chapter 13 Conceptual Change in the History of Science: Life, Mind, and Disease
[18 - March 17] EXAM
Part 4: Sensemaking and Organizing in Defined/Institutional Contexts
[19 - March 29] Category Structure; Institutional Categories
"Category structure refers to the principles by which a category is defined. Categories can be defined by enumerating their members, on the basis of one or more shared properties, or by less rigid principles like similarity. Institutional categories are explicitly constructed semantic models of a domain to enable more control, robustness, and interoperability than is possible with just the cultural category system. They are essential in abstract, information-intensive domains where semantic precision is essential for processes and transactions (especially automated ones). They are usually developed via rigorous and formal processes (e.g., in standards organizations or legislative bodies) and require ongoing governance and maintenance
- Institutional Categories, TDO 7.2.3
- FOR THESE TWO SECTIONS YOU CAN CHOOSE BETWEEN THE ABRIDGED AND PROFESSIONAL VERSIONS OF TDO
- Principles for Creating Categories, TDO 7.3* (skip 7.3.6 "Similarity" for now)
- Category Design Issues and Implications TDO 7.4*
[20 - March 31] Classification; Standardization
The terms categorization and classification are often used interchangeably but they are not the same. Classification is applied categorization—the assignment of resources to a system of categories, called classes, using a predetermined set of principles. Because classification and standardization are closely related, the lecture also analyzes standards and standards-making as they apply to Organizing Systems.
- READ IN TDO CORE CONCEPTS EDITION:
- Classification and Standardization, TDO 8.1.5
- Understanding Classification, TDO 8.2
- Bibliographic Classification, TDO 8.3
- Faceted Classification, TDO 8.4
- Case Study: Occupational Classification (Suzuki, 2015)
[21 - April 5] Measurement, Controlled Vocabularies, Interoperability
Sensemaking and organizing in institutional or business contexts depend on systematic and robust descriptions of resources, events, processes, and people. Systems of measurement have evolved from ad hoc techniques for comparison, many of which were based on body parts or common work artifacts. Controlled vocabularies and standard description schemas are essential in the operation of information-intensive and data-driven businesses.
- Controlled Vocabularies, TDO 4.4.3.2
- Glushko, R., and McGrath, T. (2005). Document Engineering
- Chapter 4, "Describing What Businesses Do And How They Do It" (read sections 4.2.2.4 and 4.2.2.5)
- Chapter 6, "When Models Don't Match: The Interoperability Challenge" (read section 6.0)
- Wheatley, M. (2004). Operation Clean Data, CIO Magazine.
- Cooperrider, K., and Gentner, D. (2019). The career of measurement. Cognition.
[22 - April 7] Organizing and Interaction Design
Classifications arrange resources into categories. So every classification increases the capability and efficiency of interactions with resources that are “co-located” or “within-category” and makes “between-category” interactions less efficient. Choices about descriptions and organizing principles involve tradeoffs that determine which interactions are efficient, possible, difficult, or impossible.
Distributed cognition and external representations help people understand and interact effectively when faced with challenging cognitive and physical tasks.
- Information Architecture and Organizing Systems (3.3.3.2). Interaction Design (3.4), Affordance and Capability (3.4.1)
- Classification by Activity Structure. TDO Section 8.5
- Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction (TOCHI) [Read pages 174-178 and Section 3.6 Intelligent Use of Space]
- Kirsh, D. (2009). Interaction, External Representation, and Sense-Making. Cognitive Science Society Annual Meeting.
[23 - April 12] Case Study Proposals
Brief presentations by students of their proposed case study.
Six more case studies assigned to further develop the analysis and design skills needed to write a case study.
- Dolan, K. (2019). Organizing for Inebriation Case Study
- Zou, J. (2019) High-end Professional Kitchens (Chez Panisse Case Study)
- Shang, S. (2018) Chinese Medicine Cabinet Case Study
- Wang, Z. (2021) Golf Round Management Case Study
- Palmquist, A. (2021) Residential Life Management Case Study
- Liang, J. (2016) Credit Card Fraud Case Study
Part 5: Sensemaking and Organizing with Data
[24- April 14] Organizing with Interaction Traces
Interactions with physical resources sometimes leave traces or other evidence. Many of these traces are unintentional, like fingerprints, a coffee cup stain on a newspaper, or the erosion on a shortcut path across a lawn. However, when Organizing Systems contain digital resources or physical resources that have sensing, recording, or communication capabilities, interaction traces can be made predictable, persistent, and consistent. Each record of a user choice in accessing, browsing, buying, highlighting, linking, and other interactions then becomes an “interaction resource” that can be analyzed to reorganize the resource collection or otherwise influence subsequent interactions with the primary resources
- The Concept of “Interaction Resource,” TDO 1.9
- Active or Operant Resources, TDO 4.2.3.2
- Jarvis, D., Westcott, K., and Jones, D. (2021). The hyperquantified athlete, Technology, Media, and Telecommunications Predictions.
- Kellerman, D. Collaborative Learning for the Modern Workplace. Video recording of lecture at Microsoft, 2017. (DATA-DRIVEN TEACHING AND LEARNING IS POSSIBLE! Watch all 50 minutes if you have time, but you must watch for a few minutes starting at 39:27)
[25 - April 19] Behavioral Economics
Choices about descriptions and organizing principles involve tradeoffs that determine which interactions are efficient, possible, difficult, or impossible.Organizing systems control the behavior of their users. The emerging field of applied behavioral economics explains how subtle differences in resource arrangement, the number and framing of choices, and default values can have substantial effects on the decisions people make.
- Johnson, Eric J., et al. (2012) "Beyond nudges: Tools of a choice architecture."Marketing Letters 23.2 (2012): 487-504.
- Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124-1131.
[26 - April 21] Computational Description
Categories are typically created computationally when a collection of resources or resource descriptions is too large for people to think about effectively. The simplest computational categories are the implicit ones created by descriptive statistics that identify typical or frequent and atypical or infrequent items
- Organizing with Descriptive Statistics, TDO 3.3.4
- Computational categories, TDO 7.2.5
- Similarity TDO 7.3.6*
[ 27 - April 26] Computational Classification; Computation {and,or, vs.} Cognition
Some classification tasks are hard because the categories are “close together” and the resource properties or features involved are not easy to understand and use. Other classification tasks are conceptually simpler, but can't be done by people at the needed scale or speed.
In “data science,” a classifier is a system whose input is a vector of discrete or continuous feature (or attribute) values and whose output is the name of the class. This vector might be the description of a document, an image, a person, a molecule, just about anything
- Implementing Categories Defined by Probability and Similarity, TDO 7.5.3* Computation {and,or, vs.} Cognition
- Computational classification, TDO 8.6
[28 - April 28] EXAM
[ 29 – May 3] Case Study Presentations
[ 30 – May 5] Case Study Presentations
Course Summary:
Date | Details | Due |
---|---|---|