Peer review and competition in the art exhibition game

Balietti, S., Goldstone, R., & Helbing, D. (2016).  Peer review and competition in the art exhibition game.  Proceedings of the National Academy of Sciences, 113, 8414-8419.

To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained.

Download PDF here

Download Supplemental File here

Homo Socialis and Homo Sapiens

Goldstone, R. L. (2015).  Homo Socialis and Homo Sapiens.  Review of Behavioral Economics, 2, 77-87.

[This paper is a commentary on the following article: Gintis, H., & Helbing, D. (2015). Homo Socialis: An Analytical Core for Sociological Theory.  Review of Behavioral Economics.]

Explaining how patterns of collective behavior emerge from interactions among individuals with diverse, sometimes opposing, goals is a societally crucial and particularly timely pursuit. It is timely because humans are more tightly connected to one another now than ever before. From 1984 to 2014 there has been more than a million-fold increase in the number of devices that can reach the global digital network. Although web technology is new and transformative, from a broader perspective, it is also just a recent manifestation of humanity’s perpetual drive to become more intermeshed. Earlier manifestations of this drive include the printing press, global transportation networks, telecommunication systems, and the academy. These social networks have catalyzed the formation of otherwise unattainable social patterns. Understanding the origins and possible destinations of these social patterns is both scientifically and pragmatically consequential.

Download a PDF of this paper here

Interdisciplinarity at the Journal and Specialty Level: The changing knowledge bases of the journal Cognitive Science

Leydesdorff, L., & Goldstone, R. L. (2014).  Interdisciplinarity at the Journal and Specialty Level:  The changing knowledge bases of the journal Cognitive Science.  Journal of the American Society for Information Science and Technology, 65, 164-177.

Using the referencing patterns in articles in Cognitive Science over three decades, we analyze the knowledge base of this literature in terms of its changing disciplinary composition. Three periods are distinguished: (1) construction of the interdisciplinary space in the 1980s; (2) development of an interdisciplinary orientation in the 1990s; (3) reintegration into “cognitive psychology” in the 2000s. The fluidity and fuzziness of the interdisciplinary delineations in the different visualizations can be reduced and clarified using factor analysis. We also explore newly available routines (“CorText”) to analyze this development in terms of “tubes” using an alluvial map, and compare the results with an animation (using “visone”). The historical specificity of this development can be compared with the development of “artificial intelligence” into an integrated specialty during this same period. “Interdisciplinarity” should be defined differently at the level of journals and of specialties.

Download this paper

See a movie of how the citation niche of Cognitive Science has changed over the years

Cycles and predictability in human collective behavior: An experimental generalization of Rock-Scissors-Paper

Here are some reports of our PLoS One paper on human collective behavior studying cyclic patterns in a generalization of the familiar rock-scissors-paper game.  We find situations in which groups of people grow increasingly predictable as they cycle around a set of choice options in a game similar to rock-scissors-paper but with 24 rather than 3 choices.

Social Learning Strategies in a Networked Group

Wisdom, T. N., Song, X., & Goldstone, R. L. (2013). Social Learning Strategies in a Networked Group.  Cognitive Science, 37, 1383-1425

When making decisions, humans can observe many kinds of information about others’ activities, but their effects on performance are not well understood. We investigated social learning strategies using a simple problem-solving task in which participants search a complex space, and each can view and imitate others’ solutions. Results showed that participants combined multiple sources of information to guide learning, including payoffs of peers’ solutions, popularity of solution elements among peers, similarity of peers’ solutions to their own, and relative payoffs from individual exploration. Furthermore, performance was positively associated with imitation rates at both the individual and group levels. When peers’ payoffs were hidden, popularity and similarity biases reversed, participants searched more broadly and randomly, and both quality and equity of exploration suffered. We conclude that when peers’ solutions can be effectively compared, imitation does not simply permit scrounging, but it can also facilitate propagation of good solutions for further cumulative exploration.

Download this paper

See a movie of Creature League experiment in action

Cyclic game dynamics driven by iterated reasoning

Frey, S., & Goldstone, R. L. (2013). Cyclic game dynamics driven by iterated reasoning. PLoS One, 8(2): e56416. doi:10.1371/journal.pone.0056416

Recent theories from complexity science argue that complex dynamics are ubiquitous in social and economic systems. These claims emerge from the analysis of individually simple agents whose collective behavior is surprisingly complicated. However, economists have argued that iterated reasoning–what you think I think you think–will suppress complex dynamics by stabilizing or accelerating convergence to Nash equilibrium. We report stable and efficient periodic behavior in human groups playing the Mod Game, a multi-player game similar to Rock-Paper-Scissors. The game rewards subjects for thinking exactly one step ahead of others in their group. Groups that play this game exhibit cycles that are inconsistent with any fixed-point solution concept. These cycles are driven by a ‘‘hopping’’ behavior that is consistent with other accounts of iterated reasoning: agents are constrained to about two steps of iterated reasoning and learn an additional one-half step with each session. If higher-order reasoning can be complicit in complex emergent dynamics, then cyclic and chaotic patterns may be endogenous features of real-world social and economic systems.
Download PDF version of this paper

See a movie of actual humans (shown as Xs) playing the Mod Game.  Notice the clumping of their moves and their regular progression around the circle of choices.

Learning along with others

Goldstone, R. L., Wisdom, T. N., Roberts, M. E., & Frey, S. (2013). Learning along with others. Psychology of Learning and Motivation, 58, 1-45.

Unlike how most psychology experiments on learning operate, people learning to do a task typically do so in the context of other people learning to do the same task. In these situations, people take advantage of others’ solutions, and may modify and extend these solutions, thereby affecting the solutions available to others. We are interested in the group patterns that emerge when people can see and imitate the solutions, innovations, and choices of their peers over several rounds. In one series of experiments and computer simulations, we find that there is a systematic relation between the difficulty of a problem search space and the optimal social network for transmitting solutions. As the difficulty of finding optimal solutions in a search space increases, communication networks that preserve spatial neighborhoods perform best. Restricting people’s access to others’ solutions can help the group as a whole find good, hard-to-discover solutions. In other experiments with more complex search spaces, we find evidence for several heuristics governing individuals’ decisions to imitate: imitating prevalent options, imitating options that become increasingly prevalent, imitating high-scoring options, imitating during the early stages of a multiround search process, and imitating solutions similar to one’s own solution. Individuals who imitate tend to perform well, and more surprisingly, individuals also perform well when they are in groups with other individuals who imitate frequently. Taken together, our experiments on collective social learning reveal laboratory equivalents of prevalent social phenomena such as bandwagons, strategy convergence, inefficiencies in the collective coverage of a problem space, social dilemmas in exploration/exploitation, and reciprocal imitation.

Download PDF version of this paper

Grouping by Similarity Helps Concept Learning

Weitnauer, E., Carvalho, P. F., Goldstone, R. L., & Ritter, H. (2013). Grouping by Similarity Helps Concept Learning.  Proceedings of the Thirty-Fifth Annual Conference of the Cognitive Science Society.  (pp. 3747-3752).  Berlin, Germany: Cognitive Science Society.

In inductive learning, the order in which concept instances are presented plays an important role in learning performance. Theories predict that interleaving instances of different concepts is especially beneficial if the concepts are highly similar to each other, whereas blocking instances belonging to the same concept provides an advantage for learning lowsimilarity concept structures. This leaves open the question of the relative influence of similarity on interleaved versus blocked presentation. To answer this question, we pit withinand between-category similarity effects against each other in a rich categorization task called Physical Bongard Problems. We manipulate the similarity of instances shown temporally close to each other with blocked and interleaved presentation. The results indicate a stronger effect of similarity on interleaving than on blocking. They further show a large benefit of comparing similar between-category instances on concept learning tasks where the feature dimensions are not known in advance but have to be constructed.

Download PDF of this paper

Innovation, imitation, and problem-solving in a networked group

Wisdom, T. N., & Goldstone, R. L. (2011).  Innovation, imitation, and problem-solving in a networked group.  Nonlinear Dynamics, Psychology, and Life Sciences, 15, 229-252.

We implemented a problem-solving task in which groups of participants simultaneously played a simple innovation game in a complex problem space, with score feedback provided after each of a number of rounds. Each participant in a group was allowed to view and imitate the guesses of others during the game. The results showed the use of social learning strategies previously studied in other species, and demonstrated benefits of social learning and nonlinear effects of group size on strategy and performance. Rather than simply encouraging conformity, groups provided information to each individual about the distribution of useful innovations in the problem space. Imitation facilitated innovation rather than displacing it, because the former allowed good solutions to be propagated and preserved for further cumulative innovations in the group. Participants generally improved their solutions through the use of fairly conservative strategies, such as changing only a small portion of one’s solution at a time, and tending to imitate solutions similar to one’s own. Changes in these strategies over time had the effect of making solutions increasingly entrenched, both at individual and group levels. These results showed evidence of nonlinear dynamics in the decentralization of innovation, the emergence of group phenomena from complex interactions of individual efforts, stigmergy in the use of social information, and dynamic tradeoffs between exploration and exploitation of solutions. These results also support the idea that innovation and creativity can be recognized at the group level even when group members are generally cautious and imitative.

Download this paper

Going with the group in a competitive game of iterated reasoning

Frey, S., & Goldstone, R. L. (2011).  Going with the group in a competitive game of iterated reasoning.  Proceedings of the Thirty-Third Annual Conference of the Cognitive Science Society.  (pp. 1912-1917).  Boston, Massachusetts: Cognitive Science Society.

In some strategic games, thinking ahead about other players’ reasoning can lead to better predictions about what they will do. In other games, infinitely iterated reasoning ultimately prescribes random play. In an online experiment of strategic thinking in groups, we tested participants in a game with the formal structure of a random game, but the superficial struc- ture of a game that rewards iterated reasoning. We found that participants conformed to the superficial structure of the game, and earned more than they would have by playing randomly. We estimated how many steps participants thought ahead in the game and discovered implicit coordination at the group level. Participants unexpectedly “matched” their degree of iterated thinking to each other.

Download PDF version of this paper

Adaptive group coordination and role differentiation

Roberts, M. E., & Goldstone, R. L. (2011).  Adaptive Group Coordination and Role Differentiation.  PLoS One, 6, 1-8.

Many real world situations (potluck dinners, academic departments, sports teams, corporate divisions, committees, seminar classes, etc.) involve actors adjusting their contributions in order to achieve a mutually satisfactory group goal, a win-win result. However, the majority of human group research has involved situations where groups perform poorly because task constraints promote either individual maximization behavior or diffusion of responsibility, and even successful tasks generally involve the propagation of one correct solution through a group. Here we introduce a group task that requires complementary actions among participants in order to reach a shared goal. Without communication, group members submit numbers in an attempt to collectively sum to a randomly selected target number. After receiving group feedback, members adjust their submitted numbers until the target number is reached. For all groups, performance improves with task experience, and group reactivity decreases over rounds. Our empirical results provide evidence for adaptive coordination in human groups, and as the coordination costs increase with group size, large groups adapt through spontaneous role differentiation and self-consistency among members. We suggest several agent-based models with different rules for agent reactions, and we show that the empirical results are best fit by a flexible, adaptive agent strategy in which agents decrease their reactions when the group feedback changes. The task offers a simple experimental platform for studying the general problem of group coordination while maximizing group returns, and we distinguish the task from several games in behavioral game theory.

Download PDF version of this paper

Transfer, And The Effects Of Context Outside Of The Training Task

Day, S. B., Manlove, S., & Goldstone, R. L. (2011).  Transfer, and the effects of context outside of the training task.  Proceedings of the Thirty-Third Annual Conference of the Cognitive Science Society.  (pp. 2637-2642).  Boston, Massachusetts: Cognitive Science Society.

While the use of concrete, contextualized and personally relevant examples can benefit learners in terms of comprehension and motivation, these types of examples can come with a cost. Examples may become too bound to their particular context, and individuals may have a difficult time recognizing when the underlying principles are relevant in new situations. In the current study, we provide evidence that contextualization may impair knowledge transfer even when that context occurs outside of the training example itself. Specifically, when students were taught about positive feedback systems in the context of polar ice-albedo effects, those individuals that had previously learned about the effects of global warming on polar bear populations showed reliably poorer transfer performance.

Download PDF version of this paper

Functional structure and coordination failure in real-time group behavior

Frey, S., & Goldstone, R. L. (2010). Functional Structure and Coordination Failure in Real-Time Group Behavior. Proceedings of the Thirty-Second Annual Conference of the Cognitive Science Society.  (pp. 2093-2098).  Portland, Oregon: Cognitive Science Society.

We reveal spontaneous group formation and differentiation in an online dynamic coordination experiment. We observe increased group stratification and attribute it to increases in pairwise cooperative behavior, rather than uncooperative behavior. Our network analyses document the fine scale structure of coordination failure in the face of many established determinants of coordination success. We explore previous work in coordination failure to frame our own findings. Factors that have been previously shown to improve coordination in discretetime, forced-decision experimental games do not prevent decisive coordination failure in our real-time, asynchronous group decision-making environment.

Download PDF version of this paper

The education of perception

Goldstone, R. L., Landy, D. H., & Son, J. Y. (2010).  The education of perception. Topics in Cognitive Science2, 265-284.

While the field of perceptual learning has mostly been concerned with low- to middle-level changes to perceptual systems due to experience, we consider high-level perceptual changes that accompany learning in science and mathematics. In science, we explore the transfer of a scientific principle (competitive specialization) across superficially dissimilar pedagogical simulations. We argue that transfer occurs when students develop perceptual interpretations of an initial simulation and simply continue to use the same interpretational bias when interacting with a second simulation. In arithmetic and algebraic reasoning, we find that proficiency in mathematics involves executing spatially explicit transformations to notational elements. People learn to attend mathematical operations in the order in which they should be executed, and the extent to which students employ their perceptual attention in this manner is positively correlated with their mathematical experience. For both science and mathematics, relatively sophisticated performance is achieved not by ignoring perceptual features in favor of deep conceptual features, but rather by adapting perceptual processing so as to conform with and support formally sanctioned responses. These “Rigged Up Perceptual Systems” (RUPS) offer a promising approach to educational reform.

Download PDF version of this paper

Priming a central executive search process: exploration and exploitation in generalized cognitive search processes

Hills, T. T., Todd, P. M., & Goldstone, R. L. (2010). Priming a Central Executive Search Process: Exploration and Exploitation in Generalized Cognitive Search Processes.  Journal of Experimental Psychology: General, 139, 560-609.

The trade-off between exploration and exploitation is common to a wide variety of problems involving search in space and mind. The prevalence of this trade-off and its neurological underpinnings led us to propose domain-general cognitive search processes (Hills, Todd, & Goldstone, 2008). We propose further that these are consistent with the idea of a central executive search process that combines goal-handling across subgoal hierarchies. In the present study, we investigate 3 aspects of this proposal. First, the existence of a unitary central executive search process should allow priming from 1 search task to another and at multiple hierarchical levels. We confirm this by showing cross-domain priming from a spatial search task to 2 different cognitive levels within a lexical search task. Second, given the neural basis of the proposed generalized cognitive search process and the evidence that the central executive is primarily engaged during complex tasks, we hypothesize that priming should require search in the sense of a self-regulated making and testing of sequential predictions about the world. This was confirmed by showing that when participants were allowed to collect spatial resources without searching for them, no priming occurred. Finally, we provide a mechanism for the underlying search process and investigate 3 alternative hypotheses for subgoal hierarchies using the central executive as a search process model (CESP). CESP envisions the central executive as having both emergent and unitary processes, with one of its roles being a generalized cognitive search process that navigates goal hierarchies by mediating persistence on and switching between subgoals.

Download PDF version of this paper

Recognizing group cognition

Theiner, G, Allen, C., & Goldstone, R. L. (2010). Recognizing group cognition. Cognitive Systems Research11, 378-395.

In this paper, we approach the idea of group cognition from the perspective of the ”extended mind” thesis, as a special case of the more general claim that systems larger than the individual human, but containing that human, are capable of cognition (Clark, 2008; Clark & Chalmers, 1998). Instead of deliberating about ”the mark of the cognitive” (Adams & Aizawa, 2008), our discussion of group cognition is tied to particular cognitive capacities. We review recent studies of group problem solving and group memory which reveal that specific cognitive capacities that are commonly ascribed to individuals are also aptly ascribed at the level of groups. These case studies show how dense interactions among people within a group lead to both similarity-inducing and differentiating dynamics that affect the group’s ability to solve problems. This supports our claim that groups have organization-dependent cognitive capacities that go beyond the simple aggregation of the cognitive capacities of individuals. Group cognition is thus an emergent phenomenon in the sense of Wimsatt (1986). We further argue that anybody who rejects our strategy for showing that cognitive properties can be instantiated at multiple levels in the organizational hierarchy on a priori grounds is a ”demergentist,” and thus incurs the burden of proof for explaining why cognitive properties are ”stuck” at a certain level of organizational structure. Finally, we show that our analysis of group cognition escapes the ”coupling-constitution” charge that has been leveled against the extended mind thesis (Adams & Aizawa, 2008).

Download PDF version of this paper

How you named your child: Understanding the relationship between individual decision-making and collective outcomes

Gureckis, T. M., & Goldstone, R. L. (2009). How you named your child: Understanding the relationship between individual decision-making and collective outcomes. Topics in Cognitive Science1, 651-674.

We examine the interdependence between individual and group behavior surrounding a somewhat arbitrary, real world decision: selecting a name for
one’s child. Using a historical database of the names given to children over the last century in the United States, we nd that naming choices are influenced by both the frequency of a name in the general population, and by its “momentum” in the recent past in the sense that names which are growing in popularity are preferentially chosen. This bias toward rising names is a recent phenomena: in the early part of the 20th century, increasing popularity of a name from one time period to the next was correlated with a decrease in future popularity. However, more recently this trend has reversed. We evaluate a number of formal models that detail how individual decision-making strategies, played out in a large population of interacting agents, can explain these empirical observations. We argue that cognitive capacities for change detection, the encoding of frequency in memory, and biases towards novel or incongruous stimuli may interact with the behavior of other decision makers to determine the distribution and dynamics of cultural tokens such as names.

Download PDF version of this paper

Collective behavior

Goldstone, R. L. & Gureckis, T. M. (2009).  Collective behavior. Topics in Cognitive Science1, 412-438.

The resurgence of interest in collective behavior is in large part due to tools recently made available for conducting laboratory experiments on groups, statistical methods for analyzing large data sets reflecting social interactions, the rapid growth of a diverse variety of online self-organized collectives, and computational modeling methods for understanding both universal and scenario-specific social patterns. We consider case studies of collective behavior along four attributes: the primary motivation of individuals within the group, kinds of interactions among individuals, typical dynamics that result from these interactions, and characteristic outcomes at the group level. With this framework, we compare the collective patterns of noninteracting decision makers, bee swarms, groups forming paths in physical and abstract spaces, sports teams, cooperation and competition for resource usage, and the spread and extension of innovations in an online community. Some critical issues surrounding collective behavior are then reviewed, including the questions of ‘‘Does group behavior always reduce to individual behavior?’’ ‘‘Is ‘group cognition’ possible?’’ and ‘‘What is the value of formal modeling for understanding group behavior?’’

Download PDF version of this paper

Adaptive group coordination

Roberts, M. E., & Goldstone, R. L. (2009).  Adaptive group coordination, Proceedings of the Thirty-First Annual Conference of the Cognitive Science Society. 2698-2704. Amsterdam, Netherlands: Cognitive Science Society.

Human groups exhibit poor performance in many social situations because task constraints promote either individual maximization behavior or diffusion of responsibility. We introduce a group task that tests human coordination when only a shared group goal exists. Without communication, group members submit numbers in an attempt to collectively sum to a randomly selected number. After receiving group feedback, members adjust their submitted numbers in the next round. Small groups generally outperform large groups, and for all groups, performance improves with task experience, and reactivity to feedback decreases over rounds. Our empirical results and computational modeling provide evidence for adaptive coordination in human groups despite minimal shared history and only indirect communication, and perhaps most interestingly, as the coordination costs increase with group size, large groups adapt through spontaneous role differentiation and self-consistency among members.

Download PDF version of this paper

Sub-optimalities in group foraging and resource competition

Roberts, M. E., & Goldstone, R. L. (2009).  Sub-optimalities in group foraging and resource competition. , Proceedings of the Thirty-First Annual Conference of the Cognitive Science Society 2371-2377. Amsterdam, Netherlands: Cognitive Science Society.

Previous group foraging research has shown that human groups sub-optimally distribute themselves to resources and display undermatching, with a smaller-than-expected proportion of individuals at the more abundant resource pool. In order to further explore these sub-optimalities, we extended a group foraging paradigm to test three variables: the effects of three resource pools, travel cost between pools, and the size of the pools. Although each condition led to undermatching, the conditions showed significant differences in the extent of undermatching, the frequency of switching between resource pools, the wealth inequality among foragers, and the comparative wealth inequality at different resource pools. The results for the three pool conditions suggest that human groups have difficulty in discriminating the relative value of resource pools. The results for the travel cost conditions indicate that human groups distribute themselves to resources more optimally when individuals can easily switch between pools, which is the opposite of the result found with foraging pigeons. Finally, the results for the pool size conditions indicate that larger pool sizes promote greater undermatching, apparently because individuals inefficiently compete over large areas rather than effectively parceling the pools into smaller, distinct regions.

Download PDF version of this paper

Fostering general transfer with specific simulations

Son, J. Y., & Goldstone, R. L. (2009).  Fostering General Transfer with Specific Simulations.Pragmatics and Cognition17, 1-42.

Science education faces the difficult task of helping students understand and appropriately generalize scientific principles across a variety of superficially dissimilar specific phenomena. Can cognitive technologies be adapted to benefit both learning specific domains and generalizable transfer? This issue is examined by teaching students complex adaptive systems with computer-based simulations. With a particular emphasis on fostering understanding that transfers to dissimilar phenomena, the studies reported here examine the influence of different descriptions and perceptual instantiations of the scientific principle of competitive specialization. Experiment 1 examines the role of intuitive descriptions to concrete ones, finding that intuitive descriptions leads to enhanced domain-specific learning but also deters transfer. Experiment 2 successfully alleviated these difficulties by combining intuitive descriptions with idealized graphical elements. Experiment 3 demonstrates that idealized graphics are more effective than concrete graphics even when unintuitive descriptions are applied to them. When graphics are concrete, learning and transfer largely depends on the particular description. However, when graphics are idealized, a wider variety of descriptions results in levels of learning and transfer similar to the best combination involving concrete graphics. Although computer-based simulations can be effective for learning that transfers, designing effective simulations requires an understanding of concreteness and idealization in both the graphical interface and its description.

Download PDF version of this paper

Promoting transfer through complex systems principles

Goldstone, R. L., & Wilensky, U. (2008).  Promoting Transfer through Complex Systems Principles. Journal of the Learning Sciences, 17, 465-516.

Understanding scientific phenomena in terms of complex systems principles is both scientifically and pedagogically important. Situations from different disciplines of science are often governed by the same principle, and so promoting knowledge transfer across disciplines makes valuable cross-fertilization and scientific unification possible. Although evidence for this kind of transfer has been historically controversial, experiments and observations of students suggest pedagogical methods to promote transfer of complex systems principles. One powerful strategy is for students to actively interpret the elements and interactions of perceptually grounded scenarios. Such interpretation can be facilitated through the presentation of cases alongside general principles, and by students exploring and constructing computational models of cases. The resulting knowledge can be both concretely grounded yet highly perspective-dependent and generalizeable. We discuss methods for coordinating computational and mental models of complex systems, the roles of idealization and concreteness in fostering understanding and generalization, and other complementary theoretical approaches to transfer.

Download PDF version of this paper

Emergent processes in group behavior

Goldstone, R. L., Roberts, M. E., & Gureckis, T. M. (2008).  Emergent Processes in Group Behavior. Current Directions in Psychological Science, 17, 10-15.

Just as networks of neurons create structured thoughts beyond the ken of any individual neuron, so people spontaneously organize themselves into groups to create emergent organizations that no individual may intend, comprehend, or even perceive. Recent technological advances have provided us with unprecedented opportunities for conducting controlled, laboratory experiments on human collective behavior. We describe two experimental paradigms where we attempt to build predictive bridges between the beliefs, goals, and cognitive capacities of individuals and group-level patterns, showing how the members of a group dynamically allocate themselves to resources, and how innovations are spread in a social network. Agent-based computational models have provided useful explanatory and predictive accounts. Together, the models and experiments point to tradeoffs between exploration and exploitation, compromises between individuals using their own innovations and innovations obtained from their peers, and the emergence of group-level organizations such as population waves, bandwagon effects, and spontaneous specialization.

Download PDF version of this paper

Propagation of innovations in networked groups

Mason, W. A., Jones, A., & Goldstone, R. L. (2008). Propagation of innovations in networked groups. Journal of Experimental Psychology: General, 137, 422-433.

A novel paradigm was developed to study the behavior of groups of networked people searching a problem space. We examined how different network structures affect the propagation of information in laboratory-created groups. Participants made numerical guesses and received scores that were also made available to their neighbors in the network. The networks were compared on speed of discovery and convergence on the optimal solution. One experiment showed that individuals within a group tend to converge on similar solutions even when there is an equally valid alternative solution. Two additional studies demonstrated that the optimal network structure depends on the problem space being explored, with networks that incorporate spatially-based cliques having an advantage for problems that benefit from broad exploration, and networks with greater long-range connectivity having an advantage for problems requiring less exploration.

Download PDF version of this paper

Thinking in groups

Gureckis, T. M., & Goldstone, R. L. (2006). Thinking in groups. Pragmatics and Cognition14, 293-311

Is cognition an exclusive property of the individual or can groups have a mind of their own? We explore this question from the perspective of complex adaptive systems. One of the principle insights from this line of work is that rules that govern behavior at one level of analysis (the individual) can cause qualitatively different behavior at higher levels (the group). We review a number of behavioral studies from our lab that demonstrate how groups of people interacting in real-time can self-organize into adaptive, problem-solving group structures. A number of principles are derived concerning the critical features of such “distributed” information processing systems. We suggest that while cognitive science has traditionally focused on the individual, cognitive processes may manifest at many levels including the emergent group-level behavior that results from the interaction of multiple agents and their environment.

Download PDF version of this paper

EPICURE: Spatial and Knowledge Limitations in Group Foraging

Roberts, M. E., & Goldstone, R. L. (2006). EPICURE: Spatial and Knowledge Limitations in Group Foraging. Adaptive Behavior14, 291-313.

We propose an agent-based model of group foraging, EPICURE, for patchily distributed resources. Each agent makes probabilistic movement decisions in a gridworld through a linear combination of current perceptual information and a reinforcement history. EPICURE captures the empirical results from several foraging conditions in Goldstone and Ashpole (2004) and Goldstone, Ashpole, and Roberts (2005), and it leads to a re-evaluation of findings from those papers. In particular, human foragers show contingent usage of information, initially using social information to discover resource pools before private sampling information has been established. We describe a series of simulations that test the sources of resource undermatching often found in group foraging experiments. After testing the effects of foragers’ starting locations, travel costs, the number of foragers, and the size of uniform food distributions, we discuss a novel hypothesis for undermatching. Spatial constraints lead to inadequate individual and group information sampling and cause group undermatching. The foraging group size, food rate, spatial distribution of food, and resulting forager reinforcement histories interact to produce undermatching, and occasionally overmatching, to resources.

Download PDF version of this paper
Use the simulation described in this paper

The complex systems see-change in education

Goldstone, R. L. (2006). The Complex systems see-change in education. The Journal of Learning Sciences, 15, 35-43.

The day when scientists have time to read broadly across chemistry, biology, physics and social sciences is long gone. Journals, conferences, and academic departmental structures are becoming increasingly specialized and myopic. As Peter Csermely (1999), one of the organizers of the International Forum of Young Scientists expresses it, “There is only a limited effort to achieve the appropriate balance between the discovery of new facts and finding their appropriate place and importance in the framework of science. Science is not self-integrating, and there are fewer and fewer people taking responsibility for ‘net-making” (p. 1621). One possible response to this fragmentation of science is to simply view it as inevitable. Horgan (1996) argues that the age of fundamental scientific theorizing and discoveries has passed, and that all that is left to be done is refining the details of theories already laid down by the likes of Einstein, Darwin, and Newton. Complex systems researchers, and learning scientists more generally, offer an alternative perspective, choosing to reverse the trend toward increasing specialization.

Download PDF version of this paper

Group path formation

Goldstone, R. L., Jones, A., & Roberts, M. E. (2006). Group path formation. IEEE Transactions on System, Man, and Cybernetics, Part A, 36, 611-620.

When people make choices within a group, they are frequently influenced by the choices made by others. We have experimentally explored the general phenomenon of group behavior where an early action facilitates subsequent actions. Our concrete instantiation of this problem is group path formation where people travel between destinations with the travel cost for moving onto a location inversely related to the frequency with which others have visited the location. We compare the resulting paths to optimal solutions [Minimal Steiner Trees (MSTs)] and the “Active Walker” model of pedestrian motion from biophysics. There were systematic deviations from beeline pathways in the direction of MST. These deviations showed asymmetries (people took different paths from A to B than they did from B to A) and varied as a function of the topology of the destinations, the duration of travel, and the absolute scale of the world. The Active Walker model accounted for many of these results, in addition to correctly predicting the approximate spatial distribution of steps.

Download PDF version of this paper

Self-organized trail systems in groups of humans

Goldstone, R. L., & Roberts, M. E. (2006). Self-organized trail systems in groups of humans. Complexity11, 43-50.

We have developed an experimental platform for studying the trail systems that spontaneously emerge when people are motivated to take advantage of the trails left by others. In this virtual environment, the participants’ task is to reach randomly selected destinations whileminimizing travel costs. The travel cost of every patch in the environment is inversely related to the number of times the patch was visited by others. The resulting trail systems are a compromise between people going to their destinations and going where many people have previously traveled. We compare the results from our group experiments to the Active Walker model of pedestrian motion from biophysics. The ActiveWalker model accounted for deviations of trails from the beeline paths, the gradual merging of trails over time, and the influences of scale and configuration of destinations on trail systems, as well as correctly predicting the approximate spatial distribution of people’s steps. Two deviations of the model from empirically obtained results were corrected by (1) incorporating a distance metric sensitive to canonical horizontal and vertical axes, and (2) increasing the influence of a trail’s travel cost on an agent’s route as the agent approaches its destination.

Download PDF version of this paper

Computational models of collective behavior

Goldstone, R. L., & Janssen, M. A. (2005). Computational models of collective behavior. Trends in Cognitive Science, 9, 424-430.

Computational models of human collective behavior offer promise in providing quantitative and empirically verifiable accounts of how individual decisions lead to the emergence of group-level organizations. Agent-based models (ABMs) describe interactions among individual agents and their environment, and provide a process-oriented alternative to descriptive mathematical models. Recent ABMs provide compelling accounts of group pattern formation, contagion, and cooperation, and can be used to predict, manipulate, and improve upon collective behavior. ABMs overcome an assumption underlying much of cognitive science – that the individual is the critical unit of cognition. The advocated alternative is that individuals participate in collective organizations that they may not understand or even perceive, and that these organizations affect and are affected by individual behavior.

Download PDF version of this paper

Connecting concepts to the world and each other

Goldstone, R. L., Feng, Y., & Rogosky, B. (2005).  Connecting concepts to the world and each other. In D. Pecher & R. Zwaan (Eds.)  Grounding cognition: The role of perception and action in memory, language, and thinking.  Cambridge: Cambridge University Press. (pp. 292-314)

How can well tell that two people both have a concept of doggold, or car despite differences in their conceptual knowledge?  Two kinds of information can be used to translate between the concepts in two persons’ minds: the internal relations between concepts within each person’s mind, and external grounding of the concepts.  We present a neural network model called ABSURDIST (Aligning Between Systems Using Relations Derived Inside Systems Themselves) that integrates internal and external determinants of conceptual meaning to find translations across people or other systems.  The model shows that appropriate translations can be found by considering only similarity relations among concepts within a person.  However, simulations also indicate synergistic interactions between internal and external sources of information. ABSURDIST is then applied to analogical reasoning, dictionary translation, translating between web-based ontologies, subgraph matching, and object recognition.  The performance of ABSURDIST suggests the utility of concepts that are simultaneously externally grounded and enmeshed within a conceptual system.

Download PDF version of this paper

The simultaneous evolution of article and author networks in PNAS

Börner, K, Maru, J. T., & Goldstone, R. L. (2004).  The simultaneous evolution of article and author networks in PNAS.  The Proceedings of the National Academy of Science, 101, 5266-527.

There has been a long history of research into the structure and evolution of mankind’s scientific endeavor. However, recent progress in applying the tools of science to understand science itself has been unprecedented because only recently has there been access to high-volume and high-quality data sets of scientific output (e.g., publications, patents, grants), as well as computers and algorithms capable of handling this enormous stream of data. This paper reviews major work on models that aim to capture and recreate the structure and dynamics of scientific evolution. We then introduce a general process model that simultaneously grows co-author and paper-citation networks. The statistical and dynamic properties of the networks generated by this model are validated against a 20-year data set of articles published in the Proceedings of the National Academy of Science. Systematic deviations from a power law distribution of citations to papers are well fit by a model that incorporates a partitioning of authors and papers into topics, a bias for authors to cite recent papers, and a tendency for authors to cite papers cited by papers that they have read. In this TARL model (for Topics, Aging, and Recursive Linking), the number of topics is linearly related to the clustering coefficient of the simulated paper citation network.

Download PDF version of this paper

Learning to perceive while perceiving to learn

Goldstone, R. L. (2003).  Learning to perceive while perceiving to learn.  in R. Kimchi, M. Behrmann, and C. Olson (Eds.) Perceptual Organization in Vision: Behavioral and Neural Perspectives.  Mahwah, New Jersey.  Lawrence Erlbaum Associates. (pp. 233-278)

The external world must be filtered through our perceptual systems before it can have an impact upon us.  That is, the world we experience is formed by our perceptual processing.  However, it is not viciously circular to argue that our perceptual systems are reciprocally formed by our experiences.  In fact, it is because our experiences are necessarily based on our perceptual systems that these perceptual systems must be shaped so that our experiences are appropriate and useful for dealing with our world.

In what follows, I will argue that the “building blocks” an observer uses for construing their world depends on the observer’s history, training, and acculturation. These factors, together with psychophysical constraints, mold one’s set of building blocks.  Researchers who have proposed fixed sets of hard-wired primitives are exactly right in one sense — the combinatorics of objects, words, scenes, and scenarios strongly favor componential representations.  However, this does not necessitate that the components be hard-wired.  By developing new components to subserve particular tasks and environments, a newly important discrimination can generate building blocks that are tailored for the discrimination.  Adaptive building blocks are likely to be efficient because they can be optimized for idiosyncratic needs and environments.

Download PDF version of this paper

The transfer of abstract principles governing complex adaptive systems

Goldstone, R. L., & Sakamoto, Y. (2003). The Transfer of Abstract Principles Governing Complex Adaptive Systems.  Cognitive Psychology, 46, 414-466.

Four experiments explored participants’ understanding of the abstract principles governing computer simulations of complex adaptive systems.  Experiment 1 revealed better transfer between computer simulations when they were governed by the same abstract principle, even when the simulations’ domains were dissimilar.  Experiments 2 and 3 showed better transfer of abstract principles across simulations that were relatively dissimilar, and that this effect was due to participants who performed relatively poorly on the initial simulation.   In Experiment 4, participants showed better abstract understanding of a simulation when it was depicted with concrete rather than idealized graphical elements.  However, for poor performers, the idealized version of the simulation transferred better to a new simulation governed by the same abstraction.  The results are interpreted in terms of competition between abstract and concrete construals of the simulations.  Individuals prone toward concrete construals tend to overlook abstractions when concrete properties or superficial similarities are salient. 

Download PDF version of this paper

Using relations within conceptual systems to translate across conceptual systems

Goldstone, R. L., & Rogosky, B. J. (2002). Using relations within conceptual systems to translate across conceptual systems, Cognition, 84, 295-320.

We explore one aspect of meaning, the identification of matching concepts across systems (e.g. people, theories, or cultures).  We present a computational algorithm called ABSURDIST (Aligning Between Systems Using Relations Derived Inside Systems for Translation) that uses only within-system similarity relations to find between-system translations.  While illustrating the sufficiency of within-system relations to account for translating between systems, simulations of ABSURDIST also indicate synergistic interactions between intrinsic, within-system information and extrinsic information.

Download PDF version of this paper  

Here is a brief description and commentary on ABSURDIST:
Dietrich, E. (2003).  An ABSURDIST model vindicates a venerable theory.  Trends in Cognitive Science7, 57-59.

Download PDF version of this paper  

The role of roles in translating across conceptual systems

Goldstone, R. L., & Rogosky, B. J. (2002). The role of roles in translating across conceptual systems, Proceedings of the Twenty-fourth Annual Conference of the Cognitive Science Society.  Hillsdale, New Jersey: Lawrence Erlbaum Associates.  (pp. 369-374).

According to an “external grounding” theory of meaning, a concept’s meaning depends on its connection to the external world.  By a “conceptual web” account, a concept’s meaning depends on its relations to other concepts within the same system.  We explore one aspect of meaning, the identification of matching concepts across systems (e.g. people, theories, or cultures).  We present a computational algorithm called ABSURDIST (Aligning Between Systems Using Relations Derived Inside Systems for Translation) that uses only within-system similarity relations to find between-system translations.  While illustrating the sufficiency of a conceptual web account for translating between systems, simulations of ABSURDIST also indicate powerful synergistic interactions between intrinsic, within-system information and extrinsic information.  Applications of the algorithm to issues in object recognition, shape analysis, automatic translation, human analogy and comparison making, pattern matching, neural network interpretation, and statistical analysis are described.

Download PDF version of this paper  

Hanging Together: A Connectionist Model of Similarity

Goldstone, R. L. (1998). Hanging Together: A connectionist model of similarity. In J. Grainger & A. M. Jacobs (Eds.)  Localist Connectionist Approaches to Human Cognition.  (pp. 283 – 325).  Mahwah, NJ: Lawrence Erlbaum Associates.

Human judgments of similarity have traditionally been modelled by measuring the distance between the compared items in a psychological space, or the overlap between the items` featural representations. An alternative approach, inspired jointly by work in analogical reasoning (D. Gentner, 1983; K. T. Holyoak & P. Thagard, 1989) and interactive activation models of perception (J. L. McClelland & D. E. Rumelhart, 1981), views the process of judging similarity as one of establishing alignments between the parts of compared entities. A localist connectionist model of similarity, SIAM, is described wherein units represent correspondences between scene parts, and these units mutually and concurrently influence each other according to their compatability. The model is primarily applied to similarity rating tasks, but is also applied to other indirect measures of similarity, to judgments of alignment between scene parts, to impressions of comparison difficulty, and to patterns of perceptual sensitivity for matching and mismatching features.

View This Paper (HTML) [without figures, but with equations]

Download PDF version of this paper

Isolated and Interrelated Concepts.

Goldstone, R. L. (1996). Isolated and Interrelated Concepts. Memory & Cognition24, 608-628

A continuum between purely isolated and purely interrelated concepts is described. A concept is interrelated to the extent that it is influenced by other concepts. Methods for manipulating and identiying a concept`s degree of interrelatedness are introduced. Relatively isolated concepts are empirically identified by a relatively large use of nondiagnostic features, and by better categorization performance for a concept`s prototype than for a caricature of the concept. Relatively interrelated concepts are identified by minimal use of nondiagnostic features, and by better categorization performance for a caricature than a prototype. A concept is likely to be relatively isolated when: subjects are instructed to create images for their concepts rather than find discriminating features, concepts are given unrelated labels, and the categories that are displayed alternate rarely between trials. The entire set of manipulations and measurements supports a graded distinction between isolated and interrelated concepts. The distinction is applied to current models of category learning, and a connectionist framework for interpreting the empirical results is presented.

Download Isolated and Interrelated Concepts (Postscript file)

View This Paper (HTML) [with figures at end]

Download PDF version of this paper

Similarity, interactive activation, and mapping

Goldstone, R. L. (1994). Similarity, Interactive Activation, and Mapping. Journal of Experimental Psychology: Learning, Memory, and Cognition20, 3- 28.

The question of “what makes things seem similar?” is important both for the pivotal role of similarity in theories of cognition and for an intrinsic interest in how people make comparisons. Similarity frequently involves more than listing the features of the things to be compared and comparing the lists for overlap. Often, the parts of one thing must be aligned or placed in correspondence with the parts of the other. The quantitative model with the best overall fit to human data assumes an interactive activation process whereby correspondences between the parts of compared things mutually and concurrently influence each other. An essential aspect of this model is that matching and mismatching features influence similarity more if they belong to parts that are placed in correspondence. In turn, parts are placed in correspondence if they have many features in common and if they are consistent with other developing correspondences.

View This Paper (HTML)

Download PDF version of this paper