Rutgers Center for Cognitive Science
Videos footage from RuCCS Colloquium Talks can be found on the RuCCS YouTube Channel.
Abstract: The Entangled Brain framework promotes the idea that we need to understand the brain as a complex, entangled system. Why does a complex systems perspective, one that entails emergent properties, matter for brain science? In fact, many neuroscientists consider these ideas a distraction. We discuss principles of brain organization that inform the question of the interactional complexity of the brain: (1) massive combinatorial anatomical connectivity; (2) highly distributed functional coordination; (3) non-linear, reentrant processing; and (4) networks/circuits as functional units. To motivate the challenges of mapping structure and function, we discuss neural circuits illustrating the high anatomical and functional interactional complexity typical in the brain. We discuss implications for brain science, including the need to characterize decentralized and heterarchical anatomical–functional organization. The view advocated has implications for causation, too, because traditional accounts of causality provide poor candidates for explanation in interactionally complex systems like the brain given the distributed, mutual, and reciprocal nature of the interactions. Ultimately, to make progress understanding how the brain supports complex mental functions, we need to dissolve boundaries within the brain—those suggested to be associated with perception, cognition, action, emotion, motivation—as well as outside the brain, as we bring down barriers between biology, psychology, mathematics, computer science, philosophy, and so on.
Bio: Dr. Luiz Pessoa
Dr. Pessoa received a bachelor’s degree in Computer Science and a masters in Computer Engineering from the Federal University of Rio de Janeiro, Brazil. He obtained a PhD in computational neuroscience at Boston University, USA. He then returned to Brazil for a few years where he was a professor of Computer and Systems Engineering at the Federal University of Rio de Janeiro. Subsequently, he took a U-turn and received further postdoctoral training at the National Institute of Mental Health, USA. Prior to his current position, he held faculty positions at Brown University and Indiana University, Bloomington. Since 2011, he has been at the Department of Psychology, University of Maryland, College Park, where he is full Professor and Director of the Maryland Neuroimaging Center. His research interests center around the interactions between emotion/motivation and perception/cognition. His most recent book is “The entangled brain: How perception, cognition, and emotion are woven together” by MIT Press (2022) and is aimed at a general audience interested in science.
Synopsis: Counting is one of the simplest forms of visual reasoning: to count, a system must identify individual objects, keep them distinct, and aggregate them into a representation of number. Yet even state-of-the-art vision-language models often fail at this seemingly elementary task.
Visual counting provides a window into the internal computations underlying multimodal intelligence. Large vision-language models exhibit a striking behavioral pattern reminiscent of human numerical cognition: highly accurate judgments for small numerosities give way to increasingly noisy estimates as the number of objects grows. Using mechanistic interpretability tools, specialized attention mechanisms that support object localization, individuation, and numerical aggregation can be identified. Together, these mechanisms form a structured “counting circuit” that is shared with broader visual reasoning tasks.
What accounts for these limitations in counting? Visual patchification can fragment objects and impair object individuation, while attention-based aggregation progressively compresses distinctions between neighboring numerosities. Lightweight architectural interventions can substantially improve counting and, surprisingly, transfer to broader spatial reasoning.Together, these findings raise broader questions about how artificial visual systems construct objects, represent quantity, and perform compositional reasoning
Together, these findings raise broader questions about how artificial visual systems construct objects, represent quantity, and perform compositional reasoning
Abstract: The Study of Language and Math (SLaM) project examines how language modality (signed vs. spoken) and the timing of language access (from birth vs. later) shape cognitive development. While home language environment influences development in all children, deaf and hard-of-hearing children show especially wide variation in language experience. Across a range of tasks, including language-dependent measures (e.g., vocabulary) and measures considered less dependent on language (e.g., object tracking, standardized nonverbal tests), the timing of language access was a better predictor of variability than modality was. These findings highlight the need to disentangle and de-confound deafness from language access in research design. They also refine theoretical accounts of how language supports development across domains, and underscore a practical and ethical imperative: early, accessible language is critical for optimal cognitive development.
Bio: Dr. Marie Coppola
Dr. Marie Coppola is a Professor of Psychological Sciences (Developmental Program) and Linguistics at the University of Connecticut, where her research examines how language experience shapes cognitive development in deaf and hard-of-hearing children and other populations with atypical language access. Her research program, which also investigates an emerging sign language and homesign languages in Nicaragua, has been funded by NSF and NIH. From 2023 to 2025 she served as an American Association for the Advancement of Science (AAAS) Science and Technology Policy Fellow at the National Science Foundation, where her portfolio included accessibility for scientists with disabilities and public access and open science. She is the founder and executive director of Signs and Smiles, a nonprofit organization that advocates for early access to language and education for deaf and hard-of-hearing children globally. Signs and Smiles has developed smartphone applications in Nicaraguan Sign Language and Mexican Sign Language to facilitate communication between hearing parents and their deaf children.
Abstract 1 (Dr. Jardine): The ability to learn language is a fundamental part of being human, but researchers do not yet understand the mechanisms that underlie this ability. However, linguistic generalizations are not arbitrary, and are in fact guided by computational and structural restrictions related to memory and perception. Importantly, such restrictions can be expressed with computationally simple forms of automata. In this talk, I discuss how these computational restrictions can be leveraged to provide a modular, interpretable, and small-data approach to tackle the problem of language acquisition. As a case study, I discuss a solution to the problem of simultaneously learning the mental representations of words and their morphological and phonological patterning. In this way, we can better understand, qualitatively and computationally, the mechanisms which underlie the human capacities for both constructing mental representations of words and learning the morpho-phonological patterns governing them.
Abstract 2 (Dr. Semenova): Machine learning is increasingly deployed in high-stakes domains like healthcare, lending, and criminal justice. In these fields, it is crucial that human decision-makers can actually understand how an algorithm arrives at its conclusions. However, there is a widespread assumption that we must face a trade-off: to get the highest accuracy, we must rely on complex, uninterpretable "black-box" models. Because finding optimal, perfectly tailored simple models is computationally difficult, researchers often don't even undertake the effort to look for them. This talk asks a practical question: do we really have to sacrifice interpretability for accuracy? I will explore the conditions under which simple, interpretable models—like basic rule lists or decision trees—perform just as well as complex black boxes. By looking at the mechanics of how data is generated and the choices analysts make during the learning process, I will show that highly accurate, easy-to-understand models exist in practice far more often than we might expect.
Abstract: Children have powerful cognitive capacities that enable efficient social learning, but also acquire many beliefs that are false or over-generalized. The present talk proposes that this is partly because, although even young children distinguish between knowledgeable and ignorant sources, they do not always successfully integrate and preserve this epistemic information in memory in ways that appropriately constrain subsequent belief and generalization.
Synopsis: Public discussions of artificial intelligence often swing between enthusiasm and alarm: AI is described as a transformative technology that may expand human capabilities, or as a threat to work, creativity, education, truth, and even humanity itself. But evaluating many of these claims requires us to think carefully about concepts that cognitive scientists have studied for decades: intelligence, learning, reasoning, representation, understanding, memory, and agency.
Abstract 1 (Dr. Feldman): Compositionality---the way people combine concepts to form more complex concepts---has often been identified as a point of difficulty for AI. In this talk I'll present results comparing human and machine performance in on a common platform, the "Game of Hidden Rules" (GOHR). The GOHR is a simple rule-discovery game in which a player (human or AI) tries to classify objects into categories based on an unknown rule that they must infer by trial and error. In a series of experiments, we compared human and AI (RL) performance on "compositional" rule sequences, in which later rules were constructed from combinations of earlier ones. For example, if the learner first solves a rule involving a color match, and then one involving shape, does that make it easier to solve a later rule involving both color and shape? That is, does simpler learning "transfer" to composite learning? The results show that human and AI simple-to-complex transfer are almost completely uncorrelated, suggesting that contemporary AI does not yet effectively reflect the way that humans learn from prior experience.
Abstract 2 (Dr. Schellenberg) : Our capacity for self-reference allows us to introspect on our thoughts and preferences, engage in metacognition, and evaluate our progress on projects while reconfiguring our approach as needed. Despite being central to human intelligence, it has received marginal attention in developing artificial intelligence. There are burgeoning signs of an artificial equivalent of our capacity for self-reference. To illustrate, so-called self-attention mechanisms in Large Language Models, meta-reinforcement learning modules, and second-guessing can each be argued to be examples of artificial self-reference. However, in each case, the capacity is rigid in scope compared to our human capacity, and it developed as a side effect of pursuing other goals. To date, no explicit attention has been directed at artificially replicating this central element of human intelligence. The paper argues that a general capacity for self-reference is key to bringing AI to the next level
.
What Works and What Doesn’t: Things to Know to Land an Internship
Speaker: Elizabeth Langemak, Associate Director of Campus Programs, Verizon
In this talk, we will discuss how insights into the computational underpinnings of psychotic symptoms can serve as a bridge across levels of description and across time as psychosis develops.
Abstract: Brood parasitic birds represent several evolutionary and ontogenetic dilemmas for researchers: how do parasites recognize their own species when raised by a different one and why do hosts accept parasitic eggs and chicks instead of rejecting them.
Abstract: The best future for science on children's learning will be one that embraces both descriptive research and great experiments. We can all look forward to the new hypotheses that emerge from this union, which will position us to create new models of learning, growth, and change.
Abstract: Humans regularly reason about the belief states of others. Where does this capacity originate? Competing hypotheses include biologically evolved endowments, social interaction, and exposure to language. Recent
Please arrive on time as parking is very limited and students arrive promptly at 1:00 PM.