New paper: Assembling multimodal performances
[2/3/23] Led by Dr. Camila Alviar
, former member of the lab and now postdoc at Vanderbilt, we extensively review many traditions in the study of interpersonal processes, and summarize a new computational framework that integrates some of these traditions. See the article here
, in Language Sciences
New paper: Methodological variety
[11/29/22] We published a wide ranging review in Nature Reviews Psychology
with COMM colleagues Prof. Anne Warlaumont
and Prof. Kerri Johnson
. The review describes a principle of "methodological variety" that we argue should be baked into the study of very complex processes, such as communication itself. See it here!
New preprint: Theoretical model of interpersonal dynamics
[7/12/22] Led by Ph.D. student Grace Miao
, in collaboration with Prof. Alexia Galati, we build a simple, tractable dynamic model that permits explorations of various interpersonal parameters (such as influence) and importantly assumes that the interactive task
is central to studying coordination. Read it here
. Presented by Grace at the Society for Text & Discourse
New paper: Reconceptualizing, measuring "interdisciplinarity"
[3/28/22] Cognitive science, and perhaps to a degree communication and other social sciences, are often defined in part by the extent to which they engage multiple more traditional disciplines. In a project led by co-advisee Pablo Contreras Kallens
, we argue for a revised conception of this "interdisciplinarity," and measure it using a large-scale dataset: "We describe an information-theoretic measure of interdisciplinarity and apply it to multiauthored published articles. Results suggest that cognitive science journals mix expertise more than topically related journals. We suggest that perceptions of diminishing interdisciplinarity may in part be due to the emergence of different theoretical perspectives and use a semantic model to illustrate this argument. We conclude by describing some benefits of this broader conception." Click here for the article at Topics in Cognitive Science
New paper: Cooperation in sound and motion
[9/1/21] Collaborators Profs. Drew Abney
and Alexandra Paxton
lead a project that quantifies how people coordinate by analyzing subtle properties of their dynamics. In particular, the results suggest that interpersonal interactions are supported by a matching of "complexity": "We measured coordination in a joint tower building task through the layers of sound and movement patterns produced by partners and found that partners built higher towers when their sound patterns fell into more similar relations with each other across timescales, as measured by complexity matching. Our findings shed light on the function of complexity matching and lead to new hypotheses about multiscale coordination and communication. We discuss how complexity matching encompasses flexible and complementary dynamics between partners that support complex acts of human coordination." Click here
for the entry in Journal of Experimental Psychology: General
New paper: Expanded dynamic analysis for R
[6/14/21] In a multi-lab collaboration led by Dr. Moreno Coco
, we updated and deployed a new version of the crqa
library for R. The cross-recurrence quantification (CRQA) R package has been downloaded tens of thousands of times and has been used in many publications
. In this new version, we added a number of new features such as multidimensional recurrence (by Wallot, Mønster et al.) and new measures (by Leonardi et al.). The paper was just accepted at the R Journal
. Click here to see an early preprint release
New paper: Multimodal measurement
[4/16/21] In work led by Profs. Kentaro Kodama and Daichi Shimizu
, we devised a new way of aligning continuous data (such as body movement) and categorical data (such as verbal data, like language). We illustrate how this can work by analyzing lyrical performance by a professional rapper, showing that it is possible to analyze quite distinct types of behavioral data in a single integrated analysis. See the paper here
, published in Frontiers in Quantitative Psychology and Measurement
New paper: Expressivity structures behavioral dynamics
[10/15/20] New journal article now published in an issue of Discourse Processes
: In a project led by Ph.D. student Camila Alviar
, we explored the dynamic structure of speech and music, and the underlying expressivity of these complex performances, such their spontaneity (e.g., improvisational jazz). Using YouTube video sources of various kinds of speech and music, Camila quantified the dynamic structure of sound and movement of performers, and found they may be better captured by the observing the expressivity (the semantic goals) of their performance, over and above the physical or compositional constraints of the music itself. Click here to see this paper
New preprint: Linking cognitive science and mass media
[8/5/20] A new preprint has been posted to the Open Science Foundation detailing our CogMedia project. This paper gives some theoretical backdrop for the project, along with detailed examples of possible applications of this data set, which includes hundreds of thousands of news headlines along with applied NLP tools for connecting cognitive measures to news media production and consumption. Click here to see this preprint
New poster: Cognitive efficiency and information spread in mass media
[7/20/20] Undergraduate researcher Jason Luna has prepared our CogMedia research presentation for the Annual Meeting of the Cognitive Science Society, held virtually this year (official presentation date: 7/31). You can see a summary of this preliminary project in which we predict how fast news headlines spread online by using mental processing indices (specifically, how easy it is for the mind to process a news headline). Click here to see the presentation
New tool: Interactive website for COVID news
[3/18/20] The Co-Mind Lab has adapted its CogMedia
project to serve as a central informational resource on media coverage of COVID-19 matters. Check out a summary on the UCLA Social Science blog: UCLA Researchers Use Big Data Expertise to Create a News Media Resource on the COVID-19 Crisis
. Our "big-data" resource contains hundreds of thousands of articles, and updates throughout the day. This new resource filters crisis-relevant information and presents it in an organized manner so that students and the broader public can gain a bird's-eye view of ongoing coverage. Click here to see this page
Keynote: Returning home to UTSC and Toronto!
[2/28/20] Rick gave a keynote presentation at the Scarborough Undergraduate Linguistics Conference (SULC)
, and also served as a judge for the conference's best student presentations. Scarborough Campus of the University of Toronto is where Rick attended as an undergraduate. It was fun to spend time with students and present on both research and career matters, especially on the topic of the cognitive science of language.
Keynote: Language is integrated with socio-cognitive constraints
[11/14/19] Rick gave a plenary presentation in the President's Symposium of the annual meeting of the Society for Computation in Psychology
. He summarized our various strands of research over the years, illustrating that the core of human language involves constraints from the cognitive and social domains, quite unlike what might be expected from a theory that sees language as an abstract and encapsulated module of our mind.
Commentary: Experimental exploration of action-cognition integration
[10/30/19] Rick contributed to the #time4action Digital Features Section of the Psychonomic Society: Action in focus for an integrative approach to the mind
. There I argued that psychological researchers "remind us of the importance of carefully parameterized experiments for isolating what underlies integrative properties of several behaviors and processes: gesture, motor cognition, memory and language. Importantly, in these designs, actions either perceived or produced, are the windows onto this integrative system."
New preprint: Codifying methods reporting for cognitive dynamics
[10/1/19] We participated in a meta-analysis led by Martin Schoemann and Stefan Scherbaum at Technische Universitaet Dresden, entitled "Using mouse cursor tracking to investigate online cognition: Preserving methodological ingenuity while moving towards reproducible science." You can read it here
. Our lab has often used dynamic
measures of language and communication by tracking how people make decisions using the computer mouse. When participants use a computer to communicate, for example, they often move their computer mouse around when interpreting or making decisions about language or other domains. Despite seeming so simple and common, this mouse movement is actually a detailed signal of mental processing, and it can shed light on how these communications are unfolding (either how they are being interpreted, or generated, by a human mind). In this meta-analysis, we discuss what are useful standards for reporting these experiments so this measurement approach can yield the most scientific value. For some background, we have a fun review of the literature from a few years ago, which you can read here
(led by Jon Freeman).
Keynote: Three kinds of coordination in interpersonal communication
[8/1/19] I'll be presenting at the Society for Chaos Theory in Psychology & Life Sciences
29th Annual International Conference
at Chapman University. The title of my talk is "The Integrated Dynamics of Natural Language Performance," and I'll be summarizing work from our lab and other labs on how we can expand our understanding of the underlying dynamics of human interaction.
3 kinds of "coordination"
In the presentation, I highlighted three ways in which "coordination" can be construed based on an integration of our work. The first, and perhaps the most studied, is the sometimes weak but relatively widespread "hum" of local coordination -- sometimes known as "synchrony." We recently demonstrated
another form of coordination, in which interlocutors exhibit a more "global" temporal coordination, called complexity matching
. In complexity matching, interlocutors tend to exhibit similar fluctuations -- which may be loosely called "cadence" or "rhythm." Complexity matching need not involve immediate synchrony, but can span across several minutes. Another kind of coordination we have studied is the manner or distribution of events in interaction. We recently showed
that many interactive behaviors are more "bursty" than rhythmic, suggesting that different nonlinear models, beyond coupled oscillators, may be needed to understand these behaviors.
Commentary: Big theory!
[7/20/19] I contributed
to a recent Digital Features section
of the Psychonomic Society, on the topic of big data
. I summarize some work from others that highlights the need for more theory to help shape our approach to big data and research practices: big theory? After more thought, and reconsidering the cool "big experiments"
idea of Gureckis and Griffiths, this figure appeared in a dream. I wish I'd discussed something like this to my own commentary.
In some ways, cognitive science has been steeped in grand theory, the conflict among many paradigms (see an oldie but goodie here?
). My commentary focuses on ideas from Oberauer and Lewandowsky
, sharpening the concept of theory and how studies and data should be tightly tethered to it.
Classroom tool: Chatbot lab
To illustrate principles of computer modeling and communication, we created a chatbot authoring tool
for use in undergraduate class COMM 131: Computer Models of Communicators
. Students are able to build fully functioning and deployable chatbots (deployable on Discord
!). The system helps students understand expert rule systems, their design, and how to test them with users. The class also includes discussion of neural network approaches to language, and we also explored a simplified neural network conversational bot which you can read about here
Target article: Discovering equations of socio-cognitive systems
In a new SCTPLS newsletter article, I summarize
the recent paper with my collaborator Harish Bhat
on using data science techniques to recover, from raw data, precise governing equations
for dynamical systems (in the form of ordinary differential equations). We illustrate it on model systems here
, including socio-cognitive systems -- where the governing equations may reveal couplings between agents. Code on GitHub
and library now available on CRAN
New paper: Quantifying complex communication dynamics
In a project led by Ph.D. student Camila Alviar
, we use freely available video of presentations as samples of temporally extended communication. Using automated analysis methods, we explore this performance as a kind of "socio-technical" system, analyzing voice, body movements, and slide changes as an integrated system. Now published at Cognitive Science
. Code here