
Check out our GitHub repo if you want to integrate this framework into your research! We're really excited to see the scientific and clinical applications of cross-participant mapping github.com/HuthLab/rapid-cor… 7/7

postdoctoral fellow at UT Austin interested in language disorders and brain-computer interfaces

Check out our GitHub repo if you want to integrate this framework into your research! We're really excited to see the scientific and clinical applications of cross-participant mapping github.com/HuthLab/rapid-cor… 7/7

This approach can also generalize across modalities: here we trained models on brain responses to stories and transferred them by aligning brain responses to silent movies. This could be effective for mapping concepts in children and patients with language impairments 6/7

We found that cross-participant models trained on 24 *minutes* of calibration data produce similar maps as within-participant models trained on 5 *hours* of data! 5/7

First we train a model on brain responses from existing reference participants. Then we show a much smaller set of calibration stimuli to each new goal participant. By aligning brain responses to the calibration stimuli, we can transfer the model to the goal participant 4/7

To address this bottleneck, we developed a framework for using functional alignment to transfer encoding models across participants 3/7

Encoding models and cortical maps could be very helpful for clinical applications such as localizing implant and stimulation sites. But these models require many hours of brain responses from each participant, which can be infeasible for clinical populations 2/7

Our new study on cross-participant cortical mapping (with @alex_ander) is out in @ImagingNeurosci! direct.mit.edu/imag/article/… 1/7

This was an incredibly rewarding project to work on. Thanks to the amazing team that made this possible! Carly Millanski, Allison Chen, Lisa Wauters, Jordyn Anders, @ShilpaShamapant , @smwilsonau, @alex_ander, Maya Henry 8/8

We also found good decoding performance from individual brain regions. This suggests that we could move our decoder from fMRI into more portable systems. The best regions differed across participants so we think fMRI will remain very important for localizing recording sites 7/8

Moving forward we hope to develop practical systems that can support communication. We found that decoding performance reliably improved with the amount of training data. So we’re optimistic that there's plenty of room for improvement 6/8

Next we explored why this works. We found that conceptual processing was largely spared outside of damaged brain regions. This suggests that our approach could generalize across patients with a wide range of lesion profiles and speech / language impairments 5/8

We found that the decoder predictions could describe what the participants with aphasia were hearing about / seeing / imagining! This shows how brain-computer interfaces could predict the concepts that patients are thinking about but struggling to express 4/8

We previously showed that concepts can be decoded from neurologically healthy participants using functional MRI. Here we used a new transfer learning approach where decoders are trained on neurologically healthy participants and then transferred to participants with aphasia 3/8

Aphasia is one of the most common and debilitating effects of stroke. Patients with aphasia struggle with different aspects of language (e.g. word finding, grammatical construction, phonological encoding). But many patients have relatively spared conceptual knowledge 2/8

We're excited to share our new study on decoding brain activity in participants with post-stroke aphasia! We think this is an important step towards cognitive brain-computer interfaces for patients with language disorders biorxiv.org/content/10.64898… 1/8

How does the human brain represent semantic information from different languages? Our new preprint suggests that bilingual language comprehension relies on shared semantic representations that are systematically modulated by each language! 1/n
Bilingual language processing relies on shared semantic representations that are modulated by each language biorxiv.org/cgi/content/shor… #bioRxiv