←
Jerry Tang47 posts
Jerry Tang avatar

Jerry Tang

@jerryptang

postdoctoral fellow at UT Austin interested in language disorders and brain-computer interfaces

◷ Joined May 2021▧ 16 Photos and videos
Jerry Tang avatar
Jerry Tang@jerryptang·Sep 8

This approach can also generalize across modalities: here we trained models on brain responses to stories and transferred them by aligning brain responses to silent movies. This could be effective for mapping concepts in children and patients with language impairments 6/7

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Sep 8

We found that cross-participant models trained on 24 *minutes* of calibration data produce similar maps as within-participant models trained on 5 *hours* of data! 5/7

Jerry Tang avatar
Jerry Tang@jerryptang·Sep 8

First we train a model on brain responses from existing reference participants. Then we show a much smaller set of calibration stimuli to each new goal participant. By aligning brain responses to the calibration stimuli, we can transfer the model to the goal participant 4/7

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Sep 8

To address this bottleneck, we developed a framework for using functional alignment to transfer encoding models across participants 3/7

Jerry Tang avatar
Jerry Tang@jerryptang·Sep 8

Encoding models and cortical maps could be very helpful for clinical applications such as localizing implant and stimulation sites. But these models require many hours of brain responses from each participant, which can be infeasible for clinical populations 2/7

Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

We also found good decoding performance from individual brain regions. This suggests that we could move our decoder from fMRI into more portable systems. The best regions differed across participants so we think fMRI will remain very important for localizing recording sites 7/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

Moving forward we hope to develop practical systems that can support communication. We found that decoding performance reliably improved with the amount of training data. So we’re optimistic that there's plenty of room for improvement 6/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

Next we explored why this works. We found that conceptual processing was largely spared outside of damaged brain regions. This suggests that our approach could generalize across patients with a wide range of lesion profiles and speech / language impairments 5/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

We found that the decoder predictions could describe what the participants with aphasia were hearing about / seeing / imagining! This shows how brain-computer interfaces could predict the concepts that patients are thinking about but struggling to express 4/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

We previously showed that concepts can be decoded from neurologically healthy participants using functional MRI. Here we used a new transfer learning approach where decoders are trained on neurologically healthy participants and then transferred to participants with aphasia 3/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

Aphasia is one of the most common and debilitating effects of stroke. Patients with aphasia struggle with different aspects of language (e.g. word finding, grammatical construction, phonological encoding). But many patients have relatively spared conceptual knowledge 2/8

Post attachment
Jerry Tang avatar
Jerry Tang@jerryptang·Apr 9

We're excited to share our new study on decoding brain activity in participants with post-stroke aphasia! We think this is an important step towards cognitive brain-computer interfaces for patients with language disorders biorxiv.org/content/10.64898… 1/8

Catherine Chen avatar
⟳ Jerry Tang retweeted
Catherine Chen@cathychen23·2 Jul 2024

How does the human brain represent semantic information from different languages? Our new preprint suggests that bilingual language comprehension relies on shared semantic representations that are systematically modulated by each language! 1/n

Post attachment

Bilingual language processing relies on shared semantic representations that are modulated by each language biorxiv.org/cgi/content/shor… #bioRxiv