←
Sam Gershman2,686 posts
Sam Gershman avatar

Sam Gershman

@gershbrain

Professor, Department of Psychology and Center for Brain Science, Harvard University

◷ Joined July 2016▧ 156 Photos and videos
Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

My impression is that there is a cultural barrier where systems neuroscientists overlook the relevance of non-invasive brain imaging to test certain hypotheses, simply because it's not directly measuring spikes.

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

My point is that it's too simplistic to think that measuring spiking activity is always a more "direct" way of testing hypotheses about the relationship between neural activity and information processing.

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

It's also possible that the patterns are encoded in a distributed way across thousands of neurons. To test that hypothesis, you might need methods like 2 photon imaging.

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

In some cases, what matters for information processing is inter-area communication, which is not something that is measured in most ephys studies, but can be accessed with fMRI (again, I'm not arguing that's true in the case of imagery).

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

Ephys will only sample a relatively small number of neurons at the same time. It won't find patterns that are only visible when you aggregate many neurons. It's conceivable that methods like fMRI could detect such patterns (I'm not arguing that's true in the case of imagery).

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

Let's take the hypothesis that sensory neurons are activated during mental imagery. There are trade-offs in using different methods to address this question. And it depends a lot on how you think about the relevant neural activity.

Sam Gershman avatar
Sam Gershman@gershbrain·19 Oct 2024

I think my point here has been misunderstood by most commentators. Obviously I agree that ephys is a more direct measure of spiking activity. Let me try to clarify...

Papers that report neuronal recordings sometimes say that they provide "direct" evidence for neural encoding of something, in contrast to "indirect" methods such as non-invasive brain imaging. I don't really understand this. What makes one "direct" and the other "indirect"?

Sam Gershman avatar
Sam Gershman@gershbrain·17 Oct 2024

Is the alternative hypothesis that something other than neural activity is generating the non-invasive brain signals? Or is the qualifier "direct" simply a rhetorical flourish?

Sam Gershman avatar
Sam Gershman@gershbrain·17 Oct 2024

Papers that report neuronal recordings sometimes say that they provide "direct" evidence for neural encoding of something, in contrast to "indirect" methods such as non-invasive brain imaging. I don't really understand this. What makes one "direct" and the other "indirect"?

Sam Gershman avatar
Sam Gershman@gershbrain·14 Oct 2024

I'm mainly interested in examples where neuroscientists make a correct ex ante prediction that some brain fact will improve performance when incorporated into an AI system (without changing other things). Ex post explanations in terms of neuroscience are less convincing.

Sam Gershman avatar
Sam Gershman@gershbrain·14 Oct 2024

I'd like to teach a paper which shows how a fact about the brain materially improved an AI system in a way that is unlikely to have been figured out by engineering alone. I haven't been able to find a single example of this. Suggestions welcome.

Sam Gershman avatar
Sam Gershman@gershbrain·14 Oct 2024

What are the most compelling real-world applications of cognitive science? I'm looking for empirical papers (not opinions/reviews).

Lucy Lai, PhD avatar
⟳ Sam Gershman retweeted
Lucy Lai, PhD@drlucylai·10 Oct 2024

we've finally updated our 2⃣ year old preprint on action chunking as (conditional) policy compression! this was a lesson in perseverance and not giving up on your ideas...work with @gershbrain & @AnnHuang42 ✨ (1/3) osf.io/preprints/psyarxiv/z8…