←
Haim Sompolinsky57 posts
Haim Sompolinsky avatar

Haim Sompolinsky

@HSompolinsky

@Harvard Professor of MCB & Physics and Director of Swartz Program in Theoretical Neuroscience; @HebrewU Professor of Physics and Neuroscience (Emeritus)

◷ Joined July 2018▧ 11 Photos and videos
יצחק הרצוג Isaac Herzog avatar
⟳ Haim Sompolinsky retweeted
יצחק הרצוג Isaac Herzog@Isaac_Herzog·7 Mar 2024

בגאווה ישראלית גדולה בירכתי היום את פרופסור חיים סומפולינסקי מהאוניברסיטה העברית בירושלים על זכייתו בפרס Lundbeck היוקרתי - הפרס החשוב ביותר בעולם בתחום חקר המוח. מדובר בהישג ישראלי פורץ דרך, שמשקף את מצוינות האקדמיה הישראלית במחקר ובכלל. אני סמוך ובטוח כי בעקבותיו יבואו עוד אותות ופרסים שיוקירו את תרומתם של ישראליות וישראלים לקהילה המדעית העולמית, ומקווה ופועל לכך שנדע להכיר תודה - כחברה וכמדינה - לענקי האקדמיה והמחקר שלנו.

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·8 Jan 2024

Topics include principles of early sensory processing; unsupervised and supervised learning; attractors, memory, and spatial functions in cortical circuits; noise, chaos, and neural coding; learning, representations, and cognition in deep neural networks in brains and AI. 3/3

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·8 Jan 2024

The course introduces analytical and numerical tools from information theory, dynamical systems, statistics, statistical physics, AI, and machine learning for the study of neural computation. 2/3

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·8 Jan 2024

My Harvard/Neuro 231, 2024 Edition begins soon. It explores contemporary brain theory spanning local neuronal circuits as well as deep neural networks. It examines the relationship between network structure, dynamics, and computation. 1/3

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·18 Sep 2023

The theory unites NTK and NNGP as two limits of the same underlying process. We introduce the Neural Dynamical Kernel (NDK), derive equations for the dynamics of the mean predictor of the network, and discuss implications for the problem of representational drift in neuroscience.

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·18 Sep 2023

I am excited to announce a recent work by Yehonatan Avidan and Qianyi Li arxiv.org/abs/2309.04522 presenting an analytical theory for learning dynamics in infinitely wide neural network.

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·18 Jul 2023

Jet Blue just entered the Book of Guinness for World Record on Greediness. It cancelled my flight due to weather conditions but refused to fully refund me. They charged me cancellation fee! Never underestimate the creative way companies such as Jet Blue chase your money! advice?

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·19 Dec 2022

Our model proposes a novel scheme for associative memory of temporal sequence. In contrast to using sequence attractors (Sompolinsky and Kanter, 1988), here entire sequences are stored holistically as fixed points-a scheme that is robust to overlap between sequences.

Post attachment
Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·19 Dec 2022

and then store multiple compressed vectors as fixed points in RNN. Retrieved fixed points is followed by decoding individual linked components. Thus, model consists of two memory systems: 'dictionary' for items and 'episodic' for their linked structures.

Post attachment
Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·19 Dec 2022

However real-life memory must be able to store multiple knowledge structures each composed of connected building blocks, such as episodes, cognitive maps and temporal sequences. To tackle this problem we first compress structures into fixed-length distributed representations

Haim Sompolinsky avatar
Haim Sompolinsky@HSompolinsky·19 Dec 2022

I am excited to announce the publication of the wonderful paper of Julia Steinberg on Associative memory of structured knowledge in scientific reports nature.com/articles/s41598-0…. Most neural models of associative memory store structureless knowledge as simple random patterns in RNNs