←
Moshe Poliak100 posts
Moshe Poliak avatar

Moshe Poliak

@MoshePoliak

PhD student at MIT Brain and Cognitive Sciences, Tedlab. I study psycholinguistics. international 🏳️‍🌈 he/him ex-STEM-phobic

◷ Joined November 2020▧ 16 Photos and videos
Ted Gibson, Language Lab MIT avatar
⟳ Moshe Poliak retweeted
Ted Gibson, Language Lab MIT@LanguageMIT·4 Oct 2025

39th Annual Conference on Human Sentence Processing March 26-28, 2026 hsp2026.org/ MIT, Cambridge MA, USA. email: info@hsp2026.org Special session: Language and thought in minds and machines Submission deadline: December 12 2025 (Real deadline; no extension)

Micha Heilbron avatar
⟳ Moshe Poliak retweeted
Micha Heilbron@m_heilb·18 Aug 2025

New preprint! w/ @dr_han_jones Adding human-like fleeting memory to transformers improves language learning, but impairs reading time prediction This supports ideas from cognitive science but complicates the link between model architecture and behavioural prediction

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

Curtis Chen initiated this as a class project, but he had sadly passed away before the work was completed. He was a brilliant and kind young scientist with a wonderful, dry sense of humor, and he had a bright future ahead of him. His passing is a great tragedy. He will be missed.

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

THANK YOU SO MUCH to my incredible advisor and the senior author of this work, Ted Gibson. Your insight and patience strongly shaped this paper and continue shaping my work and development.

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(11) Bonus from the appendix 💰💰💰 Prompted by reviewers, we investigated the effect of label choice in binary acceptability rating (acceptable, good, grammatical, natural), and found that participants’ behavior is invariant to the specific labels that the study uses.

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(10) Moreover, word and construction probabilities are valid constructs across languages and are fairly easy to compute, facilitating cross-linguistic research. Thus, construction probability is a powerful and potentially highly general tool for explaining acceptability.

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(9) The current work merges insights on language processing from construction-based and probability-based approaches: participants are sensitive to the probabilities of words, sequences of words, and even argument structure, which is a more abstract quantity.

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(8) We replaced verbs with adjectives (e.g., “What was Mary glad that John bought?”), finding that both P(adjective) and P(that | adjective) predicted acceptability ratings in a similar way. Thus, a broader range of constructions is governed by word and construction probabilities

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(7) We conducted a replication of LR, adding fillers, removing catch trials, and slightly altering the critical materials, arriving at the same results. We learn that these effects are robust and replicable, despite the changes in materials and study platform (MTurk -> Prolific).

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(6) P(verb) and P(that | verb) were largely independent; this justified using them and their interaction in an alternative model to that of LR, which only used the bigram probability of ‘{verb} that’. Both parameters and their interaction were significant and positive!

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(5) We extracted the probabilities of the verbs, P(verb), from COCA, and syntactically parsed the sentences therein to extract the argument structure of each verb, finding the probability with which each verb takes a sentence complement, P(that | verb).

Post attachment
Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(4) In the current work, we evaluate the contribution of all 3 quantities using LR's original data, a modified replication experiment, and an extension to a new construction. We show how the alternative, simpler (but also probability-based) approach accounts for the data better.

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(3) LR proposed that acceptability depends on the probability of the verb-frame of the verb (“whine that”). But why start with the bigram “whine that” and not the probabilities that compose it: the lexeme probability P(whine) and argument structure probability P(that | whine)?

Moshe Poliak avatar
Moshe Poliak@MoshePoliak·5 Aug 2025

(2) What affects the acceptability of long-distance extractions has long been debated, with multiple accounts proposed. Liu, Ryskin et al. (2022; LR) proposed a succinct probability-based account of a subtype of such sentences (e.g., “What did Mary whine that John bought?”).