Cory Shain (coryshain@bsky.social) Profile Banner
Cory Shain (coryshain@bsky.social) Profile
Cory Shain ([email protected])

@coryshain

2,046
Followers
783
Following
109
Media
1,765
Statuses

Language in minds, brains, and machines. Linguistics faculty @Stanford . He/him.

Don't wanna be here? Send us removal request.
Pinned Tweet
@coryshain
Cory Shain ([email protected])
7 months
Now out in @PNASNews ! Large-scale reading evidence that next-word predictability effects in humans are driven by *inference* (logarithmic in predictability) rather than preactivation (linear in predictability). 1/10
2
45
152
@coryshain
Cory Shain ([email protected])
3 years
My toddler has learned that the formula for English question formation is "what the heck X?" like "what the heck blanket?" (where's the blanket) or "what the heck mac n cheese?" (can I have lunch). What the heck?
7
48
648
I can't believe I'm saying this, but here goes: I'm going to be a professor! At Stanford Linguistics (starting fall 2024)!
58
19
583
@coryshain
Cory Shain ([email protected])
2 years
One thing that has struck me as a linguist+parent is the fact that my kids sometimes learn rules that are wrong, idiosyncratic, and productive. Two examples: 1/10
3
40
315
👋I boost a lot of job opportunities on here and now it's time to boost my own! I'll be arriving at #Stanford in fall of 2024 and I'm looking for awesome people to help me figure out language. 🧵👇
4
79
219
@coryshain
Cory Shain ([email protected])
8 months
Linguist here! We have so many. pied piping sausage machine vocal fry bleeding counterbleeding colorless green ideas Nim Chimpsky copula sloppy identity wug
17
10
121
@coryshain
Cory Shain ([email protected])
3 months
Boarding a *one way* flight to SFO with the fam! Close of a wonderful chapter in @ev_fedorenko 's lab and hopefully the start of another one in my own.
7
3
121
@coryshain
Cory Shain ([email protected])
2 years
Example 1: When my twins were toddlers, they learned the following rule for forming reciprocals, which is more complex than the actual rule ("each other"): our -> ourchothers your -> yourchothers their -> theirchothers 2/10
4
1
115
@coryshain
Cory Shain ([email protected])
5 months
🚨JOB ALERT🚨 2-year full-time research coordinator. Help me get my new language-brain lab at @Stanford off the ground! fMRI and coding bg needed. Ideal for post-bacs interested in comp/cog/neuro/lang. Apply by May 31 for full consideration. Please RT!
0
54
107
@coryshain
Cory Shain ([email protected])
2 years
Want to understand recursion? Try reading papers the way I do it! WARNING: I have never finished a paper. read <- func(a) { for b in cited_by(a) { read(b) } }
8
5
103
@coryshain
Cory Shain ([email protected])
2 years
Since joining @ev_fedorenko 's lab from A Linguistics Department, I've been surprised at the combination of misinterpretation and rancor directed toward her functional localization paradigm for language. 1/
@pictureofitself
(((Aperols for Aurelian)))
2 years
This is a great example of how psychologists continue to use folk-scientific ideas about language even in their cutting-edge research, and why that matters: 🧵 1/
5
47
266
5
14
98
One of my academic heroes is William Sealy Gosset, aka "Student". My admiration for him comes less from his contributions (which were huge) than from the model of his life. Many haven't heard of him, so here's a 🧵: 1/20
Tweet media one
1
19
94
@coryshain
Cory Shain ([email protected])
2 years
The Gricean Toddler Me: I love you. T: I love Mom. Me: I love Mom, too, but don't you love me? T (pause): I *just* love Mom.
5
4
90
@coryshain
Cory Shain ([email protected])
2 years
This is why language development is such a fun puzzle: it's hard to explain BOTH the striking uniformity of developmental trajectories and adult language competence AND the flexible data-driven learning processes that yield idiosyncratic and contingent incorrect inferences. 8/10
2
2
89
*New preprint!* "Word Frequency and Predictability Dissociate in Naturalistic Reading". TLDR; Multiple datasets show that word frequency has a big effect on reading times that is not reducible to predictability, even during naturalistic reading. 1/22
2
15
87
@coryshain
Cory Shain ([email protected])
3 years
Our toddler used to say "waba" for "water bottle" but eventually figured out that this isn't enough syllables. So now it's been corrected to "wabawaba".
2
4
85
@coryshain
Cory Shain ([email protected])
4 years
I'm a Dr.!
9
1
79
@coryshain
Cory Shain ([email protected])
2 years
And yes :), if you did the math, I have 4 kids. They do a lot of talking and I try to do a lot of listening. 11/10
3
0
73
@coryshain
Cory Shain ([email protected])
2 years
Example 2: My youngest (still a toddler) has learned to always add the contracted copula in addition to the actual copula: I'm am we're are you're are He otherwise uses subject pronouns correctly (I want, you like, etc.) 3/10
1
2
73
@coryshain
Cory Shain ([email protected])
2 years
New preprint! "A Deep Learning Approach to Analyzing Continuous-Time Systems" (with William Schuler) We propose a way to use deep learning to *analyze* (not just imitate) complex continuous-time processes. 1/
2
19
70
@coryshain
Cory Shain ([email protected])
2 years
It also strikes me how easy it is to miss these observations precisely because they're idiosyncratic. Non-dorky non-linguist parents may not notice or report them, and most experimental and corpus methods are designed to find population-level patterns. 9/10
1
2
65
@coryshain
Cory Shain ([email protected])
2 years
These errors are very cute so we naturally repeat them back to them all the time and even use them jokingly among each other, reinforcing the wrong pattern possibly even more frequently than the right one. 4/10
2
1
62
@coryshain
Cory Shain ([email protected])
6 months
@linguistMasoud Linguistics is the nexus of the known universe. It defies classification.
2
3
60
@coryshain
Cory Shain ([email protected])
3 years
I followed the advice to delete "very" in my writing, so I did that ewhere and now ething is so much punchier. Works e time!
1
1
61
@coryshain
Cory Shain ([email protected])
2 years
These errors can also be contagious for other learners. The twins' older brother started (earnestly) using their incorrect reciprocal form based on their input, even though he had never done this before. 5/10
1
1
56
@coryshain
Cory Shain ([email protected])
2 years
What kinds of clues about our amazing language learning abilities are lurking in the diversity of errorful learning trajectories that we explore (and eventually find our way out of) as individual children? 10/10
3
0
56
@coryshain
Cory Shain ([email protected])
2 years
I'm not aware of previous reports of these specific error patterns, either from the research literature or from other parents. Despite highly similar genes and experiences, my kids borked the English language in unique and revealing ways, all on their own. 7/10
2
1
53
@coryshain
Cory Shain ([email protected])
3 years
Nothing can stop Praat from playing that sound you clicked on. Nothing.
3
4
52
@coryshain
Cory Shain ([email protected])
3 years
Whenever I get too jazzed about the power of human statistical learning I remember that I'm still at chance accuracy on which switch turns on the light vs the ceiling fan
3
0
49
@coryshain
Cory Shain ([email protected])
6 months
Now out in Open Mind @mitpress (with William Schuler)! "Black box" neural nets can be surprisingly useful for helping scientists interpret complex time series, like continuous human behavioral or brain responses: . 1/
1
19
49
@coryshain
Cory Shain ([email protected])
3 years
Now to appear in Cognition! Continuous-time deconvolutional regression (CDR, ) estimates cognitive dynamics from online experimental measures. Tested on synthetic, self-paced reading, eye tracking, and fMRI data (also applies to EEG, MEG, and others). 1/
2
14
48
@coryshain
Cory Shain ([email protected])
2 years
Despite these adverse learning conditions, they correct these patterns relatively quickly (a few months). 6/10
1
0
46
@coryshain
Cory Shain ([email protected])
3 years
Doing the same thing over and over expecting a different result. You may call it insanity. I call it sampling.
0
3
45
This morning I swooped my 3yo up in a big hug and said, "I love you". His eyes were kind, but full of pity. He replied, "I don't love you. I love Mom."
3
0
45
My lab will focus broadly on language in minds, brains, and machines (learning, representation, and processing), using computational, behavioral, and neuroimaging approaches. If you're a prospective student interested in this stuff, let's talk!
4
3
44
@coryshain
Cory Shain ([email protected])
7 months
Peer review is not quality control. 🧵 1/
2
8
42
@coryshain
Cory Shain ([email protected])
7 months
Are you self aware?
Tweet media one
@rachelmetz
Rachel Metz
7 months
this is an example of a bunch of things but it is NOT an example of self-awareness or anything approaching AGI. c'mon people.
Tweet media one
23
21
170
1
6
38
@coryshain
Cory Shain ([email protected])
3 years
To be safe, I'm correcting my p value by the total number of hypothesis tests ever conducted. Anyone have that number off hand?
3
1
33
@coryshain
Cory Shain ([email protected])
3 years
Our #Cognition paper on continuous-time deconvolutional regression ( #CDR ) is finally out! I've already talked on here about the general idea 👇, so instead, here's a practical thread on how to actually use it to analyze your data. 1/
@coryshain
Cory Shain ([email protected])
3 years
Now to appear in Cognition! Continuous-time deconvolutional regression (CDR, ) estimates cognitive dynamics from online experimental measures. Tested on synthetic, self-paced reading, eye tracking, and fMRI data (also applies to EEG, MEG, and others). 1/
2
14
48
1
5
32
@coryshain
Cory Shain ([email protected])
4 years
Excited to announce a new paper with Micha Elsner @conll_conf : "Acquiring language from speech by learning to remember and predict". 1/n
2
8
32
@coryshain
Cory Shain ([email protected])
2 years
So excited to be in Pittsburgh for #HSP2023 , my first in-person conference in almost 4 years 🤯! Here are some thumbnails of the work I'll be presenting this week. Find me in person or online to chat about any of them (or anything else!):
1
6
30
@coryshain
Cory Shain ([email protected])
4 months
Super excited for the amazing @YuhanZhang_ and for all the cool stuff she plans to do in her upcoming postdoc with me!
@YuhanZhang_
Yuhan Zhang
4 months
🙌🏻 I defended my PhD thesis “The Rational Processing of Language Illusions” yesterday!🎓 I am extremely grateful for my amazing advisors @LanguageMIT and @TeaAnd_OrCoffee and dear committee members @roger_p_levy and Kevin Ryan!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
18
4
187
1
0
30
@coryshain
Cory Shain ([email protected])
4 months
The final version of our "Distributed Sensitivity to Syntax" paper is now out and open access!
@coryshain
Cory Shain ([email protected])
5 months
Now out in @JOCN_Journal ! Distributed Sensitivity to Syntax and Semantics throughout the Language Network. . A 🧵...
4
28
89
1
5
29
@coryshain
Cory Shain ([email protected])
5 months
My 11yo today: "I meant to think X but instead I thought Y." Turns out she was talking about her inner voice, which made a speech error (!). This blew my mind. Do other people have this experience?
2
2
27
@coryshain
Cory Shain ([email protected])
3 years
My approach to the cocktail party problem of being an interdisciplinary researcher Them: So what do you do? Me: I'm a postdoc at blabla Them: Oh really? What field? Me: I don't know
0
2
28
@coryshain
Cory Shain ([email protected])
3 months
The recording of my #HSP2024 talk ("Are word predictability effects really linear?") is now online (first talk of the session)! .
1
8
28
@coryshain
Cory Shain ([email protected])
2 years
Incidental finding 1: GPT-2(-small) is a much better estimator of human surprisal than GPT-3, even though GPT-3 is 1000x bigger and trained on much more data. Large transformer LMs may be "too good" at next-word prediction. 18/
1
6
27
@coryshain
Cory Shain ([email protected])
5 months
If you're at #HSP2024 and can drag yourself to a virtual talk in the toughest slot (9am tomorrow/Saturday), I'll try to reward you with a bit of a 🌶️ take on "prediction" in language comprehension, w/ @clara__meister @tpimentelms @ryandcotterell & @roger_p_levy
2
6
26
Kid got a homework problem asking them to show that there are no positive integers a, b, c such that a^n + b^n = c^n for integer n > 2. I worked on it all evening and I'm stumped. These new math standards are tough!
4
0
25
@coryshain
Cory Shain ([email protected])
3 months
I wonder when my kids will figure out how closely linked their bedtime is to how annoying they've been throughout the day.
2
0
25
1. He embodied the disinterested pursuit of knowledge. His pay and reputation were totally disconnected from his academic work. He was not after citation counts, society honors, or "legacy". 10/20
1
1
24
@coryshain
Cory Shain ([email protected])
2 years
Toddlers reveal our hidden assumptions by messing with them. Today I let mine put his bread in the toaster and he put it in UPSIDE DOWN. This makes no practical difference but it bothers me to no end.
1
1
24
Pro tip: I use the @zotero browser widget to quickly save papers I see on social media to my reading list. Not having time to read papers that are on my list feels much better than not having time to read papers that are not on my list.
2
0
24
@coryshain
Cory Shain ([email protected])
2 years
PSA in hopes of making everyone feel better about themselves: I just finished the poster for the conference abstract *that was accepted as an oral presentation*.🤦
0
0
24
@coryshain
Cory Shain ([email protected])
8 months
In case you were wondering, it was NOT because they didn't want me. They were just fortunate to have received many strong applicants for this position (myself included) and had decided to move forward with other candidates at this time. Whew!
@coryshain
Cory Shain ([email protected])
8 months
If you think you've been snubbed by a job posting that didn't even have the courtesy to send you a rejection letter, be patient. Today I got a rejection letter from a place I applied to almost a year and a half ago. Employers, it's never too late to make someone's day!
0
0
21
0
1
23
lol 2 of the key examples of America's "education dominance" (MIT & Caltech) don't even have legacy admissions
4
2
22
@coryshain
Cory Shain ([email protected])
3 years
My laptop just briefly attained sentience, typing random numbers and letters on its own. After a panicked restart and some web shopping for new computers, realized the toddler had found my bluetooth keyboard in the other room 🥴.
0
2
22
parenthood
Tweet media one
0
0
21
@coryshain
Cory Shain ([email protected])
8 months
If you think you've been snubbed by a job posting that didn't even have the courtesy to send you a rejection letter, be patient. Today I got a rejection letter from a place I applied to almost a year and a half ago. Employers, it's never too late to make someone's day!
0
0
21
@coryshain
Cory Shain ([email protected])
6 months
4yo (points at random stranger): What's that person's name? Me: Your guess is as good as mine. 4yo: I think it's Ronky. Me: Actually my guess may be better.
0
0
21
@coryshain
Cory Shain ([email protected])
11 months
A quick bump for those in the back: PhD applications for #StanfordLinguistics are due *Nov 30*: . Please RT!
1
12
21
My 3yo says "hostable" instead of "hospital". I like this because it swaps places of articulation but keeps the voicing features where they should be.
3
2
21
@coryshain
Cory Shain ([email protected])
3 years
@LanguageMIT The fact that that's not what it is makes me suspect this comes from siblings instead of me
0
0
20
@coryshain
Cory Shain ([email protected])
3 years
8 yo spontaneously made me regalia and a diploma for my zoom commencent 😍
Tweet media one
0
0
20
@coryshain
Cory Shain ([email protected])
7 months
Most of my own papers have improved immensely through interactions with constructive reviewers. I suspect this experience generalizes. As a result, I'm a fan of peer review and I take my role as a reviewer really seriously. 8/
2
0
18
@coryshain
Cory Shain ([email protected])
6 months
What kind of eclipse is it again when the sun comes between the earth and the moon?
4
1
18
@coryshain
Cory Shain ([email protected])
3 years
Sometimes I look at my own sentences and feel profound relief that they are not in the treebank I'm annotating.
1
0
19
If you're a psychologist interested in generating good nonce words for experiments, my toddler is serviceable. A piece of playground equipment was "spoodgered" and he keeps telling me to "landle down". But they're catchy so act now before they catch on.
0
1
18
@coryshain
Cory Shain ([email protected])
2 years
You know a field is moving (too?) fast when people keep referring to papers from last year as "classical"
1
1
18
@coryshain
Cory Shain ([email protected])
3 years
Can I make a humble request to get a decision *immediately* whenever I apply for something? This would improve my mental health greatly. Thx.
1
0
18
@coryshain
Cory Shain ([email protected])
3 years
8yo: How do you say "I agree" in French? me: Je suis d'accord. 8yo: I am... agree? me: *long explanation about how translation isn't word by word, with several examples* 8yo (smirking): I am agree!
0
0
18
I owe this to a huge number of people, but esp @RSmithShain and my (official and unofficial) mentors William Schuler, Micha Elsner, @ev_fedorenko , @marty_with_an_e , @LanguageMIT , and @roger_p_levy .
1
0
18
@coryshain
Cory Shain ([email protected])
2 years
Proposal: Give authors+reviewers anonymous email addresses so they can ask each other clarifying q's before submitting official reviews/responses. 1/10
2
0
18
@coryshain
Cory Shain ([email protected])
2 years
An EvLab study led by @tamaregev has in fact shown exactly this! The morphophonological plausibility of nonwords modulates the degree to which they engage the language network. 8/
@tamaregev
Tamar Regev
3 years
Excited to share the first preprint from my postdoc! We show that brain regions that process “high-level” meaning in language also process meaningless phoneme clusters, according to how much they respect linguistic phoneme-combinatorial constraints. 1/n
3
13
82
3
0
17
@coryshain
Cory Shain ([email protected])
2 years
And on the very last day that this can be called Shain, Paunov, Chen et al *2022*, our article on language and theory of mind is out in Cerebral Cortex! @ampaunov @Jessica_ChenXY @ben_lipkin @ev_fedorenko Happy New Year everybody!
@coryshain
Cory Shain ([email protected])
2 years
New preprint! "No evidence of theory of mind reasoning in the human language network" with @ampaunov , @Jessica_ChenXY , @ben_lipkin , & @ev_fedorenko . *Alex, Jessica and I contributed equally 1/
3
13
58
0
7
17
As he made discoveries, he wanted to make them public, but was contractually prevented from doing so by his employer. The workaround they converged on was for him to publish under a pseudonym. He chose "Student". That's the only author attribution in any of his >20 papers. 6/20
1
0
17
@coryshain
Cory Shain ([email protected])
2 years
My toddler has started asking what time it is. He has no concept of time. I tell him it's 26.
1
0
17
@coryshain
Cory Shain ([email protected])
4 months
Glad to see our recent study covered by @ElliotMurphy91 in @PsychToday ! Here's the full team: @HopeKean , @_coltoncasto , @ben_lipkin , @AffourtitJosef , @MattSiegelman , Frank Mollica, @ev_fedorenko
@ElliotMurphy91
Elliot Murphy
4 months
Latest article for @PsychToday reviewing an excellent paper on neural correlates of syntax by @coryshain , @HopeKean , @_coltoncasto , @ben_lipkin , @AffourtitJosef and others.
0
10
32
0
0
15
@coryshain
Cory Shain ([email protected])
11 months
So exciting to see a computational psycholinguistics paper in Nature! Congrats @LakeBrenden & Marco Baroni!
@LakeBrenden
Brenden Lake
11 months
Today in Nature, we show how a standard neural net, optimized for compositional skills, can mimic human systematic generalization (SG) in a head-to-head comparison. This is the capstone of a 5 year effort with Marco Baroni to make progress on SG. (1/8)
Tweet media one
24
392
2K
0
1
17
@coryshain
Cory Shain ([email protected])
5 years
I had a great time talking at virtual #CUNY2020 today, thanks all for your great questions! Stay tuned for a link to the recording, which should be up soon... #CUNY2020
@adelegoldberg1
Adele Goldberg
5 years
great presentation by @coryshain #CUNY2020 who finds that Surprisal, both on the basis of word strings (5 grams) and at the level of grammatical constructions (e.g, NP VP; 'syntax') increase activation in the language-network
1
3
17
0
0
16
(Let's pause and note how few structural incentives he had to do public-facing research. He did not hold a research job. Publication was actively discouraged. And publications were pseudonymous. As a result, he is to this day much less well known than his contemporaries.) 7/20
1
0
16
@coryshain
Cory Shain ([email protected])
2 years
2. "Large-Scale Evidence for Logarithmic Effects of Word Predictability on Reading Time" (Spoken Session 5, submission #32 ), with @clara__meister , @tpimentelms , @ryandcotterell , and @roger_p_levy Plenary talk! For more details, see this thread:
@coryshain
Cory Shain ([email protected])
2 years
New preprint! Large-Scale Evidence for Logarithmic Effects of Word Predictability on Reading Time . With @clara__meister , @tipimentelms , @ryandcotterell , & @roger_p_levy . TLDR; supports a key role of probabilistic inference in language processing. 1/
3
28
81
2
4
15
Only partly joking: I think a good indicator of the reliability of a scientific idea/result is the number of times the authors have publicly reversed themselves. 1/4
1
2
16
@coryshain
Cory Shain ([email protected])
2 years
This Christmas my toddler gave us a new word: forbrought. Used when you forgot to put a toy you were holding away and brought it along instead.
0
2
16
@coryshain
Cory Shain ([email protected])
4 months
Last day to apply for guaranteed consideration! Stragglers still welcome to submit after this 😉, I'll probably keep looking at new apps for at least a few days.
@coryshain
Cory Shain ([email protected])
5 months
🚨JOB ALERT🚨 2-year full-time research coordinator. Help me get my new language-brain lab at @Stanford off the ground! fMRI and coding bg needed. Ideal for post-bacs interested in comp/cog/neuro/lang. Apply by May 31 for full consideration. Please RT!
0
54
107
0
2
15
@coryshain
Cory Shain ([email protected])
6 months
Me: Do you know what "chill out" means? 4yo: What? Me: It means not having strong emotions about little things. You should try it. 4yo: I HATE CHILLING OUT!
2
0
15
@coryshain
Cory Shain ([email protected])
7 months
I think peer review IS very good at one thing: quality *improvement* for good faith research. 7/
1
3
15
@coryshain
Cory Shain ([email protected])
4 months
One week left to apply!
@coryshain
Cory Shain ([email protected])
5 months
🚨JOB ALERT🚨 2-year full-time research coordinator. Help me get my new language-brain lab at @Stanford off the ground! fMRI and coding bg needed. Ideal for post-bacs interested in comp/cog/neuro/lang. Apply by May 31 for full consideration. Please RT!
0
54
107
0
5
15
@coryshain
Cory Shain ([email protected])
3 years
I had a great time talking with Stephen in depth about our latest preprint on language, working memory, and the brain: ! If you're interested, I'll be taking questions at @SNLmtg slide slam session B, Tues Oct 5 3:30pm ET (or wherever questions are asked).
@smwilsonau
Stephen Wilson
3 years
Language Neuroscience Podcast #16 , I talk with @CoryShain about his fascinating new preprint on working memory demand in naturalistic language comprehension. Get yourself in the mood for @SNLmtg this week! @ev_fedorenko @IbanDlank @LanguageMIT
1
22
82
0
3
14
@coryshain
Cory Shain ([email protected])
3 years
8yo: Wacha doing? Me: Writing a paper 8yo: Boring Me: YOU'RE boring 8yo: You're MORE boring Me: You're INFINITY boring 8yo: 😑 Did I win that? Yes I did.
1
0
14
@coryshain
Cory Shain ([email protected])
3 months
missed recursion opportunity
Tweet media one
1
0
14