Spoken languages exhibit communicative efficiency by minimizing speaker+listener effort.
What about signed languages?
American Sign Language handshapes reflect efficiency pressures - but only in native signs, not signs borrowed from English!
#ACL2024
🧵
My waiter at this Irish pub asked what “DeepMind” on my hoodie means, I told him it’s the name of the company I worked for and he said “oh wow! Are you like a mindfulness/meditation coach?” 🧠
Thank you so much Jacob and everyone!
My student visa was refused and is currently stuck in administrative processing. I am supposed to start my PhD at
@UCBerkeley
next week.
If you have any leads or advice please message me, and please RT Jacob's tweet to amplify!
My student Kayo Yin needs your help. Her visa has been unnecessarily delayed, which would prevent her from coming to UC Berkeley to start her studies. Despite bringing all required documents, the
@StateDept
refused to process the visa and it could take months to re-process.
How can we explain language model predictions?
We use contrastive explanations to interpret LMs and show that they:
- are better aligned with linguistic rules
- improve model simulatability
- help us characterize how LMs make decisions
(w/
@gneubig
)
🧵1/7
I'm blown away and super honored that our paper was awarded *Best Theme Paper* at ACL 2021! Really grateful to my collaborators and the committee for recognizing our work, I really hope this can help more NLP researchers to work with signing communities in the next few years 😊
I'm super excited to join
@DeepMind
this summer as a research intern!
I'll be working on some really fun topics in multilingual NLP with
@redpony
and the language team👩💻
Can't wait to be in London to do some cool research with amazing people 🤩
I'm going to do a PhD at
@berkeley_ai
@BerkeleyNLP
!! 🥳 Really looking forward to working with
@JacobSteinhardt
, Dan Klein,
@trevordarrell
and all the amazing people at Berkeley! So excited for this new journey!
Here's a photo of the sunset Dan insisted we see when I visited 🤩
Document-level context is essential to close the gap between MT and humans.
But which words require context to be translated? And do models translate them well?
Check our MuDA benchmark, for 14 LPs! To appear at
#ACL2023
!
(co-lead
@kayo_yin
)
1/15
Extremely honored to be the 2020 recipient of the Clarkson Medal in Computer Science🏅
Thank you
@UndergradAward
for the beautiful evening, it’s well worth the 2 years wait ☺️
My first piano duet with AI, so cool to see the keys move next to me 🤯
@IJCAIconf
Thank you Carlos Cancino-Chacón and Gerhard Widmer for letting me play with ACCompanion () 🎶
How can we explain language model predictions?
We use contrastive explanations to interpret LMs and show that they:
- are better aligned with linguistic rules
- improve model simulatability
- help us characterize how LMs make decisions
(w/
@gneubig
)
🧵1/7
Thank you
@SCSatCMU
for featuring a story about me and my research on NLP for signed languages in their magazine 🤩
Deeply thankful to everyone who helped me work on my goal of developing language technologies for signers, there's still a long way to go!
I can’t believe it’s over, my 2 years at
@CarnegieMellon
flew by so fast!!!
Thank you
@LTIatCMU
family for everything you taught me and for all the wonderful memories, I really can’t put into words how grateful I am 🥰❤️❤️
Extremely thrilled that 3 of my papers have been accepted to the
#ACL2021NLP
main conference! 🥳 Super excited to share these work soon with the world :) But for now, I shall sleep
my first attempt at
#betterposter
!
pros: a lot of people complimented my poster and stopped to hear about my work even if their own research area is unrelated 🥰
cons: I lost my voice after talking about my poster through my mask for 2h non-stop :P
Having lived in cities that can’t brag about their weather the past 17 years (Paris->Pittsburgh->London), I thought it was an urban myth but wow sunlight really DOES improve your mood and energy levels
Has anyone tried *not* having a home office setup during their PhD?
I actually really enjoyed not having a WFH setup during my internship and only working when I'm at the office, so thinking of doing this during my PhD too 🤔
100% recommend applying for an internship at DeepMind!!
I've had a wonderful time here meeting so many friendly and brilliant people and getting to work on really exciting research 😊 Happy to also share my experience applying and working with the Language team!
Internship applications are now open! This year we have opportunities across various teams and offices 🌎🌍
Apply today via and learn more about the experience below ⬇️
#DeepMindInterns
Super happy that our paper "Interpreting Language Models with Contrastive Explanations" is accepted to EMNLP 🥳🎉
If you're interested in why LMs predict certain words and not others, please check out our preprint, play with our Colab demo, and come talk to us in Abu Dhabi!!
How can we explain language model predictions?
We use contrastive explanations to interpret LMs and show that they:
- are better aligned with linguistic rules
- improve model simulatability
- help us characterize how LMs make decisions
(w/
@gneubig
)
🧵1/7
When navigating different PhD options and talking to faculty/students, they're often biased and want to persuade you to join a particular program, so they're great at telling us positive things.
What are some *difficult* questions we can ask potential advisors and their students?
Super excited to have 2 papers accepted to
#EMNLP2021
main conference! 🥳
Disappointed that my third submission was rejected after R2 changed their score from 4 to 2.5 even though we addressed all their concerns during the rebuttal 🥴
I was confused why there were 5 candles and only 3 of them were lit, but my housemates are all CS PhD students so they arranged my birthday candles in binary
Thank you everyone for attending my talk on "Including Signed Languages" at the
#ACL2021NLP
Best Paper Session! I am so grateful for all the enthusiasm 😊
We will upload ASL interpretations soon! In the meantime, here's my pre-recording with EN subtitles:
I’m so happy to share that my long paper “Better Sign Language Translation with STMC-Transformer” has been accepted to
#coling2020
🎉
It’s my first full conference submission, I’m so excited! 😊
I’m in Vienna this week, would love to meet / catch up with people!
I’ll be at the alignment workshop, ICML, and the mech interp workshop!
I’ll also be at outdoor concerts and Danube beaches :)
I am so honored to be selected as a 2022 Siebel Scholar! I'm extremely grateful to my advisor
@gneubig
and all of my collaborators for all their support and encouragement, and I'm super excited to join this incredible community of
@SiebelScholars
😊
A couple of random ASL signs are being thrown around in these videos but it's mostly gibberish and none of the videos match the English prompt.
It's a cool effort and I'd love to see ASL generation work in the future, but let's not overstate what current models are capable of!
SignLLM is the first multilingual sign language model that can generate sign language gestures from input text!
I don't speak sign language, can anyone tell me how good these actually are? Especially because of the hand morphing 😅
9 examples + links ⬇️
no one in my family has a graduate degree and my dad always hoped that I'd get a PhD (without pushing me too hard either and wanting me to be happy above anything else), so I'm so happy to make my parents proud ❤️
This is what my dad responded with when I showed him some of the positive ACL reviews I got 🥰 Neither of my parents are computer scientists or academics so they don't always understand what I'm researching, but they are always extremely supportive and proud of my achievements 💛
Saw these signs in restrooms on campus today, thank you
@CarnegieMellon
for taking action and also posting a statement on gender inclusive restrooms! And really grateful to all the students, faculty and staff who pushed to make this happen ❤️
In my
#coling2020
paper, I demonstrate the advantage of Transformers and the inefficiency of gloss supervision in Sign Language Translation. Please come by my live poster session (POSTER22) on Friday, Dec 11 16:30-17:00 (CET), 10:30-11:00 (EST) to chat!
I got my hands on a grand piano for the first time in two years (thanks
@CMU_CFA
!) and not to be melodramatic but it really felt like I found an old friend or a part of me that I forgot about again!! Needless to say I spent the entire afternoon playing ❤️
Finally made the switch to QWERTY after 10 years on AZERTY! Since moving to CMU, I write more Python than French so I can give up being able to type "é" with 1 key to be able to type "[" with 1 key instead of 3
I am beyond thrilled to be named the Global Winner in Computer Science for my Bachelor's Thesis on Sign Language Translation!
I am eternally grateful to the
@Bachelor_X
program for igniting my passion for CS, and especially my advisor Dr. Jesse Read for his wonderful mentorship✨
🎉 Congratulations to our 2020 Global Winners! Out of over 4,000 entries this year, these are the 25 highest scoring entrants in their individual categories. Check out who they are on our website ⤵️
#UA2020
#AwardYourWork
#undergraduateresearch
I’m on my way to
#EMNLP2022
! Would love to chat about the world cup (🇫🇷), music, snowboarding, interpretability, signed languages, multilingual NLP, or anything else!
I will be presenting my work on interpreting language models 👇
How can we explain language model predictions?
We use contrastive explanations to interpret LMs and show that they:
- are better aligned with linguistic rules
- improve model simulatability
- help us characterize how LMs make decisions
(w/
@gneubig
)
🧵1/7
I originally had a drake meme on the title slide and my god I’m so glad I replaced it with an illustrative figure about my paper, I would’ve been so embarrassed to have the original version projected in front of the entire conference
Come hang out with us at
#ICML2024
and submit your work to our workshop (even if it’s not “classic” mech interp)!
I look forward to learning more about how models work and hearing everyone’s takes on this new, very fast-moving field! 💥
CfP + details:
Announcing the first Mechanistic Interpretability workshop, held at ICML 2024! We have a fantastic speaker line-up
@ch402
@JacobSteinhardt
@davidbau
@ghandeharioun
, $1,750 in best paper prizes, and a lot of recent progress to discuss!
Paper deadline: May 29, either 8 or 4 pages
I presented my research in less than 3 minutes to non-experts today! I had a lot of fun and definitely recommend others whose schools are also organizing Three Minute Thesis to give it a try :) Thanks
@CMULibraries
@3MT_official
!
I unfortunately tested positive for COVID the day before my flight back to the US, I made the most of my extra two weeks in Paris with lots of French pastries 🍰 (and thankfully I wasn't sick for too long!)
Fun fact: the only LM we used in this paper was an n-gram model, >50% of works we cited were published <2009 (min=1949)
This was a fun paper to write, and pretty different from what I've worked on in the past :)
Curious what people in linguistics / cognitive science think!
Spoken languages exhibit communicative efficiency by minimizing speaker+listener effort.
What about signed languages?
American Sign Language handshapes reflect efficiency pressures - but only in native signs, not signs borrowed from English!
#ACL2024
🧵
I revisited my old Tumblr blog and found this answer I wrote when I was 15, I feel happy that 7 years later my big dream hasn't changed, I found one way to achieve it (making interpretable and accessible multilingual NLP systems) and I am still working on it 😊
Pretty nervous and also excited to give this (personal) talk about not feeling "queer enough" as someone straight-passing 🥸
See you virtually at NAACL 🥳
Thank you so much! We are so honored and grateful for this recognition of the importance of studying signed languages!
#ACL2021NLP
attendees, I will present and take questions on this paper during the Best Paper Session tomorrow at 20:20 EDT!
Underline:
Congrats to MLT student
@kayo_yin
on winning Best Theme Paper at
#ACL2021
! Read about Kayo's paper on incorporating signed languages into NLP research, and all of the other LTI researchers featured at this year's conference:
Happy new year! I had my first summer new year’s day and by far the hottest☀️ I also caught more waves today than I ever have in a single surf session 🌊
I’m joining the Columbia Computer Science faculty as an assistant professor in fall 2025, and hiring my first students this upcoming cycle!!
There’s so much to understand and improve in neural systems that learn from language — come tackle this with me!
I'm very excited to present our paper "Signed Coreference Resolution" at the virtual poster session
@emnlpmeeting
tomorrow Nov. 8 12:30 - 14:00 AST!
We introduce a new task and model to resolve pronominal indexing signs 👇
🎬:
📜:
my dog's dogsitter sends my family photos of our dog every day with these speech bubbles in one of the languages that our multilingual dog knows, they make my day
packing/downsizing for a big move makes me realize that I should just burn the expensive candles and drink the nice wine whenever I want to, instead of hoarding them for a special occasion :')
How did I just learn that CMU is one of the only schools offering a major in bagpipes, now I want to orient my master towards a CS-bagpipes double degree 😍
I visited Gallaudet University for the first time last Monday 😊 I'm so happy I finally got to meet some of my collaborators at
@GallaudetU
, it was so exciting to be inside the
@MotionLightLab
, and I learned a lot about deaf space design too! Thank you so much for having me 💛
I'm giving a talk on context-aware machine translation this Friday (tomorrow!) at 4PM EST / 8PM UTC 😊
Really looking forward to it and hope to see many of you there!
🍁We are delighted to announce our next speaker ✨Kayo Yin
@kayo_yin
✨!
Title: Understanding, Improving and Evaluating Context Usage in Context-aware Machine Translation
Join us:SEPT,17th at 20:00 UTC!
The link will be on our RC:
+
I unfortunately couldn't make it to ACL Dublin this year, but I will be attending IJCAI in Vienna this summer (July 23-29)! I don't know many folks going to IJCAI so please please let me know if you're going as well 😊
It doesn't help that I'm spending this summer in the US, Japan, and France, and each country uses a different date format (MM/DD/YYYY, YYYY/MM/DD, DD/MM/YYYY respectively). Right now I'm in Japan and I keep buying food thinking it expires June 21 when in fact it's June @@ 2021 😅
My first poster session was a success 🎉 I still get excited about how cute the little avatars in front of the little posters are on gather town :') Thanks to everyone who dropped by!
Still in disbelief at receiving this high of a distinction, thank you
@Polytechnique
for interviewing me! I was very happy to share more about what the
@UndergradAward
means to me, my winning entry and my future ambitions 😊
École
@Polytechnique
congratulates Kayo Yin, Graduate of
@Bachelor_X
program, who has been awarded the 2020 Global
@UndergradAward
in Computer Science for her Bachelor thesis on “Sign Language Translation with Transformers”! 🏆👏🎉
➡️ More info:
I played Brahms' Hungarian Dances No. 1-5 at
@CMU_CFA
Chamber Music recital 🎹🎶
It was my first time performing a piano four hands and I had so much fun, I can't wait to play more piano duets! (people in Berkeley, lmk if you'd like to play together 🤩)
I had a great time visiting EPFL to talk about current challenges in AI for signed languages and my recent research on American Sign Language! Thanks
@ICepfl
@ABosselut
😄
Happy to share slides upon request, DMs are open. I also plan to post them publicly within 1-2 months!
I started journaling in 2021 and just completed my first 160-page journal! I'm grateful how this new habit helps me document how everything is temporary, even when I feel stuck each new day brings me a step closer to my goals, and all things will turn out good enough with time☀️
I'm endlessly thankful to
@gneubig
who gave me tremendous support the past 2 years❤️Joining CMU and meeting Graham are two of the luckiest things to happen to me, I'm so grateful to have such a skilled and supportive advisor who helped me achieve more than I ever thought I could!
I joined the chamber music program
@CMUmusic
this semester where I will be learning collaborative piano! 🎹
I'll start with a selection of Brahms Hungarian Dances 💃 as 2/4 of a four-hands piano 🥳 I'm so excited to have piano lessons again!
How did I just learn that CMU is one of the only schools offering a major in bagpipes, now I want to orient my master towards a CS-bagpipes double degree 😍