Jong Wook Kim ๐Ÿ’Ÿ Profile Banner
Jong Wook Kim ๐Ÿ’Ÿ Profile
Jong Wook Kim ๐Ÿ’Ÿ

@_jongwook_kim

3,854
Followers
484
Following
11
Media
298
Statuses

Member of Technical Staff @OpenAI , authored CLIP and Whisper; previously at @nyuMARL , @SpotifyResearch , @pandoramusic , @kakaocorpglobal , and @NCSOFT

United States
Joined December 2010
Don't wanna be here? Send us removal request.
Pinned Tweet
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
8 months
OpenAI is nothing without its people
10
34
594
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
8 months
โ™ก
@sama
Sam Altman
8 months
i love the openai team so much
5K
4K
73K
8
16
380
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
1.7x fewer tokens in Korean, which means GPT-4o feels 3.4x faster to Korean users!
Tweet media one
21
32
267
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
9 months
I can finally say that my voice in Whisper's ICML presentation video was AI-generated ๐Ÿ˜„
5
11
170
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 years
Whisper is now available in Hugging Face transformers! Happy to learn that it's become more accessible to the ๐Ÿค— community and hoping it enables lots of amazing applications!
@art_zucker
Arthur Zucker
2 years
โฐโžก๐Ÿ‘†We just released Whisper in ๐Ÿค— transformers! @openai โ€™s latest speech recognition transformer trained on 680 000 hours of audio! For example use case, check this notebook :
Tweet media one
18
174
987
2
15
94
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
4 years
@seeingwithsound @ilyasut The smallest CLIP model is available at . Itโ€™s larger than typical models for mobile, but I think it can fit and run (slowly) on mobile devices.
3
22
75
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
Iโ€™m a doctor!
Tweet media one
8
4
62
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
MusicNet Inspector: Browse the MusicNet dataset and explore how the labels look like while enjoying the music! (feedback welcome)
Tweet media one
0
13
34
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
CLIP is secretly a music generation model!
@drscotthawley
Scott H. Hawley
3 years
Prompt: "a mel-spectrogram of an electric guitar playing" (VQGAN+CLIP) Won't sound great but will throw it into Griffin-Lim... You can kinda see little guitar shapes ๐Ÿคฃ
Tweet media one
2
14
134
0
1
21
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
The largest GPT-2 model is now LIVE! So happy to have participated in the detection work which marks my first (co-authored) publication at @OpenAI :D Check out the new blog post and the report for our latest findings and thoughts.
@OpenAI
OpenAI
5 years
We're releasing the 1.5billion parameter GPT-2 model as part of our staged release publication strategy. - GPT-2 output detection model: - Research from partners on potential malicious uses: - More details:
Tweet media one
58
620
2K
0
2
17
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
GPT-4o is way better at optical character recognition in non-English / non-Latin script languages!
@Deyoyoyo
ใงใ‚‡
2 months
ใ“ใ‚ŒใฏๅฎŸ็”จๆ€ง้ซ˜ใ„ ๅทฆ:gpt-4o ๅณ:gpt-4
Tweet media one
Tweet media two
104
7K
37K
1
1
15
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
4 years
Make TFRecords Usable Again!
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
4 years
@keunwoochoi Now available with a file-level iterator that works without tensorflow :D
0
0
5
1
1
12
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
Visualizing the MusicNet dataset for sanity check... I need to find the best way (for a machine) to learn music from these
1
4
13
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
So excited to attend @ismir2019 and present my latest work at @nyuMARL ! Flying to the Netherlands today๐Ÿš€
Tweet media one
0
2
11
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
Closely related to the Nature paper, my wonderful wife @nayoung_jun 's PhD research during the past few years is now on bioArXiv!
1
0
10
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
4 years
And a shoutout to @sveltejs which made building the explorer so easier and faster!
@prafdhar
Prafulla Dhariwal
4 years
Excited to finally release what we've been working on since June! Jukebox is a small step in making neural nets produce music! Thanks to my collaborators Heewoo, @mcleavey , @_jongwook_kim , @AlecRad , @ilyasut , this work wouldnโ€™t be possible without them!
18
44
195
0
2
8
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
@Prashant_1722 Yes! GPT-4o has significantly improved speech recognition accuracy across languages. We don't have multilingual OCR evaluations like this yet, but you can try on the ChatGPT app!
Tweet media one
0
0
6
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@ClementDelangue Thanks for putting up the web interface! The model is hardly perfect, but we hope this can spark further discussions in detection studies. The current model is only for GPT-2, and itโ€™d be very interesting to build a โ€œfits-allโ€ detector that works with many different generators.
0
0
6
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
@mynameisdjkim ์•„๋ž˜ ์ธ์šฉํ•˜์‹  ๋ถ„ ํฌํ•จ ๋Œ€๋ถ€๋ถ„ ๊ฐ€์งœ์ž…๋‹ˆ๋‹ค. ๋‹จ์ˆœ ๊ฐœ๋“œ๋ฆฝ๋„ ์žˆ์ง€๋งŒ ์˜๋„์ ์œผ๋กœ ์ธ๊ธฐ ํ‚ค์›Œ๋“œ์— ์˜ฌ๋ผํƒ€์„œ ํด๋ฆญ์œ ๋„ํ•˜๋ ค๋Š” ๋ชฉ์ ์ด ์ปค์š”
1
5
5
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@lostanlen Vincent Lostanlen presents periodic modulation recognition in music signals
Tweet media one
0
2
5
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
What does retinal structure tell about the information efficiency of mammalian vision? Find out in @DukeTodayUpdate 's coverage on @nayoung_jun 's recent publications.
0
1
5
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
Good morning #ISMIR2019 !
Tweet media one
1
0
4
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
@id62ai 27->23 tokens with this ChatGPT-provided translation "Halo, nama saya GPT-4o. Saya adalah jenis model bahasa baru, senang bertemu dengan Anda!". Token savings are bigger with the non-Latin alphabet languages. You can try yourself with Tiktoken !
6
0
4
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 years
Nature is beautiful!
@nayoung_jun
Nayoung Jun
2 years
Moreover, the number of cell types depends on the number of available RGCs (=channel capacity)! As we allow more neurons, the RFs are initially small in space and integrating in time; with larger numbers, RFs are larger in space and differentiating in time.
1
1
10
0
0
4
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
0
0
4
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@GretchenMarina @OpenAI @IreneSolaiman OMG I love it!!!!! Iโ€™m crying now
0
0
3
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
@RiversHaveWings @pbaylies @danielrussruss I realize the legend is confusing; in that figure we meant "CLIP" as the general contrastive (language-image) pre-training method, and for that figure we still used BOW as input. Released CLIP models use transformer text encoder which can be thought of as a glorified bag of words
0
0
3
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
๐ŸŽŠ๐Ÿ‘๐Ÿผ๐Ÿ‘๐Ÿป๐Ÿ‘ฉ๐Ÿปโ€๐ŸŽ“๐Ÿง ๐Ÿ–ฅโค๏ธ
@nayoung_jun
Nayoung Jun
3 years
Such a precious experience, getting to meet and learn with these awesome people every day. Didn't believe it when people said you learn so much more by teaching than as a student, but now I fully admit it. Probably the 3-weeks period that I have grown THE most. Thanks @neuromatch
Tweet media one
1
2
44
0
0
3
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
Just have reset this account, hoping to keep it somewhat official, tweeting technical and research stuff primarily.
0
1
2
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 years
Great walkthrough! Thanks @gordic_aleksa
@gordic_aleksa
Aleksa Gordiฤ‡ ๐Ÿฟ๐Ÿค–
2 years
[๐Ÿง ๐Ÿ‘จโ€๐Ÿ’ป ML Coding Series ๐Ÿ‘จโ€๐Ÿ’ป๐Ÿง ] Kicking off a machine learning coding series! I'll be deep-diving into the code behind many of the ML papers I've covered over the last few years - starting with @OpenAI 's CLIP! YT: @AlecRad @_jongwook_kim @ilyasut 1/
Tweet media one
1
14
104
0
0
2
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
Turns out that the MusicNet labels are not quite reliable. Track 1817 has a totally different music between 0:10 and 0:40. It also contains oboe as opposed to the label.
1
1
2
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
8 months
@BorisMPower @jeremyphoward Thatโ€™s how I added mine!
0
0
2
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
1
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
9 months
@heiga_zen Thank you for paving the way! ๐Ÿ˜
1
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 years
๐Ÿคฏ
@benbarry
Ben Barry
2 years
I spent most of this past weekend experimenting with DALLยทE 2, OpenAIโ€™s new AI system that can create realistic images from a written description. I curated a book of 1000 robot paintings. You can view the entire thing online at #dalle
Tweet media one
42
252
1K
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@jordiponsdotme Thank you Dr. Puig!
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
@naotokui ไปŠใพใง่ฆ‹ใŸCLIPใ‚’ไฝฟใฃใŸ็”Ÿๆˆใƒขใƒ‡ใƒซใฎไธญใงไธ€็•ชๆฐ—ใซๅ…ฅใฃใŸๅฟœ็”จใงใ™๏ผColabใพใงใ‚ใ‚ŠใŒใจใ†ใ”ใ–ใ„ใพใ™๐Ÿ˜Š
1
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@neomoha Thank you Moha! Happy Thanksgiving!
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@deeplearnmusic Congratulations, Stefan!
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@QhansaD Thanks :D:D
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
4 years
@seeingwithsound Forward-pass compute for the image encoder is about 4.5 GFLOPs, so it should be possible with modern mobile processors, although I have no experience on mobile AI. (I should also mention that it is intended for research and not for any deployed use cases)
1
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@finneco Thank you senpai!
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
2 months
@Aizkmusic Sorry, fix on the way!
2
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
@GregDField
Greg D. Field
3 years
Latest work from our lab published in Nature today. Proud of the terrific effort and creativity of โฆ @roy_suva โฉ and โฆ @nayoung_jun โฉ and of our colab with โฆ @jmxpearson โฉ. We show efficient coding -> coordinated tiling across cell types.
19
47
205
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
8 months
@neomoha Hi Moha, thank you so much for your support๐Ÿค So glad to hear from you and letโ€™s get some beer or something when this is over
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
0
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
5 years
@colinraffel @unccs Awesome news, congratulations!
1
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
@keunwoochoi Does BytesIO work?
2
0
1
@_jongwook_kim
Jong Wook Kim ๐Ÿ’Ÿ
3 years
@ocelma @Spotify Congratulations, Oscar!
0
0
1