Abhishek Das Profile Banner
Abhishek Das Profile
Abhishek Das

@abhshkdz

6,348
Followers
221
Following
318
Media
2,818
Statuses

Building something new. Prev: Research Scientist at FAIR @Meta & @OpenCatalyst , PhD at @GeorgiaTech .

San Francisco
Joined October 2009
Don't wanna be here? Send us removal request.
Pinned Tweet
@abhshkdz
Abhishek Das
6 months
Update: I left Meta yesterday. Working on @OpenCatalyst at FAIR has been one of my most cherished career journeys. The team's really strong, with ambitious step-change research in the pipeline. I'm rooting for them! As for what's next, excited to build something new! Stay tuned
32
4
427
@abhshkdz
Abhishek Das
3 years
Useful advice for (not just) PhD students from @AustinZHenley
Tweet media one
5
136
785
@abhshkdz
Abhishek Das
5 years
Excited to share that I successfully defended my PhD day before yesterday! Huuuge thanks to @DhruvBatraDB and @deviparikh for being amazing mentors on this journey!
Tweet media one
18
8
521
@abhshkdz
Abhishek Das
4 years
Delighted to share that my PhD thesis won the GT Sigma Xi and College of Computing awards! Thesis pdf: GT Sigma Xi: GT CoC:
Tweet media one
Tweet media two
29
10
507
@abhshkdz
Abhishek Das
5 years
Accepted at #ICML2019 🎉
@abhshkdz
Abhishek Das
6 years
New preprint! TarMAC, a simple and effective architecture for learning targeted communication protocols in multi-agent RL. Leads to intuitive cooperation strategies on diverse environments. w/ @theo_gervet , Joshua, @DhruvBatraDB , @deviparikh , Mike, Joelle
2
25
110
9
13
225
@abhshkdz
Abhishek Das
3 years
We're looking for research interns to join us at FAIR as part of . If you're a PhD student interested in graph neural networks for modeling atomic relaxations, that will then be used to explore catalysts for renewable energy storage, please reach out to me!
5
42
170
@abhshkdz
Abhishek Das
4 years
Introducing — @deviparikh and my attempt at reducing some of the information asymmetry in industry job offers in AI. Consider using this as a reference for negotiations. Covers a tiny slice of companies in US atm but should get wider coverage over time.
@deviparikh
Devi Parikh
4 years
Introducing AI Paygrades ()! Statistics of industry offers for AI jobs. The goal is to reduce information assymetry so candidates can make informed decisions and negotiate better. Submit your information and spread the word! With @abhshkdz .
42
234
1K
2
26
168
@abhshkdz
Abhishek Das
4 years
Excited for the first major release of , result of a wonderful ongoing collaboration b/w FAIR and CMU. Our goal is to use ML to accelerate the search for low-cost catalysts that can drive reactions converting renewable energy to storable forms. (1/8)
3
18
165
@abhshkdz
Abhishek Das
6 years
Excited and honored to announce that I was selected for the Facebook fellowship this year!
10
2
154
@abhshkdz
Abhishek Das
7 years
Panoptic Segmentation, neat work from FAIR / Heidelberg University on unifying instance and semantic segmentation, and a new intuitive evaluation metric for the task, with human studies + machine baselines
Tweet media one
0
53
147
@abhshkdz
Abhishek Das
4 years
Astronauts flying around in space at 27k+ km/hr, launched on a reusable rocket, all being globally livestreamed from multiple camera angles with commentary. What a time. 🌎🚀
Tweet media one
1
7
148
@abhshkdz
Abhishek Das
3 years
Happy to share that @paperswithcode will now be running ! It's been fun to see this random side project evolve into something so many from the AI community use (20k-30k active users / month) and help maintain (600+ forks, 300+ PRs)!
@paperswithcode
Papers with Code
3 years
🤝 Papers with Code is now helping to maintain . AI Conference Deadlines makes it easy to find and follow conference deadlines in areas such as machine learning and NLP. Thanks to @abhshkdz for this great initiative.
Tweet media one
2
72
292
2
11
146
@abhshkdz
Abhishek Das
7 years
Adversarial training + REINFORCE for Visual Dialog Nice results! State-of-the-art on VisDial
Tweet media one
Tweet media two
0
56
143
@abhshkdz
Abhishek Das
4 years
How much environment knowledge can an agent learn purely through self-supervised egocentric prediction? We measure this by asking it questions (in English)! #ICML2020 paper from my internship at @DeepMind . [1/4]
1
18
138
@abhshkdz
Abhishek Das
3 years
Honored to be selected as a runner-up for the 2020 AAAI/ACM SIGAI Dissertation Award! Huge thanks to the committee, my mentors and collaborators. I had the time of my life during my PhD, and often joke about how I might gladly do another :)
@RealAAAI
AAAI
3 years
Congratulations to David Abel (A Theory of Abstraction in Reinforcement Learning) and Abhishek Das (Building Agents that Can See, Talk, and Act) for Honorable Mentions for the 2020 AAAI/ACM SIGAI Dissertation Award. #AAAI2022
0
7
33
8
5
125
@abhshkdz
Abhishek Das
6 years
New preprint! TarMAC, a simple and effective architecture for learning targeted communication protocols in multi-agent RL. Leads to intuitive cooperation strategies on diverse environments. w/ @theo_gervet , Joshua, @DhruvBatraDB , @deviparikh , Mike, Joelle
2
25
110
@abhshkdz
Abhishek Das
6 years
ML research tool idea: self-updating academic benchmarks; that auto-scrapes arxiv, parses pdfs to build a unified table of results (on say CIFAR, Imagenet, COCO, etc.). Easily exportable to latex, csv. Should make it v easy to answer “What is the current state-of-the-art on X?”.
13
9
105
@abhshkdz
Abhishek Das
5 years
Just came across this year's Google Summer of Code ( @gsoc ) stats: Heartening to see my alma mater, @iitroorkee , top this year's list of schools with the most accepted students! 😃 Kudos to @sdslabs and everyone involved! 💪💥
1
10
104
@abhshkdz
Abhishek Das
5 years
Is it even a real deadline if Overleaf doesn't go down? #CVPR2020
4
3
104
@abhshkdz
Abhishek Das
8 years
Our latest work on 'Learning Cooperative Visual Dialog Agents with Deep RL'
Tweet media one
4
37
97
@abhshkdz
Abhishek Das
6 years
That one day of the year you spend all day updating your bashrc / zshrc, vimrc, tmuxrc, gitconfig, sublime plugins, latex snippets, themes, fonts, colors at the cusp of transforming into an unstoppable maximally productive force of nature :)
3
6
86
@abhshkdz
Abhishek Das
2 years
Super excited to share AdsorbML (from @OpenCatalyst ): We show that machine learning can speed up density functional theory calculations for computing adsorption energies by * 1300x * at 85% accuracy (and by up to * 4000x * at 75% accuracy). 🧵
Tweet media one
4
22
83
@abhshkdz
Abhishek Das
3 years
We just announced the winners of the Open Catalyst Challenge #NeurIPS2021 ! Congratulations to @MSFTResearch Asia for winning the challenge with their 3D-Graphormer approach to relaxed energy prediction! 🏆🎉 Learn more: @OpenCatalyst @MetaAI @CMU_ChemE
Tweet media one
1
13
85
@abhshkdz
Abhishek Das
6 years
Yesterday we released data + code for our CVPR 2018 paper on EmbodiedQA. Train embodied agents for navigation and question answering in environments! Data: Code:
2
19
84
@abhshkdz
Abhishek Das
8 years
Excited to share our latest work on generating visual 'explanations' for CNN-based models Work led by @ramprasaath21
Tweet media one
2
27
79
@abhshkdz
Abhishek Das
4 years
We're looking for research interns to come work with us as part of at FAIR. Applicants need to be PhD students, ideally interested in graph neural networks / ML for climate change, and available for 12-16 weeks over summer 2021. Get in touch with me!
5
26
82
@abhshkdz
Abhishek Das
6 years
Code + pretrained model for single model winning entry (and overall runner-up) in this year's VQA challenge at #CVPR2018 out already. Cool stuff!
0
24
81
@abhshkdz
Abhishek Das
7 years
Two papers accepted at #ICCV2017 ! 🎉🎊🍾🥂
Tweet media one
8
0
74
@abhshkdz
Abhishek Das
4 years
Tried acrylic pouring today!
2
0
74
@abhshkdz
Abhishek Das
6 years
Excited to announce v1.0 of the VisDial dataset! Evaluation servers for the Visual Dialog Challenge are now open! Details: Evaluation server: (with @SatwikKottur @deshrajdry @kdexd @ayshrv Stefan @deviparikh @DhruvBatraDB )
1
23
73
@abhshkdz
Abhishek Das
7 years
Detectron, huuuge object detection code + model release from Ross Girshick et al. at FAIR, 70+ pretrained models and performance baselines!
0
20
69
@abhshkdz
Abhishek Das
6 years
CVPR19 decisions are out! (Obligatory) acceptance vs. paper ids plot :) Looks fairly even (much nicer than CVPR17, ICCV17). Earlier versions:
Tweet media one
@abhshkdz
Abhishek Das
7 years
Acceptance vs. paper id for CVPR/ICCV. CVPR18 looks a lot more evenly distributed than last few cycles (could be due to reviewer fatigue / worse paper quality <—> later registrations / changes in policy that I don't know of).
Tweet media one
Tweet media two
Tweet media three
2
14
39
1
12
70
@abhshkdz
Abhishek Das
5 years
Depressing every time I realize there are more great books / podcasts than I'll ever have the time to read / listen to
3
2
70
@abhshkdz
Abhishek Das
2 years
I'm at #NeurIPS2022 ! Happy to chat about @OpenCatalyst and FAIR. We're also looking for research interns and residents for 2023, so please get in touch if you're interested.
4
3
68
@abhshkdz
Abhishek Das
6 years
New state-of-the-art on Visual Dialog! Multi-step attention architecture from Gan et al. / Microsoft. (Compares against published and unpublished work :)).
Tweet media one
Tweet media two
Tweet media three
1
22
69
@abhshkdz
Abhishek Das
6 years
Slides for our #acl2018 tutorial are now up on ! Tying together relevant ideas/works in a single coherent story took a fair bit of heavy-lifting. Was a fun exp. overall! We hope it was useful, and any feedback is very welcome :)
Tweet media one
1
20
66
@abhshkdz
Abhishek Das
8 years
Our paper on Visual Dialog () was accepted at #CVPR2017 (as spotlight)! Congratulations team!
Tweet media one
3
11
64
@abhshkdz
Abhishek Das
6 years
Announcing the 1st Visual Dialog Challenge! Build dialog agents to hold conversations in natural language about visual content. Winners to be announced at ECCV 2018! Brought to you by @SatwikKottur @deshrajdry @kdexd Stefan Lee @deviparikh @DhruvBatraDB
0
22
63
@abhshkdz
Abhishek Das
3 years
California putting on a great show today
Tweet media one
Tweet media two
Tweet media three
1
0
62
@abhshkdz
Abhishek Das
5 years
Excited to announce the 3rd #NeurIPS2019 workshop on Visually-Grounded Interaction and Language (ViGIL)! We have an exciting lineup of speakers: — Linda Smith — Josh Tenenbaum — Jay McClelland — Lisa Anne Hendricks — Jesse Thomason (more to be added)
1
11
60
@abhshkdz
Abhishek Das
3 years
Weekend trip to Lake Tahoe; beautiful as always
Tweet media one
1
1
59
@abhshkdz
Abhishek Das
5 years
* Visual Dialog challenge update * ~300 submissions from ~40 teams so far! ~One month to go! $10k in GCP credits to be won! Winners TBA at CVPR. Pytorch starter code now supports both generative & discriminative models:
1
11
58
@abhshkdz
Abhishek Das
3 years
now has ~120+ verified offers! Huge thanks to Rora () for contributing ~75 of them (with permission) Those on the AI job market this year -- consider adding your data if you're comfortable. More data on this = lesser info asymmetry
2
4
60
@abhshkdz
Abhishek Das
2 years
Did the Grand Canyon rim-to-rim this past weekend. ~24 miles total, -5k ft down, +6k ft up, 100+ temperatures. Probably the most physically challenging hike I’ve done, but gorgeous views all throughout!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
5
0
59
@abhshkdz
Abhishek Das
5 years
Spent the last week in Kerala with my family. 🌴🌅😃❤️
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
0
58
@abhshkdz
Abhishek Das
7 years
Excited to be co-orgnizing the NIPS 2017 wrkshop on Visually-Grounded Interaction & Language! Submissions due Nov 3!
2
14
53
@abhshkdz
Abhishek Das
7 years
Super excited for #CVPR17 ! Presenting my 1st CVPR paper: Visual Dialog, as a conference spotlight + an invited talk at the VQA workshop :)
0
2
51
@abhshkdz
Abhishek Das
3 years
Still some rough edges, but developing this for @fx_hash_ #fxhash #generative #creativecoding #p5js
1
5
49
@abhshkdz
Abhishek Das
6 years
Huge thanks to @deviparikh @DhruvBatraDB for being amazing mentors! 🍻 And thank you @ICatGT for the wonderful article 🙌🏽
@DhruvBatraDB
Dhruv Batra
6 years
Can confirm -- @abhshkdz is indeed pursuing some pretty cool research! #ProudAdvisorMoment @mlatgt @gtcomputing
1
4
63
0
0
49
@abhshkdz
Abhishek Das
5 years
Attending #NeurIPS2019 till Friday! Come say hi if you want to discuss grounded language learning or climate change or how to survive a PhD or just want to go get some sushi :)
2
1
50
@abhshkdz
Abhishek Das
7 years
ICLR18 Reproducibility Challenge Excellent opportunity to validate + accelerate research in ML!
3
29
49
@abhshkdz
Abhishek Das
6 years
New architecture for embodied question answering: decomposing navigation into high-level, interpretable subgoal prediction and low-level control Presenting as a spotlight at #corl2018 . Work done with Georgia Gkioxari, @stefmlee , @deviparikh , @DhruvBatraDB
Tweet media one
1
11
48
@abhshkdz
Abhishek Das
7 years
(Nice surprise at the end of a 13hr long flight!) Thanks @Snap for the fellowship! 🙌🏼
10
1
48
@abhshkdz
Abhishek Das
7 years
Happy to be presenting (along with @panderson_me and Qi Wu) a tutorial on language, vision and actions at ACL 2018!
1
8
49
@abhshkdz
Abhishek Das
4 years
Excited to share a couple of updates on the Open Catalyst Project! We've updated our paper with DimeNet++ (Klicpera et al.) results: . This is now the best-performing model for ML-driven relaxations on this task (still far from practical use tho). (1/3)
Tweet media one
1
5
47
@abhshkdz
Abhishek Das
6 years
Earlier today, Facebook CTO Mike Schroepfer mentioned our work on Embodied Question Answering () at F8!
Tweet media one
1
3
46
@abhshkdz
Abhishek Das
7 months
EquiformerV2 was accepted at #ICLR2024 ! EquiformerV2 is the result of (Yi-Lun's) careful empirical analysis of how to incorporate efficient equivariant convolutions into transformers, resulting in an architecture that scales surprisingly well across atomic datasets.
@yilunliao
Yi-Lun Liao
7 months
🧵(1/7) Excited to share that our work, EquiformerV2, has been accepted to #ICLR2024 . EquiformerV2 is the state-of-the-art on large-scale atomistic benchmarks -- OC20, OC22, AdsorbML, and ODAC23. Joint work with @bwood_m , @abhshkdz from @OpenCatalyst and @tesssmidt Paper:
Tweet media one
2
33
167
0
4
46
@abhshkdz
Abhishek Das
3 years
Malika Favre in Fidenza. For today's prompt, "trade styles with a friend", I drew inspiration from a couple of artists whose works I love. @malikafavre 's Terrain Vague x @tylerxhobbs ' Fidenza. #genuary #genuary2022 #generative #creativecoding #p5js
Tweet media one
4
3
43
@abhshkdz
Abhishek Das
6 years
IIT Roorkee (my alma mater) tops this year's Google Summer of Code accepted candidates' list! Woot!
@harshasha256
Harsha Sharma
6 years
Pretty cool!! IIT Roorkee stands I with maximum no. of selections in gsoc.
0
10
32
2
3
44
@abhshkdz
Abhishek Das
3 years
New #ICLR2022 paper on Graph Parallelism () — a distributed training method for GNNs with higher-order interactions (triplets / quadruplets) common in modeling atomic systems. Work led by @anuroopsriram as part of @OpenCatalyst .
Tweet media one
3
9
45
@abhshkdz
Abhishek Das
6 years
Just finished reading Elephant in the Brain by Simler and Hanson. By far one of the most (almost depressingly) influential books I've read in a while. Irrespective of whether you agree / disagree, like / hate what's said, helps build an accurate world model. Highly recommended.
2
1
44
@abhshkdz
Abhishek Das
5 years
(~tiny) update: calendar now lists abstract deadlines as well. .ics: subscribe via google calendar:
0
6
44
@abhshkdz
Abhishek Das
5 years
I'll be presenting "TarMAC: Targeted Multi-Agent Communication" today at #ICML2019 . Joint work with @theo_gervet , Josh, @DhruvBatraDB , @deviparikh , Mike, Joelle ( @mlatgt @facebookai ). Talk at 5pm in Hall B. Slides: Paper:
@abhshkdz
Abhishek Das
5 years
Accepted at #ICML2019 🎉
9
13
225
2
7
45
@abhshkdz
Abhishek Das
7 years
Interesting results from this year's Stack Overflow >100k developer survey — TF is most loved, torch/pytorch 3rd (against React / Node / Django etc.) — More excited about possibilities than potential dangers of AI — Sufficiently concerned about AI biases
Tweet media one
Tweet media two
Tweet media three
2
11
45
@abhshkdz
Abhishek Das
6 years
In Montréal for a summer internship; first thought — feels good to be back in metric-system-land and not have do mental math to go from pixels to understanding :)
3
2
43
@abhshkdz
Abhishek Das
3 years
10,000 circles, 2022 yet to be colored. #genuary #genuary2022 #generativeart
Tweet media one
2
1
39
@abhshkdz
Abhishek Das
5 years
Recently watched Joker and absolutely loved it. Dark, intense, thought-provoking. Flips the typical villain narrative on its head. Ferocious performance by Joaquin Phoenix 🙏🏽 Watch if you haven't already. Highly recommended.
1
0
44
@abhshkdz
Abhishek Das
5 years
23 extra minutes of daily commute has the same effect on happiness as a ~19% reduction in income! :o (controlled for a lot of ~obvious response biases) From Stress That Doesn't Pay: The Commuting Paradox (Stutzer and Frey, 2004)
Tweet media one
1
3
41
@abhshkdz
Abhishek Das
4 years
This looks delightful :) On-the-fly in-browser 2D —> 3D photos.
@cyrildiagne
Cyril Diagne
4 years
Just pushed the code of a chrome extension that turns every Instagram posts into 3d images using #3DPhotoInpainting . No GPU needed thanks to @GoogleColab but a bit of patience to set it up ;-) Demo: @parrstudio 's amazing work Code: #AIUX #Interaction #ML
38
612
2K
0
4
40
@abhshkdz
Abhishek Das
7 years
😀🙌🎉🍾
@DhruvBatraDB
Dhruv Batra
7 years
Congrats to @ICatGT and @mlatgt PhD students @abhshkdz and Patsorn Sangkloy on being selected for 2018 @Adobe Fellowship. @abhshkdz 's second fellowship this year. Nice going :-).
Tweet media one
2
1
33
0
1
41
@abhshkdz
Abhishek Das
6 years
View of Sigiriya from Pidurangala
Tweet media one
1
0
39
@abhshkdz
Abhishek Das
8 years
Visual Dialog update — Releasing v0.5 dataset (reported in arxiv paper) and code for data collection chat interface
0
17
40
@abhshkdz
Abhishek Das
3 years
Ran my first 10-miler yesterday (and didn’t die)!
Tweet media one
1
0
39
@abhshkdz
Abhishek Das
7 years
Acceptance vs. paper id for CVPR/ICCV. CVPR18 looks a lot more evenly distributed than last few cycles (could be due to reviewer fatigue / worse paper quality <—> later registrations / changes in policy that I don't know of).
Tweet media one
Tweet media two
Tweet media three
2
14
39
@abhshkdz
Abhishek Das
6 years
RescueTime log from #iclr2019 deadline day — ~18h of sublime text + localhost:8000 + iterm + omnigraffle + skim + overleaf :)
Tweet media one
1
1
39
@abhshkdz
Abhishek Das
6 years
(Super useful) ML reproducibility checklist put together by Joelle Pineau
0
11
38
@abhshkdz
Abhishek Das
6 years
Join @panderson_me , Qi Wu and me for our @acl2018 tutorial on Connecting Language and Vision to Actions tomorrow! July 15, 9:30 AM — 12:30 PM, Room 218, MCEC. Peter made a cool viz showing some of the topics we'll be covering :)
1
9
38
@abhshkdz
Abhishek Das
5 years
My #ICLR2020 peer review review: Kudos to the one (and only) high-quality reviewer out of six across two papers. (Also the only one that recommended rejection ¯\_(ツ)_/¯)
0
0
38
@abhshkdz
Abhishek Das
6 years
The Visual Dialog Challenge was featured in this month's CV news Deadline in 2 weeks! Winners to be announced at ECCV 2018 in Munich!
0
9
38
@abhshkdz
Abhishek Das
6 years
Cool paper from AI2 on meta learning for visual navigation Learns a self-supervised interaction loss function to quickly adapt in unseen environments
Tweet media one
2
16
35
@abhshkdz
Abhishek Das
2 years
Gorgeous colors in the Adirondacks this weekend🍁
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
0
37
@abhshkdz
Abhishek Das
6 years
Pleasantly surprised to see google analytics after a while: ~3k users / week, ~11k / month. w00t!
Tweet media one
Tweet media two
1
2
36
@abhshkdz
Abhishek Das
3 years
Plotted some of these alphabets today! #genuary #genuary2022
1
2
35
@abhshkdz
Abhishek Das
7 years
End of a [vision, language, action]-packed summer at FAIR! :)
Tweet media one
0
0
34
@abhshkdz
Abhishek Das
6 years
Labmates Nirbhay and Viraj released a very nice-looking, clean pytorch implementation of our ICCV17 paper on Cooperative Visual Dialog Agents
1
10
35
@abhshkdz
Abhishek Das
3 years
Roommates introduced me to Gaia Project this weekend, and we ended up playing a marathon 7-hour game! Way too many rules to keep track of, but amazing game design and space colonization theme; it’s now overtaken Terraforming Mars as my new favorite :)
Tweet media one
2
0
34
@abhshkdz
Abhishek Das
7 years
Very cool! Write-up: Code:
@RichardSocher
Richard Socher
7 years
State of the art, single model, visual question answering. Amazing performance! #cs224n
Tweet media one
0
3
53
0
9
35
@abhshkdz
Abhishek Das
7 years
Wrote a short @mlatgt blog post on EmbodiedQA
0
6
35
@abhshkdz
Abhishek Das
3 years
Glitchy gradients. Made with a lot of input from @chandy__r . And learnt about shaders today! #genuary #genuary2022 #generative #creativecoding #p5js
Tweet media one
1
6
33
@abhshkdz
Abhishek Das
5 years
🐶🌤️
Tweet media one
0
1
34
@abhshkdz
Abhishek Das
7 years
🙃
Tweet media one
0
0
33
@abhshkdz
Abhishek Das
4 years
😍
Tweet media one
1
0
32
@abhshkdz
Abhishek Das
2 years
It’s nice to be back to #CVPR2022 :)
Tweet media one
Tweet media two
Tweet media three
0
2
34