Remi Cadene @RemiCadene Twitter profile

Pinned Tweet

Remi Cadene

2 months

Meet LeRobot, my first library at @huggingface robotics 🤗 The next step of AI development is its application to our physical world. Thus, we are building a community-driven effort around AI for robotics, and it's open to everyone! Take a look at the code:

35

211

818

Last Seen Profiles

@rawslaw5

@bevans_98

@ratzlaff_tanner

@Michael00254731

@Henrietta3119

@PorvenirOficial

@MrGervaisWrites

@VukVikingson

@saviorcmlpx

@basesbf

@Brysonbrown20

@ModernDaySins

@Kougamet

@HsamDyaly

@joeochman

@ooc_urd

@_workless_

@stephwcampbell

@YACAD_Bradford

@WillieRJ81

@CindieEnge10478

@clement_Animate

@kyler_beaty

@evligiz60125833

@SAGEUNIVERS3

@devilininio

@Ay_Kudirat

@Bull_Alfa23

@mmbecs

@Mauro_Mateos

@bowenc0221

@junjun5281990

@galery_basah10

@NeveahDfishbate

@LukeSchoonmaker

@ssudanii

Remi Cadene

@RemiCadene

6 months

Big news for me. I left Tesla! I’ve been very fortunate to be part of the Autopilot and Optimus teams. Five years ago, I started as an intern with Andrej, witnessing the impressive achievements of a small team. At this time, I improved the neural backbone, a fundamental module

144

86

2K

Remi Cadene

@RemiCadene

4 months

After 3 years @tesla and Optimus, I am thrilled to announce that I joined Hugging Face to start an ambitious open robotics project! (open as in open-source, not as in Open AI) Looking for engineers to build real robots in Paris 🇫🇷 🤖🤗

125

188

2K

Remi Cadene

@RemiCadene

10 months

We are making fast progress! Come join us 😃

Tesla Optimus

@Tesla_Optimus

10 months

Optimus can now sort objects autonomously 🤖 Its neural network is trained fully end-to-end: video in, controls out. Come join to help develop Optimus (& improve its yoga routine 🧘) →

3K

8K

35K

33

59

866

Remi Cadene

@RemiCadene

10 days

Yeah! Teleoperation on low-cost robot arm from @taurobots working natively at 200Hz with and a very simple code. We are working a video tutorial to make it easy for anyone to reproduce our setup (in simulation or with a real robot). Stay tuned 😋

16

49

441

Remi Cadene

@RemiCadene

7 months

With end-to-end self-driving, TeslaAI is building a powerful causal agent that learns to take the optimal decisions in the real world.

Tesla AI

@Tesla_AI

7 months

Tesla AI is building next-generation autonomy on a single foundation video network that directly drives the car Join the team and build state-of-the-art end-to-end models using massive fleet data on one of the world's largest training clusters

469

1K

6K

12

17

254

Remi Cadene

@RemiCadene

29 days

We made Reachy2 from @pollenrobotics autonomously doing household chores and interacting with us. It can move its full body, including its neck. Even the dog was impressed! 🐶 You can do the same at home on smaller robots with and

21

75

260

Remi Cadene

@RemiCadene

10 months

Congrats to tesla autopilot team! I was totally mind blown when I first tried the end-to-end version.

Elon Musk

@elonmusk

10 months

15K

27K

166K

4

14

251

Remi Cadene

@RemiCadene

7 months

What the neck! 😬

Tesla Optimus

@Tesla_Optimus

7 months

There’s a new bot in town 🤖 Check this out (until the very end)!

3K

7K

31K

7

1

251

Remi Cadene

@RemiCadene

2 months

Now testing repeatability of data collected with and . Stay tuned 😁

3

25

183

Remi Cadene

@RemiCadene

1 month

Collecting data at @pollenrobotics in Bordeaux 🇫🇷! Impressed by their low latency teloperation through VR. You can control the full mobile body and the neck of the robot to see through its eyes 👀 This cool robot is called Reachy2 and you can buy it soon.

7

17

180

Remi Cadene

@RemiCadene

21 days

Did you miss that @Stanford open-sourced a humanoid robot dataset? We just made it available on @huggingface hub to allow everyone to train their own humanoid robot with LeRobot: Here is a cool visualization with @rerundotio . More in this thread 🧵

Zipeng Fu

@zipengfu

22 days

Introduce HumanPlus - Shadowing part Humanoids are born for using human data. We build a real-time shadowing system using a single RGB camera and a whole-body policy for cloning human motion. Examples: - boxing🥊 - playing the piano🎹/ping pong - tossing - typing Open-sourced!

17

165

763

3

34

175

Remi Cadene

@RemiCadene

6 months

@YunTaTsai1 Thanks Yun-Ta. I will miss you!

2

1

157

Remi Cadene

@RemiCadene

2 months

Just installed Aloha-v2! Thanks @trossenrobotics 🤗

3

4

149

Remi Cadene

@RemiCadene

1 month

With just 50 episodes and 30mn of training, our policy works pretty well! It generalizes to new robot positions and light conditions 😁 Fun fact, @pollenrobotics is one of the biggest humanoid robot company worldwide with 100 robots sold to customers. They work 4 days a week!

9

18

145

Remi Cadene

@RemiCadene

11 days

Assembling some Alexander Koch arms from @taurobots ! We will properly support them with our library:

3

12

154

Remi Cadene

@RemiCadene

2 months

Thanks for trusting me to start this adventure! After 2 months, @huggingface is now one of the best places to work on open-source robotics 😇 Who wants to do a summer internship with us?

clem 🤗

@ClementDelangue

2 months

Time for robotics AI to go open-source! Welcome to LeRobot by the amazing @remicadene and team!

12

23

231

12

13

130

Remi Cadene

@RemiCadene

2 months

Proof of concept that you can do a lot with low-cost hardware (200$) and a smart robot brain. Is robotics a software problem?

Alexander Koch

@alexkoch_ai

2 months

Excited to announce Tau Robotics ( @taurobots ). We are building a general AI for robots. We start by building millions of robot arms that learn in the real world. In the video, two robot arms are fully autonomous and controlled by a single neural network conditioned on different

126

317

2K

11

117

Remi Cadene

@RemiCadene

16 days

I am mind blown by this new technology! AI is now embodied. And we are open-sourcing it all. Listen to @HaixuanT casually discussing with its cute robot at the @linuxfoundation : 🙂 What's your name? > I am Reachy, a robot from @pollenrobotics , I have two arms. 😀 What do you

3

25

105

Remi Cadene

@RemiCadene

3 months

But I thought Hugging Face was just a software company 🤔

merve

@mervenoyann

3 months

what is happening at the @huggingface office 👀 @RemiCadene

12

9

120

8

3

108

Remi Cadene

@RemiCadene

1 month

🤗 Let's play Lego now! (video speedup by 2x)

6

9

108

Remi Cadene

@RemiCadene

22 days

LeRobot is trending on github! Thanks :)

1

7

107

Remi Cadene

@RemiCadene

2 months

LeRobot is trending on github! Thanks for your interest everyone! Please join our discord channel to see what we are working on. Is it a hardware?

3

9

98

Remi Cadene

@RemiCadene

2 years

Excited about Tesla AI Day 2 this Friday 🤓 Tesla is the best place for real-world AI: infinite amount of data + insane compute. Join the effort!

2

9

89

Remi Cadene

@RemiCadene

2 months

I was also impressed by the last video from @Tesla Optimus about scaling up data collection to dozen of robots and more tasks in their lab! I can't imagine what the open-source robotic community will be able to achieve with thousands of affordable robots in various places! 🚀🚀

Remi Cadene

@RemiCadene

2 months

Meet LeRobot, my first library at @huggingface robotics 🤗 The next step of AI development is its application to our physical world. Thus, we are building a community-driven effort around AI for robotics, and it's open to everyone! Take a look at the code:

35

211

818

2

4

88

Remi Cadene

@RemiCadene

3 months

Super excited about this open-source tool to visualize robotics dataset (written in rust!). Super easy to setup :)

Rerun

@rerundotio

3 months

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by @SashaKhazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.

2

23

125

0

9

84

Remi Cadene

@RemiCadene

10 months

Join us to be part of the incoming revolution in real world AI.

Tim Zaman

@tim_zaman

10 months

Tesla AI 10k H100 cluster, go live monday. Due to real-world video training, we may have the largest training datasets in the world, hot tier cache capacity beyond 200PB - orders of magnitudes more than LLMs. Join us!

138

439

3K

3

4

80

Remi Cadene

@RemiCadene

2 months

Legend! 😋 Who wants some stickers?

Andrei Bursuc

@abursuc

2 months

Check out the LeRobot library and if you catch the amazing @RemiCadene in-person don't forget to ask him for the cute LeRobot stickers

0

2

12

1

79

Remi Cadene

@RemiCadene

4 months

Important paper from Chelsea Finn and Sergey Levine lab: The authors trained a unique diffusion policy on a real-world dataset of various robots and tasks (manipulation arms, wheeled robots, self-driving cars, robot dogs, drones). Co-training gets 5%-20%

0

8

78

Remi Cadene

@RemiCadene

2 months

What strikes me with this video from our lab is how easy we can give a friendly personality to an inanimate object. It's basically possible to make anything cute and lovely. By any chance, do you have good resources for this? (e.g. there is a book on how they made the alien look

Axel Peytavin

@ax_pey

2 months

@huggingface 's LeRobot team is awesome Last week in Paris, their teleop was already up to 500Hz thanks to @HaixuanT 's dora-rs. Feels very natural! Great work @RemiCadene and team! The year of robotics continues to 📈

7

31

172

11

4

77

Remi Cadene

@RemiCadene

3 months

Groundbreaking work. If the hardware can do it, the software will eventually follow.

Alexander Koch

@alexkoch_ai

3 months

Folding clothes with $250 robot arms. I've added another motor to improve mobility and extend the reach. The CAD files and the code are public at: (video at 2x speed)

130

389

3K

3

5

75

Remi Cadene

@RemiCadene

9 months

Thrilled that researchers around the world are converging for #ICCV2023 in Paris – truly a gem among cities! 🇫🇷 First-timer? Cruise along the Seine for iconic views ⛴️ Places to hang out 🌳 Jardin du Luxembourg 🍺 Rue Mouffetard 🌸 Jardin des Plantes 🌲 Bois de Vincennes 🏞️

#ICCV2023

@ICCVConference

9 months

At #ICCV2023 🇫🇷 this week? Share your fun photos and tag us at @ICCVConference .

3

66

3

4

72

Remi Cadene

@RemiCadene

6 months

@AnandSwa Thanks Anand :) It was a pleasure to work with you and I will miss you too!

0

72

Remi Cadene

@RemiCadene

3 months

Super excited about what we can achieve with the power of open source! @pollenrobotics built a pretty cool and capable robot. And it's just the beginning! Hope I can try it soon 😇

Pollen-Vision: Unified interface for Zero-Shot vision models in robotics

huggingface.co

3

12

73

Remi Cadene

@RemiCadene

1 month

We need more affordable robots!

Alexander Koch

@alexkoch_ai

1 month

Packing the parts for the low-cost robot arm using our robot arms. Join the waitlist to get yours here:

29

82

631

3

8

71

Remi Cadene

@RemiCadene

4 months

Smooth 👌

Ashish

@ashishkr9311

4 months

Looking more human by the day! @Tesla_Optimus , @Tesla

17

10

251

2

1

68

Remi Cadene

@RemiCadene

4 months

Image generated by Stable Cascade by @stabilityai thanks to with the prompt: "hugging cute little smiling robots with like wall-e with dad high definition scifi 5k holding flowers in paris eiffel tower"

3

1

64

Remi Cadene

@RemiCadene

6 months

Impressive teleoperated tasks! Looking forward to 2024. Let's learn these tasks with a general robot platform and a few demos!

Zipeng Fu

@zipengfu

6 months

Mobile ALOHA's hardware is very capable. We brought it home yesterday and tried more tasks! It can: - do laundry👔👖 - self-charge⚡️ - use a vacuum - water plants🌳 - load and unload a dishwasher - use a coffee machine☕️ - obtain drinks from the fridge and open a beer🍺 - open

408

2K

7K

4

6

57

Remi Cadene

@RemiCadene

9 months

I want a robot pet!

Davide Scaramuzza

@davsca1

9 months

@DisneyResearch introduces their new robot at #IROS2023 ! Trained in simulation with #reinforcementlearning ! @ieeeiros

106

2K

6K

3

4

57

Remi Cadene

@RemiCadene

2 months

Additionally, the same models can be trained on real-world datasets. Here is a cool data visualization with @rerundotio which is fully integrated with our video format optimized for training. The data originally comes from the Aloha project:

1

6

56

Remi Cadene

@RemiCadene

2 months

Do you have recommendation on papers for robot navigation in home? Is end-to-end navigation a thing? Is it possible to avoid SLAM or use it only as conditioning/input?

12

9

56

Remi Cadene

@RemiCadene

2 months

Really interesting work! A big issue with current AI for robotics approaches is that you dont really know when to early stop the training. It's not like with image classification where you just take the best checkpoint on the validation set. When doing imitation learning on real

Stone Tao

@Stone_Tao

2 months

Don’t have a real robot/setup but want to evaluate policies trained on real world datasets? Check out SIMPLER, fast, safe, and reliable evaluation of real robot policies in sim via ManiSkill 2. The ManiSkill 3 beta will port SIMPLER over soon so stay tuned!

2

6

59

5

6

53

Remi Cadene

@RemiCadene

3 months

Paris on a Friday afternoon 7PM, people are meeting their friends for a few drinks and to share some tasty food! So nice and scenic 🇫🇷

7

1

54

Remi Cadene

@RemiCadene

2 months

LeRobot is to robotics what the Transformers library is to NLP. It offers clean implementations of advanced AI models with pre-trained checkpoints. We also reimplemented 31 datasets from academia, and some simulation environments, allowing to get started without a physical robot.

1

5

53

Remi Cadene

@RemiCadene

2 months

Another visualization with LeRobot, this time on Mobile Aloha data, to learn navigation and manipulation totally end-to-end. Both datasets have been collected on @trossenrobotics robot arms.

3

8

50

Remi Cadene

@RemiCadene

10 months

@YunTaTsai1 Sooner than expected 😋

2

1

50

Remi Cadene

@RemiCadene

4 months

Teleoperation though a VR headset will certainly be the cheapest and most efficient approach to teach a robot to achieve complex tasks. I recently came across from @soumithchintala robotic group at NYU that does just that! Thx for open sourcing the code!

5

2

46

Remi Cadene

@RemiCadene

1 month

When your robot policy doesn't have memory of past experiences... It was only supposed to nod once 🤣

2

3

49

Remi Cadene

@RemiCadene

3 months

Soon no need for boxes and moving, objects will go and place themselves all on their own 😂

Shintaro Inoue / 井上信多郎

@shin0805__

3 months

『すずめの戸締まり』に登場する3本脚の椅子を再現したロボット設計，強化学習による歩容生成の論文を公開しました！来週アメリカで開催されるRoboSoft2024にて発表します！ website - #すずめの戸締まり

32

4K

15K

5

1

49

Remi Cadene

@RemiCadene

17 days

Really cool challenge for robotics!!!

GitHub - 1x-technologies/1xgpt: world modeling challenge for humanoid robots

world modeling challenge for humanoid robots. Contribute to 1x-technologies/1xgpt development by creating an account on GitHub.

github.com

Christian Wolf

@chriswolfvision

17 days

1

12

1

6

47

Remi Cadene

@RemiCadene

7 months

@tim_zaman It was a pleasure working with you. You have been very inspiring over the years. I wish you the best for your next adventure ;)

1

0

45

Remi Cadene

@RemiCadene

21 days

Would be so cool to have it on LeRobot to control affordable robot arms: Just a matter of weeks maybe? ^^

GitHub - huggingface/lerobot: 🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch

🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch - huggingface/lerobot

github.com

Moo Jin Kim

@moo_jin_kim

22 days

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

19

162

670

3

2

45

Remi Cadene

@RemiCadene

4 months

@bowenc0221 @Tesla @OpenAI I feel lucky that our paths crossed at Tesla. I learned a lot working with you. Best luck for your next projects! 😎

1

44

Remi Cadene

@RemiCadene

2 months

LeRobot also features the Diffusion Policy, a powerful imitation learning algorithm, and TDMPC, a reinforcement learning method that includes a world model, continuously learning from its interactions with the environment.

2

6

44

Remi Cadene

@RemiCadene

4 months

Impressive! Unitree H1 costs 150k$. Certainly the most capable hardware at this price! 😃

Unitree

@UnitreeRobotics

4 months

Unitree H1 Breaking humanoid robot speed world record [full-size humanoid] Evolution V3.0 🥰 The humanoid robot driven by the robot AI world model unlocks many new skills! Strong power is waiting for you to develop! #Unitree #AI #subject3 #BlackTech

41

230

921

3

42

Remi Cadene

@RemiCadene

6 months

Impressive work :) Congrats @tonyzzhao and lab mates

Tony Z. Zhao

@tonyzzhao

6 months

Introducing 𝐌𝐨𝐛𝐢𝐥𝐞 𝐀𝐋𝐎𝐇𝐀🏄 -- Hardware! A low-cost, open-source, mobile manipulator. One of the most high-effort projects in my past 5yrs! Not possible without co-lead @zipengfu and @chelseabfinn . At the end, what's better than cooking yourself a meal with the 🤖🧑‍🍳

235

1K

5K

2

5

43

Remi Cadene

@RemiCadene

5 years

Our biases reduction method (RUBi) has been accepted at @NeurIPSConf ! Thanks to my great co-authors @cdancette @LaBegne @quobbe @deviparikh RUBi: Reducing Unimodal Biases in Visual Question Answering Paper: Code:

3

10

41

Remi Cadene

@RemiCadene

2 months

wow! Do you have the link to an open source code to reproduce this?

Brian Smith

@sirwart

2 months

Playing around with a modified version of the LEAP hand by @kenny__shaw . Still need to train it to shoot hoops on its own though

6

2

65

5

3

41

Remi Cadene

@RemiCadene

5 months

Woooow 🤩

Cheng Chi

@chichengcc

5 months

Can we collect robot data without any robots? Introducing Universal Manipulation Interface (UMI) An open-source $400 system from @Stanford designed to democratize robot data collection 0 teleop -> autonomously wash dishes (precise), toss (dynamic), and fold clothes (bimanual)

43

346

2K

3

2

39

Remi Cadene

@RemiCadene

6 months

@juergenhillmann

0

1

36

Remi Cadene

@RemiCadene

10 months

Really great contribution from @kenny__shaw , @pathak2206 and colleagues! We need more affordable robotic platforms to teach and study the fundamentals 🤩

Deepak Pathak

@pathak2206

10 months

Robotic hands are daunting -- costly yet super fragile. After yrs of frustration, we decided to make one that is better, stronger & anyone can build! Open sourcing LEAP Hand 🚀🤖 - low cost ($2K) - 3D printed. Easy to assemble (3hr) - sim2real code etc.

17

125

720

1

5

34

Remi Cadene

@RemiCadene

2 months

LeRobot codebase has been validated by replicating state-of-the-art results in simulations. For example, here is the famous ACT policy which has been retrained and made available as a pretrained checkpoint:

1

33

Remi Cadene

@RemiCadene

3 months

It was my pleasure to discuss with @parmy about Hugging Face and the importance of open source AI and robotics in our society. You should also check out other insightful articles from Parmy Olson on @Bloomberg 👀

Brigitte 🤗

@BrigitteTousi

3 months

“[Open-source AI] is really fundamental because it allows everyone to seize the technology, to diminish the fear of limited understanding or of not being qualified to use AI” - @RemiCadene 🔥🔥 Great piece in @opinion by @parmy on the open-source landscape

3

14

57

5

6

33

Remi Cadene

@RemiCadene

7 months

@svpino What is the linux of the search engines?

10

1

31

Remi Cadene

@RemiCadene

3 months

Showcasing the powerful Idefics2, latest Vision LLM from Hugging Face, on a robot! 🚀

Thomas Wolf

@Thom_Wolf

3 months

Time for the open-source AI robots revolution 🚀 We’ve been playing with a low-cost DJI robot controlled by 3 local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) & orchestrated by Dora-cs In comments a 250 lines code gist to build on top of it => enjoy!!

27

117

596

0

7

32

Remi Cadene

@RemiCadene

1 month

We are honoured to host @chichengcc , author of Diffusion Policy and UMI (Universal Manipulation Interface), for our next LIVE paper discussion. To access: 1. Join our discord: 2. Click on google meet link of this post:

Join the LeRobot Discord Server!

Check out the LeRobot community on Discord - hang out with 779 other members and enjoy free voice and text chat.

discord.com

Alexander Soare

@asoare159

1 month

For our next #LeRobot Paper Discussion, @chichengcc will present his first authored Diffusion Policy! The event will start at 6 PM GMT on 12 June and will officially run for 1 hr. Join our Discord and check out the events channel for full details. 🤗

1

3

13

1

3

32

Remi Cadene

@RemiCadene

2 months

Fill this google form to receive LeRobot stickers🤗

Who wants some stickers?

docs.google.com

Remi Cadene

@RemiCadene

2 months

Legend! 😋 Who wants some stickers?

12

1

79

2

3

32

Remi Cadene

@RemiCadene

28 days

@pollenrobotics We are thankful to Pollen Robotics for open-sourcing these datasets: You can visualize them with LeRobot and @rerundotio

1

10

32

Remi Cadene

@RemiCadene

4 months

Looking forward to what OpenAI + Figure will be able to achieve in robotics 😇

OpenAI

@OpenAI

4 months

OpenAI + humanoid robots — we’re collaborating with @Figure_robot to expand our multimodal models to robotic perception, reasoning, and interaction.

677

1K

7K

4

0

30

Remi Cadene

@RemiCadene

9 months

Thanks for all the messages!

3

0

30

Remi Cadene

@RemiCadene

29 days

@pollenrobotics Again, we only trained on 50 episodes for 2 hours. We tested all checkpoints and saw our network learning new concepts! At 20k steps, it learned to put the cup on the dish rack reliably. At 40k steps, it learned to rotate its base to give back the apple! At 60k steps, it learned

4

29

Remi Cadene

@RemiCadene

17 days

Really cool :) Maybe some possible future collaborations with Hugging Face for open source robotics: crow-sourced datasets, foundational models, affordable hardware?

GitHub - huggingface/lerobot: 🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch

🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch - huggingface/lerobot

github.com

Sven Behnke

@SvenBehnke

17 days

University of Bonn is part of the new BMBF-funded Robotics Institute Germany (RIG). Five groups from Bonn contribute: * Sven Behnke * Cyrill Stachniss * Maren Bennewitz * Chris McCool * Heiner Kuhlmann. Press release:

0

2

33

1

2

29

Remi Cadene

@RemiCadene

6 months

@itsclivetime Thanks Clive, I will miss you too! Paris has nice climbing gyms. You should check them out :P

2

0

28

Remi Cadene

@RemiCadene

6 months

Paris is calling!

Omar Sanseviero

@osanseviero

6 months

The ML ecosystem in France is on fire🔥 It has amazing talent and resources. Here are 10 facts you might not know: 1. There are great research labs - from @MistralAI and @kyutai_labs to large ones from @AIatMeta and @GoogleDeepMind . The Llama 2 and CodeLlama authors are based in

46

310

2K

1

2

28

Remi Cadene

@RemiCadene

2 months

Thanks to the AI and robotics community without whom LeRobot won't have been possible. Among others: @tonyzzhao , @zipengfu , @chichengcc , @ncklashansen , @yunhaif , @HaixuanT , @VincentMoens , @antoniloq , @ashishkr9311 , @therobotstudio , @matth_lapeyre ; too numerous to be listed here.

1

0

28

Remi Cadene

@RemiCadene

6 months

Congrats to torchrl developers and community! Torchrl is on its way to become THE library for reinforcement learning and robotics in pytorch. You should check it out ;)

GitHub - pytorch/rl: A modular, primitive-first, python-first PyTorch library for Reinforcement...

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning. - pytorch/rl

github.com

torchrl

@torchrl1

6 months

🎉 Exciting news! TorchRL paper has been accepted as a spotlight talk at @iclr_conf in Vienna this May! Huge thanks to the amazing OSS community, there would be no torchrl if it wasn't for our contributors. See you there! #ICLR2024 #Vienna

0

19

78

1

5

27

Remi Cadene

@RemiCadene

3 months

Amazed how easy 3d printing has become!

6

2

27

Remi Cadene

@RemiCadene

10 months

@adamraudonis The tools that you and your team are building are critical to ensure fast progress! Thanks for all 🙏

0

24

Remi Cadene

@RemiCadene

2 months

Huge thanks to @alibert_s , @asoare159 , @Thom_Wolf whom I am closely working with and all my colleagues at Hugging Face. Among others: @QGallouedec , @qlhoest , @LoubnaBenAllal1 , @lee_chunte , @art_zucker , @gloriamika , @clefourrier , @fdaudens , @BrigitteTousi , and many more 🤗

3

0

26

Remi Cadene

@RemiCadene

4 months

Assembling time! 🤗

Thomas Wolf

@Thom_Wolf

4 months

just finished printing first Universal Manipulation Interface (UMI) - now assembling time with @RemiCadene and on to labeling in the wild very excited about what's coming for open-source $500 robots h/t @chichengcc & co for pushing more robot data collection democratization

3

10

92

1

0

25

Remi Cadene

@RemiCadene

2 months

Really cool! 😎 Thanks Sylvain

Sylvain Filoni

@fffiloni

2 months

Surprise @RemiCadene 🤗 —›

0

3

19

0

25

Remi Cadene

@RemiCadene

2 months

Come join our Discord channel. We are building a diverse community from various backgrounds, software and hardware, to develop the next generation of smart robots in the real-world!

Join the LeRobot Discord Server!

Check out the LeRobot community on Discord - hang out with 779 other members and enjoy free voice and text chat.

discord.com

1

4

24

Remi Cadene

@RemiCadene

28 days

@pollenrobotics We also made their pretrained models available (which is useful for the ~100 customers of Pollen-Robotics): Of course, we plan to do the same for affordable robot arms that everyone can own! Stay tuned 😇

pollen-robotics/act_reachy2_static_cup · Hugging Face

huggingface.co

0

4

24

Remi Cadene

@RemiCadene

2 months

Could Google latest open source VLLM be used for robotics? I am wondering what "real world" data its training set contains.

merve

@mervenoyann

2 months

New open Vision Language Model by @Google : PaliGemma 💙🤍 📝 Comes in 3B, pretrained, mix and fine-tuned models in 224, 448 and 896 resolution 🧩 Combination of Gemma 2B LLM and SigLIP image encoder 🤗 Supported in @huggingface transformers Model capabilities are below ⬇️

9

70

434

3

2

24

Remi Cadene

@RemiCadene

26 days

is trending for the second time! What do you think of the codebase and documentation so far?

0

4

23

Remi Cadene

@RemiCadene

9 months

Reminder: do not put your cat in a microwave to dry it after a shower

Paul Röttger

@paul_rottger

9 months

After spending just 20 minutes with the @MistralAI model, I am shocked by how unsafe it is. It is very rare these days to see a new model so readily reply to even the most malicious instructions. I am super excited about open-source LLMs, but this can't be it! Examples below 🧵

213

107

763

1

23

Remi Cadene

@RemiCadene

7 months

This!

Lerrel Pinto

@LerrelPinto

7 months

Our primary goal: get more robotics and AI researchers to go beyond constrained lab environments and start getting into homes! So, we open-sourced our entire system. Dataset, code, robot software & hardware: Github repo: (8/n)

2

35

0

1

23

Remi Cadene

@RemiCadene

10 months

Interesting facts on the development of self-driving cars at @Tesla_AI I can relate 😇

Walter Isaacson

@WalterIsaacson

10 months

How Elon Musk set Tesla on a new course for self-driving - Isaacson

185

321

2K

1

21

Remi Cadene

@RemiCadene

3 months

What are the recent open-source Visual SLAM projects for robotics? 👀

4

2

22

Remi Cadene

@RemiCadene

10 months

@Anteejay @Tesla_Optimus haha no it can keep balance

0

21

Remi Cadene

@RemiCadene

26 days

Very insightful visualization on the inner workings of a neural network trained end-to-end with

GitHub - huggingface/lerobot: 🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch

🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch - huggingface/lerobot

github.com

Alexander Soare

@asoare159

26 days

I used #lerobot 's diffusion policy implementation to figure out if spatial softmax learns semantically sensible keypoints. Short answer: no. Here's my short writeup with animated visualizations:

1

7

30

0

1

21

Remi Cadene

@RemiCadene

4 months

@TechCrunch I dont find hugging face in the list ^^

Remi Cadene

@RemiCadene

4 months

After 3 years @tesla and Optimus, I am thrilled to announce that I joined Hugging Face to start an ambitious open robotics project! (open as in open-source, not as in Open AI) Looking for engineers to build real robots in Paris 🇫🇷 🤖🤗

125

188

2K

1

0

21

Remi Cadene

@RemiCadene

3 months

So important to release fully open-source codebase, big datasets and recipes for LLM training! FineWeb is one of these big datasets 😇

HuggingFaceFW/fineweb · Datasets at Hugging Face

huggingface.co

Guilherme Penedo

@gui_penedo

3 months

We have just released 🍷 FineWeb: 15 trillion tokens of high quality web data. We filtered and deduplicated all CommonCrawl between 2013 and 2024. Models trained on FineWeb outperform RefinedWeb, C4, DolmaV1.6, The Pile and SlimPajama!

40

348

2K

0

3

21

Remi Cadene

@RemiCadene

6 months

@COOLBREEZE_____ Unfortunately not possible to clone myself to stay at Tesla 😅

3

0

21

Remi Cadene

@RemiCadene

8 months

Looking forward to at Station F in Paris 🇫🇷 Eric Schmidt (Google founder), Jensen Huang (Nvidia founder), Xavier Niel (Free founder), among other speakers.

ai-Pulse 2024: November 7 2024, Station F

Save the date! Organized by Scaleway, the Cloud provider that enables AI innovation in Europe, ai-PULSE comes back to Station F, Paris, on Nov 7th 2024.

www.ai-pulse.eu

Yann LeCun

@ylecun

8 months

Big AI industry event at Station F in Paris, Friday Nov 17. Keynote Speakers: Eric Schmidt (Schmidt Future), Jensen Huang (CEO Nvidia), Xavier Niel (Iliad/Scaleway). Speakers include: Thomas Scialom (Meta, of Llama fame), Arthur Mensch (CEO Mistral, or Mistral-7B fame), Jason

26

94

825

1

3

19

Remi Cadene

@RemiCadene

6 months

@deshrajdry Same :) I wish you the best Deshraj

0

19

Remi Cadene

@RemiCadene

4 months

@ClementDelangue Thanks Clem! Looking forward to what we will achieve together with the robotics community and the amazing people at Hugging Face.

1

0

20

Remi Cadene

@RemiCadene

9 months

How to do good research? Like making good music. Everyone have their style. You eventually find your own. Trying to copy styles that work best can be useful at first.

Preetum Nakkiran

@PreetumNakkiran

9 months

careful about overfitting to lists like this. there are many ways to do good research -- my fav papers were born out of getting "stuck in rabbit holes" that no-one else went down...

5

10

212

2

0

19

Remi Cadene

@RemiCadene

5 months

Impressive work! Especially, finetuning with online RL with reward provided by a CLIP model + automated reset :) Any plan to open-source the dataset like Mobile ALOHA? @HaoyuXiong1 @mendonca_rl @pathak2206

AK

@_akhaliq

5 months

Adaptive Mobile Manipulation for Articulated Objects In the Open World paper page: Deploying robots in open-ended unstructured environments such as homes has been a long-standing research problem. However, robots are often studied only in closed-off lab

2

69

299

1

18

Remi Cadene

@RemiCadene

4 months

In 2024, explaining what a model learned or why it generated a certain output is still challenging! LENS is tackleing this by providing all concepts used by a pretrained model for all 1000 classes of ImageNet. Check-out by yourself, it's super interesting 🤠

Thomas Fel

@Napoolar

4 months

👋👨‍🍳🍵 After a year of cooking up a secret project, I'm thrilled to officially reveal: The 𝐋𝐄𝐍𝐒 𝐏𝐫𝐨𝐣𝐞𝐜𝐭. By combining modern tools of Explainable AI, how much can we explain a ResNet50? 🧶

11

66

268

1

19