Axel Peytavin Profile Banner
Axel Peytavin Profile
Axel Peytavin

@ax_pey

1,320
Followers
646
Following
11
Media
173
Statuses

Making artificial machines alive | prev @stanford @theoceancleanup @centralesupelec

Palo Alto, CA, USA
Joined December 2011
Don't wanna be here? Send us removal request.
Pinned Tweet
@ax_pey
Axel Peytavin
4 months
We gave a tiny body to gpt-4o Fully autonomous, give it just one prompt Robot sees -> thinks -> does -> repeat Can also: • pick up trash • shake hands • talk with you All for $200 off-the-shelf Building a bigger version What should we have it do?
172
328
3K
@ax_pey
Axel Peytavin
5 months
@huggingface 's LeRobot team is awesome Last week in Paris, their teleop was already up to 500Hz thanks to @HaixuanT 's dora-rs. Feels very natural! Great work @RemiCadene and team! The year of robotics continues to 📈
@RemiCadene
Remi Cadene
5 months
Meet LeRobot, my first library at @huggingface robotics 🤗 The next step of AI development is its application to our physical world. Thus, we are building a community-driven effort around AI for robotics, and it's open to everyone! Take a look at the code:
Tweet media one
35
217
835
7
31
173
@ax_pey
Axel Peytavin
6 months
In the future AI Engineers won't replace us. Instead, we will orchestrate them! And that's what we built this weekend at the @MistralAI @cerebral_valley hackathon! · Spin up devs or reviewers · Define tasks for them on a board · Check their code on Github and more coming ⚡️
12
24
131
@ax_pey
Axel Peytavin
3 months
Given that this is blowing up, if you want to financially support an AI x robotics team building from Palo Alto, feel free to reach out We're working hard on this
5
2
82
@ax_pey
Axel Peytavin
3 months
@SimonTheSpecter This might or might not be what we're working on right now already
3
1
48
@ax_pey
Axel Peytavin
10 months
@emollick Same impression, but from what I read on Reddit (), it might be because it's more "basic" by default, but more customizable to make custom GPTs
2
3
25
@ax_pey
Axel Peytavin
3 months
@CNuhhhh So gpt-4o alone is not enough :) We had to add a bunch of AI pre-processing around it to make it work properly. Might open source it!
3
0
26
@ax_pey
Axel Peytavin
4 months
@Pranavi9228 Right now thinking of doing chores, once it gets better it will be able to help elders. But at first, laundry, tidying... What do you think of it?
9
0
26
@ax_pey
Axel Peytavin
3 months
@victor_explore Yes, I'm trying this today!
1
0
22
@ax_pey
Axel Peytavin
3 months
@sourav_bz Completely autonomous There's a ToF camera on it and that's enough
2
0
17
@ax_pey
Axel Peytavin
3 months
@JokesOnAI Custom made from a kids car set to assemble, a raspberry pi, and a breadboard with all cables assembled myself I was surprised this worked honestly
1
0
17
@ax_pey
Axel Peytavin
1 month
3
0
14
@ax_pey
Axel Peytavin
5 months
I actually built this Recall AI 2 months ago. Runs entirely locally so that your data stays safe. Can be used to figure out what you did during the day and how focused you were. Should I release it?
@tsarnick
Tsarathustra
5 months
Satya Nadella says Windows PCs will have a photographic memory feature called Recall that will remember and understand everything you do on your computer by taking constant screenshots
5K
3K
10K
3
1
12
@ax_pey
Axel Peytavin
2 years
@TwitterDev Will you deprecate the academic accesses before proposing new solutions for academics? We have studies running over long timespans that would really suffer from an interruption
1
0
10
@ax_pey
Axel Peytavin
6 months
Want to try it for yourself? The code and instructions are here: Feel free to reach out for feedback or even to contribute! We're already using this ourselves, and want to see what best works for the community!
1
0
9
@ax_pey
Axel Peytavin
3 months
@alvarocha2 Yes, it really behaves entirely autonomously If you could see the computer screen there, the "thoughts" are coming in with what it decides on doing Does not work all the time perfectly, but we're working on it. It's a complex but fascinating system
2
0
7
@ax_pey
Axel Peytavin
3 months
@GoogleGoo009 Yep that's one of these!
0
0
7
@ax_pey
Axel Peytavin
6 months
It took us a couple days and a couple tens of dollars to 🛳️ this device Crazy good team Love being a builder in SF
@kodjima33
Nik Shevchenko
6 months
Today I saw the launch of another "open-source" AI wearable that has not published anything just to charge you 5x the cost At @MistralAI x @cerebral_valley hackathon in @SHACK15sf we built FRIEND - an AI Wearable that: - Works 24+ hours on a single charge - Costs ~$20 -
141
267
2K
1
0
7
@ax_pey
Axel Peytavin
3 months
@shafayat_sheikh Yeah we had to add a few things around it so that it understands space better
0
0
7
@ax_pey
Axel Peytavin
8 months
@tsarnick Couldn't it be some form of survivor bias? Doesn't everyone who gets to that age start not to be bothered by much stuff?
0
0
7
@ax_pey
Axel Peytavin
6 months
This is the product of an incredible team who worked day and night to make this a reality: @Aiswarya_Sankar @yumat_10 and @pierrecollignon Hacking with amazing builders is what makes SF such an incredible city!
Tweet media one
Tweet media two
2
1
6
@ax_pey
Axel Peytavin
3 months
@Guygies Could be a thing! But I think the best way to know what is going to be the best way to make a brain for these things is first to make the things. After making a couple of different ones maybe we'll be able to distribute a good software for people to use
1
0
6
@ax_pey
Axel Peytavin
3 months
@pranman Great question. We're working on that precisely
1
0
6
@ax_pey
Axel Peytavin
6 months
Want to ask questions about OpenArchitect or contribute to its next phase? We're having a meetup on Discord in 15mn!
@ax_pey
Axel Peytavin
6 months
In the future AI Engineers won't replace us. Instead, we will orchestrate them! And that's what we built this weekend at the @MistralAI @cerebral_valley hackathon! · Spin up devs or reviewers · Define tasks for them on a board · Check their code on Github and more coming ⚡️
12
24
131
0
0
6
@ax_pey
Axel Peytavin
3 months
@ankkala Yep, big time I've been playing with this for a while and it is magic
1
0
6
@ax_pey
Axel Peytavin
1 month
@jasonjoyride @1x_tech So much better than humanoid companies making grandiose videos on staged demos of 1 task only Go go go @1x_tech !
0
0
5
@ax_pey
Axel Peytavin
6 months
Little sneak peek of what's about to drop 👀
@Aiswarya_Sankar
Aiswarya Sankar
6 months
Jensen Huang said engineers of the future will primarily be orchestrating a group of agents to build their visions. Well that’s what we’ve built. Dropping our new OpenArchitect crew of engineering assistants from the @MistralAI SF hackathon this weekend in a few days! 👀
Tweet media one
Tweet media two
5
15
276
0
0
5
@ax_pey
Axel Peytavin
5 months
@KennethCassel Working on a system without a depth cam here Stereo cameras have a lot of issues (very disappointed by my OAK-D Lite), and ToF cameras are expensive - or very shitty. Monocular Depth Estimation on the other end made huge progress. I'm hopeful
2
0
5
@ax_pey
Axel Peytavin
10 months
@emollick Architecture changes, Better data, better performance given a fixed size, dedicated chips... And even fine-tuning for specific use-cases to reduce size further. If each of these 10x's speed, we can easily get 5 orders of magnitude. Likely more over the years
1
2
4
@ax_pey
Axel Peytavin
3 months
@beaudjango Oh thanks for letting me know! It's fixed!
0
0
4
@ax_pey
Axel Peytavin
6 months
@ClementDelangue The world sort of needs open-source eval systems that you cannot train on. Something that generates inputs / outputs to eval that are different every time? But stay consistent in regards to what you're testing?
2
0
3
@ax_pey
Axel Peytavin
5 months
@SouveraineTech J'ai créé une IA locale qui fait déjà ca il y a quelques mois. Ca permet au moins de garder ces données pour soi
@ax_pey
Axel Peytavin
5 months
I actually built this Recall AI 2 months ago. Runs entirely locally so that your data stays safe. Can be used to figure out what you did during the day and how focused you were. Should I release it?
3
1
12
0
0
4
@ax_pey
Axel Peytavin
5 months
That uses the incredible surya from @VikParuchuri for local processing And @ollama for local running of LLMs to understand what's going on
0
0
3
@ax_pey
Axel Peytavin
1 month
Very, very impressive! Can't help but notice the absence of legged locomotion while it's doing a task. Moving legs while you're doing a manipulation task in a clean way remains to be seen Up next for real AGI: World modeling, long-term planning and seamless interaction
@1x_tech
1X
1 month
Introducing NEO Beta. Designed for humans. Built for the home.
2K
2K
19K
1
0
3
@ax_pey
Axel Peytavin
6 months
@audrow @vishivishx @abemurray Agreed. It's most likely what will happen, and we need to think more about how we're going to interact with them
1
0
3
@ax_pey
Axel Peytavin
8 months
😫 How tiring is it to build a whole React frontend for every API you build? Introducing... 🪄 Natural Frontend for @FastAPI : Generate a frontend for your backend with one-line. 👥 You can even make multiple frontends for different use-cases. Completely open source!
1
0
3
@ax_pey
Axel Peytavin
7 months
One can never have enough of these
Tweet media one
0
0
3
@ax_pey
Axel Peytavin
3 months
@KluepfelMark Actually @GroqInc we would love to talk with you about that
1
0
3
@ax_pey
Axel Peytavin
3 months
@StoicIronMind We have already played with such use cases so yes! Working on making it more reliable for more videos coming soon
0
0
2
@ax_pey
Axel Peytavin
6 months
@thedigitaldr @MistralAI @cerebral_valley Not yet? But you can host it yourself very easily (our repo indicates how) You only need an api key from openai or mistral We'll make it gradually easier for everyone to host it of course
0
0
0
@ax_pey
Axel Peytavin
5 months
@audrow As a SWE/AI person, it really felt like there was so much legacy to learn to even make something work. What do you think would help more people make robots faster? Software-wise?
3
0
2
@ax_pey
Axel Peytavin
6 months
0
0
2
@ax_pey
Axel Peytavin
10 months
@Thomasbcn I remember Manifest V2 already made it much much harder to have my extension communicate between different domains... How more painful is this one going to be?
1
0
0
@ax_pey
Axel Peytavin
5 months
@xiao_ted So true! The funny thing is, if you make a co and ask VCs, they would probably tell you that they expect you to provide value now with something that works, not to rely on scale catching up later :)
0
0
2
@ax_pey
Axel Peytavin
8 months
@audrow I would be happy to read about a page the lists the most important ones to learn about it Cooking AI-based robots myself in my garage and this is an area I don't know anything about
2
0
2
@ax_pey
Axel Peytavin
6 months
@audrow @vishivishx @abemurray I would call it architect :) This is kind of why we created this
@ax_pey
Axel Peytavin
6 months
In the future AI Engineers won't replace us. Instead, we will orchestrate them! And that's what we built this weekend at the @MistralAI @cerebral_valley hackathon! · Spin up devs or reviewers · Define tasks for them on a board · Check their code on Github and more coming ⚡️
12
24
131
1
0
2
@ax_pey
Axel Peytavin
5 months
@chris_j_paxton @KennethCassel Can't it be done in the cloud? Depth estimation may not have to be done with such a low latency / high freq - ACT can do high freq-required task just with RGB. Could also distill a local model to train on images seen and estimated with the cloud one after a while
1
0
1
@ax_pey
Axel Peytavin
6 months
@melvinsalvador_ @Aiswarya_Sankar @lorenzejayTech @cerebral_valley @SHACK15sf @yumat_10 For the agent orchestration it's similar but we're integrating it fully in dev tools So that you really have something that you can control in a standard way for software
0
0
2
@ax_pey
Axel Peytavin
1 month
@chris_j_paxton It feels like they get the timing right though - essentially, Starship reducing the cost per kg launched by 1 OOM By the time their proof of concept is done it should fly - if you believe everything will go right
0
0
2
@ax_pey
Axel Peytavin
7 months
@ai_jaksa @eshear The Bicameral Mind from Westworld We're all LLMs talking to ourselves inside the brain in a Chain-of-Thoughts or Chain-of-Code fashion running at 1000Hz and our reflexes are lower-level transformers trained to follow any instructions from the high-level LLM
0
0
1
@ax_pey
Axel Peytavin
6 months
1
0
2
@ax_pey
Axel Peytavin
5 months
@aaditsh Built that for myself recently! And to keep your data private, it runs entirely locally. Considering open-sourcing
@ax_pey
Axel Peytavin
5 months
I actually built this Recall AI 2 months ago. Runs entirely locally so that your data stays safe. Can be used to figure out what you did during the day and how focused you were. Should I release it?
3
1
12
0
0
2
@ax_pey
Axel Peytavin
5 months
@ijustine @Microsoft I built this some time ago already. Runs entirely on your computer, so no privacy issues!
@ax_pey
Axel Peytavin
5 months
I actually built this Recall AI 2 months ago. Runs entirely locally so that your data stays safe. Can be used to figure out what you did during the day and how focused you were. Should I release it?
3
1
12
0
0
2
@ax_pey
Axel Peytavin
6 months
Fascinating interactions under a @CommunityNotes Sometimes I wonder how different we are from LLMs online
Tweet media one
0
0
2
@ax_pey
Axel Peytavin
7 months
The problem is not detect spam bots online, it's to be sure you're not removing an actual human that just has a weird behavior If you mess up even only once, that's censorship and it looks very bad We should be less harsh with platforms' issues. Demanding, but not harsh
@dvassallo
Daniel Vassallo
7 months
I don’t know how to put a rocket in orbit, but I’m 110% confident I can fix spam bots with a few if statements.
92
12
556
0
1
2
@ax_pey
Axel Peytavin
10 months
@Thomasbcn And it's mandatory in 6 months apparently. What a shame
0
0
1
@ax_pey
Axel Peytavin
6 months
@audrow @vishivishx @abemurray Yeah Funny how at the end of the day it might not be who has the best agent or model that will win, just who interfaces it the best with humans
0
0
2
@ax_pey
Axel Peytavin
5 months
@KennethCassel We built an agent-based robot navigating around and interacting autonomously without SLAM nor LIDAR, just a camera and a VLM. Works really well! We used a ToF but now trying to see if it performs well without it and just DepthAnything
0
0
2
@ax_pey
Axel Peytavin
10 months
This is a correct way of comparing search engines and chatbots. People complain LLMs hallucinate and thus are not accurate, but forget humans also make mistakes. What's important is that LLMs are already faster and less error-prone than us (except if you take 15hr for search)
@emollick
Ethan Mollick
10 months
For any complex topic, the declining value of Google compared to AI-assisted search engines is getting clear. Despite small issues, Bard, Bing & Perplexity do a much better job. I would also suspect that they are often less error-prone than "doing your own research" with Google.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
24
53
462
0
0
0
@ax_pey
Axel Peytavin
5 months
@bnj We thought about exactly this for a recent hackathon project!
@ax_pey
Axel Peytavin
6 months
In the future AI Engineers won't replace us. Instead, we will orchestrate them! And that's what we built this weekend at the @MistralAI @cerebral_valley hackathon! · Spin up devs or reviewers · Define tasks for them on a board · Check their code on Github and more coming ⚡️
12
24
131
0
0
1
@ax_pey
Axel Peytavin
6 months
@b05crypto Not yet but it's on the roadmap! Didn't have the time to cater to this part yet, we're mostly working on improving the coding agent because we want to deliver something that works well reliably :)
1
0
1
@ax_pey
Axel Peytavin
3 months
@thejamesvance If you know someone there to help us do that, that would be amazing indeed :)
0
0
1
@ax_pey
Axel Peytavin
6 months
@VikParuchuri Sweet! Can definitely see this being useful in may other projects. Maybe @MikeBirdTech useful for OI? I used surya already for some screenshot's text OCR
1
0
1
@ax_pey
Axel Peytavin
6 months
@onemoremichael @ClementDelangue Honestly looks like an interesting business idea
1
0
1
@ax_pey
Axel Peytavin
8 months
@nabeelqu Is it really the whole of America? Is it not just parts of it? In SF it's easy to integrate but probably because most people are already from abroad
1
0
1
@ax_pey
Axel Peytavin
10 months
@barrowjoseph Ah thanks! Been wanting to help adding support for it, seems like a decent amount of work though
1
0
0
@ax_pey
Axel Peytavin
5 months
@ADarmouni @mattshumer_ I think it only makes sense when you want your output to be formatted in a way that makes sense to your use-case or to get your model to get faster to the point But fine-tuning it as a way to teach it new knowledge is pointless imo. Just do ICL for this
1
0
1
@ax_pey
Axel Peytavin
7 months
Idea for a human-computer interaction experiment: Observe evolution of brain ECG while reading tweets and try to find correlations / predict reaction based on tweet
@karpathy
Andrej Karpathy
7 months
Reading a tweet is a bit like downloading an (attacker-controlled) executable that you instantly run on your brain. Each one elicits emotions, suggests knowledge, nudges world-view. In the future it might feel surprising that we allowed direct, untrusted information to brain.
782
1K
11K
0
0
1
@ax_pey
Axel Peytavin
6 months
@analyticsaurabh @cerebral_valley @MistralAI Thank you! And yeah that's the goal. We don't think the future of AI is going to interact with chatbots It's too limited We can do much better than that
0
0
1
@ax_pey
Axel Peytavin
6 months
@stevensmpldv @CollinCornwell Honestly I want to build this I do research in AI and social media and it bums me that they can't flag this
0
0
1
@ax_pey
Axel Peytavin
5 months
@traiden6 @huggingface @HaixuanT @RemiCadene As a software guy, I am incredibly impressed by those who can make the hardware very fast to be honest. AI / software is important, but if you're limited in your speed of iteration because you can't go fast on hardware, you're still f*cked
0
0
1
@ax_pey
Axel Peytavin
3 months
@MummaLabs First option, yes!
0
0
1
@ax_pey
Axel Peytavin
4 months
@cory @reply Interested!
0
0
0
@ax_pey
Axel Peytavin
10 months
@barrowjoseph Agreed, will get an Mx MBPro soon so I'd really like to see it working. Good luck!
0
0
1
@ax_pey
Axel Peytavin
3 months
Also welcoming @Vignesh_Robots to X 👋 We're building this together
0
0
1
@ax_pey
Axel Peytavin
6 months
We added an agent to create tickets for you! Feel free to join our discord if you want to keep updated or give feedback!
@Aiswarya_Sankar
Aiswarya Sankar
6 months
Built. Shipped. Delivered. Now you can have full “architect” control over your crew of swe agents - Describe what to build - Discuss the best way to build it within your code - Create tickets - Agents build! Thanks team and @cerebral_valley @SHACK15sf best hackathon to date!
19
30
273
1
0
1
@ax_pey
Axel Peytavin
1 month
@Teknium1 Yes, good engineering is akin to art You need to be creative enough to put together pieces in a way to make something new and useful
0
0
1
@ax_pey
Axel Peytavin
2 years
Are you managing comment sections or communities on a website? @aliteshnizi and I know it's hard, and we'd like to know more about your experience as part of our research at @Stanford on healthily engaging communities online. Let us know if you're down for a chat :)
0
0
1
@ax_pey
Axel Peytavin
7 months
@eshear The Bicameral Mind from Westworld We're all LLMs talking to ourselves inside the brain in a Chain-of-Thoughts or Chain-of-Code fashion running at 1000Hz and our reflexes are lower-level transformers trained to follow any instructions from the high-level LLM
1
0
1
@ax_pey
Axel Peytavin
10 months
@s_streichsbier Even without SOTA performance overall for small LLMs, we can probably reach incredible perf for some specific use-cases on devices. For a local github copilot, this one looks amazing
1
0
1
@ax_pey
Axel Peytavin
6 months
@onemoremichael @ClementDelangue Yeah, still game-able... But at least not on the exact same labels of the original dataset so you still force the model to really understand the task at hand
1
0
1
@ax_pey
Axel Peytavin
3 months
@sourav_bz Not on this model. The next one we're working on, yes
1
0
1
@ax_pey
Axel Peytavin
6 months
@chichengcc We should see that as a sign that hardware will learn to use very cheap hardware very well Kind of akin to humans that are shaking can still do fine tasks because they learn how to compensate it
0
0
1
@ax_pey
Axel Peytavin
6 months
@1littlecoder @Aiswarya_Sankar @cerebral_valley @SHACK15sf @yumat_10 The coders and reviewers are! But we want you to be able to switch between LLMs for each task, so that you can decide if you take a "junior" (less expensive) for dev or a better LLM for example.
1
0
0
@ax_pey
Axel Peytavin
11 months
🤖🌎 I used the latest @OpenAI update to create a GPT for the planet in an hour. ✈️ It is made to help you travel more sustainably. Just say where you want to go!
1
0
1
@ax_pey
Axel Peytavin
5 months
0
0
1
@ax_pey
Axel Peytavin
8 months
- Add Speech-to-text & TTS - Interface with @OpenInterpreter Get Jarvis 🤖
@josephsemrai
Joseph Semrai
8 months
inference on your head mistral 7b (4bit quantized) running locally on apple vision pro
38
118
1K
1
0
0
@ax_pey
Axel Peytavin
6 months
1
0
1
@ax_pey
Axel Peytavin
2 years
I don't think Twitter realizes the impact turning its @TwitterAPI off like that will have. It's useful for so many things, and research is one of them. If you can at least grant academic access like before, that would be awesome for us researchers.
0
0
1
@ax_pey
Axel Peytavin
6 months
If you didn't spend Saturday night in the @MistralAI @cerebral_valley hackathon, you missed half the experience
0
0
1
@ax_pey
Axel Peytavin
6 months
@ryanmcnutty33 @MistralAI @cerebral_valley I agree Intelligence is going to be commoditized through agents working for you And we will need ways of orchestrating this AI labor work
0
0
0
@ax_pey
Axel Peytavin
7 months
@SullyOmarr 100% What AI is good at is inferring what we might want based on our behavior. Understanding should lead to 10x better products
0
0
0