Bart Trzynadlowski Profile Banner
Bart Trzynadlowski Profile
Bart Trzynadlowski

@BartronPolygon

5,170
Followers
948
Following
867
Media
10,233
Statuses

Exploring applied AI. Ex-Apple AR. Author of Supermodel, the Sega Model 3 emulator, and Owl, always-on AI:

Joined November 2016
Don't wanna be here? Send us removal request.
Pinned Tweet
@BartronPolygon
Bart Trzynadlowski
14 days
Wrote a GUI for my PC-based debugger to render the occupancy map (which is now computed from scene meshes) and plot routes. I have automatic pathing code too but it doesn't work great yet. The 360 maneuver helps build an initial map. Everything is done on the phone -- the PC app
5
2
36
@BartronPolygon
Bart Trzynadlowski
9 months
Why wait for someone else to productize your life? With open models and readily available wearable hardware, you can accelerate your cognition right now, That's why @EthanSutin and I are launching a fully open source project to build an ambient smart assistant system that listens
Tweet media one
Tweet media two
Tweet media three
Tweet media four
95
215
2K
@BartronPolygon
Bart Trzynadlowski
7 months
@AntonHand I still haven’t put a GUI on my emulator and ask people to use the command line. Guess how well that’s going for me? 😂
20
1
1K
@BartronPolygon
Bart Trzynadlowski
2 years
Natural language interfaces have truly arrived. Here's ChatARKit: an open source demo using #chatgpt to create experiences in #arkit . How does it work? Read on. (1/)
37
249
1K
@BartronPolygon
Bart Trzynadlowski
1 year
Crank up the volume and wreck your space! #VisionPro 's scene understanding was the feature I was most excited about at Apple. It's going to enable wild, reality-bending immersive experiences like this. I can't wait to see what other creators dream up!
81
150
787
@BartronPolygon
Bart Trzynadlowski
5 months
@mycoliza Okay but are we talking about ML, or like, *basic* computer science algos here?
5
1
624
@BartronPolygon
Bart Trzynadlowski
1 year
Let's talk about the most important feature of the Apple #VisionPro that is getting the least attention right now: high quality spatial audio. Apple understands audio and TDG's VP, Mike Rockwell, was formerly a VP at Dolby. Look the size of those speaker drivers! (1/)
26
33
470
@BartronPolygon
Bart Trzynadlowski
1 year
Apple #VisionPro eye-tracking mega-thread! I'm seeing some concern about eye fatigue. @EricPresidentVR brought up this legitimate worry. I think there is some misunderstanding of how AVP differs from other implementations. I'll also dive into some interesting eye UX work. (1/)
Tweet media one
20
66
459
@BartronPolygon
Bart Trzynadlowski
10 months
@sterlingcrispin @peterthiel I’m going to make an AI NOTE TAKING APP!
7
2
405
@BartronPolygon
Bart Trzynadlowski
1 year
Back to kicking the tires on Apple Vision Pro and RealityKit this weekend. A few hours in and I’ve got Strike Force coming to life with game pad support.
21
40
397
@BartronPolygon
Bart Trzynadlowski
6 months
@indianloonie No, my sheltered child. *This* is the most bizarre 60 seconds in film history.
10
15
383
@BartronPolygon
Bart Trzynadlowski
7 months
Introducing Owl - OPEN SOURCE wearable AI by @EthanSutin and me! Listens (and soon, 👁️) to everything you experience, all-day long. Supports a number of capture devices, including Apple Watch and a tiny wearable with days of battery life! Interactive assistance coming soon. (1/)
25
34
301
@BartronPolygon
Bart Trzynadlowski
2 years
I thought I should introduce myself to all the recent followers I've gained here and the people I met at #AWE2022 . I've been working in #AugmentedReality since 2016 and am currently working on REK ( @REKverse ) with @CixLiv , a co-located fitness game for passthrough HMDs. (1/)
10
27
214
@BartronPolygon
Bart Trzynadlowski
1 year
Apple Valkyrie Pro. Starting to look like an actual game in the visionOS simulator!
16
13
194
@BartronPolygon
Bart Trzynadlowski
1 year
Unity. I’m sorry, Unreal devs.
Tweet media one
24
11
180
@BartronPolygon
Bart Trzynadlowski
3 months
Source code to my iPhone-based teleoperation and ACT project for the low-cost arm is here:
3
26
166
@BartronPolygon
Bart Trzynadlowski
1 year
Great success! Technical evaluation of portals and wall fracturing on Apple Vision Pro. The helicopter flies into the room and back out (note the change of lighting). Still some things missing but I am now satisfied that "Break Point" is possible on visionOS with RealityKit!
9
18
160
@BartronPolygon
Bart Trzynadlowski
1 month
Wow. How did ROS become a thing? This is truly one of the worst things I’ve ever seen in computing.
29
7
159
@BartronPolygon
Bart Trzynadlowski
1 year
Hello, World! 😉
11
14
156
@BartronPolygon
Bart Trzynadlowski
3 years
@TylerAlterman In grad school I developed a recurring nightmare that I signed up for a class that I forgot to drop in time, and I realize only before the final exam that I am still enrolled. I have to take the final without any adequate preparation. I am flung awake with a start.
19
0
142
@BartronPolygon
Bart Trzynadlowski
5 months
This might just be crazy enough to work.
10
17
154
@BartronPolygon
Bart Trzynadlowski
7 months
@pauldacity @AntonHand I’m a sadist and quite enjoying it. Command line works great for me!
5
0
148
@BartronPolygon
Bart Trzynadlowski
3 years
@Deathmarch___ @ArtifactsHub Friendly reminder that carbon dating is not used to date dinosaur bones.
4
0
139
@BartronPolygon
Bart Trzynadlowski
2 years
This mixed reality door trick is really clever! How it works explained in a 🧵 (1/)
@udasan_koubou
ウダサン
2 years
じたくの戸締まり #QuestPro
5
337
902
2
16
144
@BartronPolygon
Bart Trzynadlowski
3 years
Excited to announce I'm partnering with @CixLiv to build @REKverse : the future of #Metaverse sports! We want a Metaverse centered on playing together *in-person*, not home alone, engaging our bodies and expanding our social circles. Join us at ! (1/3)
14
11
135
@BartronPolygon
Bart Trzynadlowski
6 months
@Empty_America Not weird at all. Back then people had kids in their 20s, mom stayed home, and dad excavated rocks all day on the back of a brontosaurus. Only once the kids were old enough and there was some cash in the bank could they yabadabadoo and party till 4am. Now, fun first, kids later.
3
1
127
@BartronPolygon
Bart Trzynadlowski
3 months
@BasedBeffJezos Because these are extremely rare events and the countersniper was himself probably surprised and trying to make sense of the situation before pulling the trigger. Like duh?
27
2
124
@BartronPolygon
Bart Trzynadlowski
4 months
Tweet media one
1
3
128
@BartronPolygon
Bart Trzynadlowski
1 year
Ported over the AI steering and threw in a second AI helicopter that patrols a fixed route. #visionOS
4
20
123
@BartronPolygon
Bart Trzynadlowski
25 days
Wrote a simple IK visualizer for the 7-axis arm I built using Python and OpenGL. I'm going to try a couple different IK packages next because this one is pretty slow. The purple sphere is the end effector target.
8
2
116
@BartronPolygon
Bart Trzynadlowski
6 months
@indianloonie Content warning: Christopher Walken.
2
1
112
@BartronPolygon
Bart Trzynadlowski
1 month
Added a second phone to the mix. A bit hard to see the button presses here but I’m raycasting the cyan cursor from the handheld phone and whenever I press “Drive To”, the robot goes there. Shared SLAM is so fun!
9
2
111
@BartronPolygon
Bart Trzynadlowski
9 months
A friend noticed what might be the first ever public screenshot from Meta's AR glasses. It was shared in a job posting on LinkedIn.
Tweet media one
8
13
107
@BartronPolygon
Bart Trzynadlowski
8 months
Excited to be helping Brilliant with this incredible product 😎
@brilliantlabsAR
Brilliant Labs
8 months
What if your glasses gave you AI superpowers? This is Frame, a reinvention of eyewear for the AI era Learn more @
229
375
2K
10
4
100
@BartronPolygon
Bart Trzynadlowski
5 months
Teleoperation with iPhone working but difficult!
9
5
100
@BartronPolygon
Bart Trzynadlowski
2 years
Demoed @REKverse to its youngest players yet at a BBQ last weekend: 18-year-olds. They'd never even tried a VR headset before but of course, instantly figured out the game. I hope that by Independence Day next year, people are busting out HMDs at BBQs to play some REK :D #quest2
4
14
97
@BartronPolygon
Bart Trzynadlowski
3 years
Custom collision detection and resolution starting to work. Welcome to Lens Studio, where you have to code everything yourself from scratch :)
4
15
98
@BartronPolygon
Bart Trzynadlowski
2 months
@anpaure If kids are so great, why are you weirdos always obsessed with childless high-earners having more fun than you? Weirdo.
2
3
96
@BartronPolygon
Bart Trzynadlowski
3 years
What if you had a persistent virtual "water cooler" you could approach to quickly join other people talking about e.g., your Unity or Lens Studio projects?
4
11
97
@BartronPolygon
Bart Trzynadlowski
2 months
Coming along but unfortunately need to reprint the linkage. It’ll have to wait until after my Tahoe hiking and beach outing tomorrow.
Tweet media one
3
2
98
@BartronPolygon
Bart Trzynadlowski
3 years
Ready to have your FACE MELTED OFF? My #LensStudio game, STRIKE FORCE, is now out! It's a lot of fun outdoors. I hope you enjoy :) Link posted below in the thread.
14
14
92
@BartronPolygon
Bart Trzynadlowski
2 months
Hoverboard base working pretty well! Soldering and splicing new wires took all day and I still need to design a mount for the boards.
5
5
91
@BartronPolygon
Bart Trzynadlowski
12 days
Surgery was a partial success. I can still feel a wire getting snagged internally at about 100 degrees. I’m going to limit this joint to +/- 90 or even 80. I think it should still offer enough mobility to pick up objects below the arm and from the side? The joint at the very end
4
5
91
@BartronPolygon
Bart Trzynadlowski
1 year
I need some logo design work done. Thinking: dark mode, procedural, fractal, geometric, clean and minimal. It would be AI/XR related. If you know anyone or do this kind of design work, please get in touch and would appreciate RTs for reach 🙏
112
5
74
@BartronPolygon
Bart Trzynadlowski
1 year
This photo shows just how thin and light the headset is while still packing hardware magic years ahead of the competition. Note all the compute is in there!
Tweet media one
10
7
86
@BartronPolygon
Bart Trzynadlowski
4 months
Tweet media one
7
2
85
@BartronPolygon
Bart Trzynadlowski
4 months
AR glasses are the best form factor for contextual assistance. It’s so exciting to finally see this product shipping after a year of hard work with the @brilliantlabsAR team! Here’s @chesterzelaya getting to work with them. (1/3)
12
8
84
@BartronPolygon
Bart Trzynadlowski
3 months
@TonOlives @JamesSurowiecki “Yeah you were way more likely to be murdered, and huge swaths of the city were no-go areas, but street parking was easier!”
1
0
83
@BartronPolygon
Bart Trzynadlowski
4 months
ACT working with only 44 samples on an uncontrolled background. 🤯 Trained with iPhone teleop. Thanks for open sourcing this awesome work, @tonyzzhao ! (1/2)
6
3
84
@BartronPolygon
Bart Trzynadlowski
9 months
@MrCatid @EthanSutin This sort of stuff is still very exploratory. And sensitive. I want to be able to run it myself and see all the code, tailor it to my needs, too.
0
0
83
@BartronPolygon
Bart Trzynadlowski
2 years
Get ready to grab your headset, head to an open court, and experience Sports 2.0. @REKverse has kicked off fundraising. Our plan is to bring the future of sports home to consumers directly. (1/)
3
14
81
@BartronPolygon
Bart Trzynadlowski
3 years
Home stretch! Just need rotor sounds and then a bunch of UX polish. Also, I’m seeing assets frequently failing to spawn (or maybe a SLAM error?) @SnapAR is this a known issue?
5
5
74
@BartronPolygon
Bart Trzynadlowski
5 months
@Lucas_Gage_ Not a fan of the guy but he is correct and the community note is wrong. No one came to liberate the Jews despite evidence of what was happening. The US and Britain were primarily concerned about Britain and France.
43
1
74
@BartronPolygon
Bart Trzynadlowski
3 months
@baronitaigas “The MSM can’t be trusted! They’re useless!” Also: “CNN breaking news!!!”
6
0
74
@BartronPolygon
Bart Trzynadlowski
4 months
First signs of life from the ACT model!
4
2
71
@BartronPolygon
Bart Trzynadlowski
2 months
Thanks to mechanical whizzes @shlykur and @0xmmo , who noticed my belt was slipping due to too much play on the hand side. Turns out what I thought was a cosmetic panel helps hold the bearing sprocket firm. Also added a second spring for more tension. So far so good!
5
5
71
@BartronPolygon
Bart Trzynadlowski
2 years
I get why people think #AugmentedReality sports is a crazy idea. That’s why @CixLiv and I build while they spectate 😉 But if they were there when this guy played a match and then wanted to sportscast his friends’ game, they’d absolutely get it.
5
8
68
@BartronPolygon
Bart Trzynadlowski
2 years
@AlanJLSmith @ZoeSchiffer It’s in the middle of nowhere, surrounded by 70’s era houses. There isn’t even a sushi joint within walking distance!
8
0
63
@BartronPolygon
Bart Trzynadlowski
2 years
I tip my headset to the publicity shy engineers who make #augmentedreality possible: those Sultans of SLAM, Barons of Bundle Adjustment, Viceroys of VIO. You know you are. @CixLiv and I are going to keep pushing your systems to the limit with @REKverse .
2
6
69
@BartronPolygon
Bart Trzynadlowski
27 days
@swyx Hey whatever happened to Devin? Haven’t heard much since it failed at Karpathy’s coding task.
8
1
67
@BartronPolygon
Bart Trzynadlowski
1 year
Wow! Running on my Mac M1 Pro laptop.
Tweet media one
@ggerganov
Georgi Gerganov
1 year
This is LLaVA 7B v1.5 running on M2 Ultra thanks to the amazing work of GH user monatis I'm surprised this works so well - downloaded a few photos from my phone and every single one was accurately described. Mind is blown!
4
37
410
5
5
68
@BartronPolygon
Bart Trzynadlowski
1 year
Who remembers this AR game console from the mid-90’s?
Tweet media one
Tweet media two
9
3
62
@BartronPolygon
Bart Trzynadlowski
3 years
@BangaSoup @ArtifactsHub Fossils like this are almost always formed by being submerged and buried in sediment. Once the animal has decayed, it is likely the bones will be pushed around by currents before being properly buried. Complete, undisturbed burial of the whole intact skeleton is rare.
0
0
59
@BartronPolygon
Bart Trzynadlowski
2 years
First thread covering how the @QxrStudios Metropolis demo built in #LensStudio works. This video shows door placement, the robot navigating itself to a chair, and then jumping into the seat. I'll go over how all of this works in the coming days, starting with door placement. (1/)
7
13
61
@BartronPolygon
Bart Trzynadlowski
8 months
The more things change, the more they stay the same.
9
8
63
@BartronPolygon
Bart Trzynadlowski
1 year
Ran some numbers on per-user OpenAI model costs for an app. GPT-4 is a no-go.
Tweet media one
6
7
61
@BartronPolygon
Bart Trzynadlowski
1 year
Want to try using the world mesh for occlusion on Vision Pro? Here's some really quick-and-dirty code that gets the job done. If you improve it, send me back the changes :)
Tweet media one
9
5
61
@BartronPolygon
Bart Trzynadlowski
6 years
I'm playing with the spatial mapping SDK by @nobbis and @aboundlabs . Very simple Swift API that provides a controller capable of scanning and obtaining .obj format meshes. Looking forward to playing with this more! Awesome work, Tim! Highly recommend folks check this out! #arkit
3
13
58
@BartronPolygon
Bart Trzynadlowski
2 years
@REKverse was *intense* last night at @TwoBitCircus . Augmented sports and shared AR are only going to get better from here. Running around in #AugmentedReality is totally new to people but they instantly *get it*. Don’t miss out if you’re in LA tonight through Sunday!
4
11
59
@BartronPolygon
Bart Trzynadlowski
1 year
@KyleOrl @VRNima Given the dependence of modern games on ephemeral online services, it’s more important than ever to emulate current generation hardware for the purpose of capturing and preserving software.
2
3
55
@BartronPolygon
Bart Trzynadlowski
9 months
@EthanSutin has been doing some awesome demos of this stuff so make sure to check him out. He's found some great leads on hardware and the objective will be to have a couple of simple boards, at least one with LTE capability capable of fully independent operation.
2
2
58
@BartronPolygon
Bart Trzynadlowski
1 month
@emollick Amazing but also supremely irritating that the source code isn’t available given that it’s based on an open source model.
3
0
56
@BartronPolygon
Bart Trzynadlowski
6 months
Why didn't Humane make their device connect to the phone? Well, because it's damn near impossible to do so. You can't for example access iMessages/SMS messages from an iOS app to summarize them.
17
3
56
@BartronPolygon
Bart Trzynadlowski
1 year
Here's a a killer creator use case for #VisionPro : music creation. Apple has powerful brand equity among musicians and I think spatial computing can make music creation even better. Let's see how. (1/)
Tweet media one
8
2
57
@BartronPolygon
Bart Trzynadlowski
1 year
Selling my Quest Pro with Oculus Link cable! Near perfect condition, everything included, and I've never used VRChat, so you can be assured the device is clean and nothing inappropriate ever happened with it.
Tweet media one
Tweet media two
4
0
55
@BartronPolygon
Bart Trzynadlowski
8 months
@afoxdesign Tracking cams…
2
0
53
@BartronPolygon
Bart Trzynadlowski
1 year
The ultimate gaming display: a huge MR portal. Extend non-XR games into mixed reality by knocking down your wall. This was our hackathon project at the @Meta Presence Platform hackathon this week. (1/)
2
13
55
@BartronPolygon
Bart Trzynadlowski
5 months
@mualphaxi I don’t understand the negativity here. It’s a legit recipe - I used to cook it for my ex.
10
0
49
@BartronPolygon
Bart Trzynadlowski
3 years
Instead of #Metaverse how about a Betterverse? What are some of the things you'd like to be able to hang out and do with people? Let me know :)
8
4
50
@BartronPolygon
Bart Trzynadlowski
2 months
@kiiroi_jacket 1) We don’t use dependencies, we rewrite them ourselves from *scratch*. 2) We install them in our place of choice, modifying build scripts as needed.
2
1
51
@BartronPolygon
Bart Trzynadlowski
2 months
@erikbryn Thank you, Biden!
5
4
51
@BartronPolygon
Bart Trzynadlowski
1 year
I got the transcript of Robert’s therapy session and it’s exactly what I expected.
Tweet media one
@Scobleizer
Robert Scoble
1 year
This is the scariest tweet I've made in a long time. On Friday I met with a psychiatrist, @MundinMd and did a 30 minute session, where I was her patient. These are the notes that the system she was using, which uses @OpenAI 's GPT as back end, made. Wow. Thread:
Tweet media one
194
436
2K
3
0
46
@BartronPolygon
Bart Trzynadlowski
2 years
🧵on @REKverse 's new direction. AR sports will happen but headset availability and outdoor support are just not there yet. We believe AR provides huge opportunities *now* with passthrough HMDs. I've long wanted to capture the feeling of Hong Kong action films in AR/VR. (1/)
6
5
47
@BartronPolygon
Bart Trzynadlowski
2 years
@shekitup @thejessezhang I have an open source example of how to do this called ChatARKit. Specifically the prompt wrapping happens here:
1
3
46
@BartronPolygon
Bart Trzynadlowski
2 months
@AntonHand Wait. I’ve been out of the Unity scene for a year. Are they actually deleting the forums? Why would they even contemplate that?
1
0
46
@BartronPolygon
Bart Trzynadlowski
1 year
Had a phone conversation earlier today and I think we just found a killer app for Vision Pro that will absolutely mint money. I already had a variant of it in my big list of “AI App Ideas”. There’s also external validation. Let’s see how much it gnaws at me in coming weeks.
5
1
46
@BartronPolygon
Bart Trzynadlowski
1 year
Apple’s collaboration with Unity is very deep indeed. Unity will support shared app creation by handing rendering to RealityKit! This is a pleasant surprise.
4
5
44
@BartronPolygon
Bart Trzynadlowski
2 years
Quick weekend project experimenting with @OpenAI ’s Whisper (on-device c/o @ggerganov ), #ARKit , and @Sketchfab .
2
11
44
@BartronPolygon
Bart Trzynadlowski
2 years
This is a great demo of what is seen as the killer app for passthrough AR headsets: remain present in the real world while also being present with someone far away. It’s a big deal.
@NathieVR
Nathie
2 years
Mark Zuckerberg has posted a new video of the Quest Pro showing its mixed reality mode while fencing online. Do you find this cool or gimmicky?
163
132
993
2
5
43
@BartronPolygon
Bart Trzynadlowski
2 years
Thinking of starting a forum (not a Discord but a forum, although I’m open to suggestions) for mixed reality (Quest, Snap, HoloLens?) devs to talk tech. Would anyone want to join? I feel there just aren’t good focused forums covering this stuff.
18
2
41
@BartronPolygon
Bart Trzynadlowski
2 months
@michaelmiraflor @RamdaniRedouane He is second only to Michael Jackson in name familiarity in France. They affectionately refer to him as Le Snoop.
1
2
42
@BartronPolygon
Bart Trzynadlowski
7 months
Today, we launch with Apple Watch, Xiao ESP32S3 Sense, and Sony Spresense support. Code and design files for the ulta-low-power wearable coming soon. We are looking for select people to give out units to and set up private servers for, to help us test and spread the word! (2/)
Tweet media one
Tweet media two
Tweet media three
Tweet media four
11
3
43
@BartronPolygon
Bart Trzynadlowski
2 years
Interesting article primarily for the acknowledgment that AR and VR are actually quite divergent. MR/passthrough AR headsets are not "getting us ready" for some sort of AR convergence. They're very different products and will likely have different UX.
6
2
41
@BartronPolygon
Bart Trzynadlowski
8 days
@Andercot @anduriltech @SpaceX This would likely violate space non-proliferation treaties and ignite an unconstrained space arms race between the US and China.
8
1
44