Jonathan Stephens @jonstephens85 Twitter profile

Last Seen Profiles

@MixerCommUK

@bjl77

@stw_ibu2

@bokeplokalmalam

@NM33_S

@kiesherion

@JavierGuti47732

@mmwdlszly172439

@CREATEdigmanpub

@Miruna_Rosca

@OXY_Official_

@alytym54150

@tujijenge_tz

@SackvilleDonald

@Kgarcadia

@NftSquad93207

@MokNiyak50638

@RwandaEvents

@BinorRaja

@HiroKennelly

@dj_chubz05

@vvgoes

@stwmaniax

@wars_hero53186

@crackero1

@thematchday

@liki277431

@stwmaniax

@excell305

@nerksthetoaster

@Xenon_kisenon_J

@HugoRichard_art

@Greenninja27519

@PlayersPunch

@graemecurnow

@2hPKdJmEUjEYzI2

Jonathan Stephens

@jonstephens85

2 years

🚨New NeRF app alert 🚨 Watch to the end for the results! It’s called Captur3 and it’s already available on the @Apple App Store. #3D #AI #neuralnetworks

33

192

1K

Jonathan Stephens

@jonstephens85

2 years

Wow! Put yourself virtually in a real NBA game!!! This is the #augmentedreality dream people have been waiting for! And the NBA is behind it, not just some small AR/VR shop. #AR #MixedReality

31

303

1K

Jonathan Stephens

@jonstephens85

1 year

This is NOT a mesh, NOT a NeRF, NOT video footage. This is 3D Gaussian Splatting which produces a similar output to NeRFs. Check out those reflections in the water! The fine structure detail 🤩 #3D #AI #Computervision #VFX

59

167

1K

Jonathan Stephens

@jonstephens85

2 years

I wanted to model my hotel room this week and decided to give @Polycam3D 's roomplan mode a whirl. 👏 Well done! They added a wonderful touch by putting 3D objects in the output that are actual representations of the room objects. Not just geometric shapes. Why aren't more

20

140

1K

Jonathan Stephens

@jonstephens85

2 years

I think I just walked down a path I cannot come back from. @Luxottica / @RealityLabs Ray-Ban Stories plus @NVIDIAAIDev Instant-NeRFs. Imagine me running around a @NASCAR event with these one @Scobleizer 😎 Notice the bounce is gone without cropping the scene. Get it now? #3D #AI

29

190

1K

Jonathan Stephens

@jonstephens85

2 years

Follow along as I do a series of structured @Apple RoomPlan tests and share my findings/notes in this thread. First up, I tried tricking RoomPlan with a large mirror. Surprisingly it wasn't fooled! Also, it was way off on french doors height. #WWDC22 #AR #ARKit #AI @Scobleizer

20

232

943

Jonathan Stephens

@jonstephens85

2 years

How long before 360 camera tours are irrelevant? 2 years? This is one of Zip-NeRF's 360 tours. I can look around, pause and recompose my shot. This is way better than a few static positions. I only see 2 challenges today: 1. Quality - still not photorealistic, but I bet we will

48

91

748

Jonathan Stephens

@jonstephens85

2 years

Are kids, cars, and dogs messing up your PERFECT instant NeRF? Never again! My upcoming tutorial will show you how you can automatically remove unwanted objects. Since it's automated, it only takes a few extra seconds to remove objects. Thanks @NVIDIAAIDev for the enhancements!

10

103

589

Jonathan Stephens

@jonstephens85

2 years

FINALLY getting to try editing NeRFs in #VR . This is a NeRF being rendered in real-time on my Oculus Pro Headset. This one I already cleaned up a bit, but you can see me moving around the scene and removing some floaters. Just a reminder, some floaters

13

66

490

Jonathan Stephens

@jonstephens85

1 year

🏎 3D Gaussian Splatting with cars is INSANE! 🏎 One aspect of NeRFs that has always plagued me is that car paint reflections looked blocky or smeared. Not here!!! Also, this is running in real-time. @Scobleizer 👀 #AI #3D #Spatialcomputing

17

64

443

Jonathan Stephens

@jonstephens85

2 years

My take: NeRFs in game engines mixed with 3D model assets is going to be the key to long term NeRF success. Here is one great example! NVIDIA will also be bringing NeRF interoperability to the Omniverse (my prediction). #ue5 #gamedesign

15

61

432

Jonathan Stephens

@jonstephens85

1 year

⚠ The most important NeRF project I've seen since Zip-NeRF! ⚠ This team solved a plaguing problem that I run into: NeRFing long, linear, forward-facing image sets! Now I can NeRF alleyways and streets! The trick here is 2-fold 1️⃣ Creating multiple-local radiance fields along

5

80

433

Jonathan Stephens

@jonstephens85

2 years

Made my first @NVIDIAAIDev NeRF with the @insta360 RS One 1-Inch camera. I used 23 seconds of slow walking down a random alley as my test. Extracted 1 fps. I have some settings to tweak in my workflow to optimize the output. I did this with 6 lines in a CLI. #AI #NeuralNetworks

11

67

406

Jonathan Stephens

@jonstephens85

2 years

At the 11 second mark you realize what you are looking at 😏. What is your favorite aspect of the @NVIDIAAIDev Instant NeRF? I can't decide if I like the subtle cloud changes or water reflections more. #neuralnetworks #AI #Drones

10

64

386

Jonathan Stephens

@jonstephens85

2 years

Scanned this telecom tower compound last week with an iPad Pro while with a client. Trying out point clouds with UE5 for the first time. This could go places... #UE5 #Telecom #industry40

13

31

361

Jonathan Stephens

@jonstephens85

2 years

I went a bit overboard scanning my brother's truck yesterday. 150 million points...from an iPhone. No data cleanup. I missed some of the top...but hey! I was trying NOT to slip on the icy snow! You can achieve these the same results from the @Pointprecise app which is powered

6

21

347

Jonathan Stephens

@jonstephens85

1 year

This pretty much sums up 3D Gaussian Splatting!

13

81

347

Jonathan Stephens

@jonstephens85

3 years

You're going to want to watch this twice for it to sink in... I used @NVIDIAAIDev 's instant NeRFs to recreate this @CaterpillarInc 312D excavator. Notice I have infinite views from just a few images. This is the power of NeRF. #AI #NeuralNetworks #Computervision

10

64

326

Jonathan Stephens

@jonstephens85

2 years

Who’s ready for my world tour powered by @NVIDIAAIDev ’s Instant NeRFs?! The newest update is going to let me push this all a little further! #InstantNeRFSweepstakes #3D (Fixed version of the cut off video)

15

58

331

Jonathan Stephens

@jonstephens85

2 years

I traveled all the way to Endor to capture this NeRF! #AI #3D #InstantNeRF @NVIDIAAIDev

17

33

326

Jonathan Stephens

@jonstephens85

3 years

I have never used Clips before in my iPhone or iPad. These AR affects are under appreciated! The room scanning experience is also fun…reminds me of scanning my room with the Magic Leap. #AugmentedReality #AR

8

43

318

Jonathan Stephens

@jonstephens85

2 years

Could NeRFs be used for ecological studies? I did not think all of the plants and foliage would turn out so good! The blurry/smeared bushes in the front and the mossy tree branch are only blurry because they were out of focus in in the source imagery. @NVIDIAAIDev #3D #AI

7

34

315

Jonathan Stephens

@jonstephens85

2 years

Welcome to @wooorldXR on the new @Meta Quest Pro! I had sooooo much fun exploring in solo mode. THIS is how map navigation in VR should be done. Also, watch with sound on! 🔊 Thanks to the team at Wooooorld for letting me explore this app. Way more to come. #MetaQuestPro #VR

14

61

310

Jonathan Stephens

@jonstephens85

2 years

🚨 Let's clear up some confusion on NeRFs vs Photogrammetry 🚨 Matt Tancik - a leading NeRF researcher, explains in simple terms what a NeRF is, and more importantly, what it is not. We also talk about his work with @nerfstudioteam ! @Scobleizer

Will NeRFs Replace Photogrammetry? - Computer Vision Decoded Ep. 6

In this episode of Computer Vision Decoded, we are going to dive into one of the hottest topics in the industry: Neural Radiance Fields (NeRFs)We are joined ...

www.youtube.com

5

62

311

Jonathan Stephens

@jonstephens85

2 years

Haven't made a NeRF in a while. Today, I am going to update my "drag and drop" automation for the new Instant NeRF windows executable that @NVIDIAAIDev released. I will add automation for installing dependencies. Expect an update sometime today on my git:

9

29

310

Jonathan Stephens

@jonstephens85

2 years

You have to wait a tiny but longer for the @NVIDIAAIDev Instant NeRF tutorial. But here is what you will be able to do... #ai #3d

4

41

298

Jonathan Stephens

@jonstephens85

2 years

No code Instant NeRF was too much work. I just posted a video on how to make a total end to end automated @NVIDIAAIDev Instant NeRF with your own images or video. Just drag a file or folder of images into a script then sit back and enjoy! #AI #Neuralworks

10

53

301

Jonathan Stephens

@jonstephens85

1 year

People are getting very excited about dynamic gaussian splatting, as am I. However, I would like to point out that samples like this one were recorded using 60 synchronous cameras. This will be a technology for studios with specialized setups. #3D #AI

20

28

302

Jonathan Stephens

@jonstephens85

2 years

MobileNeRF is so last year. All hail BakedSDF! Although it’s not technically rendering a NeRF in your browsers. But do we care?

9

29

296

Jonathan Stephens

@jonstephens85

3 years

The new @Apple Pay #AR transit experience is out of this world! I rode the subway to NYC and back from my backyard. I definitely know how easy Apple Pay will be for transit riders. Looking forward to more phenomenal #augmentedreality experiences like this in the near future.

10

51

254

Jonathan Stephens

@jonstephens85

2 years

Did a final render of the @NVIDIAAIDev Instant NeRF from Amalfi, IT. The waves are definitely deceiving at first! #InstantNeRF

8

23

251

Jonathan Stephens

@jonstephens85

2 years

My son no longer asks for his photo. He wants me to 3D model him instead. He moved his head slightly as I walked around. Other than that, this looks like another stunning output from @LumaLabsAI . #ai #NeuralNetworks

6

20

258

Jonathan Stephens

@jonstephens85

2 years

The water on this @NVIDIAAIDev Instant NeRF is 👌 Thanks to @bilawalsidhu for pushing me to do more NeRFs with water! Reflections and sunflare make for gorgeous visuals. #AI #3D #NeuralNetworks

8

32

252

Jonathan Stephens

@jonstephens85

2 years

I love simulating movement in @NVIDIAAIDev Instant NeRFs. Check out these waves 😍 They are camera motion locked. I can fast forward or rewind the waves by moving the camera right or left. #AI #InstantNeRF #NeuralNetworks

10

30

249

Jonathan Stephens

@jonstephens85

2 years

NeRFing this lakefront villa in @NVIDIAAIDev Instant NGP, @nerfstudioteam and @LumaLabsAI to compare. More to come on the morning!

4

19

252

Jonathan Stephens

@jonstephens85

2 years

PSA: You're scanning everything WRONG! Follow these three tips when capturing video or photos for #photogrammetry . That's right, this works for @PhotoCatch3D , @scanamaze , @Polycam3D or any photogrammetry software. Of course there are many other factors, but these are a must! #3D

10

37

241

Jonathan Stephens

@jonstephens85

2 years

🎅 I almost missed @NVIDIAAIDev 's Christmas present: No Code Instant NeRF! That's right, they finally made a NeRF executable with no need to compile code! In this video I walk you through everything you need to know. #Computervision #neuralnetworks

NVIDIA Introduces No Code Instant NeRF!

After a long wait, NVIDIA released window binaries for their Instant-NGP software. That's right, not more code compiling, no more conda environments, just do...

www.youtube.com

6

30

244

Jonathan Stephens

@jonstephens85

2 years

I had fun with this NeRF. The reflections in the windows are 😎 I also tested what would happen if I pushed in on the scene for the first 5 seconds of the source video...surprisingly it all came together with an interesting effect. @NVIDIAAIDev #3D #architecture #AI

8

39

229

Jonathan Stephens

@jonstephens85

3 years

I modeled my @Nike Metcon shoe using photos from the new @apple #iPadPro and #ObjectCapture on my Macbook Pro. Here is the CRAZY part, it processed in less than 10 minutes. I will upload the model to @Sketchfab in a bit. There is one hole in the model from bad lighting.

6

67

224

Jonathan Stephens

@jonstephens85

2 years

So far, @NVIDIAAIDev Instant NeRF is winning the battle against @LumaLabsAI on linear unbounded captures. I think this is because they are taking 2 different approaches. On the left is Luma's pre-rendered video and me showing the interactive web views. #3D #AI #NeuralNetworks

8

33

225

Jonathan Stephens

@jonstephens85

2 years

Extremely low light RoomPlan worked like MAGIC on my iPad Pro. You know what I’m doing in the morning! Scanning the whole house! #WWDC22 #ar #AugmentedReality

10

28

208

Jonathan Stephens

@jonstephens85

2 years

This is quite incredible! Perhaps one of my favorite NeRFs ever! I love the whole city as the camera quickly pulls away from the building. @NVIDIAAIDev #ai #3d

FilmSpektakel

@FilmSpektakel

2 years

The datatset consists of only 92 images taken from a aerial flight in NYC a few years ago. And 3D rendering takes less than a minute! #instantNeRF #InstantNeRFSweepstakes @paultrillo @nvidia @jonstephens85

5

87

418

8

39

196

Jonathan Stephens

@jonstephens85

3 years

I did an @Apple Object Capture of a decorative stone in Raw detail. I love how I noticed the spider in the scan but not real life. #WWDC21 #3dmodeling

5

18

183

Jonathan Stephens

@jonstephens85

3 years

I’m blown away from the results I am getting from then #RayBanStories 3D scans using @EveryPointIO ! I’m working on a more hands on video with some pros/cons of using #smartglasses . Should I do a TwitterSpace session to discuss with ya’ll? #3Scanning

11

46

194

Jonathan Stephens

@jonstephens85

2 years

Blender AND Unreal Engine NeRF integration videos all in one day! Watch out everyone, NeRFs are going to inch into more and more creators' toolsets. #NeuralNetworks #AI

nerfstudio

@nerfstudioteam

2 years

v0.1.16 Released 🎉 New Blender integration for VFX workflows! #NeRF #nerfacto #VFX #Blender3d

11

127

777

3

27

191

Jonathan Stephens

@jonstephens85

2 years

Just NeRFing a @Ferrari in case they want me to meet their marketing team somewhere to do a full 360 😎 Check out those reflections! The detail of the villa and gardens! Just so much to take in here! 150 images from a 1080 smartphone video. #Ferrari @NVIDIAAIDev #3D #AI

8

24

183

Jonathan Stephens

@jonstephens85

2 years

Don't think twice that with all this #WWDC22 content I wouldn't be squeezing a NeRF in for the day. Boom! @NVIDIAAIDev 's Instant NeRF FTW! #AI #NeuralNetworks

7

34

168

Jonathan Stephens

@jonstephens85

2 years

. @NVIDIAAIDev Instant NeRF from @insta360 One RS 1-Inch camera! Overall, it came out kinda "soft". I have ideas for improvement! I decided to show the approximate imagery from source at the bottom right so you can see how much sharper the 360 footage is. There was a nagging

8

25

173

Jonathan Stephens

@jonstephens85

2 years

BOOM! Instant wall, window, and door dimensions AS YOUR SCAN with @Apple 's new RoomPlan API. This may not look pretty, we are just moving fast and seeing what works. If you look closely, it knows the difference between open and closed doors. Impressive! #WWDC22 #architecture #3D

5

37

164

Jonathan Stephens

@jonstephens85

1 year

3D Gaussian Splats in Unreal Engine 🔥

麻場健司／MocapFor(Streamer|All)開発

@KenjiASABA

1 year

#UE5 で 3D Gaussian Splatting とりあえずできた！残課題：・パフォーマンス最適化。現状はRTX3070で40fps ・色や透明度がちょっと正しくないかも？

13

63

438

4

14

164

Jonathan Stephens

@jonstephens85

2 years

NeRF Mesh vs Photogrammetry Mesh Reveal!

9

28

161

Jonathan Stephens

@jonstephens85

2 years

Check out my first look at @LumaLabsAI 's web interface. I compare results from Luma AI and @NVIDIAAIDev instant NeRF. @Scobleizer

6

23

154

Jonathan Stephens

@jonstephens85

1 year

Have you seen all of the amazing 3D Gaussian Splatting posts and want to try it out yourself! Well, I have a guide for you! This absolute beginners guide will walk you step by step to make your own scene. #AI #3D #VFX

Getting Started With 3D Gaussian Splatting for Windows (Beginner...

In this video, I walk you through how to install 3D Gaussian Splatting for Real-Time Radiance Field Rendering. I also walk you through how to make your own s...

www.youtube.com

17

28

160

Jonathan Stephens

@jonstephens85

2 years

Instant NeRF in VR. I wished I could show this off better! This is interesting… @NVIDIAAIDev #vr #ai

6

15

149

Jonathan Stephens

@jonstephens85

2 years

Quiz Time! One is from Photogrammetry via a company’s photo mode. One is from NeRF via @LumaLabsAI ’s mesh export. Which one is which? Leave a comment! Also, how long before photogrammetry is replaced by NeRF tech? @Scobleizer @gravicle

31

12

151

Jonathan Stephens

@jonstephens85

1 year

I explored NeRFs several months ago for image stabilization. Worked well on static scenes. DynIBaR is an awesome implementation for dynamic scenes! WOW! #computervision #neuralnetworks #VFX

7

21

146

Jonathan Stephens

@jonstephens85

2 years

I found this to be an interesting set of objects that @Apple 's new RoomPlan detects. Buckle up, I plan to do a lot of testing today. #WWDC22 #AR #AI #AugmentedReality

6

26

144

Jonathan Stephens

@jonstephens85

2 years

Does this NeRF feel like a virtual Monet painting? This scene would be TOUGH for photogrammetry to visualize. NeRFs make it extremely easy to visualize scenes like this one that is full of flat, think structures. What should I NeRF Next? #AI #neuralnetworks #3D #Art

13

25

137

Jonathan Stephens

@jonstephens85

1 year

I got 3D Gaussian Splatting for Real-Time Radiance Field Rendering up and running with my own data. Here is my quick first impression. Much more to come! Just follow the YT channel to see more as it comes out. #AI #3D #NeuralNetworks

3D Gaussian Splatting First Impressions

In this video, I give you my first impressions on using 3D Gaussian Splatting for Real-Time Radiance Field Rendering. I used 289 images taken from a DJI Mavi...

www.youtube.com

8

20

141

Jonathan Stephens

@jonstephens85

3 years

Perhaps my best @NVIDIAAIDev Instant NeRF yet! Those water reflections are stunning. This would have been even better if I had a beefier GPU. I had to downsample images to stay within vram limits. The results are 🔥 #AI #NueralNetwork #Computervision

10

24

131

Jonathan Stephens

@jonstephens85

2 years

I've processed this kitchen dataset a TON of different ways into a NeRF. Let's take some guesses: what software did I use for this output: A. @NVIDIAAIDev Instant-NeRF B. @nerfstudioteam C. @LumaLabsAI Tomorrow I post the complete comparison breakdown.

12

135

Jonathan Stephens

@jonstephens85

2 years

WOW! Excellent use of NeRF technology for VFX! Incredible work @FilmSpektakel !

FilmSpektakel

@FilmSpektakel

2 years

It was a pleasure to have been flown to Amsterdam with Mazda Austria! Thanks for having us and giving us the opportunity to try out new filmmaking techniques! #instantNeRF #InstantNeRFSweepstakes @NVIDIAAIDev @jonstephens85 @paultrillo @LumaLabsAI #ai #deeplearning #3d

16

93

551

1

23

122

Jonathan Stephens

@jonstephens85

2 years

This is the most images I have ever used in a NeRF: 330 I have a new GPU arriving with 2.4x capacity, bring on the images! This NeRF is of the Memorial Union at @oregonstate Can you spot the robot in the video!? #3d #Computervision #architecture #AI

11

18

116

Jonathan Stephens

@jonstephens85

2 years

Upgraded. It lives up to the speed hype! I’ll share results soon! Also, who wants a community tutorial for installing and running Nerfstudio?

nerfstudio

@nerfstudioteam

2 years

Nerfstudio team hard at work! Install our latest version for a 1.4x speedup! 🏃‍♀️🏃🏃‍♂️ #nerfacto #nerfstudio #NeRF #neuralrendering #AI #machinelearning #computervision #VFX

7

68

436

14

7

110

Jonathan Stephens

@jonstephens85

2 years

How long before I can completely replace real video footage with a NeRF and no one knows? I continue to be SHOCKED how well I can NeRF @RealityLabs Ray-Ban Stories footage! #3d #InstantNeRF #VFX @NVIDIAAIDev

5

18

113

Jonathan Stephens

@jonstephens85

2 years

Watch till the 30 second mark, I added a little glow mode 🌟 It's been a while since I posted a NeRF. Life/work has been VERY busy, but I am excited about this one. I am going to use VR to manipulate this scene for an "art experience". I love what @NVIDIAAIDev has been up to

6

17

110

Jonathan Stephens

@jonstephens85

2 years

It’s ridiculous how good @LumaLabsAI ’s results are.

amit ⚡️

@gravicle

2 years

NeRF at Night @LumaLabsAI

7

28

298

6

12

114

Jonathan Stephens

@jonstephens85

2 years

I showed RoomPlan to a realtor. He jumped out of his bar stool! He said he wants this NOW to capture house layouts. He doesn't care about accuracy, he just wants his clients to understand layouts. @Scobleizer proves your point that Apple knows non tech people! #realestate

7

17

106

Jonathan Stephens

@jonstephens85

2 years

My goodness!!! @FilmSpektakel just put on a master class on NeRFing humans. @franclucent and @smallfly you have met your competition on scanning people!

3

8

106

Jonathan Stephens

@jonstephens85

2 years

I only took one video on my camping trip at Suttle Lake Lodge as we were headed out of the mountains. I am quite surprised how well a 20 second iPhone video works for making an @NVIDIAAIDev #InstantNeRF ! #3d #architecture #AI

5

17

103

Jonathan Stephens

@jonstephens85

2 years

THIS is one of the main uses of NeRFs - the accelerate the development of visualizing a scene. ❓ Are you excited about it?❓ Currently, my feelings about NeRF quality is that they are not quite game/or film production quality yet. However, for machine learning and simulation,

Luma AI

@LumaLabsAI

2 years

Introducing the Luma✨Unreal Engine alpha! Fully volumetric Luma NeRFs running realtime on Windows in UE 5 for incredible cinematic shots and experiences, starting today! Try now:

86

521

3K

6

12

106

Jonathan Stephens

@jonstephens85

3 years

I am working on a tutorial on "gamifying" a point cloud in @unity3d to make it navigable with collisions so you can move around in FPS Character mode. Here is a sneak peek of the navigation. Checked out my pinned tweet where I set up the stylized level using Stipple. #Unity3d

8

26

103

Jonathan Stephens

@jonstephens85

1 year

Which one is better? Why? Let's hear it in the comments! #AI #3D #VFX #computervision

15

7

106

Jonathan Stephens

@jonstephens85

1 year

This post deserves a million views! 3D Gaussian Splats running in real-time in VR! Dang this is moving FAST! #AI #3D #VR

Andrey Volodin

@s1ddok

1 year

I just completed a splats inspired DX12/OpenXR particle demo that runs on both AMD and NVIDIA, with my 4090 running it at a whopping 2x2224x2160 @ 120 FPS I'm still processing the results, but the Quest 3/Vision Pro VR season is definitely going to be wild! [1/n]

22

101

649

1

13

106

Jonathan Stephens

@jonstephens85

2 years

I'm going through all of my NeRF renderings to gather material for a presentation and I came across my Dolomites NeRF. This is one easily is one of my favorites. This was all the way back on June 1st when I made it. @NVIDIAAIDev #InstantNeRF #Computervision

4

12

98

Jonathan Stephens

@jonstephens85

2 years

Pretty much getting my @unitygames VFX Graph education by combing through the setup that @_kzr created for bibcam vfx. I want to take this a whole new direction after this!

2

11

105

Jonathan Stephens

@jonstephens85

2 years

Tried Record3D to NeRF tonight. 1 minute capture, NO POSE ESTIMATION, trained for 4 minutes. Could have trained for longer. This was just a test. Nice work @nerfstudioteam ! This will be great for live demos! Next up, could I wifi stream this to NeRF training? #3D #AI

3

6

101

Jonathan Stephens

@jonstephens85

1 year

Take you 360 footage and use it for 3D Gaussian Splats and NeRFs!!! This is the EASIEST but not the BEST way to use 360 imagery. Stay tuned, I want to collab with someone to make a far better video. #AI #3D #VFX #Computervision

How to Use 360 Video for 3D Gaussian Splatting (and NeRFs!)

In this video, I show you how to take 360 video or images and use them to train a 3D Gaussian Splatting scene. This is an absolute beginner's guide and is th...

www.youtube.com

1

7

103

Jonathan Stephens

@jonstephens85

2 years

I went overkill and used 1,283 images from a video to see this @NVIDIAAIDev Instant NeRF What I learned: more images do not necessarily make the output better. However, it does help in areas with only one camera pass. 641 image version and more in the🧵 #AI #NeuralNetworks 1/5

6

13

103

Jonathan Stephens

@jonstephens85

2 years

This needs more views. I love it.

nerfstudio

@nerfstudioteam

2 years

Amazing render by @brenthyi ! Captured on a phone (no drone involved) #nerfacto #NeRF #neuralrendering #AI #computervision #nerfstudio

21

206

1K

3

17

97

Jonathan Stephens

@jonstephens85

2 years

Trying out different NeRF techniques in the evenings. I am going to compare this NeRF with @nvidiadeveloper Instant NeRF, @nerfstudioteam , and @LumaLabsAI . Who is going it win? Any bets?! The result here is rendering in real-time in Instant-NeRF with an RTX 3090ti. DLSS enabled

4

5

101

Jonathan Stephens

@jonstephens85

2 years

Something meshes never do: capture fog. If always has to be simulated in post.

Ian George

@Scannerian1

2 years

A frosty morning at the Abbey House, Glastonbury. ⁦ @LumaLabsAI ⁩

2

19

133

4

11

100

Jonathan Stephens

@jonstephens85

2 years

My first NeRF using #Nerfstudio . Some aspects look way better than my Instant NeRF rendering, and some parts are a bit weird...like my legs doing their dissapearing trick. I learned a lot! Next video will be much better! #AI #3D

5

11

95

Jonathan Stephens

@jonstephens85

2 years

How does he have sub 200 followers? This NeRF is insane. He is inspiring me to do 360 NeRFs...but I literally shipped my pro 360 camera to a client last week. So do I get a new one to test?

grade eterna

@gradeeterna

2 years

360 video footage -> processed with animeGAN's paprika model -> @NVIDIAAIDev instant NeRF 🥲 #NeRF #instantNGP #volumetric #synthesis #AI #neuralrendering #neuralradiancefields #photogrammetry

8

57

252

3

16

98

Jonathan Stephens

@jonstephens85

2 years

߷ SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with NeRFs I've posted about in-painting on NeRFs before. I find that this line of research will be highly useful for future applications. Project page:

2

29

94

Jonathan Stephens

@jonstephens85

2 years

#VR NeRF here were come!!! Still LOTS to figure out. Stay tuned...and thanks for the tips @gradeeterna @Scobleizer I am crossing every finger that this Fall I can make these on an @Apple Mac Studio or an updated Pro. #NeuralNetworks

5

17

94

Jonathan Stephens

@jonstephens85

2 years

Who's up for some automatic person removal in @NVIDIAAIDev Instant NeRF? It's super easy...once you get Detectron2 installed. #computervision #NeuralNetworks

2

8

94

Jonathan Stephens

@jonstephens85

1 year

Bravo to @Polycam3D and @cpheinrich for being the first to launch Gaussian Splats commercially! My first test was of my cat on my desk using 170 images extracted from video. He moved a tiny bit and the white balance changed at once point, which you can see in the result. #AI #3d

5

13

97

Jonathan Stephens

@jonstephens85

2 years

This visualization is nuts!

James Perlman

@jperldev

2 years

Blender visualization of a flexible camera model I made for rendering in #InstantNeRF so you can see what’s going on. Who says we have to use perspective cameras all the time?! I love NeRF so much. Cheap and easy photorealistic renders is a game changer for digital surrealism.

14

295

2K

2

11

88

Jonathan Stephens

@jonstephens85

2 years

A NeRF test set on the new @NVIDIA RTX 3090 ti. It's not as crisp because I chose 24 fps to speed up rendering. No hiccups on the upgrade and I can already tell the rendering is faster! Tomorrow, I will try 1000 images in a NeRF! #3D #InstantNeRF @NVIDIAAIDev

5

12

92

Jonathan Stephens

@jonstephens85

1 year

This is very cool! This project is being built on a NeRF Unity VR Project that I installed and played with about a year ago. Cool to see it being build on top of for industry.

1

19

91

Jonathan Stephens

@jonstephens85

1 year

This is really exciting! @leo_nid_k published a paper that shows it is possible to build 3D Guassian plat models in minutes on a CPU. He also produced meshes and more! Check out the link to the project in his post. #AI #3D #Computervision

leonidk

@leo_nid_k

1 year

My newest paper: Flexible Techniques for Differentiable Rendering with 3D Gaussians We show connections between 3D Gaussian renderers (FM & 3DGS), build fast models in minutes on CPU, optimize differentiable optical flow, and export colored meshes.

6

40

212

2

10

92

Jonathan Stephens

@jonstephens85

2 years

Check out those water reflections in this @NVIDIAAIDev Instant NeRF! Now that's something you won't get with traditional #photogrammetry ! #Neuralnetworks

5

11

89

Jonathan Stephens

@jonstephens85

2 years

If you read one thig today, this is it. The article is interactive and teaches you a lot about cameras and lenses. I am bookmarking this article for future reference.

Cameras and Lenses – Bartosz Ciechanowski

Interactive article explaining how cameras and lenses work.

ciechanow.ski

3

20

88

Jonathan Stephens

@jonstephens85

2 years

Well this is interesting!!! Training my first #nerfstudio NeRF! I think I will have to make a quick tutorial for the community of people who aren't used to working with command line software. #AI #NeuralNetworks

6

11

86

Jonathan Stephens

@jonstephens85

1 year

🔥 Looking to make awesome camera animations with 3D Gaussian Splatting? Look no further! I made a tutorial! Thanks to the @nerfstudioteam viewer! It's so easy, you can get up and running in about 15 minutes. #AI #3D #VFX

How to Use The Nerfstudio Viewer With 3D Gaussian Splatting

In this video I show you how to set up the Nerfstudio viewer to work with trained 3D Gaussian Splatting models. You can create camera animations and render f...

www.youtube.com

2

16

88

Jonathan Stephens

@jonstephens85

2 years

I’ve clearly been out-NeRFd! This is a next level compilation!

Bilawal Sidhu

@bilawalsidhu

2 years

NeRF compilation time ft. drones, phones and oh my! Photogrammetry ain't new, but it's never looked better thanks to AI. Plus, it's so satisfying to see it breath new life into old 3d scans! Watch the full 4 min video here: #ComputerVision #NeRF #3D #AI

21

202

1K

1

7

88

Jonathan Stephens

@jonstephens85

2 years

Best post all day!

James Perlman

@jperldev

2 years

Holy smokes it actually worked. Live preview of @NVIDIAAIDev #instantNeRF rendering in Blender. This is the start of something very beautiful 🥹 and I can’t wait to share more of what I’m working on next.

59

325

3K

0

10

85

Jonathan Stephens

@jonstephens85

2 years

Time for my kids to make this mess: 36 seconds Time to make this NeRF and render video: 36 minutes This isn't replacing Matterport tours yet... Capture method: 3 loops of 1080p video using iPhone 14 Pro ultra wide lens Training Method: Nerfacto via @nerfstudioteam Next up,

4

12

85

Jonathan Stephens

@jonstephens85

2 years

Real-time photogrammetry on an iPhone is getting crazy! Our team RAN around a stockpile with the @SRMeasure app and it scanned the whole pile flawlessly! He even got the measurement data in less time than it took to get his breathe back. Here is the

6

8

83