Designers and developers using Needle Engine are not impacted by Unity's runtime fees. Needle Engine is a completely separate runtime environment based on
@threejs
and designed for the web.
We are not charging per install/per view and are definitely not planning to do so.
When Apple releases a new AR scene for their events, there's often interesting tech art in those files!
Let's do a little digging ⚒️👀We'll venture into browser debugging, Blender, usdview, Unity, three.js, Needle Engine :)
And the animation is live at
The new 3D models at Apple's website are using
@glTF3D
,
@threejs
r165 and gltf-transform 4.0.8 by
@donrmccurdy
on the iPhone 16 page 🔥
The files aren't really valid though, and won't load in many viewers – but we will fix that.
Let's take a look under the hood –
Today I learned that there's a really nice Layer explorer hidden in the
@ChromeDevTools
- It shows why things are on separate render layers, which order they are in, why/when they repaint, ...
- And it's in 3D! You can rotate and peek behind things 🤯
#madewithneedle
#webdev
Some promising experiments to make tooling for gaussian splats!
Objects can be cut out / masked, and multiple captures can be combined together.
Captures with
@LumaLabsAI
, viewer by
@aras_p
IT'S HAPPENING!
✨ OPEN BETA ✨
Needle Engine is now live.
✔️ web 3D based on
@threejs
✔️ export right from
@unity
✔️ crazy fast workflow
✔️ deploy to
@glitch
in seconds
✔️ tons of docs
✔️ new website
#madewithneedle
#madewithunity
Let's get started.
Creating product microsites in 3D, right from
#blender
?!
So cool to tune meshes, materials, lighting and see it in the web, from the first moments of modelling all the way to the live website.
I think we made a very nice workflow with Needle 😌
#screenshotsaturday
#threejs
#b3d
Quest 3 can give you a (rough) mesh of the environment! And I added support for it in
@NeedleTools
Engine / WebXR today 😀
View and download your own room as 3D model now:
New Needle Engine sample:
Device Sensors!🍃
Got it to work on Android and iOS 😊
You can try here, curious if it works/doesn't work on all phones already:
#madewithneedle
@NeedleTools
@unity
→
@threejs
Updated the USD Web Viewer with proper color space support and fixed some lighting issues.
The carbon frame bike looks good now:
Please let me know if the above link doesn't work (what error you're getting on what platform) so I can catch that – thanks!
Hey
@unity
twitter, please
❌ DO NOT ❌ update to Hub 3.1.
Seems someone injected "protestware" that (at least) creates a file on your desktop into node-ipc, and Unity shipped that with the Hub today.
It seems harmless but I'd be cautious... (too late for me)
#Unity
Links →
Collaborative AR Drawing with Quest Pro and Pico 4, both in passthrough mode, in the same space 😎
Watch
@llllkatjallll
and me draw some plants, a little pond, a boat and some life 🌿⛵🐸🪰
@GravitySketch
on
@MetaQuestVR
and
@PICOXR
Big news for glTF and USD!
I'm very happy to announce: Asset Explorer
A web app that will help to bridge the gaps between
@glTF3D
and
@openusd
.
✨File feature info
✨Download USDZ conversions
✨View USDZ in the web
✨AR on Android, iOS, visionOS
🛠️WIP!
@mattdeitke
Nice! Two questions:
1) Are all objects from the dataset from Sketchfab, or are there other sources?
2) How did you check that the licenses set on models are actually correct? (there's many assets with "CC" licenses that are clearly not CC)
Around 5 years ago, I opened some small GitHub issues around glTF.
This led me to an incredible journey of improving projects all over the 3D ecosystem. Step by step, I became an open source contributor...
Now, 1267 commits later, UnityGLTF is back.
Quest Browser 31.1 was released with support for
#WebXR
depth sensing. If you have a
#Quest3
, you can try it out a basic sample here:
Let me know if you run into any issues.
This is a glimpse into the future of the web:
We see VR and AR as logical progressions for responsive web sites.
You're not building a "VR app" or an "AR app", you're building a space that people can explore on any device, any hardware.
#madewithunity
#madewithneedle
#threejs
After nearly two years of fixes, features, and using all of this in production, I finally made The Big Pull Request that will bring the UnityGltf repository back to life:
In a nutshell: this makes
@unity
a very versatile
@glTF3D
exporter.
🖼️🧵1/13:
Material Variants! 🔵🟠🟡
@unity
2022.1 is now in BETA -
and with it a feature I was really looking forward to:
You can now make "child materials" that inherit settings from their parents, and can override them with a prefab-like UI ✨
#unitytips
#madewithunity
1/7
I got carried away a bit over the last days 😅 and now proudly present a new
@NeedleTools
package:
📚ShaderGraph Markdown
Shiny inspectors for
@unity3d
ShaderGraphs, the easy way ✨
You can get it NOW from OpenUPM:
#madewithunity
More in thread ⚒:
1/
Finally found some time to wrap this up and release it –
a Compilation Visualizer for
@unity3d
!
This is helpful to check and optimize dependencies between AsmDefs & Packages 🌵
Available on
#OpenUPM
:
Based on initial code from
@KarlJamesJones
Ever got a bug report that your code breaks
@unity
builds on some platform? Not anymore!
@NeedleTools
Compilation Visualizer has
✔️ 400⭐on GitHub
✔️ new feature: EditMode Tests!
Easy to check your code runs everywhere😇
Free & open source!
#madewithunity
#screenshotsaturday
I gave this scene by
@bruno_simon
a quick spin in
@NeedleTools
Engine, exported from
@unity
to
@threejs
😊
You can mess with it on Desktop, Phones, AR, VR –
Super excited about what you'll all soon build🚀
Deployed in one click to
@glitch
, try it here:
For the first time since the introduction of the SRPs (in 2018!), content creators can now again build for ALL render pipelines (URP, HDRP, BiRP) using Shader Graph.
This took far too long, but I guess late is better than never. Out with 2020 LTS😄
#SRPLife
Unity 2022 LTS has arrived 🥳
Get ready to create DOTS-powered games, multiplayer experiences, immersive HD environments, and much more!
Explore the latest release:
So many graphics people are explaining that this is "basic stuff", when the actual issue imho is that most UI frameworks make it hard to add a bit of 3D into 2D UIs. You typically have to turn to 3D and add lots of UI to it...
(e.g. Unity is actively removing that ability)
So Apple has shipped Freeform, their take on an infinite collaborative canvas, and it's already a pretty good way to showcase 3D models.
Can directly embed
@openusd
files, view in 3D and in
#AugmentedReality
with a click.
Any other infinite canvas apps with good 3D integration?
Needle Viewer is our powerful browser-based workspace for inspecting 3D files.
It's crazy dense with information, and allows deep inspection of all aspects of a glTF file.
Here, looking at various texture channels and surface properties:
I was trying to optimize some of
@KenneyNL
's assets on import in
@unity
(combining multiple meshes into one mesh with vertex colors), and then thought "why not add AO?"
Raytracing seemed like the obvious choice to do that for low-poly meshes 🤷♂️
1/4
#madewithunity
@NeedleTools
I just stumbled upon a really cool
@unity
Inspector trick 🤯
You can add custom search terms to AddComponentMenu! Just add \0 and then some tags ✨
#unitytips
@NeedleTools
We are excited to introduce Stable Fast 3D, Stability AI’s latest breakthrough in 3D asset generation technology. This innovative model transforms a single input image into a detailed 3D asset in just 0.5 seconds, setting a new standard for speed and quality in the field of 3D
TL;DR:
glTF 3D is powerful and the age of spatial experiences on the web is here.
It doesn't need to be this complex though, we're building
@NeedleTools
so you can focus on creating beautiful 3D web experiences at a fraction of the effort:
I've updated our Quick Look Showcase just in time for
#wwdc24
On
#VisionOS
, we can support particles, hand tracking, physics, ... Fingers crossed for these features coming to iOS as well – no app needed, runs directly from the browser
Now that high-dynamic range is working, some basic support for tonemapping and exposure controls!
Mapping right from the URP Volume in
@unity
to
@threejs
😀
#madewithneedle
@NeedleTools
(note to self: need to get three-filmic in both)
So! Unity Gaussian Splatting v0.7.0 got a bit faster rendering speed, and together with
@hybridherbst
added a "cutouts" feature for faster splat editing. And some other stuff.
Oooh this is a fancy new dev feature on VisionOS:
The virtual Mac screen can now stay active during an immersive-vr session if I get that right.
Means: code changes from inside the headset + hot reload + stay in VR
That's it! Key takeaways:
- frame-by-frame animation still exists
- it can be the only way to achieve complex mesh deformation in some technologies (QuickLook USDZ, glTF)
- USD-to-glTF conversion (and vice versa) gets good
-
@NeedleTools
Engine &
@threejs
bring 3D to the web :)
Here's a musical instrument I built with Needle Engine
What's special: you can play this on iOS AR too!
We're getting really close on our journey to Everywhere Actions — the same app, everywhere.
@glTF3D
meets 🤝
@openusd
#madewithneedle
@unity
@threejs
#AR
Link in 🧵
I really like where creative workflows are going ☺️
In two evenings I
- modelled an old turtle drummer in
@nomadsculpt
- added a stage and extra animation in
@Blender
- brought it to the web with
@NeedleTools
and
@threejs
. Zero coding.
Live (with sound!) here:
The new
@UnrealEngine
"Editor for Fortnite" is interesting, both technically and for learning 3D!
- directly launches Fortnite, syncs it with Unreal
- contains full game assets to inspect
- can load glTF and export to FN
Running around with some of our
@NeedleTools
assets:
So! The Hackathon is over, and we placed IN THE TOP 3 with our interactive puppet play, Handmade Stories.
On Day 2 I already did three shows for four very happy kids 😀
Made in 2½ days!
#WebXR
! With
@NeedleTools
Engine and
@threejs
, exported from
@unity
😊
Here's the trailer:
First mixed impressions of Apple's Vision OS Simulator:
- works in principle
- Safari in the sim behaves different to Safari on the same Mac (glitchy 3D textures, links)
- keyboard locale broken
- crashes often
- can't place on surfaces
- spatial layering is hard, even for Apple
Played around with a little 2D/2.5D sidescroller this evening. Switching between side view and top-down view feels pretty nice!
Try it here, arrow keys and mouse wheel:
#madewithneedle
@threejs
#webdev
Super exciting – a ton of work on making sure automatic, unsupervised glTF optimization "just works" went into this (with improvements still ongoing).
The result is much faster loading speeds, faster raycasts, faster physics, much higher scene complexities, ...
without having to
@antonkudin
Haha, so many custom launchers in this thread. We also have our own internal one at
@NeedleTools
that lives entirely inside the Explorer context menu:
Compilation Visualizer, a completely free and open-source
@unity
Package by
@NeedleTools
now has 300 Stars📦⭐💯💯💯 on GitHub!
🔎 shows compilation times and dependencies
🔎 helps to find bottlenecks
🔎 see build errors without building
🔗
#UnityTips