Open Brush, Open Blocks, Icosa Gallery•2y ago

@mana - the "stars" brush strokes around the middle of the flower - can you erase them or something

@mana - the "stars" brush strokes around the middle of the flower - can you erase them or something to see if it fixes it? that's where Blender stops loading the scene.

Aandybak @mana - the "stars" brush strokes around the middle of the flower - can you eras...

Mana👽•2/21/24, 12:13 AM

strange. ok I can try that

Petra•3/28/24, 1:03 PM

Hi there, I tried uploading glb files to Icosa, but it only shows a black screen? What did I do wrong?

mikesky•3/28/24, 1:04 PM

@andybak correct me if i'm wrong, but you'll also need to upload the brush images that were alongside the glb as well

mikesky•3/28/24, 1:04 PM

it's a bug right now i'm afraid, working on it

Mmikesky @andybak correct me if i'm wrong, but you'll also need to upload the brush image...

andybakOP•3/28/24, 1:04 PM

Yes - you have to multiselect all the files in the glb folder. (you'll see an error after upload but you can ignore that)

Petra•3/28/24, 1:10 PM

Alright, I'll try again, thanks!

James Tunick•8/10/24, 10:31 PM

https://x.com/willeastcott/status/1821506505956331748 @andybak per our chat about Web 3D editors. This one of course specific to Gsplats so not a great fit but I’ll share a few more generic examples in this thread

Will Eastcott (@willeastcott) on X

After 10 months of development, it's finally here!

SuperSplat 1.0

The open source editor for working with 3D Gaussian Splats.
TRY NOW: https://t.co/ZpCz2o7GpB
GITHUB: https://t.co/fmjd2oDRMc

Twitter

•

8/8/24, 11:19 AM

AncientWorlds•8/11/24, 8:35 PM

Splats are incredible. Still no idea how to make one, but they seem quite powerful

AAncientWorlds Splats are incredible. Still no idea how to make one, but they seem quite power...

andybakOP•8/11/24, 8:45 PM

Easiest way is luma.ai - although they've made it hard to find since then started pushing their Sora competitor

Aandybak Easiest way is luma.ai - although they've made it hard to find since then starte...

AncientWorlds•8/11/24, 9:21 PM

I couldn't figure out how to download it. Actually recorded one the other day, then waited about 30 hours for it to process.
Seemed there used to be a way. Maybe have to have a subscription?

James Tunick•8/12/24, 2:11 AM

Luma app for iPhone or droid allows video upload. Usually takes 5-10min to process. No subscription needed. Can view via their website & download, then load in Unity or Unreal via pluggin. Highly recommend. Workflow, compression & quality improves constantly… https://apps.apple.com/us/app/luma-ai/id1615849914

App Store

‎Luma AI

‎Show your world in spectacular quality 3D, and share anywhere on the web. Brought to you by Luma AI.

Luma is a new way to create incredible lifelike 3D with AI using your iPhone. Easily capture products, objects, landscapes, moments and scenes wherever you are. Share these fast spectacular scenes w…

James Tunick•8/12/24, 2:12 AM

CEO good guy too & company growing like gang busters…

Tieguaili•8/12/24, 6:30 AM

i still have no idea why artists would have any use for a slot machine that's trying to replace the creative process

JJames Tunick Luma app for iPhone or droid allows video upload. Usually takes 5-10min to proce...

AncientWorlds•8/12/24, 8:51 AM

I'm on android. I was able to upload and process the video (currently takes 1-2 days if not a subscriber).
What I want to do, if possible is download the ply/splat/model whatever is produced.
I thought this used to be an option, but looks like can only download the video now?

TTieguaili i still have no idea why artists would have any use for a slot machine that's tr...

AncientWorlds•8/12/24, 8:58 AM

Depends on what level of the creative process you want to work with. It costs a fortune and requires a huge number of people, typically to make a feature length film.
If my goal is to tell a story, then I'm perfectly happy editing clips together. People build scenes using models all the time, rather than painstakingly craft them piece by piece, because the emphasis of their interests is in the composition or final output rather than working out mesh topology for each one.

Also some people enjoy randomness. For those who are more commercially inclined it comes down to whether the client is willing to accept long turn around times and quality over speed.
Unfortunately this has adverse impacts on the industry. From a competitive lens it's obviously not a great situation for artists. From a purely creative lens, I can see why some people feel differently about it.

TTieguaili i still have no idea why artists would have any use for a slot machine that's tr...

andybakOP•8/12/24, 9:37 AM

We're talking about creating gaussian splats from video - not generative AI. That's a separate debate and would belong in #offtopic anyway.

andybakOP•8/12/24, 9:39 AM

(but I'll just say that generative and procedural techniques have been part of art since the first cave painting used pigment blown through a straw - it's a difference in degree not in kind...)

Aandybak We're talking about creating gaussian splats from video - not generative AI. Tha...

Tieguaili•8/12/24, 10:24 AM

and luma AI is a generative AI company, that's what i was commenting on

andybakOP•8/12/24, 10:25 AM

only recently. before dream machine they were working on gaussian splats

andybakOP•8/12/24, 10:25 AM

(which is what we were talking about)

andybakOP•8/12/24, 10:27 AM

(which is AI - and to some degree "generative" but probably not what you mean by "generative AI")

andybakOP•8/12/24, 10:27 AM

Here's an example: https://lumalabs.ai/capture/78df11bf-2288-4223-b96e-3f1f68a0351d

Shelter - Created by @andybakuk with Luma

June 18, 2024

Tieguaili•8/12/24, 10:30 AM

took a bit of hunting to find that, all the links are going to their dream machine crap

Tieguaili•8/12/24, 10:30 AM

the nerf/splat thing is pretty useful though

James Tunick•8/12/24, 7:51 PM

Oh wow what a pain… feel free to share the video with me & I’ll process & export in your chosen formats when I have time. See attached screencap showing options.

JJames Tunick Oh wow what a pain… feel free to share the video with me & I’ll process & export...

James Tunick•8/12/24, 7:56 PM

Keep in mind it’s only UE & splat export formats that retain the view dependent effects like reflections

James Tunick•8/12/24, 7:59 PM

Example high poly Luma GLTF export @AncientWorlds

textured_mesh_glb.glb35.31MB

JJames Tunick Example high poly Luma GLTF export @AncientWorlds

James Tunick•8/12/24, 8:01 PM

Pretty nuts… 5min to process on Luma iPhone app. Sorry to hear droid app is not the same…

JJames Tunick Pretty nuts… 5min to process on Luma iPhone app. Sorry to hear droid app is not ...

AncientWorlds•8/14/24, 7:18 AM

I suspect its because I'm not a paid subscriber? I systematically cancelled everything over the last couple of months.
Almost everything is something I use once in a while, hard to justify keeping them all active.

That looks really cool. I often feel primitive in android world.
Those scan extractions look great though.
Might take you up on that, going to look at the mesh you sent when I fire up the headset

AAncientWorlds I suspect its because I'm not a paid subscriber? I systematically cancelled ev...

James Tunick•8/15/24, 8:32 AM

Cool feel free - also keep in mind that mesh is high poly - there is also medium & low poly options. You may have more luck with web upload & processing. Luma used to allow it though I haven't checked recently. Also if interested see below. @andybak no doubt you've seen these & think we discussed a while back but resurfacing with all the Icosa progress of late - as well as increasing public interest in nerfs/splats/3D scans:) https://github.com/aras-p/UnityGaussianSplatting https://github.com/antimatter15/splat

GitHub

GitHub - aras-p/UnityGaussianSplatting: Toy Gaussian Splatting visu...

Toy Gaussian Splatting visualization in Unity. Contribute to aras-p/UnityGaussianSplatting development by creating an account on GitHub.

GitHub

GitHub - antimatter15/splat: WebGL 3D Gaussian Splat Viewer

WebGL 3D Gaussian Splat Viewer. Contribute to antimatter15/splat development by creating an account on GitHub.

JJames Tunick Cool feel free - also keep in mind that mesh is high poly - there is also medium...

James Tunick•8/15/24, 8:33 AM

I should mention this came through trusted rec of master Keijiro https://github.com/keijiro/SplatVFX

GitHub

GitHub - keijiro/SplatVFX: 3D Gaussian Splatting with Unity VFX Graph

3D Gaussian Splatting with Unity VFX Graph. Contribute to keijiro/SplatVFX development by creating an account on GitHub.

James Tunick•8/15/24, 8:34 AM

James Tunick•8/15/24, 8:35 AM

Palaeolak•8/29/24, 8:24 PM

Hi guys, I'm uncertain if this is the right channel. But is there any site that hosts .tilt files that can be downloaded?

PPalaeolak Hi guys, I'm uncertain if this is the right channel. But is there any site that ...

andybakOP•8/30/24, 7:39 AM

That's exactly what Icosa Gallery is for - we're a few weeks away from a release with that functionality (well - you can already manually upload and download .tilt files from your own account but I suspect you want to make them available for other people as well?)

Aandybak That's exactly what Icosa Gallery is for - we're a few weeks away from a release...

Palaeolak•8/30/24, 9:04 AM

That's what I meant. I want for us all to be able to share our .tilt files.

PPalaeolak That's what I meant. I want for us all to be able to share our .tilt files.

andybakOP•8/30/24, 9:05 AM

Yep. Stay tuned then. We're nearly there. Everything works in the app like it used to with Google Poly

leon_van_kammen#4615•9/18/24, 3:43 PM

Hi @andybak Leon here (https://xrfragment.org).
(Thanks for getting back to me in the issuetracker.)

leon_van_kammen#4615•9/18/24, 3:59 PM

btw. to explain https://xrfragment.org from a icosagallery/

.tilt

.tilt

-fileformat perspective:

.tilt

.tilt

is an (open) 3D file(format) for XR experiences.
XR Fragments (XRF) spec is about (implicit+explicit) metadata (found in a 3D file) which hints the viewer-application (icosagallery e.g.) to enhance XR experiences, for example:

navigate in-VR to other 3D file by make objects with URL-metada clickable
load/project video on a plane with videoURL-metadata
switch camera/position/animation by clicking an objectIn theory, the XRF js-parser can be included in THREE.js to leverage those features (it just scans the `.userData`-fields of a loaded `.tilt|glb|obj` 3D file).(I'm writing an NLnet proposal atm, and am thinking of making a XRF>Icosagallery PR a milestone)

Lleon_van_kammen#4615 btw. to explain https://xrfragment.org from a icosagallery/ `.tilt`-fileformat p...

andybakOP•9/18/24, 7:09 PM

OK. I think there's an important distinction between "editing a scene" and "viewing/interacting with a scene". We do try and cover both in Open Brush but the lines are a bit blurry and the "view only" side of things is a bit unfinished

andybakOP•9/18/24, 7:10 PM

I think the Icosa Gallery is a better target for everything related to "Viewing/Interacting with" - I'm currently wondering if it's worth incorprating parts of Spoke (the Mozilla Hubs scene composer/editor) or the three.js editor into Icosa.

andybakOP•9/18/24, 7:11 PM

However - "marking up" a sketch in Open Brush so that extra capabilities are enabled when viewing is totally in scope.

leon_van_kammen#4615•9/18/24, 7:22 PM

These thoughts make sense.
I actually studied Spoke & Three.js editor during drafting the XR Fragments spec.
The idea was to create a fileformat-agnostic version (first I wanted to bet on Spoke, until it got abandoned by mozilla).
The texturescrolling- and link-features (of XR Fragments) were inspired by Spoke extensions, and can be used by other fileformats too now.
The deeplinking/teleporting-via-URL aspects of XR Fragments were something I've always longed for with Spoke/Hubs.

leon_van_kammen#4615•9/18/24, 7:27 PM

Btw. is there a drop-in THREEjs viewer-library of

.tilt

.tilt

files?
I'd love to add support for

.tilt

.tilt

-files on https://xrfragment.org
The fact that it is an open portable format is important for XR Fragments to promote.

Lleon_van_kammen#4615 Btw. is there a drop-in THREEjs viewer-library of `.tilt` files? I'd love to add...

andybakOP•9/18/24, 8:35 PM

We don't really intend tilt files themselves to be portable. We would rather put effort into making our gltf exports portable.

andybakOP•9/18/24, 8:36 PM

There is a tilt viewer for threejs but it's very rudimentary. There is far too much magic baked into our brushes for tilt files to be easily rendered outside of the app.

andybakOP•9/18/24, 8:37 PM

But the gltf files can have enough metadata to be rendered with varying levels of fidelity across many apps.

leon_van_kammen#4615•9/19/24, 8:13 AM

ah like progressive enhancement

leon_van_kammen#4615•9/19/24, 8:15 AM

indeed, I noticed a very cool scene in icosagallery which had some sort of illuminating fog/nebula.
I figured that perhaps some sort of shadermagic was going on.

Lleon_van_kammen#4615 indeed, I noticed a very cool scene in icosagallery which had some sort of illum...

andybakOP•9/19/24, 11:37 AM

Yep. Currently only the more basic brushes look correct in other apps (unless they can directly use our Unity or WebGL shaders).

I am trying to improve the export (with the help of @Nick ) to get closer to what is theoretically possible. The lack of additive blending in GLTF is a hindrance but I want to propose an extension to cover this and try and get a few other apps to implement it.