Open Brush, Open Blocks, Icosa Gallery•4y ago

Was just discussion yesterday whether we can support gltf animation inside Open Brush (not editing,

Was just discussion yesterday whether we can support gltf animation inside Open Brush (not editing, but at least showing existing animated models). Any idea how much of that GLTFast supports?

Aandybak Was just discussion yesterday whether we can support gltf animation inside Open ...

omn0mn0m•8/21/22, 8:24 AM

Loaded with some geometry errors, but meh

mikesky•8/21/22, 8:26 AM

Should support animations fine, I use that in production in other apps. May need the import settings tweaking?

andybakOP•8/21/22, 8:26 AM

Yowzer!

mikesky•8/21/22, 8:26 AM

Also our build times are gonna skyrocket

omn0mn0m•8/21/22, 8:28 AM

Definitely needs some import setting tweaks. Not all the textures are loading

omn0mn0m•8/21/22, 8:28 AM

What it should be looking like https://github.com/KhronosGroup/glTF-Sample-Models/blob/master/2.0/BrainStem/screenshot/screenshot.gif

GitHub

glTF-Sample-Models/screenshot.gif at master · KhronosGroup/glTF-Sam...

glTF Sample Models. Contribute to KhronosGroup/glTF-Sample-Models development by creating an account on GitHub.

Mmikesky Also our build times are gonna skyrocket 😅

omn0mn0m•8/21/22, 8:29 AM

I've been doing web development the past few years and working on this has made me realise I kinda miss compile time coffee breaks

Oomn0mn0m Loaded with some geometry errors, but meh

andybakOP•8/21/22, 8:29 AM

save/load of sketches with imported models seems to work!

andybakOP•8/21/22, 8:31 AM

Biggest bug I've found so far is that the scale of the thumbnail model is sometimes so big that it fills the scene

andybakOP•8/21/22, 8:31 AM

Try the first couple of models in the Khronos samples repo

Oomn0mn0m I've been doing web development the past few years and working on this has made ...

andybakOP•8/21/22, 8:32 AM

tbh I forgot you were working on this so to see it in this state feels like an early Xmas present!

omn0mn0m•8/21/22, 8:33 AM

Lol I barely did anything to get this working XD Just added shaders to the right paths and everything fell into place

Aandybak Biggest bug I've found so far is that the scale of the thumbnail model is someti...

omn0mn0m•8/21/22, 8:34 AM

Yeah I noticed that as well :/ I think also the way that the thumbnails are staying loaded ends up costing too many resources (on the quest at least). Haven't looked too far into that

Oomn0mn0m Lol I barely did anything to get this working XD Just added shaders to the right...

andybakOP•8/21/22, 8:34 AM

I found the async bits tricky but I've done very little async in C#

andybakOP•8/21/22, 8:34 AM

GLTFast was async only - how did you work round that?

omn0mn0m•8/21/22, 8:34 AM

Lmao I just used your code from your first go

omn0mn0m•8/21/22, 8:35 AM

Tried giving it a fresh look and couldn't really think of a different enough way of doing it

andybakOP•8/21/22, 8:35 AM

ha! glad it was useful. I expected you to rip it out and start again.

Oomn0mn0m Yeah I noticed that as well :/ I think also the way that the thumbnails are stay...

andybakOP•8/21/22, 8:36 AM

Maybe just a button to "unload all thumbnails"?

Aandybak ha! glad it was useful. I expected you to rip it out and start again.

omn0mn0m•8/21/22, 8:38 AM

I started to, but ended up having to balance my dev time between trying to get this working and getting some sort of workable app using the Open Brush API for a teaching session soon

Oomn0mn0m I started to, but ended up having to balance my dev time between trying to get t...

andybakOP•8/21/22, 8:38 AM

Remind me what you're doing with the API and teaching?

andybakOP•8/21/22, 8:39 AM

(Ah. Loading a scene with imported models fails after restarting the app. Probably because the models aren't initialized properly if the thumbs aren't loaded?)

Aandybak Maybe just a button to "unload all thumbnails"?

omn0mn0m•8/21/22, 8:39 AM

I'm wondering if this would be any better? IDK if y'all are already using it. If that's the case, sorry for the redundancy. https://docs.unity3d.com/ScriptReference/AssetPreview.html

Aandybak (Ah. Loading a scene with imported models fails after restarting the app. Probab...

omn0mn0m•8/21/22, 8:40 AM

yeah currently it looks like clicking the asset to load the thumbnail will create the object. And I think clicking the thumbnail again just duplicates it into the scene

Oomn0mn0m yeah currently it looks like clicking the asset to load the thumbnail will creat...

andybakOP•8/21/22, 8:40 AM

Loading the scene twice works. So first time is correctly initing the thumbs but not the scene models.

omn0mn0m•8/21/22, 8:41 AM

Huh interesting

andybakOP•8/21/22, 8:41 AM

Probably related to async completion.

Oomn0mn0m I'm wondering if this would be any better? IDK if y'all are already using it. If...

andybakOP•8/21/22, 8:42 AM

AssetPreview looks like it's Editor-only

Aandybak Remind me what you're doing with the API and teaching?

omn0mn0m•8/21/22, 8:42 AM

For context: currently in med school. I'm working with the anatomy dept to create interactive VR learning modules. Currently, they use this thing, but it has a lot of limitations: https://www.medicalholodeck.com/en/

Medical Virtual Reality for Surgery Planning and Education

DICOM Viewer, human anatomy lab and 3D anatomy models for teamwork in virtual reality (VR) .

Oomn0mn0m For context: currently in med school. I'm working with the anatomy dept to creat...

andybakOP•8/21/22, 8:43 AM

Ah yes. I remember now.

andybakOP•8/21/22, 8:43 AM

Did you do some stuff with displaying volumetric textures as well?

Oomn0mn0m For context: currently in med school. I'm working with the anatomy dept to creat...

omn0mn0m•8/21/22, 8:43 AM

The goal is to use Open Brush's more robust drawing tools to be able to highlight structures (arteries, nerves, surgical landmarks) and then compare what the student draws with an answer key drawing

andybakOP•8/21/22, 8:45 AM

We've added point cloud import recently. Adding DICOM support would be a nice addition too.

andybakOP•8/21/22, 8:45 AM

Import ALL the things!

andybakOP•8/21/22, 8:45 AM

(had the urge to add MagicaVoxel support the other day too...)

Aandybak Did you do some stuff with displaying volumetric textures as well?

omn0mn0m•8/21/22, 8:46 AM

I did not, but it looks like gltfast has an extension that adds support for it

Oomn0mn0m I did not, but it looks like gltfast has an extension that adds support for it

andybakOP•8/21/22, 8:46 AM

Oh nice. I was just looking at https://github.com/mlavik1/UnityVolumeRendering

GitHub

GitHub - mlavik1/UnityVolumeRendering: Volume rendering, implemente...

Volume rendering, implemented in Unity3D. Want to support my project? Donate some money to Red Cross and send me a screenshot/message/issue, and I'll be greatly motivated! :) Any amount is ...

Aandybak We've added point cloud import recently. Adding DICOM support would be a nice ad...

omn0mn0m•8/21/22, 8:46 AM

Lmao the dept chair has already suggested I do this next

Aandybak Oh nice. I was just looking at https://github.com/mlavik1/UnityVolumeRendering

omn0mn0m•8/21/22, 8:47 AM

Wait nvm, it's just a planned feature https://github.com/atteneder/glTFast/issues/209

andybakOP•8/21/22, 8:49 AM

For any importer that doesn't insist on async it's pretty trivial to add support. I think point cloud import took me half a day.

andybakOP•8/21/22, 8:49 AM

I want to replace the obj importer too so it works on the Quest.

andybakOP•8/21/22, 8:50 AM

(Parsing obj files is pretty damn simple. I got a basic one done from scratch for my generative models branch)

andybakOP•8/21/22, 8:51 AM

Of course - re-exporting is tricker if the result isn't a normal mesh

omn0mn0m•8/21/22, 8:52 AM

It's funny how Unity is supposed to be this amazing cross-platform engine, but then there's so many things that don't work with VR cuz of the quest being Android

omn0mn0m•8/21/22, 8:52 AM

Still trying to find a (FOSS) webview solution :)

Oomn0mn0m Still trying to find a (FOSS) webview solution :)

mikesky•8/21/22, 9:01 AM

Let me know when you do

omn0mn0m•8/21/22, 9:06 AM

So sad that they're all like $150

Oomn0mn0m So sad that they're all like $150

andybakOP•8/21/22, 9:11 AM

A webview is such a huge blob of code, it would be better if each platform exposed it as part of their API

andybakOP•8/21/22, 9:13 AM

but then there would always be a few platforms that didn't so we could never rely on it 100%. Which means I guess we'd probably go back to wanting an embedded solution

andybakOP•8/21/22, 9:15 AM

https://github.com/Voltstro-Studios/UnityWebBrowser

GitHub

GitHub - Voltstro-Studios/UnityWebBrowser: Functional web browser f...

Functional web browser for Unity without any issues or hassle. - GitHub - Voltstro-Studios/UnityWebBrowser: Functional web browser for Unity without any issues or hassle.