Open Brush, Open Blocks, Icosa Gallery•5y ago

Quality, capture duration, movement speed

NNLR Quality, capture duration, movement speed

NLROP•11/6/21, 6:56 PM

Basically I think that the quality is too low, and that the movement speed is too high

NNLR Basically I think that the quality is too low, and that the movement speed is to...

andybak•11/6/21, 6:59 PM

Is this the "wobble" mode?

Aandybak Is this the "wobble" mode?

NLROP•11/6/21, 7:04 PM

both modes

NNLR both modes

andybak•11/6/21, 7:05 PM

What are "both"? I lose track of what modes are available. There's about 4 in the experimental build and I rarely use the non-experimental builds.

Zandy•11/6/21, 7:23 PM

Is there a way to change out the skybox to transparent png since the camera will capture pngs already?

ZZandy Is there a way to change out the skybox to transparent png since the camera will...

andybak•11/6/21, 7:25 PM

I don't actually know the answer to that

Zandy•11/6/21, 7:26 PM

ok thanks Andy!

Aandybak What are "both"? I lose track of what modes are available. There's about 4 in th...

AncientWorlds•11/7/21, 5:22 AM

There's a wobble mode and a 5 second gif capture.
The 5 second gif capture makes a really nice walk through photobox, but quality is too low to be useful on active sketches
agree that all of these would be beneficial improvements
One of the other reasons I like the gif camera is that it reacts to audio, but doesn't record audio by default.
This is important for social media sharing, as I almost always listen to music while working.
Would be nice to have that as an option on the video camera as well

AAncientWorlds There's a wobble mode and a 5 second gif capture. The 5 second gif capture mak...

andybak•11/7/21, 1:10 PM

There's actually 4 modes defined:

            SlowFollow,
            Stationary,
            Wobble,
            Circular

            SlowFollow,
            Stationary,
            Wobble,
            Circular

andybak•11/7/21, 1:11 PM

But they are disabled in non-experimental builds. There's also keyboard shortcuts to adjust some of the parameters

andybak•11/7/21, 1:12 PM

there's also this:

        TrTransform GetGifTransform(float t)
        {
            switch (m_GifStyle)
            {
                case GifMovementStyle.HorizontalArc:
                    return GetGifTransform_HorizontalArc(t);
                case GifMovementStyle.HorizontalLine:
                    return GetGifTransform_HorizontalLine(t);
                case GifMovementStyle.VerticalCircle:
                    return GetGifTransform_VerticalCircle(t);
                default:
                    return TrTransform.identity;
            }
        }

        TrTransform GetGifTransform(float t)
        {
            switch (m_GifStyle)
            {
                case GifMovementStyle.HorizontalArc:
                    return GetGifTransform_HorizontalArc(t);
                case GifMovementStyle.HorizontalLine:
                    return GetGifTransform_HorizontalLine(t);
                case GifMovementStyle.VerticalCircle:
                    return GetGifTransform_VerticalCircle(t);
                default:
                    return TrTransform.identity;
            }
        }

andybak•11/7/21, 1:12 PM

which seems to be sub-modes for the circular gif?

andybak•11/7/21, 1:14 PM

Not sure why Quest can't do mp4 video but I'm tempted to allow it to capture frame sequences as an option and leave it up to the user to compile them into video, gif or whatever. The current gif mode should just be a quick convenience mode

andybak•11/7/21, 1:19 PM

Aandybak Not sure why Quest can't do mp4 video but I'm tempted to allow it to capture fra...

mikeage•11/7/21, 1:19 PM

I don't recall if we have

ffmpeg

ffmpeg

available on the Quest, but I think output a series of frames plus a bit of documentation listing common options like

ffmpeg -i ./%04d.png output.mp4

ffmpeg -i ./%04d.png output.mp4

should be quite useful; it offers a lot more flexibility than writing compressed video, and can fit into any workflow. If we have specific requirements for certain formats, then we can look at offering quick presets too

mikeage•11/7/21, 1:20 PM

I guess we don't have ffmpeg:

... new CopyRequest(FfmpegPipe.kFfmpegDir) { omitForAndroid = true } ...

... new CopyRequest(FfmpegPipe.kFfmpegDir) { omitForAndroid = true } ...

andybak•11/7/21, 1:21 PM

I don't think android allows multiple executables in an apk? or at least they are clamping down on that kind of thing

andybak•11/7/21, 1:21 PM

i seem to remember that was the issue with LPGL code - you can to create a single signed binary

andybak•11/7/21, 1:22 PM

Although we could release a "companion app" that made it all user friendly - but something like that probably already exists

mikeage•11/7/21, 1:22 PM

I don't know. We can distribute other files, including executables, using an

.obb

.obb

file (or possibly an

.aap

.aap

, I think it's called), but I'm not an expert on exactly how that packaging works

andybak•11/7/21, 1:22 PM

got to be aware there's people who have a quest but don't own a PC or Mac or anything separate.

mikeage•11/7/21, 1:24 PM

Fair, but I feel like once we have an on screen keyboard and can name our sketches (and thus do things like foo.tilt -> foo_output/1/xxxx.png), it'll be much easier to output just images and have people put them together. It won't be sufficient for those with no computer... but I think for an MVP, it's definitely a higher priority than one more canned output format that may or may not align with a specific requirement

mikeage•11/7/21, 1:24 PM

Or maybe we can do images -> video as a hosted icosa service?

andybak•11/7/21, 1:25 PM

there must be a dll version of ffmpeg that we can call directly from C#? I wonder how ffmpeg is being called presently.

mikeage•11/7/21, 1:26 PM

Assets/Scripts/Rendering/FfmpegPipe.cs

andybak•11/7/21, 1:27 PM

hmmmm. ffmpeg must have a C API?

andybak•11/7/21, 1:27 PM

ah - we might hit GPL issues

mikeage•11/7/21, 1:28 PM

libavcodec is LGPL IIRC

andybak•11/7/21, 1:28 PM

and we're back to exactly what does "linking" mean.

mikeage•11/7/21, 1:28 PM

Or maybe dual licensed GPL/LGPL. BRB, googling

mikeage•11/7/21, 1:29 PM

Yep, dual licensed.

mikeage•11/7/21, 1:30 PM

This looks like it might have some of the answers we need, but I'm about to head out, and don't have time to read everything. Leaving it here for later. https://stackoverflow.com/questions/63946068/how-do-i-embed-a-native-code-library-in-an-android-app-sdk-29

Stack Overflow

How do I embed a native code library in an Android app (SDK 29+)?

I have an app that uses a native code library -- a custom build of ffmpeg as it happens, though that isn't strictly relevant.
Up until now I have added the executable to my res/raw directory and th...

andybak•11/7/21, 1:30 PM

this is all a bit hypothetical. it's already passed my threshold of "too much effort"

andybak•11/7/21, 1:30 PM

considering there's a workaround

andybak•11/7/21, 1:31 PM

even if people don't have access to a PC - there's web based mp4/gif generators

andybak•11/7/21, 1:32 PM

making it all seamless is a nice to have that can wait until we have a team of developer elves to call upon

andybak•11/7/21, 1:32 PM

elves are hard to come by now days. they made a fortune selling pants and no longer want to program

andybak•11/7/21, 1:33 PM

andybak•11/7/21, 1:34 PM

back to the gif thing - @AncientWorlds - take a look at this object:

andybak•11/7/21, 1:35 PM

andybak•11/7/21, 1:35 PM

try adding new presets with different settings and see how you get on.

andybak•11/7/21, 1:36 PM

@Zandy - can't remember if you're running from inside Unity. If so you could try this too

andybak•11/7/21, 1:37 PM

If it works and you can come up with some useful new presets we can add them to a future release

andybak•11/7/21, 1:38 PM

In terms of gif "quality" - do you mean resolution or something else? Disabling the post processing was mentioned before. That appears to have been accidentally reenabled and would hit gif quality quite badly in some cases

Zandy•11/7/21, 1:44 PM

Will definitely give it a try @andybak !

andybak•11/7/21, 1:48 PM

@AncientWorlds I wish we could pin down exactly when gif quality degraded. Was it bad in the first Open Brush release? Is it bad in Multibrush? I can't see what would have changed

andybak•11/7/21, 1:49 PM

You said it was fine when you compared with the last Tilt Brush release. I wonder if it was already broken in the initial open source version

mikesky•11/7/21, 2:08 PM

The gif stuff wasn’t in the initial open sourcing, we had a PR put in for it using another open source library

mikesky•11/7/21, 2:08 PM

So it may not be the original library used in tilt brush

Mmikesky The gif stuff wasn’t in the initial open sourcing, we had a PR put in for it usi...

andybak•11/7/21, 2:16 PM

ah! that's helpful

TrTransform GetGifTransform(float t) { switch (m_GifStyle) { case GifMovementStyle.HorizontalArc: return GetGifTransform_HorizontalArc(t); case GifMovementStyle.HorizontalLine: return GetGifTransform_HorizontalLine(t); case GifMovementStyle.VerticalCircle: return GetGifTransform_VerticalCircle(t); default: return TrTransform.identity; } }