Because your UI System seems very advanced

V

VoHeLi | ボヘリOP•6/25/23, 1:50 PM

Specially to compete with Apple Vision Pro Swift UI

E

ethernet•6/25/23, 1:50 PM

ok pog I got all my kimera vio stuff compiling

E

ethernet•6/25/23, 1:51 PM

I have a single, beautiful dynamic library file

E

ethernet•6/25/23, 1:51 PM

now I have to write rust bindings against it lol

E

ethernet•6/25/23, 1:51 PM

Oh no. not rust, I have to connect it to monado

E

ethernet•6/25/23, 1:51 PM

and then I can see how terrible the tracking quality is

E

ethernet•6/25/23, 1:51 PM

and then I can cry and start from scratch

E

ethernet•6/25/23, 1:51 PM

let's goOooo progress!

Eethernet and then I can cry and start from scratch

N

Nova•6/25/23, 2:01 PM

haha yayyy

VVoHeLi | ボヘリ Because your UI System seems very advanced

N

Nova•6/25/23, 2:01 PM

thanks! it can absolutely do everything apple's can given some work :3

N

Nova•6/25/23, 2:01 PM

and it can do more

N

Nova•6/25/23, 3:17 PM

pub struct SimplePulseReceiver<T: Serialize + DeserializeOwned + Default + 'static>(
    HandlerWrapper<PulseReceiver, InlineHandler<T>>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> SimplePulseReceiver<T> {
    pub fn create<Fi: Field, F: FnMut(&str, &T) + Send + Sync + 'static>(
        spatial_parent: &Spatial,
        transform: Transform,
        field: &Fi,
        on_data: F,
    ) -> Result<Self, NodeError> {
        let mut mask_serializer = FlexbufferSerializer::new();
        T::default()
            .serialize(&mut mask_serializer)
            .map_err(|_| NodeError::Serialization)?;
        Ok(SimplePulseReceiver(
            PulseReceiver::create(spatial_parent, transform, field, mask_serializer.view())?
                .wrap(InlineHandler(Box::new(on_data)))?,
        ))
    }
}
impl<T: Serialize + DeserializeOwned + Default + 'static> std::ops::Deref
    for SimplePulseReceiver<T>
{
    type Target = PulseReceiver;

    fn deref(&self) -> &Self::Target {
        self.0.node()
    }
}

struct InlineHandler<T: Serialize + DeserializeOwned + Default + 'static>(
    Box<dyn FnMut(&str, &T) + Send + Sync + 'static>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> PulseReceiverHandler
    for InlineHandler<T>
{
    fn data(&mut self, uid: &str, data: &[u8], _data_reader: MapReader<&[u8]>) {
        let Ok(root) = Reader::get_root(data) else {return};
        let Ok(data) = T::deserialize(root) else {return};
        (self.0)(uid, &data)
    }
}

pub struct SimplePulseReceiver<T: Serialize + DeserializeOwned + Default + 'static>(
    HandlerWrapper<PulseReceiver, InlineHandler<T>>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> SimplePulseReceiver<T> {
    pub fn create<Fi: Field, F: FnMut(&str, &T) + Send + Sync + 'static>(
        spatial_parent: &Spatial,
        transform: Transform,
        field: &Fi,
        on_data: F,
    ) -> Result<Self, NodeError> {
        let mut mask_serializer = FlexbufferSerializer::new();
        T::default()
            .serialize(&mut mask_serializer)
            .map_err(|_| NodeError::Serialization)?;
        Ok(SimplePulseReceiver(
            PulseReceiver::create(spatial_parent, transform, field, mask_serializer.view())?
                .wrap(InlineHandler(Box::new(on_data)))?,
        ))
    }
}
impl<T: Serialize + DeserializeOwned + Default + 'static> std::ops::Deref
    for SimplePulseReceiver<T>
{
    type Target = PulseReceiver;

    fn deref(&self) -> &Self::Target {
        self.0.node()
    }
}

struct InlineHandler<T: Serialize + DeserializeOwned + Default + 'static>(
    Box<dyn FnMut(&str, &T) + Send + Sync + 'static>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> PulseReceiverHandler
    for InlineHandler<T>
{
    fn data(&mut self, uid: &str, data: &[u8], _data_reader: MapReader<&[u8]>) {
        let Ok(root) = Reader::get_root(data) else {return};
        let Ok(data) = T::deserialize(root) else {return};
        (self.0)(uid, &data)
    }
}

pub struct SimplePulseReceiver<T: Serialize + DeserializeOwned + Default + 'static>(
    HandlerWrapper<PulseReceiver, InlineHandler<T>>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> SimplePulseReceiver<T> {
    pub fn create<Fi: Field, F: FnMut(&str, &T) + Send + Sync + 'static>(
        spatial_parent: &Spatial,
        transform: Transform,
        field: &Fi,
        on_data: F,
    ) -> Result<Self, NodeError> {
        let mut mask_serializer = FlexbufferSerializer::new();
        T::default()
            .serialize(&mut mask_serializer)
            .map_err(|_| NodeError::Serialization)?;
        Ok(SimplePulseReceiver(
            PulseReceiver::create(spatial_parent, transform, field, mask_serializer.view())?
                .wrap(InlineHandler(Box::new(on_data)))?,
        ))
    }
}
impl<T: Serialize + DeserializeOwned + Default + 'static> std::ops::Deref
    for SimplePulseReceiver<T>
{
    type Target = PulseReceiver;

    fn deref(&self) -> &Self::Target {
        self.0.node()
    }
}

struct InlineHandler<T: Serialize + DeserializeOwned + Default + 'static>(
    Box<dyn FnMut(&str, &T) + Send + Sync + 'static>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> PulseReceiverHandler
    for InlineHandler<T>
{
    fn data(&mut self, uid: &str, data: &[u8], _data_reader: MapReader<&[u8]>) {
        let Ok(root) = Reader::get_root(data) else {return};
        let Ok(data) = T::deserialize(root) else {return};
        (self.0)(uid, &data)
    }
}

pub struct SimplePulseReceiver<T: Serialize + DeserializeOwned + Default + 'static>(
    HandlerWrapper<PulseReceiver, InlineHandler<T>>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> SimplePulseReceiver<T> {
    pub fn create<Fi: Field, F: FnMut(&str, &T) + Send + Sync + 'static>(
        spatial_parent: &Spatial,
        transform: Transform,
        field: &Fi,
        on_data: F,
    ) -> Result<Self, NodeError> {
        let mut mask_serializer = FlexbufferSerializer::new();
        T::default()
            .serialize(&mut mask_serializer)
            .map_err(|_| NodeError::Serialization)?;
        Ok(SimplePulseReceiver(
            PulseReceiver::create(spatial_parent, transform, field, mask_serializer.view())?
                .wrap(InlineHandler(Box::new(on_data)))?,
        ))
    }
}
impl<T: Serialize + DeserializeOwned + Default + 'static> std::ops::Deref
    for SimplePulseReceiver<T>
{
    type Target = PulseReceiver;

    fn deref(&self) -> &Self::Target {
        self.0.node()
    }
}

struct InlineHandler<T: Serialize + DeserializeOwned + Default + 'static>(
    Box<dyn FnMut(&str, &T) + Send + Sync + 'static>,
);
impl<T: Serialize + DeserializeOwned + Default + 'static> PulseReceiverHandler
    for InlineHandler<T>
{
    fn data(&mut self, uid: &str, data: &[u8], _data_reader: MapReader<&[u8]>) {
        let Ok(root) = Reader::get_root(data) else {return};
        let Ok(data) = T::deserialize(root) else {return};
        (self.0)(uid, &data)
    }
}

N

Nova•6/25/23, 3:17 PM

:3

N

Nova•6/25/23, 3:17 PM

this looks like a lot buuut

N

Nova•6/25/23, 3:21 PM

let field = SphereField::create(client.get_root(), Transform::none(), 0.1)?;
#[derive(Debug, Default, Deserialize, Serialize)]
struct ResizeEvent {
  resize: (),
  resize_x: f32,
  resize_y: f32,
}
let pulse_receiver = SimplePulseReceiver::create(client.get_root(), Transform::none()), &field, |uid, resize| {
  println!("{uid} is trying to resize: {:?resize}");
})?;

let field = SphereField::create(client.get_root(), Transform::none(), 0.1)?;
#[derive(Debug, Default, Deserialize, Serialize)]
struct ResizeEvent {
  resize: (),
  resize_x: f32,
  resize_y: f32,
}
let pulse_receiver = SimplePulseReceiver::create(client.get_root(), Transform::none()), &field, |uid, resize| {
  println!("{uid} is trying to resize: {:?resize}");
})?;

let field = SphereField::create(client.get_root(), Transform::none(), 0.1)?;
#[derive(Debug, Default, Deserialize, Serialize)]
struct ResizeEvent {
  resize: (),
  resize_x: f32,
  resize_y: f32,
}
let pulse_receiver = SimplePulseReceiver::create(client.get_root(), Transform::none()), &field, |uid, resize| {
  println!("{uid} is trying to resize: {:?resize}");
})?;

let field = SphereField::create(client.get_root(), Transform::none(), 0.1)?;
#[derive(Debug, Default, Deserialize, Serialize)]
struct ResizeEvent {
  resize: (),
  resize_x: f32,
  resize_y: f32,
}
let pulse_receiver = SimplePulseReceiver::create(client.get_root(), Transform::none()), &field, |uid, resize| {
  println!("{uid} is trying to resize: {:?resize}");
})?;

N

Nova•6/25/23, 3:21 PM

that's all you need for a pulse receiver now

N

Nova•6/25/23, 3:22 PM

and theoretically... when we have time we can make a virtual device to plug into any pulse receiver and send events to it, even change its interface depending on the pulse receiver!

N

Nova•6/25/23, 3:23 PM

remember, all pulse receiver masks will have the same keys and value types

N

Nova•6/25/23, 3:23 PM

so that's super excitingggg

N

Nova•6/25/23, 3:49 PM

also... i think it's time for a flatland redesign, don't you all? :)

N

Nova•6/25/23, 3:49 PM

N

Nova•6/25/23, 3:52 PM

apple did some things right, but others they didn't

N

Nova•6/25/23, 3:52 PM

for example, from what I could tell there's no way to both orient and resize and position a panel at the same time

N

Nova•6/25/23, 3:52 PM

but... that was literally the first interaction I ever designed for stardust

N

NovaAPP•6/25/23, 3:52 PM

oh yeah, I love that! I think that corners will make for a better UX, especially when there are multiple windows next to each other

N

NovaAPP•6/25/23, 3:53 PM

*corners instead of circles

N

Nova•6/25/23, 3:54 PM

this is the interaction btw

N

Nova•6/25/23, 3:54 PM

you can orient the whole panel by its corners alone

N

Nova•6/25/23, 3:54 PM

you always have 1 degree of freedom unconstrained, but i just constrained the panel's x axis to the cross product of the panel center to hmd and up vector

NNova oh yeah, I love that! I think that corners will make for a better UX, especially...

N

Nova•6/25/23, 3:55 PM

oh... hmm... even though they can rotate the panel too?

N

Nova•6/25/23, 3:56 PM

also keep in mind they wouldn't show until proximity

NNova also keep in mind they wouldn't show until proximity

M

meow meow meow•6/25/23, 3:59 PM

ah I see , I missed that. Then yeah looks great :3

N

Nova•6/25/23, 4:00 PM

this also means in 6DoF you can align it to surfaces too without needing fancy environment sensing

NNova you always have 1 degree of freedom unconstrained, but i just constrained the pa...

N

Nova•6/25/23, 4:03 PM

speaking of degrees of freedom.... @Ethan Merchant you see what I mean by this? and any more... intelligent way of doing it?

N

Nova•6/25/23, 4:03 PM

@opendegree too

N

Nova•6/25/23, 4:47 PM

:panel_shell:

N

Nova•6/25/23, 4:47 PM

:3

NNova speaking of degrees of freedom.... @Ethan Merchant you see what I mean by this? ...

E

ethan merchant•6/25/23, 4:51 PM

you've got the right idea

we can help take it further as needed ^-^

N

Nova•6/25/23, 4:51 PM

yay

NNova ```rs let field = SphereField::create(client.get_root(), Transform::none(), 0.1)...

グ

グースさん•6/26/23, 6:28 AM

time to read Nova code and understand Rust even more

N

Nova•6/26/23, 6:28 AM

nice

グ

グースさん•6/26/23, 6:29 AM

might get into stardust code reading lmao

グ

グースさん•6/26/23, 6:30 AM

phone sucks for reading though

N

Nova•6/26/23, 9:24 AM

https://www.macrumors.com/2023/06/22/apple-vision-pro-travel-mode/

MacRumors

Apple Vision Pro to Feature 'Travel Mode' for Better In-Flight Expe...

Apple has an intriguing hidden feature for its Apple Vision Pro spatial computer in the first developer beta of visionOS. The feature, termed...

N

Nova•6/26/23, 9:24 AM

smh my head

N

Nova•6/26/23, 9:24 AM

I KNEW this kind of thing would happen

N

Nova•6/26/23, 9:24 AM

no UI will work in a majority of situations

N

Nova•6/26/23, 9:27 AM

so they had to design a whole new mode

N

Nova•6/27/23, 8:31 AM

https://www.figma.com/file/FmaZsHzO4nrwAUQjuqaQbQ/Forces?type=design&node-id=0%3A1&mode=design&t=GpZ5Lg1XIVwO5vkZ-1

Figma

Forces

Created with Figma

N

Nova•6/27/23, 8:31 AM

working on forces xr design again