forge sounds like it has the guts

W

WaffleophagusOP•9/6/23, 6:38 PM

I am not biased towards any one solution, as long as its open source, I'm happy

W

WaffleophagusOP•9/6/23, 6:38 PM

The one thing I think would be reasonable to do from something like gitlab/gitea is "when a push happens, build the image"

W

WaffleophagusOP•9/6/23, 6:38 PM

even if that's just like an http webhook to forge to say "go do the thing"

J

j0rge•9/6/23, 6:56 PM

can someone ptal? https://github.com/ublue-os/website/pull/431

WWaffleophagus forge sounds like it has the guts

J

j0rge•9/6/23, 6:59 PM

yeah all you need to build any of this is podman, a registry, and git

J

j0rge•9/6/23, 7:00 PM

the rest is mostly dressing

J

j0rge•9/6/23, 7:00 PM

(fancy dressing tho)

W

WaffleophagusOP•9/6/23, 7:00 PM

Ohhh so not some basic ceaser or ranch

W

WaffleophagusOP•9/6/23, 7:00 PM

something fancy... Ginger or something, a nice house dressing

J

j0rge•9/6/23, 7:01 PM

now I'm hungry

W

WaffleophagusOP•9/6/23, 7:01 PM

I just had lunch.

J

j0rge•9/6/23, 7:16 PM

1,756,154 image pulls! Only 250k left to go!

Jj0rge 1,756,154 image pulls! Only 250k left to go!

C

ChaiQi•9/6/23, 7:17 PM

What's the number per day up to?

J

j0rge•9/6/23, 7:17 PM

~8500

C

ChaiQi•9/6/23, 7:18 PM

Nice

Aakdev It requires around 3x the disk space as the image is stored in multiple places d...

W

WaffleophagusOP•9/6/23, 9:03 PM

looping back to this, 3x space while its building, but you clean up after completion yea?

W

WaffleophagusOP•9/6/23, 9:03 PM

store it 1 time once its built.

W

WaffleophagusOP•9/6/23, 9:04 PM

(I was so tempted to write "store it once once its built")

A

akdev•9/6/23, 9:04 PM

You can yeah but you still need to have the space available anyway

A

akdev•9/6/23, 9:05 PM

So I haven't even bothered

W

WaffleophagusOP•9/6/23, 9:05 PM

checks NAS

W

WaffleophagusOP•9/6/23, 9:05 PM

yea, I'm good

W

WaffleophagusOP•9/6/23, 9:05 PM

but I would like to not just completely waste the space

W

WaffleophagusOP•9/6/23, 9:05 PM

Hell, if I could, I'd love to set it up to do it all in ram and just write once

W

WaffleophagusOP•9/6/23, 9:06 PM

spin up a RAM disk, then destroy it upon final write

W

WaffleophagusOP•9/6/23, 9:06 PM

if an image is ~6g, and it does it 3 times, that's... easily doable with about 20gigs

W

WaffleophagusOP•9/6/23, 9:07 PM

But I yet again get ahead of myself.

W

WaffleophagusOP•9/6/23, 9:08 PM

step 1: get forge working.

A

akdev•9/6/23, 9:08 PM

cat /usr/local/bin/zerolayer
#!/usr/bin/env python3

from subprocess import run

def main():
    img_dir = "/var/run/image"

    # Preemptive cleanup to avoid build errors
    cleanup_cmd = ["rm", "-rf", img_dir]
    run(cleanup_cmd)

    podman_build = [
        "buildah",
        "bud",
        "-t",
        "oci:/var/run/image",
        "/etc/zerolayer"
    ]
    run(podman_build)
    
    # Post build cleanup
    run(cleanup_cmd)

if __name__ == "__main__":
    main()

cat /usr/local/bin/zerolayer
#!/usr/bin/env python3

from subprocess import run

def main():
    img_dir = "/var/run/image"

    # Preemptive cleanup to avoid build errors
    cleanup_cmd = ["rm", "-rf", img_dir]
    run(cleanup_cmd)

    podman_build = [
        "buildah",
        "bud",
        "-t",
        "oci:/var/run/image",
        "/etc/zerolayer"
    ]
    run(podman_build)
    
    # Post build cleanup
    run(cleanup_cmd)

if __name__ == "__main__":
    main()

cat /usr/local/bin/zerolayer
#!/usr/bin/env python3

from subprocess import run

def main():
    img_dir = "/var/run/image"

    # Preemptive cleanup to avoid build errors
    cleanup_cmd = ["rm", "-rf", img_dir]
    run(cleanup_cmd)

    podman_build = [
        "buildah",
        "bud",
        "-t",
        "oci:/var/run/image",
        "/etc/zerolayer"
    ]
    run(podman_build)
    
    # Post build cleanup
    run(cleanup_cmd)

if __name__ == "__main__":
    main()

cat /usr/local/bin/zerolayer
#!/usr/bin/env python3

from subprocess import run

def main():
    img_dir = "/var/run/image"

    # Preemptive cleanup to avoid build errors
    cleanup_cmd = ["rm", "-rf", img_dir]
    run(cleanup_cmd)

    podman_build = [
        "buildah",
        "bud",
        "-t",
        "oci:/var/run/image",
        "/etc/zerolayer"
    ]
    run(podman_build)
    
    # Post build cleanup
    run(cleanup_cmd)

if __name__ == "__main__":
    main()

you can just have this

A

akdev•9/6/23, 9:09 PM

just needs to have a timer to trigger every day or whatever then rebase to

ostree-unverified-image:oci:/var/run/image

ostree-unverified-image:oci:/var/run/image

ostree-unverified-image:oci:/var/run/image

ostree-unverified-image:oci:/var/run/image

A

akdev•9/6/23, 9:09 PM

rpm-ostree upgrade will work as usual

A

akdev•9/6/23, 9:12 PM

Oh and you need to put your image stuff in

/etc/zerolayer

/etc/zerolayer

/etc/zerolayer

/etc/zerolayer (Containerfile, etc - basically your image's git repo)

Aakdev ``` cat /usr/local/bin/zerolayer #!/usr/bin/env python3 from subprocess import ...

G

Gerblesh•9/6/23, 9:30 PM

did you push to zerolayer?

A

akdev•9/6/23, 9:30 PM

I have not I have this locally

Aakdev ``` cat /usr/local/bin/zerolayer #!/usr/bin/env python3 from subprocess import ...

B

bsherman•9/7/23, 3:38 AM

this is pretty cool... just do a silverblue install, then setup a script and start building local image that you can rebase to ?

A

akdev•9/7/23, 3:39 AM

yeah

A

akdev•9/7/23, 3:40 AM

And then if you want to install a package you just modify the containerfile and trigger an upgrade

A

akdev•9/7/23, 3:40 AM

I am toying with not having a Containerfile though

A

akdev•9/7/23, 3:41 AM

maybe rip off fleek's yaml

Aakdev And then if you want to install a package you just modify the containerfile and ...

B

bsherman•9/7/23, 3:41 AM

dude... this may be my new "shermanfin-dx" mode... streamline my github based image that i share with the family to just have the minimal...

then my local image builds on that for all the developer stuff

A

akdev•9/7/23, 3:41 AM

Yeah it's better to build a small set of modifications locally

A

akdev•9/7/23, 3:42 AM

It takes like 30 minutes for me to install anything cuz I'm building my base there

B

bsherman•9/7/23, 3:43 AM

in other news, @akdev , thank you for all your advice over the last while about podman and selinux stuff

i am pretty happy to have gitea's

act_runner

act_runner

act_runner

act_runner working on podman on silverblue with selinux... where it can do all the stuff i need... the tricks were simply setting a symlink for /var/run/docker.sock -> /run/podman/podman.sock and setting label=false in my containers.conf

Aakdev I am toying with not having a Containerfile though

G

Gerblesh•9/7/23, 3:43 AM

I'd take a look at the startingpoint rewrite if you want some ideas for making it declarative

Aakdev I am toying with not having a Containerfile though

B

bsherman•9/7/23, 3:44 AM

yeah, i'm curious what you'd do alternatively? more ostree native?

G

Gerblesh•9/7/23, 3:47 AM

That would be rpm-ostree no? It wouldn't be ingesting a local OCI, instead re building the ostree image with the packages, which is exactly what rpm-ostree does for package layering

Bbsherman yeah, i'm curious what you'd do alternatively? more ostree native?

A

akdev•9/7/23, 3:51 AM

Mm I am not sure, I wish there was a way of rebasing OCI layers

A

akdev•9/7/23, 3:52 AM

To be honest I am using ansible for the whole set up so that adds to it

A

akdev•9/7/23, 3:54 AM

But also it has to be written like 3 times:

podman storage
Local image in filesystem
ostree repo

A

akdev•9/7/23, 3:54 AM

Maybe there's a way of not doing that

forge sounds like it has the guts

Similar Threads

Similar Threads

Similar Threads