Since so far, I have found that project to be one of the better ways to play with “ai” tech due to t

Since so far, I have found that project to be one of the better ways to play with “ai” tech due to the easy interface and, wide module support that, and their backend API makes it possible to implement the output into other programs

GenieOP•12/22/23, 8:55 AM

However, still waiting for ollama to merge this pull request https://github.com/jmorganca/ollama/pull/1146 since that would also be awesome, being able to run ollama on my gpu

GitHub

Add cgo implementation for llama.cpp by dhiltgen · Pull Request #11...

This change revamps the way ollama wires up llama.cpp for gguf to link directly via cgo instead
of running a subprocess. Within llama.cpp, a thin facade has been added to server.cpp (via included ...

GenieOP•12/22/23, 8:56 AM

But the short version is I wanna play with cool ai tech locally

GGenie But the short version is I wanna play with cool ai tech locally

Valerie•12/22/23, 9:23 AM

I've used stable diffusion on Bazzite via distrobox using ROCM just fine

Valerie•12/22/23, 9:23 AM

https://media.discordapp.net/attachments/1131784985024680026/1165107207029923861/ezgif-1-d35b594ae3.gif?ex=6545a5a4&is=653330a4&hm=3fd0176aafeaa8aaa0c2f5dcf24065a9dd97d743a9bb9c7edd2d1d5e28ecf7c8&

j0rge•12/22/23, 12:07 PM

We should be putting ai workload shortcuts in justfiles

Jj0rge We should be putting ai workload shortcuts in justfiles

Valerie•12/22/23, 12:13 PM

I think it'd be a bit more work than it's worth, I kinda struggled to get it working because the landscape with ROCM and a lot of AI projects change quite often

VValerie I've used stable diffusion on Bazzite via distrobox using ROCM just fine

GenieOP•12/22/23, 12:34 PM

Thank you I appreciate it since now I might be able to switch

GGenie Thank you I appreciate it since now I might be able to switch

Valerie•12/22/23, 12:42 PM

No problem

Valerie•12/22/23, 12:42 PM

Actually mentioning it, I want to try and get stable diffusion working on Deck

Raltay•12/22/23, 1:42 PM

Is there a way to download (as an archive) either specific bazzite root files (conf files of pipewire/pipewire-pulse/wireplumber from /usr/share) or all bazzite root files (if former only is not possible) from bazzite-deck:testing?

j0rge•12/22/23, 1:44 PM

podman pull it

j0rge•12/22/23, 1:44 PM

Raltay•12/22/23, 1:48 PM

OK thank you!

CyberGlitterhoof•12/22/23, 3:39 PM

out of curiosity, why does bazzite have at least 3 process trackers? NVtop, Btop, and Mission Center (and on Gnome, System Monitor).

CyberGlitterhoof•12/22/23, 3:39 PM

it seems really excessive

CCyberGlitterhoof out of curiosity, why does bazzite have at least 3 process trackers? NVtop, Bto...

Valerie•12/22/23, 3:40 PM

NVTop because Nvidia is weird, btop I think to match SteamOS? And Mission Center because it's a good GUI process tracker that a lot of us are just fans of, also good for people coming from Windows to have something familliar.