Bought b70 with egpu enclosure and usb4 connection wasn’t really planning to actually run anything but now ended up with llama.cpp with openwebui - kids/parents want to/have to use chat, might as well provide local solution than them using industry options. Also started with ollama and Gemma 4 26b a4b - asked it to write script to setup llama.cpp in container.
- 7 Posts
- 3 Comments
Joined 5 years ago
Cake day: February 3rd, 2021
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
- rando@lemmy.mltoSelfhosted@lemmy.world•How would you expose Jellyfin securely without a vpn?English01·1 month ago
headscale + tailscale. U will need a very small vps for headscale though.
I’ve been testing coding capabilities a bit (mostly scripts - so that work done by ai is reproducible).
As for image gen + chat . as long as chat model + context + image model fits, u should be fine.