64G. But CPU inference is painfully slow.
- 0 Posts
- 16 Comments
Yeah, it’s “good for its size” but it’s just too flaky for me to use for any significant coding.
I’ve tried a few times but with only 8gig of vram it’s simply not worth it.
- atzanteol@sh.itjust.workstoSelfhosted@lemmy.world•[META] Should AI disclosure tags [AI], [NOT AI] be mandated when sharing projects?English915·2 days ago
No - the rabid AI hate here is… ridiculous. This only feeds it.
I hate python. Just hate it. Should I require that everyone posting indicates what language they use so that I can properly hate on the python projects?
Besides - how are you defining “AI”? Used to help? Writes the entire thing? Used for auto-complete? Should we really be gatekeeping like this? In 10 years it’ll become rare to find anything not using AI anyway. The rabid AI haters will always be around though.
- atzanteol@sh.itjust.workstoSelfhosted@lemmy.world•Recommendations for next steps for my setup and order of operations (primarily as it relates to reverse proxies)?English21·4 days ago
Unless you have a specific need there is no reason. So long as the domain resolves then you’re probably good. I use AWS so I can easily update the IP since I have a dynamic IP address. Some may use Cloudflare because it’s necessary to use other services or because there’s a ‘free’ option or something? I’m really not sure - I’m not familiar with Cloudflare but I see lots of people using their low-end free services for things.
- atzanteol@sh.itjust.workstoSelfhosted@lemmy.world•Recommendations for next steps for my setup and order of operations (primarily as it relates to reverse proxies)?English11·4 days ago
The tutorials I’d been looking at were showing them overriding the DNS servers at the domain registrar with servers from Cloudflare or elsewhere. Is that just because there may not be an automated way to update the IP dynamically with the domain registrar, but there is for Cloudflare?
Probably because those tutorials are using Cloudflare for DNS services. I actually use Amazon AWS Route53 for my domain (purchased through 123cheapdomains (yes - really)) and I update it through the AWS APIs with a small script.
- atzanteol@sh.itjust.workstoSelfhosted@lemmy.world•Recommendations for next steps for my setup and order of operations (primarily as it relates to reverse proxies)?English1·4 days ago
I was curious what distro you folks might recommend for this purpose.
This is a bit like going to an automotive forum and asking “what’s the best car to buy”. You’re going to get a lot of “I’m running <blank>” and people telling you their preferences, which is NOT the answer to your question. The answer to your question is that literally any of them would be fine for your purposes. If you’re happy with Bazzite then stick with Bazzite. There’s no reason to switch.
If I have to manage it entirely by command line, it will take 10 times longer for me to do anything I want to do, and I’d really prefer a GUI.
Then use a GUI. The extra memory used is trivial and your system will be way over-powered for a reverse proxy to a home network anyway. In Linux land there’s really no such thing as a “server distro” and a “desktop distro” for the most part. I use Ubuntu, Debian and Fedora as servers. They can all have desktops on them too.
You may find, however, that as you manage more than one system it becomes tiresome/tedious to have to use RDP for remote administration and may start learning the CLI over time. Especially since it’s often a lot easier to give somebody a list of commands to run on a forum than to say “open your network manager, which is different on Gnome from KDE, click the button that says…”.
I need something that can sit there without updating until I tell it to
Are you going to update frequently? You want to be sure you’re keeping security patches up-to-date. Auto-patching can be very good unless you have the discipline to keep up with it.
I need a domain for that, and a lot of tutorials just skip on past this step in the domain configuration screens where you “enter your DNS servers” as though I know why I’d need other DNS servers,
You’ve got a bit of reading on how DNS works. But basically there are “root DNS servers” that everybody knows by IP address that then know about other DNS servers by IP and forward traffic to them to resolve names. When you register a domain you are asking one of those DNS providers to resolve your hostname to your IP address. You can see this a bit by running
dig +trace some.host.nameand it will show the requests made. Your DNS servers would be the ones where you register your domain.BUT your IP address may change. So you generally need a way to update it if it does. There are providers like dyndns.org and others (search for dynamic domain service or something) that will give you a sub-domain for free/cheap and tools to auto-update it. Something like “mysite.dyndns.org”.
- atzanteol@sh.itjust.workstoProgramming@programming.dev•I lack the knowledge/skills to fix my slop of an attempted shell scriptEnglish01·7 days ago
You know - I hear your frustration. We’ve spent a lot of our lives learning and perfecting a craft that can now be done by anybody willing to pay an LLM to do it for them. I get it. It’s a it disheartening to see your hard-earned skill commoditized like that. But it’s not the only skill we’ve learned. The technical knowledge and experience we built up over that time is invaluable as well and can’t be replaced with an LLM. Calculators didn’t stop mathematicians from existing either.
But the world is different now. This genie is not going back in the bottle no matter how much we whine or say “but AI still makes mistakes!” Lashing out at those who use AI as either “not real programmers” or for “vibe coding” isn’t going to help either. Nobody said you had to debug this dudes code. You bitched of your own free will. You didn’t help, you were just mean.
- atzanteol@sh.itjust.workstoProgramming@programming.dev•I lack the knowledge/skills to fix my slop of an attempted shell scriptEnglish01·8 days ago
Don’t be shitty. This could be how people get into coding now - figuring out why something like this doesn’t work. They asked for help understanding what’s going on which is a good place to start.
- atzanteol@sh.itjust.workstoProgramming@programming.dev•GNU Guix transactional package manager and distribution — GNU GuixEnglish0·8 days ago
Or perhaps it’s just a small percentage of developers who actually like it and that’s why Lisp/Scheme/etc. have been relegated to academia while the rest of the world uses languages that don’t descend into parenthesis hell?
- atzanteol@sh.itjust.workstoProgramming@programming.dev•GNU Guix transactional package manager and distribution — GNU GuixEnglish0·9 days ago
It’s worse because it’s worse.
Reading lisp is a pain in the ass. You can get used to it as I did when I had to. But it’s a bit like getting used to music you hate.
- atzanteol@sh.itjust.workstoSelfhosted@lemmy.world•How would you expose Jellyfin securely without a vpn?English0·1 month ago
Your vps isn’t doing anything useful security wise… it’s just sending traffic directly to jellyfin.
You’d get the same protection with just port forwarding to a local proxy in front of jellyfin. Or you could even leave out the proxy if you didn’t need it.
- atzanteol@sh.itjust.workstoProgramming@programming.dev•GNU Guix transactional package manager and distribution — GNU GuixEnglish0·6 months ago
Well, many Schemers love the language
Neat. Everyone else hates it. Not dislikes, not “can deal with it”. But hates it.)))))))))))))) ))))))))))))))
- atzanteol@sh.itjust.workstoProgramming@programming.dev•GNU Guix transactional package manager and distribution — GNU GuixEnglish0·6 months ago
“Stop trying to make ‘scheme’ happen”
Seriously though - almost nobody but language nerds like scheme.
I’ll check that out - speed isn’t my biggest issue so much as coding performance… The qwen 3.5 model I was using can write code, but it’s… Meh? Like sometimes it doesn’t even compile.
I did try tweaking llama.cpp to do some cpu offloading and it does seem to allow for much larger contexts at a modest performance loss. I’ll check out larger models.