Llama.cpp running qwen 3.8 on a mini PC with 32GB ddr5 ram and 8GB vram. Not the most speedy but it works. I only really access it while at home but I’m also set up with tailscale.
- 0 Posts
- 6 Comments
Joined 3 years ago
Cake day: March 9th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
boudica@lemmy.worldto
Linux@lemmy.ml•Linus Torvalds shares his thoughts on Anti-AI coding rules
41·6 days agoI couldn’t agree more. There is a long list of valid reasons to hate on AI and the industry but AI = slop barely makes it onto the list anymore.
boudica@lemmy.worldto
Selfhosted@lemmy.world•ISP won't set up static IP - Services keep going downEnglish
9·6 days agoDynamic dns is what you need. Only takes a few minutes to set up
boudica@lemmy.worldto
Linux@lemmy.ml•Linus Torvalds shares his thoughts on Anti-AI coding rules
4·6 days agoNot to mention it was an issue kernel developers had spent 2 years trying to solve unsuccessfully.
boudica@lemmy.worldto
Linux@lemmy.ml•Linus Torvalds shares his thoughts on Anti-AI coding rules
1412·6 days agoLinus accepting AI now says more about how far the technology has come than anything else. AI today is not the same as AI a year ago.
We’re talking self hosting, not an enterprise setup. Industry best practices and layers of defense mitigation are not realistic expectations for something like a media server that is only intended to be accessed by the owner and maybe a couple other people.