Same. Have been using mine for almost a year now, and you may count me as a happy user.
- 0 Posts
- 11 Comments
redballooon@lemmy.worldto
Selfhosted@lemmy.world•[AIT] what is your selfhosted local LLM stack?English
3·12 days agoPi Coding Agent on the laptop, openwebui as a self hosted service.
I don’t host LLMs myself. My best hardware has 16GB of RAM, I could run a 4B model or so, but what’s the point? So I buy compute with ZDR turned on.
redballooon@lemmy.worldto
Selfhosted@lemmy.world•Is anyone self-hosting their own AI?English
1·16 days agoThey have a flag Zero Data Retention that cones with the promise that after a call no data is kept on any servers. I’m using that.
It’s contract level trust; I wouldn’t bet my life on it, but overall it’s a compromise I’m willing to make.
redballooon@lemmy.worldto
Selfhosted@lemmy.world•Is anyone self-hosting their own AI?English
2·16 days agoI run the AI service (OpenwebUi) myself, but buy the compute on OpenRouter. Self hosting models is not an economic viability for me.
redballooon@lemmy.worldto
Selfhosted@lemmy.world•Finally escaping Windows, ironically thanks to AIEnglish
2·18 days agoFor how to use bash, you can easily resort to local models with LMStudio. No internet search needed.
redballooon@lemmy.worldto
Selfhosted@lemmy.world•Finally escaping Windows, ironically thanks to AIEnglish
2·18 days agoDrop chats, use a harness. Include somewhere the procedure instructions to always look up documentation before crafting the command. Add instructions somewhere what dependencies you tolerate. Then it’s really good.
Once your tasks get larger, you need additional checks.
redballooon@lemmy.worldto
Selfhosted@lemmy.world•Self-Hosting a DNS Sinkhole is really importantEnglish
2·18 days agoProvide the URL to your AI chat and ask it to print out the article for you.
redballooon@lemmy.worldto
Privacy@lemmy.world•Has America Become the Scariest Country in the World to Visit?English
2·27 days agoThat sounds so inefficient. They have Palantier and still need to ask you for what you have done on social media?
Our society is very very good at ignoring inconvenient truths. Even when it becomes so obvious it can’t possibly not be seen, we’ll rather invent conspiracies and hunt scapegoats than even acknowledge the actual problem.
redballooon@lemmy.worldto
Privacy@lemmy.world•Backflip: Apple now wants to train AI models with user data after allEnglish
1·1 month agoFine, you don’t trust them to keep a contract.
With that mindset you can’t even open a bank account or do any other daily business. Or can you? Why trust those contracts but not Apple or Google’s?
Google is quite specific how they’re using your private data, and Apple as well. You can look into the contract and choose.
Meta has their scandal and has proven untrustworthy. Zuck very first known comments from Facebook success shows how he dismisses his users as idiots. But Google? They were even explicit when they were fine with evil.
And Apple at least has a plausible business concept to not automatically assume they must lie. So, what’s the reason other than “they might lie”, which applies to your bank as well?
The reparability and long life argument is over blown in my eyes. My family has a few iPhones that got updates for 8 years and had no issues the whole time. A one time replacement of the battery in a repair shop is a good investment.
Nevertheless, the sovereignty that comes with /e/IS is unmatched by other vendors. And the promise about fair production lines is also reassuring.