The main trouble with Stoat and Fluxer from what I’ve seen is that they’re both trying too hard to be Discord, while neither of them are quite hitting the mark. They’ll be interesting to follow in the future

Arch since 2018, mint for a few years before that, Ubuntu from 2008-2014

Nexctloud generally hasn’t pushed too hard for it have they?

In your defense, I’ve thought the same joke every time I’ve seen it lol

Funny to see someone else with an active distaste for his videos. He sets off predatory alarm bells in my head and feels smarmy to me.

I just run the llama-swap docker container with a config file mounted, set to listen for config changes so I don’t have to restart it to add new models. I don’t have a guide besides the README for llama-swap.

Especially from a 7b model

run a local LLM like Claude!

Look inside

“Run ollama”

Ollama will almost always be slower than running vllm or llama.cpp, nobody should be suggesting it for anything agentic. On most consumer hardware, the availability of llama.cpp’s --cpu-moe flag alone is absurdly good and worth the effort to familiarize yourself with llamacpp instead of ollama.

Imagine being used to a centralized authority over what your computer does smh

It’s delightful for sure

And when they wear out they can largely be recycled

Batteries exist you donkey

Pihole, my beloved

I’ve never had any trouble out of mine and I’ve used it for years across several devices. That bites to hear for you

Sometimes they’re less of a short king and more like a small jester

… Or a new foe, two seconds later

I’ve used Xpra for similar

Ive had good success on similar hardware (5070 + more ram) with GLM-4.7-Flash, using llama.cpp’s --cpu-moe flag - I can get up to 150k context with it at 20ish tok/sec. I’ve found it to be a lot better for agentic use than GPT-OSS as well, it seems to do a much more in depth reasoning effort, so while it spends more tokens it seems worth it for the end result.

Most of them are written in heavy legalese to cover asses

A perfect image to post to catbox