What tools and projects do you use for your local LLM chats and agents?

I’m trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

  • wewbull@feddit.ukEnglish
    41·
    22 hours ago
    • Pi - plain and simple - run inside firejail.
    • lamma.cpp w/ vulkan backend

    That’s it.