What tools and projects do you use for your local LLM chats and agents?

I’m trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

  • alexsantee@infosec.pub
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 hours ago

    Man, the world is so crazy right now I’m not that sure if you’re joking or not hahaha

    What about giving the “outiside consultants” their own animations and have them interacting among themselves?

    • The Bard in Green@lemmy.starlightkel.xyz
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 hours ago

      Not joking.

      TBH, the animations were a fun, early addition that were a PITA to get working properly for what’s essentially a cosmetic indicator of state… and are just a waste of resources if I’m not at the computer running her client. Once I had her working consistently, I quickly developed a backlog of things I wanted to spend GPU time on and making more videos isn’t one of them lol.