What tools and projects do you use for your local LLM chats and agents?

I’m trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

  • Riskable@programming.dev
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    4
    ·
    21 hours ago

    AI isn’t inherently unethical. The very premise of saying such a thing is flawed.

    Is it unethical to use AI to find new drugs and medical treatments? To use it for physics research? What about regular research? Writing code?

    Where do you draw the line?

    Also, AI was used to design the current crop of fusion reactors and the full potential of that is only just getting started. If it turns out that AI solves all the issues and generates a working fusion reactor design, it’ll make every one of your arguments moot. Because that one achievement will be worth everything. It would “save the world” so to speak (from an energy/emissions standpoint).

    Chatting with an LLM is less impact than driving a car. Think about that for a second before you say using it is unethical. It’s literally more negative for the world for someone to drive a car every day to work than it is to ask an AI to find something on the Internet or write a program in Python.

    Or perhaps your underlying complaint is more about capitalism than it is about AI?

    • YeahToast@aussie.zone
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      2
      ·
      20 hours ago

      How AI was trained is unethical. There was no consent, limited renumeration to individuals for using their work. If I drive to work, I provide value to people . Having AI scrape and summarize searches (incorrectly at times) has no benefit. Forcing all work meetings to use AI, has no benefit.

      • Freeposity@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        There was no consent, limited renumeration to individuals for using their work.

        When I learn skills using books from the library, am I morally obligated to pay the authors a cut of my future earnings?

        • YeahToast@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 hours ago

          … No? The library purchased a book? You are also an individual. AI is a corporation that has been ripping resources without paying for them plus commercializing the content that’s completely different. I believe you’d find you wouldn’t be allowed to get a book from the library then turn it into an ebook to resell.