Im trying to figure out how online search funkcion works… Didnt have much luck for now. And also general discusion about the app would be wery helpfull for eweryone.

  • @[email protected]
    link
    fedilink
    59 days ago

    Taking advantage of the fact that this thread became popular, question to all of you guys: do you recommend some other open source LLM front ends?

    • Domi
      link
      fedilink
      49 days ago

      LM Studio is by far my favorite. Supports all GPUs out of the box on Linux and has tons of options.

        • Domi
          link
          fedilink
          19 days ago

          Looks like you’re right.

          I switched to it when Alpaca stopped working on AMD GPUs and was under the impression it is open source.

          • @[email protected]
            link
            fedilink
            English
            09 days ago

            Depending on how you had it installed, Alpaca split support in the Flatpaks.

            If you want AMD support, you need to install com.jeffser.Alpaca.Plugins.AMD

            • Domi
              link
              fedilink
              18 days ago

              Doesn’t work for me unfortunately, always falls back to CPU ever since the packages were split up.

    • juipeltje
      link
      fedilink
      29 days ago

      So far i’ve really liked just using ollama in the terminal since it just spits out text anyway.

      • @[email protected]
        link
        fedilink
        19 days ago

        ofc I could even send raw api requests, but sometimes it’s good to have a nice GUI that “just works”.

        Specifically I’m looking for something that could handle not only text responses, but also attachments, speech recognition and MCP support.

        • juipeltje
          link
          fedilink
          19 days ago

          Yeah in that case you probably want something else. So far i’ve only ever used it for text based questions. I think i remember seeing that there is also a webui out there but i don’t remember the name.