Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • robber@lemmy.ml
    link
    fedilink
    English
    arrow-up
    2
    ·
    6 hours ago

    Given the 27b is a dense model, I think the numbers are quite ok. Curious about the quant tho.

    The cool thing about the strix is its large unified memory, but it lacks memory bandwith for compute intensive workloads. Something like Qwen3.5-122b MoE with only like 12b active parameters might run at twice the speed if it fits the configuration.

    • Domi@lemmy.secnd.me
      link
      fedilink
      English
      arrow-up
      1
      ·
      19 minutes ago

      Curious about the quant tho.

      Q8 from unsloth.

      Something like Qwen3.5-122b

      My go to model for knowledge. Definitely much faster at Q5 but it lacks the tool calling quality of the Qwen3.6 models. Really hoping we see a Qwen3.6-122b soon…

    • SuspiciousCarrot78@aussie.zoneOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 hours ago

      Yeah. Though I think theres a new strix out soon (Medusa? Gorgon? Something like that).

      Its a bit like my P40. On paper, it has 24GB. But that 24gb is capped at 400GB/s and the ai compute is what…Pascal era?

      AI = Good, fast, cheap - pick 2