“A terminal tool that right-sizes LLM models to your system’s RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.”

  • idkman@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    26 days ago

    Its a nice utility, but I’m unsure how the “score” is evaluated. Probably outdated too, cause I have gemma3 q8 installed(for the sake of having one locally), and it didn’t detected it.