cross-posted from: https://lemmy.ml/post/43700680

“A terminal tool that right-sizes LLM models to your system’s RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.”

  • lime!@feddit.nu
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 hours ago

    it’s just going to be more common with vibe coding taking over, since if you ask a model to write a readme with an installation section that’s what you’ll get.