GitHub - AlexsJones/llmfit: 206 models. 30 providers. One command to find what runs on your hardware.
github.com
206 models. 30 providers. One command to find what runs on your hardware. - AlexsJones/llmfit

cross-posted from: https://lemmy.ml/post/43700680

“A terminal tool that right-sizes LLM models to your system’s RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.”

  • toothbrush@lemmy.blahaj.zoneEnglish
    5·
    3 hours ago

    I would greatly prefer a simple calc software/website that you give a model to and it tells you how it would run, but I suppose in the era of vibecoding, making small, functional, well designed software has become a distant dream.

    (and the readme tells you to curl and execute a shell script? no thanks)