Llama.cpp + Wizard Vicuna (Uncensored, if you want to get the real thing) + one of the web interfaces that are compatible. Should be listed in the readme.

Or try gpt4all which is much easier to use and even offers a selection of downloadable models.

7B/13B/30B+ depends on your hardware, especially GPU.

Serge I’ve heard good things about this one as well.

I’ve tried https://github.com/oobabooga/text-generation-webui with LLaMA, didn’t have enough VRAM to run it though.

Hi, I think localAi is a good place to start.

I believe gpt4all has a self-hostable web interface but I could be wrong. Still it can run on relatively low end hardware (relatively because it still needs a decent amount) and you could just use it on your local computer.