This was the example I immediately thought of when I saw this post. Blew me away when I first saw it.
You could try something like this.
https://github.com/xNul/chat-llama-discord-bot
Looks like it works on Linux/Windows/MacOS.
I’d have to say I’m very impressed with WizardLM 30B (the newer one). I run it in GPT4ALL, and even though it is slow the results are quite impressive.
Looking forward to Orca 13b if it ever releases!
Currently playing through Halo Reach. I’ve never played the series before, and so far I’m really liking it. Even though it is marked as playable, the only slight slowdown was signing into Microsoft, which wasn’t too bad even.
I’m not sure it is quite there yet, but it does have a localdocs plugin. I haven’t played with it too much so I can’t really comment on it.
Try this. It works great for me.
Wow thank you. I had no idea this was a thing!