Recently (here and elsewhere) I have seen a lot of LLM discussions centre around the idea of coding. That may be selection bias, but according to a Gallup poll, only about 14% of AI users report using coding assistants at work. In another study (conducted by OpenAI/NBER) coding was only 4.2% of messages. PDF here
I think we’re all tired of the dismissive “wHaT’s yOuR uSE cASE” framing some questions receive…but I actually am curious about what folks are doing with their local models (and LLMs in general).
Myself, I code because there are certain features I am trying to bring about, as part of a larger stack, but that (coding) is not my end goal.
So…uh…what’s your use case for this junk? (gak, I feel sullied an unusual typing that).
That’s not nothing. Especially if you tie it into SearXNG or something else you self host.
Ive got mine tied to Tavily API for search, with trust domains, white lists and ad-blocks (that’s llm harness side / not a feature of Tavily).
Search (Google etc) really sucks these days. Kagi is great but I’m always in favour of roll your own.
I use Yacy, so search queries does not leak.