• 3 Posts
  • 64 Comments
Joined 1 year ago
cake
Cake day: July 21st, 2023

help-circle

  • If generation temperature is non-zero (which it often is), there is inherent randomness to the output. So even if the first number in a statistic should be 1, sometimese it will just randomly pick any other plausible number. Even if the network always picks the correct token as the highest probability, it’s basically doing a coin toss for every token to make answers more creative.

    That’s on top of hoping the LLM has even seen that data during training AND managed to memorize it during training AND that the networks just happens to be able to reproduce the correct data given your prompt (it might not be able to for a different prompt).

    If you want any reliability at all, you need to use RAG AND also you yourself have to double check all the references it quotes (if it even has that capability).

    Even if it has all the necessary information to answer correctly in it’s context window, it can still answer incorrectly.

    None of the current models are anywhere close to producing trustworthy output 100% of the time.






  • people need to take a step back and realize we have the capability to trap quasi-omnipotent quasi-demons in our personal computers

    yeah they lie a lot and rarely do what you want them to, but that’s just what demons do

    And it’s all powered by some dark crystals created with light magic that slowly poison the planet

    that’s some arcane bullshit



  • Probably because beehaw aggressively defederates from any annoying instances.

    I would say Lemmy and the lemmy apps are currently set up to funnel as many users into any communities as possible, because there are so little people on here.

    I usually browse rising (of all communties I haven’t blocked) so there is enough content. I imagine many people are doing the same.

    The only fixes I see is when 1) Lemmy gets more users, 2) defederating aggressively or 3) heavy moderation or 4) having “high effort” barriers to posting in communities (for example: must have X much karma or write a message to the mods to post).

    All my experiences on the privacy communties were that 10x more people from outside comment and are angry that I want more privacy. Which kind of defeats the point of communties. At the moment communities act more like topic tags that categorize posts, not as real communities.

    Lemmy is pretty good for what it is, but it needs many changes to survive into the future, to operate more like how it was intended.