• shnizmuffin@lemmy.inbutts.lol
    link
    fedilink
    English
    arrow-up
    26
    ·
    6 hours ago

    If I asked a PhD, “How many Bs are there in the word ‘blueberry’?” They’d call an ambulance for my obvious, severe concussion. They wouldn’t answer, “There are three Bs in the word blueberry! I know, it’s super tricky!”

    • GissaMittJobb@lemmy.ml
      link
      fedilink
      arrow-up
      3
      arrow-down
      5
      ·
      3 hours ago

      LLMs are fundamentally unsuitable for character counting on account of how they ‘see’ the world - as a sequence of tokens, which can split words in non-intuitive ways.

      Regular programs already excel at counting characters in words, and LLMs can be used to generate such programs with ease.

        • GissaMittJobb@lemmy.ml
          link
          fedilink
          arrow-up
          2
          ·
          2 hours ago

          This is true. They do not think, because they are next token predictors, not brains.

          Having this in mind, you can still harness a few usable properties from them. Nothing like the kind of hype the techbros and VCs imagine, but a few moderately beneficial use-cases exist.

          • itslilith@lemmy.blahaj.zone
            link
            fedilink
            arrow-up
            5
            ·
            1 hour ago

            Without a doubt. But PhD level thinking requires a kind of introspection that LLMs (currently) just don’t have. And the letter counting thing is a funny example of that inaccuracy