cross-posted from: https://feddit.org/post/28915273

[…]

That marketing may have outstripped reality. Early reports from Mythos preview users including AWS and Mozilla indicate that while the model is very good and very fast at finding vulnerabilities, and requires less hands-on guidance from security engineers - making it a welcome time-saver for the human teams - it has yet to eclipse human security researchers.

“So far we’ve found no category or complexity of vulnerability that humans can find that this model can’t,” Mozilla CTO Bobby Holley said, after revealing that Mythos found 271 vulnerabilities in Firefox 150. Then he added: “We also haven’t seen any bugs that couldn’t have been found by an elite human researcher.” In other words, it’s like adding an automated security researcher to your team. Not a zero-day machine that’s too dangerous for the world.

  • magikmw@piefed.social
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    5
    ·
    7 hours ago

    I mean, idk why it’s a nothingburger. The narrative don’t sit with me. The comparison is weirdly dismissive. If it’s adding a new “elite researcher” then it’s already a win, and in fact it’s adding at least 3 - if assuming 8 hour work day, except they don’t need mental, bio and otherwise breaks and you can add as many as you have money for at any point with no ramp up.

    Is this The Register backing up from some hype pieces they wrote? Or are they ashamed to have bought into marketing?

    It’s acceleration tool in a field that’s very valuable to both blue and red actors, it’s time consuming and already blink and you miss it zero days and supply chain attacks.

    Weird af article.

    • ShortN0te@lemmy.ml
      link
      fedilink
      arrow-up
      6
      arrow-down
      1
      ·
      4 hours ago

      No one ever said that the new model would not be usefull. But Anthropic hyped it up to a 0-Day machine, who finds 0-Days in every project with easy and in places they could not have been found by humans.

      • magikmw@piefed.social
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 hours ago

        I think my problem is I’m so disentisized to hype I barely register it even intellectualy. I saw the glasswing page, skimmed it over and basically thought ‘curious’. No corpo marketing can get a rise out of me.