I always love it when some massive piece of web infrastructure goes down but most websites I use are self-hosted so the only real effect is I see lots of news stories that cloudflare is down.

  • mesa@piefed.social
    link
    fedilink
    English
    arrow-up
    41
    ·
    1 day ago

    So far this year its been:

    1. AWS was massively down
    2. Azure was down a week later
    3. Cloudflare down multiple times this year

    Thats the ones that affect stuff at work. Fun times.

    • Possibly linux@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 hours ago

      My services have a higher uptime than AWS, Azure and Cloudflare despite the fact that they are running on 10 year old hardware

    • pinball_wizard@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 hours ago

      Dang. I had to look it up, but CrowdStike taking down a huge percentage of Windows PCs was so last year, I guess.

      • viking@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        20 hours ago

        If you’re stuck with Windows at work, you might have. I couldn’t log on to our domain remotely and was unable to open some documents and emails that were signed as “internal use only”.

      • mesa@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        Starbucks payments sure did.

        Mostly at work. All our stuff was on Azure, so when it went down…I kinda just stood around for the day. It was up/down the entire day. So I went for a coffee lol.

    • mesa@piefed.social
      link
      fedilink
      English
      arrow-up
      18
      ·
      1 day ago

      Cache-ing is a hard problem to solve. For MANY years cloudflare was the cheapest and easiest way to solve the issue.

      But the same people that started cloudflare have moved on or passed away. Now its just another corp. So yeah we are going to get downtime. In the corporate world, its the standard so no one is going to move off it.

      …unless it keeps going down consistently.

      For those who are in the know, does memcache work with lemmy/piefed? What is a good Cache for modern day systems?

      • irmadlad@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        1 day ago

        I do see a lot of recommendation’s to host behind Cloudflare, so if they have a problem you do too

        Fallback to Tailscale, or any number of ways to skin the cat. At the very least, everything is accessible locally. I’m not running anything mission critical, so it was more of a minor inconvenience to me.

  • iii@mander.xyz
    link
    fedilink
    English
    arrow-up
    57
    ·
    2 days ago

    Is there any meta analysis on these major outages?

    They seem to be occuring more and more regularly.

      • pinball_wizard@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 hours ago

        It would be funny if it was because of some AI coding

        It is. Sometimes the big secret turns out to just be what we all thought was happening.

      • Subscript5676@lemmy.ca
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        Please don’t remind me. Had a colleague with a senior title who just vibecoded on our CI pipeline and it ended up blocking deployments for half a day.

    • irmadlad@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 day ago

      As far as major outages, I can only think of around 10 going back 5 years. Sure there have been minor hiccups and glitches, but gosh, that’s life on the internet.

      • pinball_wizard@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 hours ago

        It does feel like the major outages are growing closer together.

        I want to blame plugging AI where it doesn’t belong, but I suppose that putting everything into the same couple of server closets could be the primary root cause.

      • BremboTheFourth@piefed.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        1 day ago

        Yeah I have issues with my home setup at least that often. I can only think of two occasions where the solution took more effort than a reboot. Maybe we’re all just old enough for “every 6 months” to feel like every 5 mins

        To clarify, by “issues” I mean “system stoppages not precipitated by me fucking with something.” I screw up my own system way more often than that lol

        • irmadlad@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 day ago

          I don’t know how old you are brother, but it feels like I’m in one of those Star Trek warps where all the stars are just whizzing by.

  • -RJ-@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    ·
    2 days ago

    “Further details will be made available when we’ve worked out how the AI screwed us this time”

    • adb@jlai.lu
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 day ago

      This really should read: further details will be made available when our AI api is back up and can self-report on how it fucked up

      • TeddE@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        AI: taking another hit of acid in preparation to research the reason why the last thing it did after taking acid didn’t work out.

  • SwizzleStick@lemmy.zip
    link
    fedilink
    English
    arrow-up
    19
    ·
    2 days ago

    Eggs, baskets, and lessons being taught about how it’s not a good idea to heavily skew their ratio.

  • db0@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 day ago

    took much of lemmy.world down. I wonder how come I’m seeing some posts from lemmy.worlders though

    • lazynooblet@lazysoci.al
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 day ago

      Cloudflare have a large international network. Perhaps some users could access sites when coming from another region

  • Confining@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    8
    ·
    1 day ago

    I don’t use cloudflare but the only reason I noticed is a lot of websites I go on use cloudflare captcha due to me using a vpn. Now I can’t even get on those website due to the captcha being down 😭

    • quick_snail@feddit.nl
      link
      fedilink
      English
      arrow-up
      1
      ·
      23 hours ago

      PSH, I can’t even pass those shitty captchas when their online. Its just an infinite loop.

      As soon as I see s site is behind a cf captcha, I close the tab and go to a different site

  • yxp@lemmy.radio
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    1 day ago

    TIL that Xitter depends on Cloudflare (I don’t have account, I just wanted to check a specific tweet). They don’t afford their own infrastructure…

    sh.itjust.work is down, but lemmy.radio is up. I need to tip them.