Google’s AI infrastructure chief tells staff it needs thousandfold capacity increase in 5 years.

Yeah, that’ll happen.

While AI bubble talk fills the air these days, with fears of overinvestment that could pop at any time, something of a contradiction is brewing on the ground: Companies like Google and OpenAI can barely build infrastructure fast enough to fill their AI needs.

During an all-hands meeting earlier this month, Google’s AI infrastructure head Amin Vahdat told employees that the company must double its serving capacity every six months to meet demand for artificial intelligence services, reports CNBC. The comments show a rare look at what Google executives are telling its own employees internally. Vahdat, a vice president at Google Cloud, presented slides to its employees showing the company needs to scale “the next 1000x in 4-5 years.”

While a thousandfold increase in compute capacity sounds ambitious by itself, Vahdat noted some key constraints: Google needs to be able to deliver this increase in capability, compute, and storage networking “for essentially the same cost and increasingly, the same power, the same energy level,” he told employees during the meeting. “It won’t be easy but through collaboration and co-design, we’re going to get there.”

  • magnetichuman@fedia.io
    4·
    15 hours ago

    “My loyal advisor,” said the king, “I must grant you a reward for your many years of good service. What is it that you desire?” And the advisor asked the king, “Sire, simply give me one grain of rice on the first square of the chessboard, two on the second square, four on the third square and so forth until all sixty-four squares are filled.” “Such a small thing?” said the king. “It shall be done at once.” And so the advisor was given all the rice in the kingdom.

  • cassandrafatigue@lemmy.dbzer0.com
    1·
    12 hours ago

    I’m really high and at first glance saw all the colorful pipes as like a 90s McDonalds play area.

    I feel like that interpretation made this whole article ~70% less silly.

  • megopie@beehaw.orgEnglish
    21·
    2 days ago

    puts a bunch of AI features in, turns them on by default without user’s asking for them, mandates employees use it when ever they can.

    “How could this be a bubble? Look at all the demand!”

  • HarkMahlberg@kbin.earth
    44·
    2 days ago

    the next 1000x in 4-5 years

    At the risk of stating the obvious, Ars is working backwards from this metric to get their headline “double every 6 months.” 2^10 = 1024, to get that number in 5 years means doubling every half-year.

    But Google didn’t set incremental 6-month deadlines for 5 years straight, they set a single 5-year deadline. Because in 6 months shareholders can call their bluff quite easily, but in 5 years they’re hoping everyone is A) distracted by some new disaster, or B) there’s a new tech hype cycle they can push. They’re trying to stall the bubble popping by pointing to a nebulous future where they magically scale to infinity, and hoping we all forget that they ever made this claim.

  • TimLovesTech@badatbeing.socialEnglish
    26·
    2 days ago

    Doubling every year would be crazy unsustainable at Google scale, but to tell employees you need to do so every 6 months seems like a fever dream of someone that doesn’t understand what they are asking (or knows they aren’t responsible for actually doing it). The old “just throw it over the fence” approach that corporate kool-aid drinkers love because they can take credit and shift blame.