“In 10 years, computers will be doing this a million times faster.” The head of Nvidia does not believe that there is a need to invest trillions of dollars in the production of chips for AI::Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that

  • eleitl@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    9 months ago

    So a Cerebras wafer will be 10^6 faster for the same computation as now, for the same price, in just 10 years? Not after Moore scaling ended many years ago and neural hardware architecture has matured. You can sure go analog, but that’s not the same computation. And that’s the end of the line, not without true 3d integration.

    • givesomefucks@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      9 months ago

      It depends what you call AI.

      True artificial intelligence likely requires quantum computing because there’s some quantum stuff happening our brains and probably the smartest living human (Sir Roger Penrose) thinks that’s where the secret to consciousness is hiding after spending the last couple decades investigating that after helping Hawking finish up Einstein’s work

      If you just mean a chat bot that can pass the Turing test, then yeah we can just wait a decade instead of developing special tech for AI.

      I mean, if we really develop artificial intelligence before we understand our own consciousness, we’re probably fucked anyways.

      It’d be like somehow inventing a nuclear bomb before understanding what radiation was. We’d have no idea what we’re creating or what the consequences of flipping the switch would be.

  • General_Effort@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    9 months ago

    Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that additional trillions of dollars need to be invested in the industry.

    *Because of

    You heard it, guys. There’s no need to create competition to Nvidia’s chips. It’s perfectly fine if all the profits go to Nvidia, says Nvidia’s CEO.

  • Buffalox@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    9 months ago

    Sorry I have doubts, because that would require a factor 4x increase every year for 10 years! 4x^10 = 1,048,576x
    Considering they historically have had problems achieving just twice the speed per year, it does not seem likely.

      • Buffalox@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        9 months ago

        Yes, but usually we keep those 2 kinds of optimizations separate, only combining chip design and production process. Because if the software is optimized, the hardware isn’t really doing the same thing.
        So yes AI speed may increase more than just the hardware, but for the most sophisticated systems, the tasks will be more complex, which may again slow the software down.
        So I think they will never be able to achieve it even when considering software optimizations too. Just the latest Tesla cars boast about 4 times higher resolution cameras, that will require 4 times the processing power to process image recognition, which then will be more accurate, but relatively slower.
        We are not where we want to be, and the systems of the future will clearly be more complex, and on the software are more likely to be slower than faster.