Does AI Really Need So Much HBM?
AI has created an enormous winner in the memory business. SK hynix. At the center of that success is HBM, or High Bandwidth Memory. HBM has become one of the most important components in the AI boom. But recently, Cathie Wood raised an interesting question. She remains highly optimistic about AI. Yet she has been reluctant to own memory companies such as SK hynix and Micron. That sounds strange. If AI keeps growing, shouldn't it need more HBM? And if it needs more HBM, shouldn't the companies making it keep benefiting? The answer may be more complicated. First, What Does HBM Actually Do? Think of AI as a giant kitchen. An NVIDIA GPU is an incredibly fast chef. But even the fastest chef can't cook if the ingredients arrive too slowly. So the chef needs a very fast supply of ingredients nearby. That's roughly what HBM does. GPU = the chef HBM = the high-speed ingredient station next to the chef As AI models process more data, that fast access to memory ...