News

Public · Published

Nvidia Stock Tumbles. IBM and Supermicro AI Deal Delivers 56x Speed Boost

Nvidia shares fell 6% in Thursday morning trading even as Nvidia, IBM and Super Micro Computer announced a collaboration on AI inference storage. In tests with a 120-billion-parameter model and 130,000-token prompts, the system produced the first response up to 56 times faster.

Published:

Updated:

What happened

Nvidia shares fell 6% in Thursday morning trading even as Nvidia, IBM and Super Micro Computer announced a collaboration on AI inference storage. In tests with a 120-billion-parameter model and 130,000-token prompts, the system produced the first response up to 56 times faster.

Confirmed

Global impact / market context

The system stores previously processed information so AI applications can reuse it instead of recalculating it. If adopted, this could reduce delays on long prompts and complex workloads, while changing how providers divide storage and computing needs across their AI systems.

Analyst inference

The announcement highlights efforts to speed up AI inference, the process of generating answers from a trained AI model. Nvidia shares nevertheless fell 6% in morning trading, while the article provides no explanation for the decline or evidence that the tested system is widely deployed.

Analyst inference

What to watch

  1. Look for evidence that the tested speed improvement holds across other models, prompt lengths and real workloads; the reported result came from a specific model and prompt size. Analyst inference
  2. Watch for details on whether customers adopt the storage system and how it is deployed across GPU clusters; the companies describe its design and testing, not sales. Analyst inference
  3. Track whether the companies report lower computing needs or costs from reusing stored information; the article describes possible workload benefits but gives no cost or financial figures. Analyst inference

Evidence