NVIDIA H100 GPU rental rates and values rise amid AI demand

NVIDIA H100 GPU rental prices and market values are showing significant shifts driven by sustained demand for AI training and inference. While rental benchmarks present mixed signals, the overall trend indicates a recovery in value following previous price slumps.

As of mid-October, median on-demand rental rates for the H100 sit between $3.30 and $3.60 per GPU-hour. One index for completed neocloud transactions recorded a rate of $2.74 per GPU-hour, reflecting a 1.8% decrease over seven days but a 4.6% increase over 30 days. In contrast, advertised on-demand rates showed a provisional median of $3.53 per hour.

The secondary market for H100 units remains strong, with new or used-condition chips trading between $25,000 and $40,000 depending on configuration. This demand has contributed to a reported average value increase of approximately 30% year-over-year.

Market pricing varies significantly by provider type; hyperscale cloud providers reportedly charge premiums between 1.7x and 2.7x higher than specialist cloud providers. These rising compute costs may impact organizations investing in AI infrastructure as they face higher operating expenses.