Excellent article! Maybe a silly question, but looking at the H100 instances on AWS, Azure, and Google Cloud, the prices for H100 are still above $4 per GPU on 3-year commitments and over $10 on-demand. Is there any trade-off in using these resellers instead of the three big cloud providers, or is this IaaS commoditized? I’m thinking abo…
Excellent article! Maybe a silly question, but looking at the H100 instances on AWS, Azure, and Google Cloud, the prices for H100 are still above $4 per GPU on 3-year commitments and over $10 on-demand. Is there any trade-off in using these resellers instead of the three big cloud providers, or is this IaaS commoditized? I’m thinking about this more to assess the ROI of cloud providers—should their prices converge to around $2 as well (given that the free market is clearing at this price), or are their services/features so different from the resellers that it is a different market?
Excellent article! Maybe a silly question, but looking at the H100 instances on AWS, Azure, and Google Cloud, the prices for H100 are still above $4 per GPU on 3-year commitments and over $10 on-demand. Is there any trade-off in using these resellers instead of the three big cloud providers, or is this IaaS commoditized? I’m thinking about this more to assess the ROI of cloud providers—should their prices converge to around $2 as well (given that the free market is clearing at this price), or are their services/features so different from the resellers that it is a different market?