I meant physical hosting part of things :)
Also, I'd maybe wait 1-2 years. We are getting close to the plateau of HW-level innovation instead of standard process scaling but I do not think we are not there yet.
LLMs meant we got FP4/8 formats for example, so anyone with pre-Hopper hardware is toast for higher-density models.