TLDR:<p>H200-powered systems are expected to begin shipping in the second quarter of 2024.<p>"The introduction of H200 will lead to further performance leaps, including nearly doubling inference speed on Llama 2, a 70 billion-parameter LLM, compared to the H100. Additional performance leadership and improvements with H200 are expected with future software updates."